2023-10-14T09:19:56.359 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-14T09:19:56.360 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} --name rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi --archive /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425164 --verbose --owner scheduled_rishabh@teuthology -- /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425164/orig.config.yaml 2023-10-14T09:19:56.408 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T09:19:56.498 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425164 branch: rishabh-2023oct13 description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} email: null first_in_suite: false job_id: '7425164' kernel: client: branch: testing flavor: default kdb: true sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: rishabh-2023oct13 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-2023oct13 sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 owner: scheduled_rishabh@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6006 sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 sleep_before_teardown: 0 subset: 402/512 suite: fs suite_branch: rishabh-2023oct13 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi102.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFwh5NEmomLdH1twgM0mFjSdTELICqTtUwIwr5b+COO+24s2altP7MGFi3jSA2PfHs9EFjfsxWBbDbY2MHU1oe4= smithi129.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCjJDbPyB/hulx2E9LwE3smeu/3pBngA8xVUoG2ZWnTy2bz9+39RnLbFTKciGkGMs/h7kdN6UjCdyI4AEIG0oMo= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestMisc teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 8cdab074dcca9a68965bc5a50e9c30b691949723 timestamp: 2023-10-13_18:04:14 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-14T09:19:56.499 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa; will attempt to use it 2023-10-14T09:19:56.500 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks 2023-10-14T09:19:56.500 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-14T09:19:56.502 INFO:teuthology.task.internal:Checking packages... 2023-10-14T09:19:56.526 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0' 2023-10-14T09:19:56.527 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-14T09:19:56.527 INFO:teuthology.packaging:ref: None 2023-10-14T09:19:56.527 INFO:teuthology.packaging:tag: None 2023-10-14T09:19:56.528 INFO:teuthology.packaging:branch: rishabh-2023oct13 2023-10-14T09:19:56.528 INFO:teuthology.packaging:sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T09:19:56.528 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=rishabh-2023oct13 2023-10-14T09:19:56.746 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6730.g4ba8a190 2023-10-14T09:19:56.746 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-14T09:19:56.754 INFO:teuthology.task.internal:no buildpackages task found 2023-10-14T09:19:56.754 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-14T09:19:56.763 INFO:teuthology.task.internal:Saving configuration 2023-10-14T09:19:56.781 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-14T09:19:56.789 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T09:19:56.816 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425164', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 09:14:50.692757', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFwh5NEmomLdH1twgM0mFjSdTELICqTtUwIwr5b+COO+24s2altP7MGFi3jSA2PfHs9EFjfsxWBbDbY2MHU1oe4='} 2023-10-14T09:19:56.834 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi129.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425164', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 09:14:50.694687', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCjJDbPyB/hulx2E9LwE3smeu/3pBngA8xVUoG2ZWnTy2bz9+39RnLbFTKciGkGMs/h7kdN6UjCdyI4AEIG0oMo='} 2023-10-14T09:19:56.835 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-14T09:19:56.842 INFO:teuthology.task.internal:roles: ubuntu@smithi102.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-14T09:19:56.842 INFO:teuthology.task.internal:roles: ubuntu@smithi129.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-14T09:19:56.842 INFO:teuthology.run_tasks:Running task console_log... 2023-10-14T09:19:56.912 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fcb28005b80>, signals=[15]) 2023-10-14T09:19:56.913 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-14T09:19:56.921 INFO:teuthology.task.internal:Opening connections... 2023-10-14T09:19:56.921 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi102.front.sepia.ceph.com 2023-10-14T09:19:56.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:19:57.009 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi129.front.sepia.ceph.com 2023-10-14T09:19:57.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:19:57.094 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-14T09:19:57.101 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2023-10-14T09:19:57.118 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2023-10-14T09:19:57.119 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2023-10-14T09:19:57.175 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream" 2023-10-14T09:19:57.176 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="9" 2023-10-14T09:19:57.176 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos" 2023-10-14T09:19:57.176 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora" 2023-10-14T09:19:57.176 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="9" 2023-10-14T09:19:57.177 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el9" 2023-10-14T09:19:57.177 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-14T09:19:57.177 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2023-10-14T09:19:57.177 INFO:teuthology.orchestra.run.smithi102.stdout:LOGO="fedora-logo-icon" 2023-10-14T09:19:57.178 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-14T09:19:57.178 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/" 2023-10-14T09:19:57.178 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T09:19:57.178 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-14T09:19:57.178 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-14T09:19:57.179 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2023-10-14T09:19:57.205 DEBUG:teuthology.orchestra.run.smithi129:> uname -m 2023-10-14T09:19:57.222 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64 2023-10-14T09:19:57.223 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2023-10-14T09:19:57.279 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream" 2023-10-14T09:19:57.279 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="9" 2023-10-14T09:19:57.279 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos" 2023-10-14T09:19:57.279 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora" 2023-10-14T09:19:57.280 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="9" 2023-10-14T09:19:57.280 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el9" 2023-10-14T09:19:57.280 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-14T09:19:57.280 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2023-10-14T09:19:57.280 INFO:teuthology.orchestra.run.smithi129.stdout:LOGO="fedora-logo-icon" 2023-10-14T09:19:57.281 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-14T09:19:57.281 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/" 2023-10-14T09:19:57.281 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T09:19:57.281 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-14T09:19:57.281 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-14T09:19:57.282 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2023-10-14T09:19:57.304 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-14T09:19:57.314 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-14T09:19:57.322 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-14T09:19:57.322 DEBUG:teuthology.orchestra.run.smithi102:> test '!' -e /home/ubuntu/cephtest 2023-10-14T09:19:57.325 DEBUG:teuthology.orchestra.run.smithi129:> test '!' -e /home/ubuntu/cephtest 2023-10-14T09:19:57.341 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-14T09:19:57.349 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-14T09:19:57.349 DEBUG:teuthology.orchestra.run.smithi102:> test -z $(ls -A /var/lib/ceph) 2023-10-14T09:19:57.381 DEBUG:teuthology.orchestra.run.smithi129:> test -z $(ls -A /var/lib/ceph) 2023-10-14T09:19:57.499 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-14T09:19:57.555 INFO:teuthology.run_tasks:Running task kernel... 2023-10-14T09:19:57.571 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'} 2023-10-14T09:19:57.572 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-10-14T09:19:57.572 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-10-14T09:19:57.573 DEBUG:teuthology.orchestra.run.smithi102:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-14T09:19:57.573 DEBUG:teuthology.orchestra.run.smithi129:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-14T09:19:57.589 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:19:57.590 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-10-14T09:19:57.594 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:19:57.594 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-10-14T09:19:57.743 DEBUG:teuthology.task.kernel:sha1 for client.0 is 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-14T09:19:57.743 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "47672119149b103ec7cec2cc65c063ccbb001ac7"... 2023-10-14T09:19:57.744 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2023-10-14T09:19:57.760 INFO:teuthology.orchestra.run.smithi102.stdout:5.14.0-361.el9.x86_64 2023-10-14T09:19:57.761 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-14T09:19:57.761 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-14T09:19:57.762 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum upgrade -y linux-firmware 2023-10-14T09:19:57.841 DEBUG:teuthology.task.kernel:sha1 for client.1 is 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-14T09:19:57.842 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "47672119149b103ec7cec2cc65c063ccbb001ac7"... 2023-10-14T09:19:57.842 DEBUG:teuthology.orchestra.run.smithi129:> uname -r 2023-10-14T09:19:57.860 INFO:teuthology.orchestra.run.smithi129.stdout:5.14.0-361.el9.x86_64 2023-10-14T09:19:57.860 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-14T09:19:57.860 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-14T09:19:57.861 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum upgrade -y linux-firmware 2023-10-14T09:19:59.794 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS-9 - AppStream 14 MB/s | 6.3 MB 00:00 2023-10-14T09:19:59.978 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS-9 - AppStream 13 MB/s | 6.3 MB 00:00 2023-10-14T09:20:01.102 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS-9 - BaseOS 7.2 MB/s | 2.0 MB 00:00 2023-10-14T09:20:01.278 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS-9 - BaseOS 6.8 MB/s | 2.0 MB 00:00 2023-10-14T09:20:02.034 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 7.9 MB 00:00 2023-10-14T09:20:02.393 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - BaseOS 9.2 MB/s | 7.9 MB 00:00 2023-10-14T09:20:03.936 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - AppStream 20 MB/s | 18 MB 00:00 2023-10-14T09:20:04.253 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - AppStream 21 MB/s | 18 MB 00:00 2023-10-14T09:20:07.620 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - CRB 15 MB/s | 5.7 MB 00:00 2023-10-14T09:20:08.703 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - CRB 4.9 MB/s | 5.7 MB 00:01 2023-10-14T09:20:09.054 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 14 kB 00:00 2023-10-14T09:20:11.012 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - Extras packages 12 kB/s | 14 kB 00:01 2023-10-14T09:20:11.474 INFO:teuthology.orchestra.run.smithi102.stdout:Extra Packages for Enterprise Linux 8.3 MB/s | 19 MB 00:02 2023-10-14T09:20:11.647 INFO:teuthology.orchestra.run.smithi129.stdout:Extra Packages for Enterprise Linux 36 MB/s | 19 MB 00:00 2023-10-14T09:20:15.964 INFO:teuthology.orchestra.run.smithi102.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2023-10-14T09:20:16.247 INFO:teuthology.orchestra.run.smithi129.stdout:lab-extras 8.4 kB/s | 1.7 kB 00:00 2023-10-14T09:20:18.233 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2023-10-14T09:20:18.244 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2023-10-14T09:20:18.245 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2023-10-14T09:20:18.245 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2023-10-14T09:20:18.245 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrading: 2023-10-14T09:20:18.246 INFO:teuthology.orchestra.run.smithi102.stdout: linux-firmware noarch 20230926-140.el9 CentOS-BaseOS 326 M 2023-10-14T09:20:18.246 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:20:18.246 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2023-10-14T09:20:18.246 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2023-10-14T09:20:18.246 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrade 1 Package 2023-10-14T09:20:18.247 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:20:18.247 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 326 M 2023-10-14T09:20:18.247 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2023-10-14T09:20:18.412 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2023-10-14T09:20:18.422 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2023-10-14T09:20:18.422 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2023-10-14T09:20:18.422 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2023-10-14T09:20:18.423 INFO:teuthology.orchestra.run.smithi129.stdout:Upgrading: 2023-10-14T09:20:18.423 INFO:teuthology.orchestra.run.smithi129.stdout: linux-firmware noarch 20230926-140.el9 CentOS-BaseOS 326 M 2023-10-14T09:20:18.423 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:20:18.423 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2023-10-14T09:20:18.424 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2023-10-14T09:20:18.424 INFO:teuthology.orchestra.run.smithi129.stdout:Upgrade 1 Package 2023-10-14T09:20:18.424 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:20:18.424 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 326 M 2023-10-14T09:20:18.424 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2023-10-14T09:20:26.223 INFO:teuthology.orchestra.run.smithi129.stdout:linux-firmware-20230926-140.el9.noarch.rpm 42 MB/s | 326 MB 00:07 2023-10-14T09:20:26.224 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2023-10-14T09:20:26.225 INFO:teuthology.orchestra.run.smithi129.stdout:Total 42 MB/s | 326 MB 00:07 2023-10-14T09:20:26.225 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2023-10-14T09:20:26.326 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2023-10-14T09:20:26.326 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2023-10-14T09:20:28.428 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2023-10-14T09:20:28.429 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2023-10-14T09:20:29.731 INFO:teuthology.orchestra.run.smithi102.stdout:linux-firmware-20230926-140.el9.noarch.rpm 28 MB/s | 326 MB 00:11 2023-10-14T09:20:29.731 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2023-10-14T09:20:29.732 INFO:teuthology.orchestra.run.smithi102.stdout:Total 28 MB/s | 326 MB 00:11 2023-10-14T09:20:29.732 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2023-10-14T09:20:29.818 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2023-10-14T09:20:29.818 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2023-10-14T09:20:32.004 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2023-10-14T09:20:32.004 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2023-10-14T09:20:34.323 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2023-10-14T09:20:34.856 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : linux-firmware-20230926-140.el9.noarch 1/2 2023-10-14T09:20:34.952 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-10-14T09:20:35.913 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-10-14T09:20:35.913 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : linux-firmware-20230926-140.el9.noarch 1/2 2023-10-14T09:20:36.290 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-10-14T09:20:36.290 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:20:36.291 INFO:teuthology.orchestra.run.smithi129.stdout:Upgraded: 2023-10-14T09:20:36.291 INFO:teuthology.orchestra.run.smithi129.stdout: linux-firmware-20230926-140.el9.noarch 2023-10-14T09:20:36.291 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:20:36.291 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2023-10-14T09:20:36.590 INFO:teuthology.task.kernel:Downloading kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on client.1... 2023-10-14T09:20:36.591 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-14T09:20:36.731 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/ 2023-10-14T09:20:36.731 DEBUG:teuthology.orchestra.run.smithi129:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/ --input-file=- 2023-10-14T09:20:36.734 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi129.front.sepia.ceph.com to complete... 2023-10-14T09:20:37.864 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2023-10-14T09:20:38.223 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : linux-firmware-20230926-140.el9.noarch 1/2 2023-10-14T09:20:38.311 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-10-14T09:20:39.257 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-10-14T09:20:39.258 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : linux-firmware-20230926-140.el9.noarch 1/2 2023-10-14T09:20:39.653 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-10-14T09:20:39.654 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:20:39.654 INFO:teuthology.orchestra.run.smithi102.stdout:Upgraded: 2023-10-14T09:20:39.654 INFO:teuthology.orchestra.run.smithi102.stdout: linux-firmware-20230926-140.el9.noarch 2023-10-14T09:20:39.654 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:20:39.655 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2023-10-14T09:20:39.962 INFO:teuthology.task.kernel:Downloading kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on client.0... 2023-10-14T09:20:39.962 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-14T09:20:40.343 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/ 2023-10-14T09:20:40.343 DEBUG:teuthology.orchestra.run.smithi102:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/ --input-file=- 2023-10-14T09:20:40.346 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi102.front.sepia.ceph.com to complete... 2023-10-14T09:20:57.909 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14 09:20:57 URL:https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm [320683515/320683515] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-14T09:20:57.910 INFO:teuthology.orchestra.run.smithi129.stderr:FINISHED --2023-10-14 09:20:57-- 2023-10-14T09:20:57.910 INFO:teuthology.orchestra.run.smithi129.stderr:Total wall clock time: 21s 2023-10-14T09:20:57.911 INFO:teuthology.orchestra.run.smithi129.stderr:Downloaded: 1 files, 306M in 21s (14.6 MB/s) 2023-10-14T09:20:57.912 INFO:teuthology.task.kernel:Installing kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on client.1... 2023-10-14T09:20:57.912 DEBUG:teuthology.orchestra.run.smithi129:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-14T09:20:59.759 INFO:teuthology.orchestra.run.smithi129.stdout:Verifying... ######################################## 2023-10-14T09:20:59.807 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing... ######################################## 2023-10-14T09:20:59.888 INFO:teuthology.orchestra.run.smithi129.stdout:Updating / installing... 2023-10-14T09:21:00.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14 09:21:00 URL:https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm [320683515/320683515] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-14T09:21:00.909 INFO:teuthology.orchestra.run.smithi102.stderr:FINISHED --2023-10-14 09:21:00-- 2023-10-14T09:21:00.909 INFO:teuthology.orchestra.run.smithi102.stderr:Total wall clock time: 21s 2023-10-14T09:21:00.910 INFO:teuthology.orchestra.run.smithi102.stderr:Downloaded: 1 files, 306M in 20s (15.3 MB/s) 2023-10-14T09:21:00.911 INFO:teuthology.task.kernel:Installing kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on client.0... 2023-10-14T09:21:00.911 DEBUG:teuthology.orchestra.run.smithi102:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-14T09:21:02.763 INFO:teuthology.orchestra.run.smithi102.stdout:Verifying... ######################################## 2023-10-14T09:21:02.878 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing... ######################################## 2023-10-14T09:21:02.957 INFO:teuthology.orchestra.run.smithi102.stdout:Updating / installing... 2023-10-14T09:21:06.970 INFO:teuthology.orchestra.run.smithi129.stdout:kernel-6.6.0_rc5_g47672119149b-1 ######################################## 2023-10-14T09:21:10.133 INFO:teuthology.orchestra.run.smithi102.stdout:kernel-6.6.0_rc5_g47672119149b-1 ######################################## 2023-10-14T09:21:22.195 INFO:teuthology.orchestra.run.smithi129.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-10-14T09:21:25.578 INFO:teuthology.orchestra.run.smithi102.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-10-14T09:21:43.230 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi129.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-14T09:21:43.231 DEBUG:teuthology.orchestra.run.smithi129:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-14T09:21:43.300 INFO:teuthology.orchestra.run.smithi129.stdout:/boot/System.map-6.6.0-rc5-g47672119149b 2023-10-14T09:21:43.300 INFO:teuthology.orchestra.run.smithi129.stdout:/boot/config-6.6.0-rc5-g47672119149b 2023-10-14T09:21:43.301 INFO:teuthology.orchestra.run.smithi129.stdout:/boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-14T09:21:43.301 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b 2023-10-14T09:21:43.301 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel 2023-10-14T09:21:43.301 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch 2023-10-14T09:21:43.301 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86 2023-10-14T09:21:43.302 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto 2023-10-14T09:21:43.302 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-14T09:21:43.302 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-14T09:21:43.302 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-14T09:21:43.303 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-14T09:21:43.303 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-14T09:21:43.303 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-14T09:21:43.303 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-14T09:21:43.303 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-14T09:21:43.304 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-14T09:21:43.304 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-14T09:21:43.304 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-14T09:21:43.304 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-14T09:21:43.304 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-14T09:21:43.304 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-14T09:21:43.305 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-14T09:21:43.305 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-14T09:21:43.305 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-14T09:21:43.305 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-14T09:21:43.305 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-14T09:21:43.306 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-14T09:21:43.306 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel 2023-10-14T09:21:43.306 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu 2023-10-14T09:21:43.306 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce 2023-10-14T09:21:43.306 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-14T09:21:43.307 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm 2023-10-14T09:21:43.307 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-14T09:21:43.307 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-14T09:21:43.307 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm.ko 2023-10-14T09:21:43.307 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto 2023-10-14T09:21:43.308 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ansi_cprng.ko 2023-10-14T09:21:43.308 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/anubis.ko 2023-10-14T09:21:43.308 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/arc4.ko 2023-10-14T09:21:43.308 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx 2023-10-14T09:21:43.308 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-14T09:21:43.309 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_pq.ko 2023-10-14T09:21:43.309 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-14T09:21:43.309 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_tx.ko 2023-10-14T09:21:43.309 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_xor.ko 2023-10-14T09:21:43.309 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/raid6test.ko 2023-10-14T09:21:43.309 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authenc.ko 2023-10-14T09:21:43.310 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authencesn.ko 2023-10-14T09:21:43.310 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blake2b_generic.ko 2023-10-14T09:21:43.310 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_common.ko 2023-10-14T09:21:43.310 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_generic.ko 2023-10-14T09:21:43.310 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/camellia_generic.ko 2023-10-14T09:21:43.311 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast5_generic.ko 2023-10-14T09:21:43.311 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast6_generic.ko 2023-10-14T09:21:43.311 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast_common.ko 2023-10-14T09:21:43.311 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ccm.ko 2023-10-14T09:21:43.311 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cmac.ko 2023-10-14T09:21:43.312 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crc32_generic.ko 2023-10-14T09:21:43.312 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_engine.ko 2023-10-14T09:21:43.312 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_user.ko 2023-10-14T09:21:43.312 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cts.ko 2023-10-14T09:21:43.312 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/des_generic.ko 2023-10-14T09:21:43.313 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/dh_generic.ko 2023-10-14T09:21:43.313 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/echainiv.ko 2023-10-14T09:21:43.313 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/essiv.ko 2023-10-14T09:21:43.313 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/fcrypt.ko 2023-10-14T09:21:43.313 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/khazad.ko 2023-10-14T09:21:43.314 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4.ko 2023-10-14T09:21:43.314 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4hc.ko 2023-10-14T09:21:43.314 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/md4.ko 2023-10-14T09:21:43.314 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/michael_mic.ko 2023-10-14T09:21:43.314 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcbc.ko 2023-10-14T09:21:43.315 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcrypt.ko 2023-10-14T09:21:43.315 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/rmd160.ko 2023-10-14T09:21:43.315 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/seed.ko 2023-10-14T09:21:43.315 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/serpent_generic.ko 2023-10-14T09:21:43.316 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tcrypt.ko 2023-10-14T09:21:43.316 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tea.ko 2023-10-14T09:21:43.316 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_common.ko 2023-10-14T09:21:43.316 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_generic.ko 2023-10-14T09:21:43.316 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/vmac.ko 2023-10-14T09:21:43.317 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/wp512.ko 2023-10-14T09:21:43.317 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xcbc.ko 2023-10-14T09:21:43.317 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xor.ko 2023-10-14T09:21:43.317 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xxhash_generic.ko 2023-10-14T09:21:43.317 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers 2023-10-14T09:21:43.317 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi 2023-10-14T09:21:43.318 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-14T09:21:43.318 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_pad.ko 2023-10-14T09:21:43.318 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/custom_method.ko 2023-10-14T09:21:43.318 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ec_sys.ko 2023-10-14T09:21:43.319 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/platform_profile.ko 2023-10-14T09:21:43.319 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbs.ko 2023-10-14T09:21:43.319 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbshc.ko 2023-10-14T09:21:43.319 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/video.ko 2023-10-14T09:21:43.319 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata 2023-10-14T09:21:43.320 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/acard-ahci.ko 2023-10-14T09:21:43.320 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci_platform.ko 2023-10-14T09:21:43.320 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ata_generic.ko 2023-10-14T09:21:43.320 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci_platform.ko 2023-10-14T09:21:43.320 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_acpi.ko 2023-10-14T09:21:43.321 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ali.ko 2023-10-14T09:21:43.321 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_amd.ko 2023-10-14T09:21:43.321 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_artop.ko 2023-10-14T09:21:43.321 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atiixp.ko 2023-10-14T09:21:43.321 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atp867x.ko 2023-10-14T09:21:43.322 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd640.ko 2023-10-14T09:21:43.322 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-14T09:21:43.322 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cypress.ko 2023-10-14T09:21:43.322 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_efar.ko 2023-10-14T09:21:43.322 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt366.ko 2023-10-14T09:21:43.323 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-14T09:21:43.323 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-14T09:21:43.323 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-14T09:21:43.323 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it8213.ko 2023-10-14T09:21:43.323 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it821x.ko 2023-10-14T09:21:43.324 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_jmicron.ko 2023-10-14T09:21:43.324 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_marvell.ko 2023-10-14T09:21:43.324 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_mpiix.ko 2023-10-14T09:21:43.324 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_netcell.ko 2023-10-14T09:21:43.324 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ninja32.ko 2023-10-14T09:21:43.325 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87410.ko 2023-10-14T09:21:43.325 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87415.ko 2023-10-14T09:21:43.325 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-14T09:21:43.325 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_opti.ko 2023-10-14T09:21:43.325 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_optidma.ko 2023-10-14T09:21:43.326 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-14T09:21:43.326 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-14T09:21:43.326 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-14T09:21:43.326 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_piccolo.ko 2023-10-14T09:21:43.326 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rdc.ko 2023-10-14T09:21:43.327 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sch.ko 2023-10-14T09:21:43.327 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_serverworks.ko 2023-10-14T09:21:43.327 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sil680.ko 2023-10-14T09:21:43.327 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sis.ko 2023-10-14T09:21:43.327 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-14T09:21:43.328 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_triflex.ko 2023-10-14T09:21:43.328 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_via.ko 2023-10-14T09:21:43.328 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pdc_adma.ko 2023-10-14T09:21:43.328 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_inic162x.ko 2023-10-14T09:21:43.328 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_mv.ko 2023-10-14T09:21:43.329 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_nv.ko 2023-10-14T09:21:43.329 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_promise.ko 2023-10-14T09:21:43.329 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_qstor.ko 2023-10-14T09:21:43.329 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil.ko 2023-10-14T09:21:43.329 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil24.ko 2023-10-14T09:21:43.329 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sis.ko 2023-10-14T09:21:43.330 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_svw.ko 2023-10-14T09:21:43.330 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sx4.ko 2023-10-14T09:21:43.330 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_uli.ko 2023-10-14T09:21:43.330 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_via.ko 2023-10-14T09:21:43.330 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_vsc.ko 2023-10-14T09:21:43.331 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay 2023-10-14T09:21:43.331 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-14T09:21:43.331 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base 2023-10-14T09:21:43.331 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap 2023-10-14T09:21:43.331 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-14T09:21:43.332 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-14T09:21:43.332 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma 2023-10-14T09:21:43.332 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/bcma.ko 2023-10-14T09:21:43.332 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block 2023-10-14T09:21:43.332 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe 2023-10-14T09:21:43.333 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/aoe.ko 2023-10-14T09:21:43.333 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/brd.ko 2023-10-14T09:21:43.333 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd 2023-10-14T09:21:43.333 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/drbd.ko 2023-10-14T09:21:43.334 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/floppy.ko 2023-10-14T09:21:43.334 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/loop.ko 2023-10-14T09:21:43.334 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx 2023-10-14T09:21:43.334 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-14T09:21:43.334 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/nbd.ko 2023-10-14T09:21:43.335 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk 2023-10-14T09:21:43.335 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-14T09:21:43.335 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/pktcdvd.ko 2023-10-14T09:21:43.335 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/rbd.ko 2023-10-14T09:21:43.335 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/virtio_blk.ko 2023-10-14T09:21:43.336 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback 2023-10-14T09:21:43.336 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-14T09:21:43.336 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkfront.ko 2023-10-14T09:21:43.336 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram 2023-10-14T09:21:43.336 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/zram.ko 2023-10-14T09:21:43.337 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char 2023-10-14T09:21:43.337 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hangcheck-timer.ko 2023-10-14T09:21:43.337 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random 2023-10-14T09:21:43.337 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-14T09:21:43.337 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-14T09:21:43.338 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-14T09:21:43.338 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-14T09:21:43.338 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-14T09:21:43.338 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi 2023-10-14T09:21:43.338 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-14T09:21:43.339 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-14T09:21:43.339 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-14T09:21:43.339 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-14T09:21:43.339 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-14T09:21:43.339 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-14T09:21:43.340 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/lp.ko 2023-10-14T09:21:43.340 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave 2023-10-14T09:21:43.340 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/mwave.ko 2023-10-14T09:21:43.340 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ppdev.ko 2023-10-14T09:21:43.340 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tlclk.ko 2023-10-14T09:21:43.341 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm 2023-10-14T09:21:43.341 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm.ko 2023-10-14T09:21:43.341 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-14T09:21:43.341 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-14T09:21:43.341 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-14T09:21:43.341 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-14T09:21:43.342 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-14T09:21:43.342 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/uv_mmtimer.ko 2023-10-14T09:21:43.342 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/virtio_console.ko 2023-10-14T09:21:43.342 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq 2023-10-14T09:21:43.342 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-14T09:21:43.343 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-14T09:21:43.343 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-14T09:21:43.343 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-14T09:21:43.343 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-14T09:21:43.343 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-14T09:21:43.344 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto 2023-10-14T09:21:43.344 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp 2023-10-14T09:21:43.344 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-14T09:21:43.344 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-14T09:21:43.344 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel 2023-10-14T09:21:43.345 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat 2023-10-14T09:21:43.345 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-14T09:21:43.345 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-14T09:21:43.345 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-14T09:21:43.345 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-14T09:21:43.346 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-aes.ko 2023-10-14T09:21:43.346 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-sha.ko 2023-10-14T09:21:43.346 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio 2023-10-14T09:21:43.346 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-14T09:21:43.346 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca 2023-10-14T09:21:43.347 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/dca.ko 2023-10-14T09:21:43.347 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq 2023-10-14T09:21:43.347 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-14T09:21:43.347 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma 2023-10-14T09:21:43.347 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw 2023-10-14T09:21:43.348 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-14T09:21:43.348 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat 2023-10-14T09:21:43.348 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-14T09:21:43.348 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac 2023-10-14T09:21:43.348 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/amd64_edac.ko 2023-10-14T09:21:43.349 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/e752x_edac.ko 2023-10-14T09:21:43.349 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-14T09:21:43.349 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3000_edac.ko 2023-10-14T09:21:43.349 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3200_edac.ko 2023-10-14T09:21:43.349 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5100_edac.ko 2023-10-14T09:21:43.350 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5400_edac.ko 2023-10-14T09:21:43.350 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7300_edac.ko 2023-10-14T09:21:43.350 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7core_edac.ko 2023-10-14T09:21:43.350 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i82975x_edac.ko 2023-10-14T09:21:43.350 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ie31200_edac.ko 2023-10-14T09:21:43.351 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/sb_edac.ko 2023-10-14T09:21:43.351 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/x38_edac.ko 2023-10-14T09:21:43.351 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware 2023-10-14T09:21:43.351 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/edd.ko 2023-10-14T09:21:43.351 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-14T09:21:43.351 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio 2023-10-14T09:21:43.352 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ich.ko 2023-10-14T09:21:43.352 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-14T09:21:43.352 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid 2023-10-14T09:21:43.352 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-appleir.ko 2023-10-14T09:21:43.352 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-aureal.ko 2023-10-14T09:21:43.353 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-axff.ko 2023-10-14T09:21:43.353 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-dr.ko 2023-10-14T09:21:43.353 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elecom.ko 2023-10-14T09:21:43.353 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elo.ko 2023-10-14T09:21:43.353 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-emsff.ko 2023-10-14T09:21:43.354 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gaff.ko 2023-10-14T09:21:43.354 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gt683r.ko 2023-10-14T09:21:43.354 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gyration.ko 2023-10-14T09:21:43.354 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-14T09:21:43.354 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-14T09:21:43.355 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtekff.ko 2023-10-14T09:21:43.355 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-hyperv.ko 2023-10-14T09:21:43.355 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-icade.ko 2023-10-14T09:21:43.355 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-keytouch.ko 2023-10-14T09:21:43.355 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kye.ko 2023-10-14T09:21:43.355 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lcpower.ko 2023-10-14T09:21:43.356 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-led.ko 2023-10-14T09:21:43.356 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lenovo.ko 2023-10-14T09:21:43.356 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-14T09:21:43.356 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-14T09:21:43.356 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-multitouch.ko 2023-10-14T09:21:43.357 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ortek.ko 2023-10-14T09:21:43.357 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-penmount.ko 2023-10-14T09:21:43.357 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-petalynx.ko 2023-10-14T09:21:43.357 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-picolcd.ko 2023-10-14T09:21:43.357 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-pl.ko 2023-10-14T09:21:43.358 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-plantronics.ko 2023-10-14T09:21:43.358 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-primax.ko 2023-10-14T09:21:43.358 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-rmi.ko 2023-10-14T09:21:43.358 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-14T09:21:43.359 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-14T09:21:43.359 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-14T09:21:43.359 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-14T09:21:43.359 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-14T09:21:43.359 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-14T09:21:43.359 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-14T09:21:43.360 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-14T09:21:43.360 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-14T09:21:43.360 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-14T09:21:43.360 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-14T09:21:43.360 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat.ko 2023-10-14T09:21:43.361 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-saitek.ko 2023-10-14T09:21:43.361 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-samsung.ko 2023-10-14T09:21:43.361 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-14T09:21:43.361 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sjoy.ko 2023-10-14T09:21:43.361 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sony.ko 2023-10-14T09:21:43.362 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-speedlink.ko 2023-10-14T09:21:43.362 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-steelseries.ko 2023-10-14T09:21:43.362 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sunplus.ko 2023-10-14T09:21:43.362 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-14T09:21:43.362 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tivo.ko 2023-10-14T09:21:43.363 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tmff.ko 2023-10-14T09:21:43.363 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-topseed.ko 2023-10-14T09:21:43.363 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-twinhan.ko 2023-10-14T09:21:43.363 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-uclogic.ko 2023-10-14T09:21:43.363 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-waltop.ko 2023-10-14T09:21:43.364 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-wiimote.ko 2023-10-14T09:21:43.364 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-xinmo.ko 2023-10-14T09:21:43.364 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zpff.ko 2023-10-14T09:21:43.364 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zydacron.ko 2023-10-14T09:21:43.364 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/uhid.ko 2023-10-14T09:21:43.364 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/wacom.ko 2023-10-14T09:21:43.365 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv 2023-10-14T09:21:43.365 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_balloon.ko 2023-10-14T09:21:43.365 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_utils.ko 2023-10-14T09:21:43.365 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_vmbus.ko 2023-10-14T09:21:43.366 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon 2023-10-14T09:21:43.366 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru.ko 2023-10-14T09:21:43.366 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru3.ko 2023-10-14T09:21:43.366 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-14T09:21:43.366 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7414.ko 2023-10-14T09:21:43.366 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7418.ko 2023-10-14T09:21:43.367 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adc128d818.ko 2023-10-14T09:21:43.367 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1025.ko 2023-10-14T09:21:43.367 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1026.ko 2023-10-14T09:21:43.367 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1029.ko 2023-10-14T09:21:43.367 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1031.ko 2023-10-14T09:21:43.368 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm9240.ko 2023-10-14T09:21:43.368 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ads7828.ko 2023-10-14T09:21:43.368 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7410.ko 2023-10-14T09:21:43.368 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7411.ko 2023-10-14T09:21:43.368 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7462.ko 2023-10-14T09:21:43.369 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7470.ko 2023-10-14T09:21:43.369 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7475.ko 2023-10-14T09:21:43.369 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7x10.ko 2023-10-14T09:21:43.369 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/amc6821.ko 2023-10-14T09:21:43.369 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/applesmc.ko 2023-10-14T09:21:43.370 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asb100.ko 2023-10-14T09:21:43.370 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asc7621.ko 2023-10-14T09:21:43.370 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-14T09:21:43.370 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/atxp1.ko 2023-10-14T09:21:43.370 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/coretemp.ko 2023-10-14T09:21:43.371 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-14T09:21:43.371 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dme1737.ko 2023-10-14T09:21:43.371 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds1621.ko 2023-10-14T09:21:43.371 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds620.ko 2023-10-14T09:21:43.371 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc1403.ko 2023-10-14T09:21:43.372 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc6w201.ko 2023-10-14T09:21:43.372 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71805f.ko 2023-10-14T09:21:43.372 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71882fg.ko 2023-10-14T09:21:43.372 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f75375s.ko 2023-10-14T09:21:43.372 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-14T09:21:43.373 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fschmd.ko 2023-10-14T09:21:43.373 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g760a.ko 2023-10-14T09:21:43.373 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g762.ko 2023-10-14T09:21:43.373 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl518sm.ko 2023-10-14T09:21:43.373 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl520sm.ko 2023-10-14T09:21:43.374 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-14T09:21:43.374 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-14T09:21:43.374 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-14T09:21:43.374 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmaem.ko 2023-10-14T09:21:43.374 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmpex.ko 2023-10-14T09:21:43.375 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina209.ko 2023-10-14T09:21:43.375 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina2xx.ko 2023-10-14T09:21:43.375 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/it87.ko 2023-10-14T09:21:43.375 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k10temp.ko 2023-10-14T09:21:43.375 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k8temp.ko 2023-10-14T09:21:43.375 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-14T09:21:43.376 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm63.ko 2023-10-14T09:21:43.376 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm73.ko 2023-10-14T09:21:43.376 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm75.ko 2023-10-14T09:21:43.376 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm77.ko 2023-10-14T09:21:43.376 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm78.ko 2023-10-14T09:21:43.377 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm80.ko 2023-10-14T09:21:43.377 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm83.ko 2023-10-14T09:21:43.377 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm85.ko 2023-10-14T09:21:43.377 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm87.ko 2023-10-14T09:21:43.377 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm90.ko 2023-10-14T09:21:43.378 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm92.ko 2023-10-14T09:21:43.378 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm93.ko 2023-10-14T09:21:43.378 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95234.ko 2023-10-14T09:21:43.378 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95241.ko 2023-10-14T09:21:43.378 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95245.ko 2023-10-14T09:21:43.379 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc2945.ko 2023-10-14T09:21:43.379 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4151.ko 2023-10-14T09:21:43.379 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4215.ko 2023-10-14T09:21:43.379 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4222.ko 2023-10-14T09:21:43.379 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4245.ko 2023-10-14T09:21:43.380 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4260.ko 2023-10-14T09:21:43.380 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4261.ko 2023-10-14T09:21:43.380 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max16065.ko 2023-10-14T09:21:43.380 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1619.ko 2023-10-14T09:21:43.380 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1668.ko 2023-10-14T09:21:43.380 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max197.ko 2023-10-14T09:21:43.381 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6639.ko 2023-10-14T09:21:43.381 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6650.ko 2023-10-14T09:21:43.381 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6697.ko 2023-10-14T09:21:43.381 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mcp3021.ko 2023-10-14T09:21:43.381 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6683.ko 2023-10-14T09:21:43.382 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-14T09:21:43.382 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775.ko 2023-10-14T09:21:43.382 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct7802.ko 2023-10-14T09:21:43.382 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87360.ko 2023-10-14T09:21:43.382 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87427.ko 2023-10-14T09:21:43.383 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pcf8591.ko 2023-10-14T09:21:43.383 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus 2023-10-14T09:21:43.383 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-14T09:21:43.383 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-14T09:21:43.383 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-14T09:21:43.384 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-14T09:21:43.384 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-14T09:21:43.384 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-14T09:21:43.384 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-14T09:21:43.385 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-14T09:21:43.385 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-14T09:21:43.385 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-14T09:21:43.385 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-14T09:21:43.385 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-14T09:21:43.386 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/powr1220.ko 2023-10-14T09:21:43.386 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5627.ko 2023-10-14T09:21:43.386 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5636.ko 2023-10-14T09:21:43.386 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-14T09:21:43.386 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht15.ko 2023-10-14T09:21:43.387 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht21.ko 2023-10-14T09:21:43.387 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/shtc1.ko 2023-10-14T09:21:43.387 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sis5595.ko 2023-10-14T09:21:43.387 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-14T09:21:43.387 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-14T09:21:43.388 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-14T09:21:43.388 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/thmc50.ko 2023-10-14T09:21:43.388 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp102.ko 2023-10-14T09:21:43.388 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp103.ko 2023-10-14T09:21:43.388 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp401.ko 2023-10-14T09:21:43.389 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp421.ko 2023-10-14T09:21:43.389 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-14T09:21:43.389 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via686a.ko 2023-10-14T09:21:43.389 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt1211.ko 2023-10-14T09:21:43.389 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt8231.ko 2023-10-14T09:21:43.390 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-14T09:21:43.390 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627hf.ko 2023-10-14T09:21:43.390 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83781d.ko 2023-10-14T09:21:43.390 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83791d.ko 2023-10-14T09:21:43.390 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83792d.ko 2023-10-14T09:21:43.391 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83793.ko 2023-10-14T09:21:43.391 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83795.ko 2023-10-14T09:21:43.391 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-14T09:21:43.391 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-14T09:21:43.391 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c 2023-10-14T09:21:43.392 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos 2023-10-14T09:21:43.392 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-14T09:21:43.392 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-14T09:21:43.392 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses 2023-10-14T09:21:43.392 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-14T09:21:43.393 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-14T09:21:43.393 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-14T09:21:43.393 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-14T09:21:43.393 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-14T09:21:43.393 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-14T09:21:43.394 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-14T09:21:43.394 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-14T09:21:43.394 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-14T09:21:43.394 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-14T09:21:43.394 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-14T09:21:43.395 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-14T09:21:43.395 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-14T09:21:43.395 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-14T09:21:43.395 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-14T09:21:43.395 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-14T09:21:43.396 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-14T09:21:43.396 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-14T09:21:43.396 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-14T09:21:43.396 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-14T09:21:43.396 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-14T09:21:43.397 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-14T09:21:43.397 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-14T09:21:43.397 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-dev.ko 2023-10-14T09:21:43.397 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-mux.ko 2023-10-14T09:21:43.397 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-14T09:21:43.398 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-14T09:21:43.398 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-stub.ko 2023-10-14T09:21:43.398 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband 2023-10-14T09:21:43.398 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core 2023-10-14T09:21:43.398 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-14T09:21:43.399 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-14T09:21:43.399 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-14T09:21:43.399 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-14T09:21:43.399 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-14T09:21:43.399 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-14T09:21:43.399 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-14T09:21:43.400 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw 2023-10-14T09:21:43.400 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4 2023-10-14T09:21:43.400 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-14T09:21:43.400 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4 2023-10-14T09:21:43.400 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-14T09:21:43.401 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5 2023-10-14T09:21:43.401 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-14T09:21:43.401 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca 2023-10-14T09:21:43.401 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-14T09:21:43.401 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp 2023-10-14T09:21:43.402 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib 2023-10-14T09:21:43.402 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-14T09:21:43.402 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser 2023-10-14T09:21:43.402 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-14T09:21:43.402 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert 2023-10-14T09:21:43.403 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-14T09:21:43.403 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp 2023-10-14T09:21:43.403 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-14T09:21:43.403 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt 2023-10-14T09:21:43.403 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-14T09:21:43.404 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input 2023-10-14T09:21:43.404 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport 2023-10-14T09:21:43.404 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-14T09:21:43.404 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-14T09:21:43.404 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/gameport.ko 2023-10-14T09:21:43.405 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/joydev.ko 2023-10-14T09:21:43.405 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard 2023-10-14T09:21:43.405 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-14T09:21:43.405 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse 2023-10-14T09:21:43.405 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/appletouch.ko 2023-10-14T09:21:43.406 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-14T09:21:43.406 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-14T09:21:43.406 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-14T09:21:43.406 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/sermouse.ko 2023-10-14T09:21:43.406 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-14T09:21:43.407 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-14T09:21:43.407 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-14T09:21:43.407 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4 2023-10-14T09:21:43.407 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-14T09:21:43.407 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio 2023-10-14T09:21:43.408 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-14T09:21:43.408 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-14T09:21:43.408 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-14T09:21:43.408 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serio_raw.ko 2023-10-14T09:21:43.408 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/sparse-keymap.ko 2023-10-14T09:21:43.409 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu 2023-10-14T09:21:43.409 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd 2023-10-14T09:21:43.409 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-14T09:21:43.409 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds 2023-10-14T09:21:43.409 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-blinkm.ko 2023-10-14T09:21:43.410 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3530.ko 2023-10-14T09:21:43.410 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp3944.ko 2023-10-14T09:21:43.410 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-ss4200.ko 2023-10-14T09:21:43.410 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger 2023-10-14T09:21:43.410 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-14T09:21:43.411 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-14T09:21:43.411 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-14T09:21:43.411 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-14T09:21:43.411 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-14T09:21:43.411 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-14T09:21:43.412 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-14T09:21:43.412 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-14T09:21:43.412 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md 2023-10-14T09:21:43.412 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache 2023-10-14T09:21:43.412 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/bcache.ko 2023-10-14T09:21:43.413 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bio-prison.ko 2023-10-14T09:21:43.413 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache-smq.ko 2023-10-14T09:21:43.413 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache.ko 2023-10-14T09:21:43.413 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-crypt.ko 2023-10-14T09:21:43.413 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-delay.ko 2023-10-14T09:21:43.413 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-flakey.ko 2023-10-14T09:21:43.414 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log-userspace.ko 2023-10-14T09:21:43.414 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-multipath.ko 2023-10-14T09:21:43.414 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-queue-length.ko 2023-10-14T09:21:43.414 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-raid.ko 2023-10-14T09:21:43.414 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-round-robin.ko 2023-10-14T09:21:43.415 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-service-time.ko 2023-10-14T09:21:43.415 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-switch.ko 2023-10-14T09:21:43.415 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-thin-pool.ko 2023-10-14T09:21:43.415 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-verity.ko 2023-10-14T09:21:43.416 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/faulty.ko 2023-10-14T09:21:43.416 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/linear.ko 2023-10-14T09:21:43.416 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/multipath.ko 2023-10-14T09:21:43.416 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data 2023-10-14T09:21:43.416 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-14T09:21:43.417 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid0.ko 2023-10-14T09:21:43.417 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid1.ko 2023-10-14T09:21:43.417 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid10.ko 2023-10-14T09:21:43.417 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid456.ko 2023-10-14T09:21:43.417 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message 2023-10-14T09:21:43.417 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion 2023-10-14T09:21:43.418 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptbase.ko 2023-10-14T09:21:43.418 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptctl.ko 2023-10-14T09:21:43.418 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptfc.ko 2023-10-14T09:21:43.418 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptlan.ko 2023-10-14T09:21:43.418 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptsas.ko 2023-10-14T09:21:43.419 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-14T09:21:43.419 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptspi.ko 2023-10-14T09:21:43.419 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd 2023-10-14T09:21:43.419 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_ich.ko 2023-10-14T09:21:43.419 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_sch.ko 2023-10-14T09:21:43.420 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mfd-core.ko 2023-10-14T09:21:43.420 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/sm501.ko 2023-10-14T09:21:43.420 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/viperboard.ko 2023-10-14T09:21:43.420 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/vx855.ko 2023-10-14T09:21:43.420 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wl1273-core.ko 2023-10-14T09:21:43.421 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc 2023-10-14T09:21:43.421 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl 2023-10-14T09:21:43.421 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-14T09:21:43.421 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds9802als.ko 2023-10-14T09:21:43.421 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds990x.ko 2023-10-14T09:21:43.422 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/bh1770glc.ko 2023-10-14T09:21:43.422 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710 2023-10-14T09:21:43.422 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/cb710.ko 2023-10-14T09:21:43.422 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom 2023-10-14T09:21:43.422 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/at24.ko 2023-10-14T09:21:43.423 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-14T09:21:43.423 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-14T09:21:43.423 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-14T09:21:43.423 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/enclosure.ko 2023-10-14T09:21:43.423 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hpilo.ko 2023-10-14T09:21:43.424 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29003.ko 2023-10-14T09:21:43.424 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29020.ko 2023-10-14T09:21:43.424 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d 2023-10-14T09:21:43.424 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-14T09:21:43.424 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-14T09:21:43.424 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei 2023-10-14T09:21:43.425 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-me.ko 2023-10-14T09:21:43.425 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-14T09:21:43.425 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei.ko 2023-10-14T09:21:43.425 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru 2023-10-14T09:21:43.425 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-14T09:21:43.426 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp 2023-10-14T09:21:43.426 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-14T09:21:43.426 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-14T09:21:43.426 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-14T09:21:43.427 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-14T09:21:43.427 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_core.ko 2023-10-14T09:21:43.427 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tsl2550.ko 2023-10-14T09:21:43.427 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_balloon.ko 2023-10-14T09:21:43.427 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci 2023-10-14T09:21:43.427 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-14T09:21:43.428 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net 2023-10-14T09:21:43.428 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding 2023-10-14T09:21:43.428 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/bonding.ko 2023-10-14T09:21:43.428 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa 2023-10-14T09:21:43.428 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53 2023-10-14T09:21:43.429 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-14T09:21:43.429 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-14T09:21:43.429 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-14T09:21:43.429 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-14T09:21:43.429 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-14T09:21:43.430 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dummy.ko 2023-10-14T09:21:43.430 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/eql.ko 2023-10-14T09:21:43.430 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet 2023-10-14T09:21:43.430 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com 2023-10-14T09:21:43.430 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-14T09:21:43.431 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-14T09:21:43.431 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-14T09:21:43.431 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-14T09:21:43.431 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390 2023-10-14T09:21:43.431 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-14T09:21:43.431 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-14T09:21:43.432 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-14T09:21:43.432 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-14T09:21:43.432 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec 2023-10-14T09:21:43.432 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-14T09:21:43.432 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere 2023-10-14T09:21:43.433 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-14T09:21:43.433 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon 2023-10-14T09:21:43.433 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-14T09:21:43.433 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera 2023-10-14T09:21:43.434 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-14T09:21:43.434 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd 2023-10-14T09:21:43.434 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-14T09:21:43.434 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-14T09:21:43.434 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-14T09:21:43.435 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros 2023-10-14T09:21:43.435 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx 2023-10-14T09:21:43.435 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-14T09:21:43.435 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-14T09:21:43.435 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-14T09:21:43.436 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-14T09:21:43.436 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-14T09:21:43.436 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-14T09:21:43.436 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-14T09:21:43.436 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-14T09:21:43.437 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom 2023-10-14T09:21:43.437 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-14T09:21:43.437 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-14T09:21:43.437 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-14T09:21:43.437 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-14T09:21:43.438 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-14T09:21:43.438 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-14T09:21:43.438 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-14T09:21:43.438 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-14T09:21:43.438 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade 2023-10-14T09:21:43.439 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna 2023-10-14T09:21:43.439 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-14T09:21:43.439 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio 2023-10-14T09:21:43.439 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-14T09:21:43.439 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-14T09:21:43.440 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-14T09:21:43.440 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-14T09:21:43.440 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-14T09:21:43.440 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-14T09:21:43.440 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-14T09:21:43.440 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-14T09:21:43.441 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-14T09:21:43.441 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-14T09:21:43.441 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco 2023-10-14T09:21:43.441 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic 2023-10-14T09:21:43.441 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-14T09:21:43.442 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec 2023-10-14T09:21:43.442 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip 2023-10-14T09:21:43.442 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-14T09:21:43.442 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-14T09:21:43.442 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-14T09:21:43.443 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-14T09:21:43.443 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-14T09:21:43.443 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-14T09:21:43.443 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink 2023-10-14T09:21:43.443 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-14T09:21:43.444 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-14T09:21:43.444 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dnet.ko 2023-10-14T09:21:43.444 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex 2023-10-14T09:21:43.444 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet 2023-10-14T09:21:43.444 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-14T09:21:43.445 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-14T09:21:43.445 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-14T09:21:43.445 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel 2023-10-14T09:21:43.445 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-14T09:21:43.445 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000 2023-10-14T09:21:43.446 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-14T09:21:43.446 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-14T09:21:43.446 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-14T09:21:43.446 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-14T09:21:43.447 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-14T09:21:43.447 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e 2023-10-14T09:21:43.447 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-14T09:21:43.447 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf 2023-10-14T09:21:43.447 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-14T09:21:43.447 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb 2023-10-14T09:21:43.448 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-14T09:21:43.448 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-14T09:21:43.448 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-14T09:21:43.448 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-14T09:21:43.448 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-14T09:21:43.449 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-14T09:21:43.449 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-14T09:21:43.449 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/jme.ko 2023-10-14T09:21:43.449 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell 2023-10-14T09:21:43.449 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-14T09:21:43.450 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-14T09:21:43.450 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-14T09:21:43.450 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox 2023-10-14T09:21:43.450 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-14T09:21:43.450 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-14T09:21:43.451 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-14T09:21:43.451 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-14T09:21:43.451 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-14T09:21:43.451 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-14T09:21:43.451 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel 2023-10-14T09:21:43.452 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-14T09:21:43.452 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom 2023-10-14T09:21:43.452 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-14T09:21:43.452 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-14T09:21:43.452 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi 2023-10-14T09:21:43.453 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-14T09:21:43.453 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-14T09:21:43.453 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion 2023-10-14T09:21:43.453 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-14T09:21:43.453 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia 2023-10-14T09:21:43.454 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-14T09:21:43.454 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines 2023-10-14T09:21:43.454 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-14T09:21:43.454 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-14T09:21:43.454 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic 2023-10-14T09:21:43.455 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-14T09:21:43.455 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-14T09:21:43.455 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-14T09:21:43.455 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-14T09:21:43.455 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-14T09:21:43.456 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc 2023-10-14T09:21:43.456 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-14T09:21:43.456 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek 2023-10-14T09:21:43.456 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-14T09:21:43.456 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-14T09:21:43.456 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-14T09:21:43.457 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-14T09:21:43.457 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker 2023-10-14T09:21:43.457 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-14T09:21:43.457 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc 2023-10-14T09:21:43.457 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-14T09:21:43.458 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan 2023-10-14T09:21:43.458 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-14T09:21:43.458 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis 2023-10-14T09:21:43.458 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-14T09:21:43.458 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-14T09:21:43.459 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc 2023-10-14T09:21:43.459 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-14T09:21:43.459 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-14T09:21:43.459 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-14T09:21:43.459 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-14T09:21:43.460 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro 2023-10-14T09:21:43.460 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-14T09:21:43.460 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-14T09:21:43.460 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-14T09:21:43.460 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun 2023-10-14T09:21:43.461 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-14T09:21:43.461 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-14T09:21:43.461 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-14T09:21:43.461 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-14T09:21:43.461 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti 2023-10-14T09:21:43.461 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-14T09:21:43.462 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti 2023-10-14T09:21:43.462 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-14T09:21:43.462 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via 2023-10-14T09:21:43.462 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-14T09:21:43.462 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-14T09:21:43.463 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet 2023-10-14T09:21:43.463 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-14T09:21:43.463 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-14T09:21:43.463 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom 2023-10-14T09:21:43.463 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-14T09:21:43.464 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/geneve.ko 2023-10-14T09:21:43.464 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv 2023-10-14T09:21:43.464 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-14T09:21:43.464 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154 2023-10-14T09:21:43.464 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-14T09:21:43.465 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ifb.ko 2023-10-14T09:21:43.465 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan 2023-10-14T09:21:43.465 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-14T09:21:43.465 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvlan.ko 2023-10-14T09:21:43.465 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvtap.ko 2023-10-14T09:21:43.465 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio 2023-10-14T09:21:43.466 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio.ko 2023-10-14T09:21:43.466 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-14T09:21:43.466 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-14T09:21:43.466 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-14T09:21:43.466 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mii.ko 2023-10-14T09:21:43.467 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/net_failover.ko 2023-10-14T09:21:43.467 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/netconsole.ko 2023-10-14T09:21:43.467 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/nlmon.ko 2023-10-14T09:21:43.467 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs 2023-10-14T09:21:43.467 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-14T09:21:43.468 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-14T09:21:43.468 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy 2023-10-14T09:21:43.468 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/amd.ko 2023-10-14T09:21:43.468 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-14T09:21:43.468 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-14T09:21:43.469 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-14T09:21:43.469 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-14T09:21:43.469 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/broadcom.ko 2023-10-14T09:21:43.469 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/cicada.ko 2023-10-14T09:21:43.469 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/davicom.ko 2023-10-14T09:21:43.470 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/dp83640.ko 2023-10-14T09:21:43.470 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/et1011c.ko 2023-10-14T09:21:43.470 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/icplus.ko 2023-10-14T09:21:43.470 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/lxt.ko 2023-10-14T09:21:43.470 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/marvell.ko 2023-10-14T09:21:43.471 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/micrel.ko 2023-10-14T09:21:43.471 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/national.ko 2023-10-14T09:21:43.471 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/phylink.ko 2023-10-14T09:21:43.471 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/qsemi.ko 2023-10-14T09:21:43.471 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/realtek.ko 2023-10-14T09:21:43.471 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/smsc.ko 2023-10-14T09:21:43.472 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-14T09:21:43.472 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/vitesse.ko 2023-10-14T09:21:43.472 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp 2023-10-14T09:21:43.472 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-14T09:21:43.472 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-14T09:21:43.473 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-14T09:21:43.473 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-14T09:21:43.473 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-14T09:21:43.473 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-14T09:21:43.473 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppoe.ko 2023-10-14T09:21:43.474 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppox.ko 2023-10-14T09:21:43.474 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pptp.ko 2023-10-14T09:21:43.474 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip 2023-10-14T09:21:43.474 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slhc.ko 2023-10-14T09:21:43.474 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slip.ko 2023-10-14T09:21:43.475 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sungem_phy.ko 2023-10-14T09:21:43.475 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tap.ko 2023-10-14T09:21:43.475 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team 2023-10-14T09:21:43.475 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team.ko 2023-10-14T09:21:43.475 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-14T09:21:43.476 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-14T09:21:43.476 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-14T09:21:43.476 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_random.ko 2023-10-14T09:21:43.476 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-14T09:21:43.476 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tun.ko 2023-10-14T09:21:43.476 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/veth.ko 2023-10-14T09:21:43.477 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/virtio_net.ko 2023-10-14T09:21:43.477 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3 2023-10-14T09:21:43.477 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-14T09:21:43.477 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan 2023-10-14T09:21:43.477 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-14T09:21:43.478 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback 2023-10-14T09:21:43.478 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-14T09:21:43.478 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netfront.ko 2023-10-14T09:21:43.478 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb 2023-10-14T09:21:43.478 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ntb.ko 2023-10-14T09:21:43.479 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme 2023-10-14T09:21:43.479 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host 2023-10-14T09:21:43.479 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-14T09:21:43.479 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme.ko 2023-10-14T09:21:43.479 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport 2023-10-14T09:21:43.479 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport.ko 2023-10-14T09:21:43.480 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_cs.ko 2023-10-14T09:21:43.480 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_pc.ko 2023-10-14T09:21:43.480 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_serial.ko 2023-10-14T09:21:43.480 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci 2023-10-14T09:21:43.480 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug 2023-10-14T09:21:43.481 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-14T09:21:43.481 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie 2023-10-14T09:21:43.481 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-14T09:21:43.481 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/xen-pcifront.ko 2023-10-14T09:21:43.481 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia 2023-10-14T09:21:43.481 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/i82092.ko 2023-10-14T09:21:43.482 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pd6729.ko 2023-10-14T09:21:43.482 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-14T09:21:43.482 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl 2023-10-14T09:21:43.482 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel 2023-10-14T09:21:43.482 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-14T09:21:43.483 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform 2023-10-14T09:21:43.483 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86 2023-10-14T09:21:43.483 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-14T09:21:43.483 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-14T09:21:43.483 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-14T09:21:43.484 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-14T09:21:43.484 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-14T09:21:43.484 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-14T09:21:43.484 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-14T09:21:43.484 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-14T09:21:43.485 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-14T09:21:43.485 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-14T09:21:43.485 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-14T09:21:43.485 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/hdaps.ko 2023-10-14T09:21:43.485 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel 2023-10-14T09:21:43.486 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-14T09:21:43.486 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-14T09:21:43.486 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-14T09:21:43.486 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-14T09:21:43.486 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-14T09:21:43.486 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-14T09:21:43.487 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-14T09:21:43.487 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-14T09:21:43.487 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-14T09:21:43.487 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-14T09:21:43.487 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-14T09:21:43.488 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi.ko 2023-10-14T09:21:43.488 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap 2023-10-14T09:21:43.488 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-14T09:21:43.488 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-14T09:21:43.488 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps 2023-10-14T09:21:43.489 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients 2023-10-14T09:21:43.489 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-14T09:21:43.489 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-14T09:21:43.489 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-14T09:21:43.489 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/pps_core.ko 2023-10-14T09:21:43.489 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp 2023-10-14T09:21:43.490 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp.ko 2023-10-14T09:21:43.490 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-14T09:21:43.490 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc 2023-10-14T09:21:43.490 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-14T09:21:43.490 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-14T09:21:43.491 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-14T09:21:43.491 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-14T09:21:43.491 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-14T09:21:43.491 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-14T09:21:43.491 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-14T09:21:43.492 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-14T09:21:43.492 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-14T09:21:43.492 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-14T09:21:43.492 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-14T09:21:43.492 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-14T09:21:43.493 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-14T09:21:43.493 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-14T09:21:43.493 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-14T09:21:43.493 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-14T09:21:43.493 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-14T09:21:43.493 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-14T09:21:43.494 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-14T09:21:43.494 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-14T09:21:43.494 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-14T09:21:43.494 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-14T09:21:43.494 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-14T09:21:43.495 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-14T09:21:43.495 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-14T09:21:43.495 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-14T09:21:43.495 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-14T09:21:43.495 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-14T09:21:43.496 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-14T09:21:43.496 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-14T09:21:43.496 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-14T09:21:43.496 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi 2023-10-14T09:21:43.496 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-14T09:21:43.497 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-sas.ko 2023-10-14T09:21:43.497 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-14T09:21:43.497 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/BusLogic.ko 2023-10-14T09:21:43.497 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/a100u2w.ko 2023-10-14T09:21:43.497 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid 2023-10-14T09:21:43.498 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-14T09:21:43.498 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/advansys.ko 2023-10-14T09:21:43.498 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx 2023-10-14T09:21:43.498 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-14T09:21:43.498 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-14T09:21:43.499 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/am53c974.ko 2023-10-14T09:21:43.499 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr 2023-10-14T09:21:43.499 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-14T09:21:43.499 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/atp870u.ko 2023-10-14T09:21:43.499 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi 2023-10-14T09:21:43.499 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-14T09:21:43.500 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa 2023-10-14T09:21:43.500 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-14T09:21:43.500 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc 2023-10-14T09:21:43.500 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-14T09:21:43.500 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i 2023-10-14T09:21:43.501 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-14T09:21:43.501 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ch.ko 2023-10-14T09:21:43.501 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor 2023-10-14T09:21:43.501 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-14T09:21:43.501 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi 2023-10-14T09:21:43.502 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-14T09:21:43.502 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-14T09:21:43.502 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-14T09:21:43.502 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-14T09:21:43.502 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-14T09:21:43.503 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dc395x.ko 2023-10-14T09:21:43.503 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler 2023-10-14T09:21:43.503 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-14T09:21:43.503 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-14T09:21:43.503 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-14T09:21:43.504 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-14T09:21:43.504 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dmx3191d.ko 2023-10-14T09:21:43.504 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r 2023-10-14T09:21:43.504 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-14T09:21:43.504 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esp_scsi.ko 2023-10-14T09:21:43.504 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe 2023-10-14T09:21:43.505 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-14T09:21:43.505 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-14T09:21:43.505 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic 2023-10-14T09:21:43.505 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-14T09:21:43.505 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hpsa.ko 2023-10-14T09:21:43.506 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hptiop.ko 2023-10-14T09:21:43.506 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-14T09:21:43.506 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/initio.ko 2023-10-14T09:21:43.506 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ipr.ko 2023-10-14T09:21:43.506 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ips.ko 2023-10-14T09:21:43.507 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci 2023-10-14T09:21:43.507 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/isci.ko 2023-10-14T09:21:43.507 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-14T09:21:43.507 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-14T09:21:43.507 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc 2023-10-14T09:21:43.507 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-14T09:21:43.508 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi.ko 2023-10-14T09:21:43.508 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-14T09:21:43.508 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas 2023-10-14T09:21:43.508 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-14T09:21:43.508 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc 2023-10-14T09:21:43.509 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-14T09:21:43.509 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid 2023-10-14T09:21:43.509 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid.ko 2023-10-14T09:21:43.509 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-14T09:21:43.509 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-14T09:21:43.510 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-14T09:21:43.510 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas 2023-10-14T09:21:43.510 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-14T09:21:43.510 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas 2023-10-14T09:21:43.510 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-14T09:21:43.511 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvumi.ko 2023-10-14T09:21:43.511 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001 2023-10-14T09:21:43.511 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-14T09:21:43.511 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pmcraid.ko 2023-10-14T09:21:43.511 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla1280.ko 2023-10-14T09:21:43.511 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx 2023-10-14T09:21:43.512 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-14T09:21:43.512 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-14T09:21:43.512 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx 2023-10-14T09:21:43.512 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-14T09:21:43.512 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/raid_class.ko 2023-10-14T09:21:43.513 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_debug.ko 2023-10-14T09:21:43.513 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-14T09:21:43.513 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-14T09:21:43.513 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-14T09:21:43.513 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-14T09:21:43.514 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-14T09:21:43.514 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ses.ko 2023-10-14T09:21:43.514 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/st.ko 2023-10-14T09:21:43.514 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/stex.ko 2023-10-14T09:21:43.514 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2 2023-10-14T09:21:43.515 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-14T09:21:43.515 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-14T09:21:43.515 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-14T09:21:43.515 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/wd719x.ko 2023-10-14T09:21:43.515 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb 2023-10-14T09:21:43.515 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ssb.ko 2023-10-14T09:21:43.516 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target 2023-10-14T09:21:43.516 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi 2023-10-14T09:21:43.516 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-14T09:21:43.516 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback 2023-10-14T09:21:43.516 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-14T09:21:43.517 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_file.ko 2023-10-14T09:21:43.517 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_iblock.ko 2023-10-14T09:21:43.517 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_mod.ko 2023-10-14T09:21:43.517 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_pscsi.ko 2023-10-14T09:21:43.517 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_user.ko 2023-10-14T09:21:43.518 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc 2023-10-14T09:21:43.518 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-14T09:21:43.518 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal 2023-10-14T09:21:43.518 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel 2023-10-14T09:21:43.518 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-14T09:21:43.519 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-14T09:21:43.519 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-14T09:21:43.519 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-14T09:21:43.519 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-14T09:21:43.519 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-14T09:21:43.519 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-14T09:21:43.520 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-14T09:21:43.520 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-14T09:21:43.520 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-14T09:21:43.520 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-14T09:21:43.520 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-14T09:21:43.521 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-14T09:21:43.521 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-14T09:21:43.521 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-14T09:21:43.521 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-14T09:21:43.521 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty 2023-10-14T09:21:43.522 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless 2023-10-14T09:21:43.522 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-14T09:21:43.522 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_gsm.ko 2023-10-14T09:21:43.522 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_hdlc.ko 2023-10-14T09:21:43.522 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/nozomi.ko 2023-10-14T09:21:43.523 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial 2023-10-14T09:21:43.523 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250 2023-10-14T09:21:43.523 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-14T09:21:43.523 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-14T09:21:43.523 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm 2023-10-14T09:21:43.524 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-14T09:21:43.524 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs 2023-10-14T09:21:43.524 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core 2023-10-14T09:21:43.524 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-14T09:21:43.524 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host 2023-10-14T09:21:43.524 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-14T09:21:43.525 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio 2023-10-14T09:21:43.525 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio.ko 2023-10-14T09:21:43.525 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_aec.ko 2023-10-14T09:21:43.525 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_cif.ko 2023-10-14T09:21:43.525 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-14T09:21:43.526 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_sercos3.ko 2023-10-14T09:21:43.526 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb 2023-10-14T09:21:43.526 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class 2023-10-14T09:21:43.526 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-14T09:21:43.526 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-14T09:21:43.527 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usblp.ko 2023-10-14T09:21:43.527 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usbtmc.ko 2023-10-14T09:21:43.527 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host 2023-10-14T09:21:43.527 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-14T09:21:43.527 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image 2023-10-14T09:21:43.528 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/mdc800.ko 2023-10-14T09:21:43.528 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/microtek.ko 2023-10-14T09:21:43.528 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc 2023-10-14T09:21:43.528 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/adutux.ko 2023-10-14T09:21:43.528 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-14T09:21:43.529 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi26.ko 2023-10-14T09:21:43.529 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi62.ko 2023-10-14T09:21:43.529 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ezusb.ko 2023-10-14T09:21:43.529 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/idmouse.ko 2023-10-14T09:21:43.529 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-14T09:21:43.530 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-14T09:21:43.530 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ldusb.ko 2023-10-14T09:21:43.530 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-14T09:21:43.530 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga 2023-10-14T09:21:43.530 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-14T09:21:43.531 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-14T09:21:43.531 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usb3503.ko 2023-10-14T09:21:43.531 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usblcd.ko 2023-10-14T09:21:43.531 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-14T09:21:43.531 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/uss720.ko 2023-10-14T09:21:43.531 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/yurex.ko 2023-10-14T09:21:43.532 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy 2023-10-14T09:21:43.532 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-14T09:21:43.532 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial 2023-10-14T09:21:43.532 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/aircable.ko 2023-10-14T09:21:43.532 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ark3116.ko 2023-10-14T09:21:43.533 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-14T09:21:43.533 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ch341.ko 2023-10-14T09:21:43.533 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cp210x.ko 2023-10-14T09:21:43.533 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-14T09:21:43.533 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-14T09:21:43.534 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-14T09:21:43.534 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/empeg.ko 2023-10-14T09:21:43.534 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-14T09:21:43.534 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-14T09:21:43.534 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-14T09:21:43.535 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_ti.ko 2023-10-14T09:21:43.535 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipaq.ko 2023-10-14T09:21:43.535 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipw.ko 2023-10-14T09:21:43.535 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-14T09:21:43.535 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-14T09:21:43.535 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan.ko 2023-10-14T09:21:43.536 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-14T09:21:43.536 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-14T09:21:43.536 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-14T09:21:43.536 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-14T09:21:43.536 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7720.ko 2023-10-14T09:21:43.537 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7840.ko 2023-10-14T09:21:43.537 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/navman.ko 2023-10-14T09:21:43.537 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/omninet.ko 2023-10-14T09:21:43.537 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/opticon.ko 2023-10-14T09:21:43.537 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/option.ko 2023-10-14T09:21:43.538 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/oti6858.ko 2023-10-14T09:21:43.538 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/pl2303.ko 2023-10-14T09:21:43.538 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcaux.ko 2023-10-14T09:21:43.538 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcserial.ko 2023-10-14T09:21:43.538 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/quatech2.ko 2023-10-14T09:21:43.539 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-14T09:21:43.539 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/sierra.ko 2023-10-14T09:21:43.539 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-14T09:21:43.539 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ssu100.ko 2023-10-14T09:21:43.539 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-14T09:21:43.540 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-14T09:21:43.540 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-14T09:21:43.540 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-14T09:21:43.540 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-14T09:21:43.540 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/visor.ko 2023-10-14T09:21:43.540 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-14T09:21:43.541 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-14T09:21:43.541 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage 2023-10-14T09:21:43.541 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/uas.ko 2023-10-14T09:21:43.541 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-14T09:21:43.541 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-14T09:21:43.542 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-14T09:21:43.542 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-14T09:21:43.542 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-14T09:21:43.542 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-14T09:21:43.542 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-14T09:21:43.543 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-14T09:21:43.543 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-14T09:21:43.543 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-14T09:21:43.543 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-14T09:21:43.543 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-14T09:21:43.544 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-14T09:21:43.544 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-14T09:21:43.544 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip 2023-10-14T09:21:43.544 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-14T09:21:43.544 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-14T09:21:43.545 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-14T09:21:43.545 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio 2023-10-14T09:21:43.545 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci 2023-10-14T09:21:43.545 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-14T09:21:43.545 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-14T09:21:43.546 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio.ko 2023-10-14T09:21:43.546 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-14T09:21:43.546 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost 2023-10-14T09:21:43.546 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost.ko 2023-10-14T09:21:43.546 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-14T09:21:43.547 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_net.ko 2023-10-14T09:21:43.547 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-14T09:21:43.547 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video 2023-10-14T09:21:43.547 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight 2023-10-14T09:21:43.547 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-14T09:21:43.548 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lcd.ko 2023-10-14T09:21:43.548 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-14T09:21:43.548 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio 2023-10-14T09:21:43.548 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio.ko 2023-10-14T09:21:43.548 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-14T09:21:43.549 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-14T09:21:43.549 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci.ko 2023-10-14T09:21:43.549 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-14T09:21:43.550 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-14T09:21:43.550 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_ring.ko 2023-10-14T09:21:43.550 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1 2023-10-14T09:21:43.550 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters 2023-10-14T09:21:43.550 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2482.ko 2023-10-14T09:21:43.551 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2490.ko 2023-10-14T09:21:43.551 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves 2023-10-14T09:21:43.551 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-14T09:21:43.551 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-14T09:21:43.551 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-14T09:21:43.552 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-14T09:21:43.552 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-14T09:21:43.552 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-14T09:21:43.552 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-14T09:21:43.552 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-14T09:21:43.552 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-14T09:21:43.553 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-14T09:21:43.553 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-14T09:21:43.553 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/wire.ko 2023-10-14T09:21:43.553 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog 2023-10-14T09:21:43.553 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-14T09:21:43.554 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-14T09:21:43.554 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-14T09:21:43.554 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/hpwdt.ko 2023-10-14T09:21:43.554 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/i6300esb.ko 2023-10-14T09:21:43.554 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-14T09:21:43.555 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-14T09:21:43.555 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-14T09:21:43.555 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ibmasr.ko 2023-10-14T09:21:43.555 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-14T09:21:43.555 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-14T09:21:43.556 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-14T09:21:43.556 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/machzwd.ko 2023-10-14T09:21:43.556 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/nv_tco.ko 2023-10-14T09:21:43.556 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-14T09:21:43.556 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-14T09:21:43.556 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-14T09:21:43.557 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-14T09:21:43.557 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/softdog.ko 2023-10-14T09:21:43.557 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-14T09:21:43.557 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/via_wdt.ko 2023-10-14T09:21:43.557 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-14T09:21:43.558 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-14T09:21:43.558 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-14T09:21:43.558 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-14T09:21:43.558 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-14T09:21:43.558 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen 2023-10-14T09:21:43.559 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-14T09:21:43.559 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-evtchn.ko 2023-10-14T09:21:43.559 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-14T09:21:43.559 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntdev.ko 2023-10-14T09:21:43.559 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback 2023-10-14T09:21:43.560 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-14T09:21:43.560 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-privcmd.ko 2023-10-14T09:21:43.560 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs 2023-10-14T09:21:43.560 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-14T09:21:43.560 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs 2023-10-14T09:21:43.561 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p 2023-10-14T09:21:43.561 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/9p.ko 2023-10-14T09:21:43.561 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs 2023-10-14T09:21:43.561 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/affs.ko 2023-10-14T09:21:43.561 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs 2023-10-14T09:21:43.562 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/befs.ko 2023-10-14T09:21:43.562 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/binfmt_misc.ko 2023-10-14T09:21:43.562 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs 2023-10-14T09:21:43.562 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/btrfs.ko 2023-10-14T09:21:43.562 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles 2023-10-14T09:21:43.563 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/cachefiles.ko 2023-10-14T09:21:43.563 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph 2023-10-14T09:21:43.563 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ceph.ko 2023-10-14T09:21:43.563 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda 2023-10-14T09:21:43.563 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/coda.ko 2023-10-14T09:21:43.563 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs 2023-10-14T09:21:43.564 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/cramfs.ko 2023-10-14T09:21:43.564 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm 2023-10-14T09:21:43.564 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/dlm.ko 2023-10-14T09:21:43.564 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs 2023-10-14T09:21:43.564 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-14T09:21:43.565 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs 2023-10-14T09:21:43.565 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/f2fs.ko 2023-10-14T09:21:43.565 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat 2023-10-14T09:21:43.565 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/fat.ko 2023-10-14T09:21:43.565 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/msdos.ko 2023-10-14T09:21:43.566 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/vfat.ko 2023-10-14T09:21:43.566 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache 2023-10-14T09:21:43.566 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/fscache.ko 2023-10-14T09:21:43.566 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse 2023-10-14T09:21:43.566 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/cuse.ko 2023-10-14T09:21:43.567 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/fuse.ko 2023-10-14T09:21:43.567 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2 2023-10-14T09:21:43.567 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/gfs2.ko 2023-10-14T09:21:43.567 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs 2023-10-14T09:21:43.567 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/hfs.ko 2023-10-14T09:21:43.568 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus 2023-10-14T09:21:43.568 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/hfsplus.ko 2023-10-14T09:21:43.568 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs 2023-10-14T09:21:43.568 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/isofs.ko 2023-10-14T09:21:43.568 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs 2023-10-14T09:21:43.569 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/jfs.ko 2023-10-14T09:21:43.569 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd 2023-10-14T09:21:43.569 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/lockd.ko 2023-10-14T09:21:43.569 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix 2023-10-14T09:21:43.569 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/minix.ko 2023-10-14T09:21:43.569 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs 2023-10-14T09:21:43.570 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/netfs.ko 2023-10-14T09:21:43.570 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs 2023-10-14T09:21:43.570 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout 2023-10-14T09:21:43.570 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-14T09:21:43.570 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout 2023-10-14T09:21:43.571 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-14T09:21:43.571 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout 2023-10-14T09:21:43.571 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-14T09:21:43.571 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfs.ko 2023-10-14T09:21:43.571 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv3.ko 2023-10-14T09:21:43.572 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv4.ko 2023-10-14T09:21:43.572 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common 2023-10-14T09:21:43.572 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/grace.ko 2023-10-14T09:21:43.572 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-14T09:21:43.572 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd 2023-10-14T09:21:43.573 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/nfsd.ko 2023-10-14T09:21:43.573 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2 2023-10-14T09:21:43.573 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/nilfs2.ko 2023-10-14T09:21:43.573 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls 2023-10-14T09:21:43.573 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-celtic.ko 2023-10-14T09:21:43.573 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-centeuro.ko 2023-10-14T09:21:43.574 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-croatian.ko 2023-10-14T09:21:43.574 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-cyrillic.ko 2023-10-14T09:21:43.574 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-gaelic.ko 2023-10-14T09:21:43.574 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-greek.ko 2023-10-14T09:21:43.574 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-iceland.ko 2023-10-14T09:21:43.575 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-inuit.ko 2023-10-14T09:21:43.575 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-roman.ko 2023-10-14T09:21:43.575 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-romanian.ko 2023-10-14T09:21:43.575 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-turkish.ko 2023-10-14T09:21:43.575 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1250.ko 2023-10-14T09:21:43.576 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1251.ko 2023-10-14T09:21:43.576 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1255.ko 2023-10-14T09:21:43.576 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp737.ko 2023-10-14T09:21:43.576 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp775.ko 2023-10-14T09:21:43.576 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp850.ko 2023-10-14T09:21:43.576 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp852.ko 2023-10-14T09:21:43.577 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp855.ko 2023-10-14T09:21:43.577 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp857.ko 2023-10-14T09:21:43.577 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp860.ko 2023-10-14T09:21:43.577 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp861.ko 2023-10-14T09:21:43.577 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp862.ko 2023-10-14T09:21:43.578 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp863.ko 2023-10-14T09:21:43.578 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp864.ko 2023-10-14T09:21:43.578 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp865.ko 2023-10-14T09:21:43.578 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp866.ko 2023-10-14T09:21:43.579 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp869.ko 2023-10-14T09:21:43.579 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp874.ko 2023-10-14T09:21:43.579 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp932.ko 2023-10-14T09:21:43.579 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp936.ko 2023-10-14T09:21:43.579 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp949.ko 2023-10-14T09:21:43.579 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp950.ko 2023-10-14T09:21:43.580 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_euc-jp.ko 2023-10-14T09:21:43.580 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-14T09:21:43.580 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-14T09:21:43.580 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-14T09:21:43.580 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-14T09:21:43.581 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-14T09:21:43.581 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-14T09:21:43.581 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-14T09:21:43.581 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-14T09:21:43.581 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-14T09:21:43.582 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-14T09:21:43.582 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-14T09:21:43.582 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-r.ko 2023-10-14T09:21:43.582 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-14T09:21:43.582 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-u.ko 2023-10-14T09:21:43.583 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ucs2_utils.ko 2023-10-14T09:21:43.583 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_utf8.ko 2023-10-14T09:21:43.583 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2 2023-10-14T09:21:43.583 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster 2023-10-14T09:21:43.583 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-14T09:21:43.584 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm 2023-10-14T09:21:43.584 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-14T09:21:43.584 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs 2023-10-14T09:21:43.584 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-14T09:21:43.584 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2.ko 2023-10-14T09:21:43.585 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-14T09:21:43.585 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-14T09:21:43.585 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-14T09:21:43.585 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs 2023-10-14T09:21:43.585 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/overlay.ko 2023-10-14T09:21:43.585 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore 2023-10-14T09:21:43.586 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ramoops.ko 2023-10-14T09:21:43.586 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs 2023-10-14T09:21:43.586 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/reiserfs.ko 2023-10-14T09:21:43.586 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs 2023-10-14T09:21:43.586 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/romfs.ko 2023-10-14T09:21:43.587 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb 2023-10-14T09:21:43.587 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client 2023-10-14T09:21:43.587 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/cifs.ko 2023-10-14T09:21:43.587 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common 2023-10-14T09:21:43.587 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-14T09:21:43.588 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_md4.ko 2023-10-14T09:21:43.588 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs 2023-10-14T09:21:43.588 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/squashfs.ko 2023-10-14T09:21:43.588 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv 2023-10-14T09:21:43.588 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/sysv.ko 2023-10-14T09:21:43.589 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf 2023-10-14T09:21:43.589 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/udf.ko 2023-10-14T09:21:43.589 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs 2023-10-14T09:21:43.589 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ufs.ko 2023-10-14T09:21:43.589 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs 2023-10-14T09:21:43.589 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/xfs.ko 2023-10-14T09:21:43.590 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel 2023-10-14T09:21:43.590 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu 2023-10-14T09:21:43.590 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu/rcutorture.ko 2023-10-14T09:21:43.590 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/torture.ko 2023-10-14T09:21:43.590 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace 2023-10-14T09:21:43.591 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-14T09:21:43.591 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib 2023-10-14T09:21:43.591 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/asn1_encoder.ko 2023-10-14T09:21:43.591 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc-itu-t.ko 2023-10-14T09:21:43.591 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc8.ko 2023-10-14T09:21:43.592 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto 2023-10-14T09:21:43.592 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libarc4.ko 2023-10-14T09:21:43.592 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libdes.ko 2023-10-14T09:21:43.592 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/libcrc32c.ko 2023-10-14T09:21:43.592 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lru_cache.ko 2023-10-14T09:21:43.593 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4 2023-10-14T09:21:43.593 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4_compress.ko 2023-10-14T09:21:43.593 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-14T09:21:43.593 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math 2023-10-14T09:21:43.593 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/cordic.ko 2023-10-14T09:21:43.594 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6 2023-10-14T09:21:43.594 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/raid6_pq.ko 2023-10-14T09:21:43.594 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon 2023-10-14T09:21:43.594 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-14T09:21:43.594 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_bm.ko 2023-10-14T09:21:43.595 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_fsm.ko 2023-10-14T09:21:43.595 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_kmp.ko 2023-10-14T09:21:43.595 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd 2023-10-14T09:21:43.595 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd/zstd_compress.ko 2023-10-14T09:21:43.595 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm 2023-10-14T09:21:43.595 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/hwpoison-inject.ko 2023-10-14T09:21:43.596 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net 2023-10-14T09:21:43.596 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan 2023-10-14T09:21:43.596 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/6lowpan.ko 2023-10-14T09:21:43.596 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_dest.ko 2023-10-14T09:21:43.596 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-14T09:21:43.597 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_hop.ko 2023-10-14T09:21:43.597 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-14T09:21:43.597 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-14T09:21:43.597 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_routing.ko 2023-10-14T09:21:43.597 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_udp.ko 2023-10-14T09:21:43.598 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802 2023-10-14T09:21:43.598 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/garp.ko 2023-10-14T09:21:43.598 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/mrp.ko 2023-10-14T09:21:43.598 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/p8022.ko 2023-10-14T09:21:43.598 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/psnap.ko 2023-10-14T09:21:43.599 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/stp.ko 2023-10-14T09:21:43.599 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q 2023-10-14T09:21:43.599 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/8021q.ko 2023-10-14T09:21:43.599 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p 2023-10-14T09:21:43.599 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet.ko 2023-10-14T09:21:43.599 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_fd.ko 2023-10-14T09:21:43.600 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_rdma.ko 2023-10-14T09:21:43.600 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_virtio.ko 2023-10-14T09:21:43.600 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv 2023-10-14T09:21:43.600 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/batman-adv.ko 2023-10-14T09:21:43.600 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge 2023-10-14T09:21:43.601 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/br_netfilter.ko 2023-10-14T09:21:43.601 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/bridge.ko 2023-10-14T09:21:43.601 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter 2023-10-14T09:21:43.601 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-14T09:21:43.601 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-14T09:21:43.601 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-14T09:21:43.602 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-14T09:21:43.602 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-14T09:21:43.602 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-14T09:21:43.602 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-14T09:21:43.602 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-14T09:21:43.603 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-14T09:21:43.603 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-14T09:21:43.603 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-14T09:21:43.603 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-14T09:21:43.603 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-14T09:21:43.604 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-14T09:21:43.604 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-14T09:21:43.604 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-14T09:21:43.604 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-14T09:21:43.604 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-14T09:21:43.604 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-14T09:21:43.605 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-14T09:21:43.605 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-14T09:21:43.605 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-14T09:21:43.605 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-14T09:21:43.605 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-14T09:21:43.606 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph 2023-10-14T09:21:43.606 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/libceph.ko 2023-10-14T09:21:43.606 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core 2023-10-14T09:21:43.606 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/failover.ko 2023-10-14T09:21:43.606 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/pktgen.ko 2023-10-14T09:21:43.607 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp 2023-10-14T09:21:43.607 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp.ko 2023-10-14T09:21:43.607 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_diag.ko 2023-10-14T09:21:43.607 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv4.ko 2023-10-14T09:21:43.607 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv6.ko 2023-10-14T09:21:43.607 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver 2023-10-14T09:21:43.608 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-14T09:21:43.608 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa 2023-10-14T09:21:43.608 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/dsa_core.ko 2023-10-14T09:21:43.608 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_brcm.ko 2023-10-14T09:21:43.608 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_dsa.ko 2023-10-14T09:21:43.609 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_none.ko 2023-10-14T09:21:43.609 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_trailer.ko 2023-10-14T09:21:43.609 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154 2023-10-14T09:21:43.609 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan 2023-10-14T09:21:43.609 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-14T09:21:43.610 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154.ko 2023-10-14T09:21:43.610 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-14T09:21:43.610 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4 2023-10-14T09:21:43.610 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ah4.ko 2023-10-14T09:21:43.610 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/esp4.ko 2023-10-14T09:21:43.611 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/fou.ko 2023-10-14T09:21:43.611 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/gre.ko 2023-10-14T09:21:43.611 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/inet_diag.ko 2023-10-14T09:21:43.611 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_gre.ko 2023-10-14T09:21:43.611 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_tunnel.ko 2023-10-14T09:21:43.611 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_vti.ko 2023-10-14T09:21:43.612 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipcomp.ko 2023-10-14T09:21:43.612 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipip.ko 2023-10-14T09:21:43.612 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter 2023-10-14T09:21:43.612 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-14T09:21:43.612 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-14T09:21:43.613 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-14T09:21:43.613 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-14T09:21:43.613 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-14T09:21:43.613 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-14T09:21:43.613 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-14T09:21:43.614 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-14T09:21:43.614 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-14T09:21:43.614 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-14T09:21:43.614 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-14T09:21:43.614 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-14T09:21:43.615 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-14T09:21:43.615 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-14T09:21:43.615 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-14T09:21:43.615 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-14T09:21:43.615 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-14T09:21:43.616 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-14T09:21:43.616 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-14T09:21:43.616 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-14T09:21:43.616 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-14T09:21:43.616 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_bic.ko 2023-10-14T09:21:43.617 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-14T09:21:43.617 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_diag.ko 2023-10-14T09:21:43.617 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-14T09:21:43.617 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_htcp.ko 2023-10-14T09:21:43.617 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_hybla.ko 2023-10-14T09:21:43.617 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_illinois.ko 2023-10-14T09:21:43.618 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_lp.ko 2023-10-14T09:21:43.618 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_scalable.ko 2023-10-14T09:21:43.618 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_vegas.ko 2023-10-14T09:21:43.618 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_veno.ko 2023-10-14T09:21:43.618 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_westwood.ko 2023-10-14T09:21:43.619 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_yeah.ko 2023-10-14T09:21:43.619 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tunnel4.ko 2023-10-14T09:21:43.619 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_diag.ko 2023-10-14T09:21:43.619 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_tunnel.ko 2023-10-14T09:21:43.619 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-14T09:21:43.620 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6 2023-10-14T09:21:43.620 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ah6.ko 2023-10-14T09:21:43.620 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/esp6.ko 2023-10-14T09:21:43.620 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/fou6.ko 2023-10-14T09:21:43.620 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-14T09:21:43.621 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-14T09:21:43.621 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_vti.ko 2023-10-14T09:21:43.621 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ipcomp6.ko 2023-10-14T09:21:43.621 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter 2023-10-14T09:21:43.621 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-14T09:21:43.621 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-14T09:21:43.622 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-14T09:21:43.622 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-14T09:21:43.622 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-14T09:21:43.622 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-14T09:21:43.622 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-14T09:21:43.623 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-14T09:21:43.623 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-14T09:21:43.623 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-14T09:21:43.623 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-14T09:21:43.623 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-14T09:21:43.624 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-14T09:21:43.624 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-14T09:21:43.624 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-14T09:21:43.624 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-14T09:21:43.624 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-14T09:21:43.624 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-14T09:21:43.625 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-14T09:21:43.625 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-14T09:21:43.625 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-14T09:21:43.625 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-14T09:21:43.625 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-14T09:21:43.626 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-14T09:21:43.626 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/sit.ko 2023-10-14T09:21:43.626 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/tunnel6.ko 2023-10-14T09:21:43.626 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-14T09:21:43.626 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key 2023-10-14T09:21:43.627 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/af_key.ko 2023-10-14T09:21:43.627 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp 2023-10-14T09:21:43.627 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_core.ko 2023-10-14T09:21:43.627 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-14T09:21:43.627 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_eth.ko 2023-10-14T09:21:43.628 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip.ko 2023-10-14T09:21:43.628 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-14T09:21:43.628 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-14T09:21:43.628 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-14T09:21:43.628 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc 2023-10-14T09:21:43.629 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc.ko 2023-10-14T09:21:43.629 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154 2023-10-14T09:21:43.629 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/mac802154.ko 2023-10-14T09:21:43.629 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls 2023-10-14T09:21:43.629 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/mpls_gso.ko 2023-10-14T09:21:43.629 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter 2023-10-14T09:21:43.630 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset 2023-10-14T09:21:43.630 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-14T09:21:43.630 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-14T09:21:43.630 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-14T09:21:43.631 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-14T09:21:43.631 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-14T09:21:43.631 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-14T09:21:43.631 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-14T09:21:43.631 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-14T09:21:43.631 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-14T09:21:43.632 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-14T09:21:43.632 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-14T09:21:43.632 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-14T09:21:43.632 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-14T09:21:43.632 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-14T09:21:43.633 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-14T09:21:43.633 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-14T09:21:43.633 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs 2023-10-14T09:21:43.633 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-14T09:21:43.633 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-14T09:21:43.634 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-14T09:21:43.634 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-14T09:21:43.634 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-14T09:21:43.634 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-14T09:21:43.634 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-14T09:21:43.634 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-14T09:21:43.635 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-14T09:21:43.635 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-14T09:21:43.635 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-14T09:21:43.635 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-14T09:21:43.635 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-14T09:21:43.636 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-14T09:21:43.636 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conncount.ko 2023-10-14T09:21:43.636 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack.ko 2023-10-14T09:21:43.636 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-14T09:21:43.636 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-14T09:21:43.637 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-14T09:21:43.637 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-14T09:21:43.637 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-14T09:21:43.637 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-14T09:21:43.637 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-14T09:21:43.637 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-14T09:21:43.638 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-14T09:21:43.638 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-14T09:21:43.638 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-14T09:21:43.638 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-14T09:21:43.638 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-14T09:21:43.639 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table.ko 2023-10-14T09:21:43.639 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-14T09:21:43.639 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-14T09:21:43.639 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat.ko 2023-10-14T09:21:43.639 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-14T09:21:43.640 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-14T09:21:43.640 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-14T09:21:43.640 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-14T09:21:43.640 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-14T09:21:43.640 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-14T09:21:43.641 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_tables.ko 2023-10-14T09:21:43.641 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink.ko 2023-10-14T09:21:43.641 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-14T09:21:43.641 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-14T09:21:43.641 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-14T09:21:43.641 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-14T09:21:43.642 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-14T09:21:43.642 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_compat.ko 2023-10-14T09:21:43.642 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_ct.ko 2023-10-14T09:21:43.642 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-14T09:21:43.643 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fib.ko 2023-10-14T09:21:43.643 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-14T09:21:43.643 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_hash.ko 2023-10-14T09:21:43.643 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_limit.ko 2023-10-14T09:21:43.643 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_log.ko 2023-10-14T09:21:43.644 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_masq.ko 2023-10-14T09:21:43.644 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_nat.ko 2023-10-14T09:21:43.644 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_numgen.ko 2023-10-14T09:21:43.644 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_queue.ko 2023-10-14T09:21:43.644 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_quota.ko 2023-10-14T09:21:43.644 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_redir.ko 2023-10-14T09:21:43.645 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject.ko 2023-10-14T09:21:43.645 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-14T09:21:43.645 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_socket.ko 2023-10-14T09:21:43.645 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_tunnel.ko 2023-10-14T09:21:43.645 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-14T09:21:43.646 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-14T09:21:43.646 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-14T09:21:43.646 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-14T09:21:43.646 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CT.ko 2023-10-14T09:21:43.646 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_DSCP.ko 2023-10-14T09:21:43.647 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HL.ko 2023-10-14T09:21:43.647 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HMARK.ko 2023-10-14T09:21:43.647 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-14T09:21:43.647 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LED.ko 2023-10-14T09:21:43.647 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LOG.ko 2023-10-14T09:21:43.648 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-14T09:21:43.648 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-14T09:21:43.648 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-14T09:21:43.648 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-14T09:21:43.648 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-14T09:21:43.649 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-14T09:21:43.649 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-14T09:21:43.649 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-14T09:21:43.649 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-14T09:21:43.649 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TEE.ko 2023-10-14T09:21:43.650 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-14T09:21:43.650 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TRACE.ko 2023-10-14T09:21:43.650 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_addrtype.ko 2023-10-14T09:21:43.650 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_bpf.ko 2023-10-14T09:21:43.650 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cgroup.ko 2023-10-14T09:21:43.650 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cluster.ko 2023-10-14T09:21:43.651 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_comment.ko 2023-10-14T09:21:43.651 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connbytes.ko 2023-10-14T09:21:43.651 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlabel.ko 2023-10-14T09:21:43.651 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlimit.ko 2023-10-14T09:21:43.651 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connmark.ko 2023-10-14T09:21:43.652 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_conntrack.ko 2023-10-14T09:21:43.652 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cpu.ko 2023-10-14T09:21:43.652 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dccp.ko 2023-10-14T09:21:43.652 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_devgroup.ko 2023-10-14T09:21:43.652 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dscp.ko 2023-10-14T09:21:43.652 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ecn.ko 2023-10-14T09:21:43.653 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_esp.ko 2023-10-14T09:21:43.653 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-14T09:21:43.653 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_helper.ko 2023-10-14T09:21:43.653 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hl.ko 2023-10-14T09:21:43.653 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-14T09:21:43.653 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_iprange.ko 2023-10-14T09:21:43.654 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipvs.ko 2023-10-14T09:21:43.654 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_l2tp.ko 2023-10-14T09:21:43.654 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_length.ko 2023-10-14T09:21:43.654 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_limit.ko 2023-10-14T09:21:43.654 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mac.ko 2023-10-14T09:21:43.655 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mark.ko 2023-10-14T09:21:43.655 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_multiport.ko 2023-10-14T09:21:43.655 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nat.ko 2023-10-14T09:21:43.655 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nfacct.ko 2023-10-14T09:21:43.655 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_osf.ko 2023-10-14T09:21:43.656 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_owner.ko 2023-10-14T09:21:43.656 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_physdev.ko 2023-10-14T09:21:43.656 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_pkttype.ko 2023-10-14T09:21:43.656 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_policy.ko 2023-10-14T09:21:43.656 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_quota.ko 2023-10-14T09:21:43.657 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_rateest.ko 2023-10-14T09:21:43.657 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_realm.ko 2023-10-14T09:21:43.657 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_recent.ko 2023-10-14T09:21:43.657 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_sctp.ko 2023-10-14T09:21:43.657 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_set.ko 2023-10-14T09:21:43.657 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_socket.ko 2023-10-14T09:21:43.658 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_state.ko 2023-10-14T09:21:43.658 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_statistic.ko 2023-10-14T09:21:43.658 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_string.ko 2023-10-14T09:21:43.658 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-14T09:21:43.658 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_time.ko 2023-10-14T09:21:43.659 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_u32.ko 2023-10-14T09:21:43.659 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink 2023-10-14T09:21:43.659 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/netlink_diag.ko 2023-10-14T09:21:43.659 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh 2023-10-14T09:21:43.659 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/nsh.ko 2023-10-14T09:21:43.660 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch 2023-10-14T09:21:43.660 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/openvswitch.ko 2023-10-14T09:21:43.660 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-geneve.ko 2023-10-14T09:21:43.660 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-gre.ko 2023-10-14T09:21:43.660 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-14T09:21:43.661 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet 2023-10-14T09:21:43.661 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/af_packet_diag.ko 2023-10-14T09:21:43.661 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds 2023-10-14T09:21:43.661 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds.ko 2023-10-14T09:21:43.661 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_rdma.ko 2023-10-14T09:21:43.662 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_tcp.ko 2023-10-14T09:21:43.662 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched 2023-10-14T09:21:43.662 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_csum.ko 2023-10-14T09:21:43.662 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_gact.ko 2023-10-14T09:21:43.662 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_ipt.ko 2023-10-14T09:21:43.663 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_mirred.ko 2023-10-14T09:21:43.663 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_nat.ko 2023-10-14T09:21:43.663 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_pedit.ko 2023-10-14T09:21:43.663 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_police.ko 2023-10-14T09:21:43.663 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_simple.ko 2023-10-14T09:21:43.663 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_skbedit.ko 2023-10-14T09:21:43.664 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_vlan.ko 2023-10-14T09:21:43.664 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_basic.ko 2023-10-14T09:21:43.664 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_bpf.ko 2023-10-14T09:21:43.664 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_flow.ko 2023-10-14T09:21:43.664 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_fw.ko 2023-10-14T09:21:43.665 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_route.ko 2023-10-14T09:21:43.665 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_u32.ko 2023-10-14T09:21:43.665 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_cmp.ko 2023-10-14T09:21:43.665 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_ipset.ko 2023-10-14T09:21:43.665 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_meta.ko 2023-10-14T09:21:43.666 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_nbyte.ko 2023-10-14T09:21:43.666 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_text.ko 2023-10-14T09:21:43.666 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_u32.ko 2023-10-14T09:21:43.666 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_choke.ko 2023-10-14T09:21:43.666 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_codel.ko 2023-10-14T09:21:43.666 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_drr.ko 2023-10-14T09:21:43.667 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq.ko 2023-10-14T09:21:43.667 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_gred.ko 2023-10-14T09:21:43.667 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hfsc.ko 2023-10-14T09:21:43.667 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hhf.ko 2023-10-14T09:21:43.667 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_htb.ko 2023-10-14T09:21:43.668 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_ingress.ko 2023-10-14T09:21:43.668 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio.ko 2023-10-14T09:21:43.668 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-14T09:21:43.668 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_multiq.ko 2023-10-14T09:21:43.668 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_netem.ko 2023-10-14T09:21:43.669 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_pie.ko 2023-10-14T09:21:43.669 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_plug.ko 2023-10-14T09:21:43.669 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_prio.ko 2023-10-14T09:21:43.669 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_qfq.ko 2023-10-14T09:21:43.669 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_red.ko 2023-10-14T09:21:43.670 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfb.ko 2023-10-14T09:21:43.670 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfq.ko 2023-10-14T09:21:43.670 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_tbf.ko 2023-10-14T09:21:43.670 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_teql.ko 2023-10-14T09:21:43.670 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp 2023-10-14T09:21:43.671 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp.ko 2023-10-14T09:21:43.671 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp_diag.ko 2023-10-14T09:21:43.671 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc 2023-10-14T09:21:43.671 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss 2023-10-14T09:21:43.671 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-14T09:21:43.672 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-14T09:21:43.672 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/sunrpc.ko 2023-10-14T09:21:43.672 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma 2023-10-14T09:21:43.672 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-14T09:21:43.672 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc 2023-10-14T09:21:43.673 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/diag.ko 2023-10-14T09:21:43.673 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/tipc.ko 2023-10-14T09:21:43.673 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix 2023-10-14T09:21:43.673 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/unix_diag.ko 2023-10-14T09:21:43.673 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock 2023-10-14T09:21:43.674 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-14T09:21:43.674 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-14T09:21:43.674 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock.ko 2023-10-14T09:21:43.674 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-14T09:21:43.674 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-14T09:21:43.675 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm 2023-10-14T09:21:43.675 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-14T09:21:43.675 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security 2023-10-14T09:21:43.675 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys 2023-10-14T09:21:43.675 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys 2023-10-14T09:21:43.675 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-14T09:21:43.676 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys 2023-10-14T09:21:43.676 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-14T09:21:43.676 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt 2023-10-14T09:21:43.676 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib 2023-10-14T09:21:43.676 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/irqbypass.ko 2023-10-14T09:21:43.677 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias 2023-10-14T09:21:43.677 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias.bin 2023-10-14T09:21:43.677 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin 2023-10-14T09:21:43.677 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.alias.bin 2023-10-14T09:21:43.677 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.bin 2023-10-14T09:21:43.678 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.modinfo 2023-10-14T09:21:43.678 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep 2023-10-14T09:21:43.678 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep.bin 2023-10-14T09:21:43.678 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.devname 2023-10-14T09:21:43.678 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.order 2023-10-14T09:21:43.679 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.softdep 2023-10-14T09:21:43.679 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols 2023-10-14T09:21:43.679 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols.bin 2023-10-14T09:21:43.680 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g47672119149b 2023-10-14T09:21:43.680 DEBUG:teuthology.orchestra.run.smithi129:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-14T09:21:43.704 INFO:teuthology.orchestra.run.smithi129.stdout:postinstall scriptlet (using /bin/sh): 2023-10-14T09:21:43.705 INFO:teuthology.orchestra.run.smithi129.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-rc5-g47672119149b -a -r /boot/System.map-6.6.0-rc5-g47672119149b ]; then 2023-10-14T09:21:43.705 INFO:teuthology.orchestra.run.smithi129.stdout:cp /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm 2023-10-14T09:21:43.705 INFO:teuthology.orchestra.run.smithi129.stdout:cp /boot/System.map-6.6.0-rc5-g47672119149b /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-14T09:21:43.705 INFO:teuthology.orchestra.run.smithi129.stdout:rm -f /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/System.map-6.6.0-rc5-g47672119149b 2023-10-14T09:21:43.705 INFO:teuthology.orchestra.run.smithi129.stdout:/sbin/installkernel 6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-14T09:21:43.706 INFO:teuthology.orchestra.run.smithi129.stdout:rm -f /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-14T09:21:43.706 INFO:teuthology.orchestra.run.smithi129.stdout:fi 2023-10-14T09:21:43.706 INFO:teuthology.orchestra.run.smithi129.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-14T09:21:43.706 INFO:teuthology.orchestra.run.smithi129.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-14T09:21:43.706 INFO:teuthology.orchestra.run.smithi129.stdout:new-kernel-pkg --remove 6.6.0-rc5-g47672119149b --rminitrd --initrdfile=/boot/initramfs-6.6.0-rc5-g47672119149b.img 2023-10-14T09:21:43.707 INFO:teuthology.orchestra.run.smithi129.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-14T09:21:43.707 INFO:teuthology.orchestra.run.smithi129.stdout:kernel-install remove 6.6.0-rc5-g47672119149b 2023-10-14T09:21:43.707 INFO:teuthology.orchestra.run.smithi129.stdout:fi 2023-10-14T09:21:43.707 INFO:teuthology.orchestra.run.smithi129.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-14T09:21:43.708 INFO:teuthology.orchestra.run.smithi129.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-14T09:21:43.708 INFO:teuthology.orchestra.run.smithi129.stdout:/sbin/update-bootloader --remove 6.6.0-rc5-g47672119149b 2023-10-14T09:21:43.708 INFO:teuthology.orchestra.run.smithi129.stdout:fi 2023-10-14T09:21:43.709 DEBUG:teuthology.orchestra.run.smithi129:> sudo rpm -qi grub2-tools 2023-10-14T09:21:43.785 INFO:teuthology.orchestra.run.smithi129.stdout:Name : grub2-tools 2023-10-14T09:21:43.786 INFO:teuthology.orchestra.run.smithi129.stdout:Epoch : 1 2023-10-14T09:21:43.786 INFO:teuthology.orchestra.run.smithi129.stdout:Version : 2.06 2023-10-14T09:21:43.786 INFO:teuthology.orchestra.run.smithi129.stdout:Release : 68.el9 2023-10-14T09:21:43.786 INFO:teuthology.orchestra.run.smithi129.stdout:Architecture: x86_64 2023-10-14T09:21:43.787 INFO:teuthology.orchestra.run.smithi129.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-10-14T09:21:43.787 INFO:teuthology.orchestra.run.smithi129.stdout:Group : Unspecified 2023-10-14T09:21:43.787 INFO:teuthology.orchestra.run.smithi129.stdout:Size : 8264254 2023-10-14T09:21:43.787 INFO:teuthology.orchestra.run.smithi129.stdout:License : GPLv3+ 2023-10-14T09:21:43.787 INFO:teuthology.orchestra.run.smithi129.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-10-14T09:21:43.788 INFO:teuthology.orchestra.run.smithi129.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-10-14T09:21:43.788 INFO:teuthology.orchestra.run.smithi129.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-10-14T09:21:43.788 INFO:teuthology.orchestra.run.smithi129.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-10-14T09:21:43.788 INFO:teuthology.orchestra.run.smithi129.stdout:Packager : builder@centos.org 2023-10-14T09:21:43.788 INFO:teuthology.orchestra.run.smithi129.stdout:Vendor : CentOS 2023-10-14T09:21:43.789 INFO:teuthology.orchestra.run.smithi129.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-14T09:21:43.789 INFO:teuthology.orchestra.run.smithi129.stdout:Summary : Support tools for GRUB. 2023-10-14T09:21:43.789 INFO:teuthology.orchestra.run.smithi129.stdout:Description : 2023-10-14T09:21:43.789 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:21:43.789 INFO:teuthology.orchestra.run.smithi129.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-14T09:21:43.790 INFO:teuthology.orchestra.run.smithi129.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-14T09:21:43.790 INFO:teuthology.orchestra.run.smithi129.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-14T09:21:43.790 INFO:teuthology.orchestra.run.smithi129.stdout:hardware devices. 2023-10-14T09:21:43.790 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:21:43.790 INFO:teuthology.orchestra.run.smithi129.stdout:This subpackage provides tools for support of all platforms. 2023-10-14T09:21:43.791 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-14T09:21:43.792 INFO:teuthology.task.kernel:Updating grub on smithi129 to boot 6.6.0-rc5-g47672119149b 2023-10-14T09:21:43.792 DEBUG:teuthology.orchestra.run.smithi129:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-14T09:21:44.475 INFO:teuthology.orchestra.run.smithi129.stderr:Generating grub configuration file ... 2023-10-14T09:21:45.894 INFO:teuthology.orchestra.run.smithi129.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-10-14T09:21:45.924 INFO:teuthology.orchestra.run.smithi129.stderr:done 2023-10-14T09:21:45.926 DEBUG:teuthology.orchestra.run.smithi129:> mktemp 2023-10-14T09:21:45.981 INFO:teuthology.orchestra.run.smithi129.stdout:/tmp/tmp.gISJMBv0oY 2023-10-14T09:21:45.982 DEBUG:teuthology.orchestra.run.smithi129:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.gISJMBv0oY 2023-10-14T09:21:46.051 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 0666 /tmp/tmp.gISJMBv0oY 2023-10-14T09:21:46.194 DEBUG:teuthology.orchestra.remote:smithi129:/tmp/tmp.gISJMBv0oY is 6KB 2023-10-14T09:21:46.242 DEBUG:teuthology.orchestra.run.smithi129:> rm -fr /tmp/tmp.gISJMBv0oY 2023-10-14T09:21:46.256 DEBUG:teuthology.orchestra.run.smithi129:> sudo /bin/ls /boot/loader/entries || true 2023-10-14T09:21:46.322 INFO:teuthology.orchestra.run.smithi129.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-10-14T09:21:46.322 INFO:teuthology.orchestra.run.smithi129.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-10-14T09:21:46.322 INFO:teuthology.orchestra.run.smithi129.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-10-14T09:21:46.323 INFO:teuthology.orchestra.run.smithi129.stdout:15949e3c88704300882482eddfd7baae-6.6.0-rc5-g47672119149b.conf 2023-10-14T09:21:46.324 DEBUG:teuthology.orchestra.run.smithi129:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-rc5-g47672119149b 2023-10-14T09:21:46.460 DEBUG:teuthology.orchestra.run.smithi129:> sudo shutdown -r now 2023-10-14T09:21:46.800 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi102.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-14T09:21:46.801 DEBUG:teuthology.orchestra.run.smithi102:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-14T09:21:46.873 INFO:teuthology.orchestra.run.smithi102.stdout:/boot/System.map-6.6.0-rc5-g47672119149b 2023-10-14T09:21:46.873 INFO:teuthology.orchestra.run.smithi102.stdout:/boot/config-6.6.0-rc5-g47672119149b 2023-10-14T09:21:46.873 INFO:teuthology.orchestra.run.smithi102.stdout:/boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-14T09:21:46.873 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b 2023-10-14T09:21:46.874 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel 2023-10-14T09:21:46.874 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch 2023-10-14T09:21:46.874 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86 2023-10-14T09:21:46.874 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto 2023-10-14T09:21:46.874 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-14T09:21:46.875 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-14T09:21:46.875 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-14T09:21:46.875 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-14T09:21:46.875 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-14T09:21:46.875 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-14T09:21:46.876 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-14T09:21:46.876 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-14T09:21:46.876 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-14T09:21:46.876 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-14T09:21:46.876 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-14T09:21:46.877 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-14T09:21:46.877 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-14T09:21:46.877 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-14T09:21:46.877 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-14T09:21:46.877 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-14T09:21:46.878 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-14T09:21:46.878 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-14T09:21:46.878 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-14T09:21:46.878 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-14T09:21:46.878 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel 2023-10-14T09:21:46.879 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu 2023-10-14T09:21:46.879 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce 2023-10-14T09:21:46.879 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-14T09:21:46.879 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm 2023-10-14T09:21:46.879 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-14T09:21:46.880 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-14T09:21:46.880 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm.ko 2023-10-14T09:21:46.880 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto 2023-10-14T09:21:46.880 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ansi_cprng.ko 2023-10-14T09:21:46.880 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/anubis.ko 2023-10-14T09:21:46.881 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/arc4.ko 2023-10-14T09:21:46.881 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx 2023-10-14T09:21:46.881 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-14T09:21:46.881 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_pq.ko 2023-10-14T09:21:46.881 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-14T09:21:46.881 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_tx.ko 2023-10-14T09:21:46.882 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_xor.ko 2023-10-14T09:21:46.882 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/raid6test.ko 2023-10-14T09:21:46.882 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authenc.ko 2023-10-14T09:21:46.882 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authencesn.ko 2023-10-14T09:21:46.883 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blake2b_generic.ko 2023-10-14T09:21:46.883 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_common.ko 2023-10-14T09:21:46.883 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_generic.ko 2023-10-14T09:21:46.883 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/camellia_generic.ko 2023-10-14T09:21:46.883 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast5_generic.ko 2023-10-14T09:21:46.883 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast6_generic.ko 2023-10-14T09:21:46.884 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast_common.ko 2023-10-14T09:21:46.884 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ccm.ko 2023-10-14T09:21:46.884 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cmac.ko 2023-10-14T09:21:46.884 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crc32_generic.ko 2023-10-14T09:21:46.884 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_engine.ko 2023-10-14T09:21:46.885 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_user.ko 2023-10-14T09:21:46.885 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cts.ko 2023-10-14T09:21:46.885 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/des_generic.ko 2023-10-14T09:21:46.885 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/dh_generic.ko 2023-10-14T09:21:46.885 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/echainiv.ko 2023-10-14T09:21:46.886 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/essiv.ko 2023-10-14T09:21:46.886 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/fcrypt.ko 2023-10-14T09:21:46.886 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/khazad.ko 2023-10-14T09:21:46.886 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4.ko 2023-10-14T09:21:46.886 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4hc.ko 2023-10-14T09:21:46.887 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/md4.ko 2023-10-14T09:21:46.887 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/michael_mic.ko 2023-10-14T09:21:46.887 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcbc.ko 2023-10-14T09:21:46.887 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcrypt.ko 2023-10-14T09:21:46.887 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/rmd160.ko 2023-10-14T09:21:46.887 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/seed.ko 2023-10-14T09:21:46.888 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/serpent_generic.ko 2023-10-14T09:21:46.888 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tcrypt.ko 2023-10-14T09:21:46.888 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tea.ko 2023-10-14T09:21:46.888 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_common.ko 2023-10-14T09:21:46.888 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_generic.ko 2023-10-14T09:21:46.889 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/vmac.ko 2023-10-14T09:21:46.889 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/wp512.ko 2023-10-14T09:21:46.889 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xcbc.ko 2023-10-14T09:21:46.889 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xor.ko 2023-10-14T09:21:46.889 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xxhash_generic.ko 2023-10-14T09:21:46.890 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers 2023-10-14T09:21:46.890 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi 2023-10-14T09:21:46.890 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-14T09:21:46.890 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_pad.ko 2023-10-14T09:21:46.890 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/custom_method.ko 2023-10-14T09:21:46.891 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ec_sys.ko 2023-10-14T09:21:46.891 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/platform_profile.ko 2023-10-14T09:21:46.891 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbs.ko 2023-10-14T09:21:46.891 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbshc.ko 2023-10-14T09:21:46.891 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/video.ko 2023-10-14T09:21:46.892 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata 2023-10-14T09:21:46.892 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/acard-ahci.ko 2023-10-14T09:21:46.892 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci_platform.ko 2023-10-14T09:21:46.892 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ata_generic.ko 2023-10-14T09:21:46.892 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci_platform.ko 2023-10-14T09:21:46.893 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_acpi.ko 2023-10-14T09:21:46.893 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ali.ko 2023-10-14T09:21:46.893 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_amd.ko 2023-10-14T09:21:46.893 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_artop.ko 2023-10-14T09:21:46.893 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atiixp.ko 2023-10-14T09:21:46.893 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atp867x.ko 2023-10-14T09:21:46.894 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd640.ko 2023-10-14T09:21:46.894 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-14T09:21:46.894 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cypress.ko 2023-10-14T09:21:46.894 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_efar.ko 2023-10-14T09:21:46.894 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt366.ko 2023-10-14T09:21:46.895 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-14T09:21:46.895 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-14T09:21:46.895 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-14T09:21:46.895 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it8213.ko 2023-10-14T09:21:46.895 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it821x.ko 2023-10-14T09:21:46.896 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_jmicron.ko 2023-10-14T09:21:46.896 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_marvell.ko 2023-10-14T09:21:46.896 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_mpiix.ko 2023-10-14T09:21:46.896 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_netcell.ko 2023-10-14T09:21:46.896 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ninja32.ko 2023-10-14T09:21:46.897 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87410.ko 2023-10-14T09:21:46.897 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87415.ko 2023-10-14T09:21:46.897 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-14T09:21:46.897 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_opti.ko 2023-10-14T09:21:46.897 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_optidma.ko 2023-10-14T09:21:46.897 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-14T09:21:46.898 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-14T09:21:46.898 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-14T09:21:46.898 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_piccolo.ko 2023-10-14T09:21:46.898 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rdc.ko 2023-10-14T09:21:46.898 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sch.ko 2023-10-14T09:21:46.899 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_serverworks.ko 2023-10-14T09:21:46.899 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sil680.ko 2023-10-14T09:21:46.899 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sis.ko 2023-10-14T09:21:46.899 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-14T09:21:46.899 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_triflex.ko 2023-10-14T09:21:46.900 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_via.ko 2023-10-14T09:21:46.900 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pdc_adma.ko 2023-10-14T09:21:46.900 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_inic162x.ko 2023-10-14T09:21:46.900 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_mv.ko 2023-10-14T09:21:46.900 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_nv.ko 2023-10-14T09:21:46.901 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_promise.ko 2023-10-14T09:21:46.901 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_qstor.ko 2023-10-14T09:21:46.901 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil.ko 2023-10-14T09:21:46.901 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil24.ko 2023-10-14T09:21:46.901 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sis.ko 2023-10-14T09:21:46.901 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_svw.ko 2023-10-14T09:21:46.902 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sx4.ko 2023-10-14T09:21:46.902 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_uli.ko 2023-10-14T09:21:46.902 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_via.ko 2023-10-14T09:21:46.902 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_vsc.ko 2023-10-14T09:21:46.902 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay 2023-10-14T09:21:46.903 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-14T09:21:46.903 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base 2023-10-14T09:21:46.903 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap 2023-10-14T09:21:46.903 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-14T09:21:46.903 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-14T09:21:46.904 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma 2023-10-14T09:21:46.904 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/bcma.ko 2023-10-14T09:21:46.904 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block 2023-10-14T09:21:46.904 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe 2023-10-14T09:21:46.904 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/aoe.ko 2023-10-14T09:21:46.904 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/brd.ko 2023-10-14T09:21:46.905 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd 2023-10-14T09:21:46.905 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/drbd.ko 2023-10-14T09:21:46.905 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/floppy.ko 2023-10-14T09:21:46.905 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/loop.ko 2023-10-14T09:21:46.905 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx 2023-10-14T09:21:46.906 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-14T09:21:46.906 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/nbd.ko 2023-10-14T09:21:46.906 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk 2023-10-14T09:21:46.906 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-14T09:21:46.906 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/pktcdvd.ko 2023-10-14T09:21:46.907 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/rbd.ko 2023-10-14T09:21:46.907 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/virtio_blk.ko 2023-10-14T09:21:46.907 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback 2023-10-14T09:21:46.907 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-14T09:21:46.907 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkfront.ko 2023-10-14T09:21:46.908 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram 2023-10-14T09:21:46.908 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/zram.ko 2023-10-14T09:21:46.908 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char 2023-10-14T09:21:46.908 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hangcheck-timer.ko 2023-10-14T09:21:46.908 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random 2023-10-14T09:21:46.908 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-14T09:21:46.909 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-14T09:21:46.909 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-14T09:21:46.909 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-14T09:21:46.909 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-14T09:21:46.909 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi 2023-10-14T09:21:46.910 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-14T09:21:46.910 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-14T09:21:46.910 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-14T09:21:46.910 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-14T09:21:46.910 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-14T09:21:46.911 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-14T09:21:46.911 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/lp.ko 2023-10-14T09:21:46.911 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave 2023-10-14T09:21:46.911 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/mwave.ko 2023-10-14T09:21:46.911 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ppdev.ko 2023-10-14T09:21:46.911 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tlclk.ko 2023-10-14T09:21:46.912 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm 2023-10-14T09:21:46.912 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm.ko 2023-10-14T09:21:46.912 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-14T09:21:46.912 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-14T09:21:46.912 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-14T09:21:46.913 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-14T09:21:46.913 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-14T09:21:46.913 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/uv_mmtimer.ko 2023-10-14T09:21:46.913 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/virtio_console.ko 2023-10-14T09:21:46.913 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq 2023-10-14T09:21:46.914 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-14T09:21:46.914 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-14T09:21:46.914 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-14T09:21:46.914 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-14T09:21:46.914 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-14T09:21:46.915 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-14T09:21:46.915 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto 2023-10-14T09:21:46.915 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp 2023-10-14T09:21:46.915 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-14T09:21:46.915 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-14T09:21:46.916 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel 2023-10-14T09:21:46.916 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat 2023-10-14T09:21:46.916 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-14T09:21:46.916 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-14T09:21:46.917 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-14T09:21:46.917 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-14T09:21:46.917 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-aes.ko 2023-10-14T09:21:46.918 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-sha.ko 2023-10-14T09:21:46.918 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio 2023-10-14T09:21:46.918 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-14T09:21:46.918 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca 2023-10-14T09:21:46.918 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/dca.ko 2023-10-14T09:21:46.919 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq 2023-10-14T09:21:46.919 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-14T09:21:46.919 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma 2023-10-14T09:21:46.919 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw 2023-10-14T09:21:46.919 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-14T09:21:46.920 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat 2023-10-14T09:21:46.920 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-14T09:21:46.920 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac 2023-10-14T09:21:46.920 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/amd64_edac.ko 2023-10-14T09:21:46.920 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/e752x_edac.ko 2023-10-14T09:21:46.921 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-14T09:21:46.921 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3000_edac.ko 2023-10-14T09:21:46.921 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3200_edac.ko 2023-10-14T09:21:46.921 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5100_edac.ko 2023-10-14T09:21:46.921 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5400_edac.ko 2023-10-14T09:21:46.922 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7300_edac.ko 2023-10-14T09:21:46.922 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7core_edac.ko 2023-10-14T09:21:46.922 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i82975x_edac.ko 2023-10-14T09:21:46.922 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ie31200_edac.ko 2023-10-14T09:21:46.922 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/sb_edac.ko 2023-10-14T09:21:46.922 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/x38_edac.ko 2023-10-14T09:21:46.923 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware 2023-10-14T09:21:46.923 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/edd.ko 2023-10-14T09:21:46.923 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-14T09:21:46.923 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio 2023-10-14T09:21:46.923 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ich.ko 2023-10-14T09:21:46.924 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-14T09:21:46.924 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid 2023-10-14T09:21:46.924 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-appleir.ko 2023-10-14T09:21:46.924 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-aureal.ko 2023-10-14T09:21:46.924 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-axff.ko 2023-10-14T09:21:46.925 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-dr.ko 2023-10-14T09:21:46.925 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elecom.ko 2023-10-14T09:21:46.925 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elo.ko 2023-10-14T09:21:46.925 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-emsff.ko 2023-10-14T09:21:46.925 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gaff.ko 2023-10-14T09:21:46.926 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gt683r.ko 2023-10-14T09:21:46.926 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gyration.ko 2023-10-14T09:21:46.926 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-14T09:21:46.926 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-14T09:21:46.926 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtekff.ko 2023-10-14T09:21:46.927 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-hyperv.ko 2023-10-14T09:21:46.927 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-icade.ko 2023-10-14T09:21:46.927 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-keytouch.ko 2023-10-14T09:21:46.927 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kye.ko 2023-10-14T09:21:46.927 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lcpower.ko 2023-10-14T09:21:46.928 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-led.ko 2023-10-14T09:21:46.928 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lenovo.ko 2023-10-14T09:21:46.928 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-14T09:21:46.928 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-14T09:21:46.928 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-multitouch.ko 2023-10-14T09:21:46.928 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ortek.ko 2023-10-14T09:21:46.929 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-penmount.ko 2023-10-14T09:21:46.929 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-petalynx.ko 2023-10-14T09:21:46.929 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-picolcd.ko 2023-10-14T09:21:46.929 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-pl.ko 2023-10-14T09:21:46.929 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-plantronics.ko 2023-10-14T09:21:46.930 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-primax.ko 2023-10-14T09:21:46.930 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-rmi.ko 2023-10-14T09:21:46.930 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-14T09:21:46.930 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-14T09:21:46.930 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-14T09:21:46.931 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-14T09:21:46.931 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-14T09:21:46.931 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-14T09:21:46.931 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-14T09:21:46.931 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-14T09:21:46.932 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-14T09:21:46.932 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-14T09:21:46.932 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-14T09:21:46.932 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat.ko 2023-10-14T09:21:46.932 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-saitek.ko 2023-10-14T09:21:46.932 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-samsung.ko 2023-10-14T09:21:46.933 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-14T09:21:46.933 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sjoy.ko 2023-10-14T09:21:46.933 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sony.ko 2023-10-14T09:21:46.933 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-speedlink.ko 2023-10-14T09:21:46.933 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-steelseries.ko 2023-10-14T09:21:46.934 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sunplus.ko 2023-10-14T09:21:46.934 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-14T09:21:46.934 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tivo.ko 2023-10-14T09:21:46.934 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tmff.ko 2023-10-14T09:21:46.934 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-topseed.ko 2023-10-14T09:21:46.935 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-twinhan.ko 2023-10-14T09:21:46.935 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-uclogic.ko 2023-10-14T09:21:46.935 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-waltop.ko 2023-10-14T09:21:46.935 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-wiimote.ko 2023-10-14T09:21:46.935 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-xinmo.ko 2023-10-14T09:21:46.936 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zpff.ko 2023-10-14T09:21:46.936 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zydacron.ko 2023-10-14T09:21:46.936 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/uhid.ko 2023-10-14T09:21:46.936 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/wacom.ko 2023-10-14T09:21:46.936 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv 2023-10-14T09:21:46.937 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_balloon.ko 2023-10-14T09:21:46.937 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_utils.ko 2023-10-14T09:21:46.937 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_vmbus.ko 2023-10-14T09:21:46.937 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon 2023-10-14T09:21:46.937 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru.ko 2023-10-14T09:21:46.938 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru3.ko 2023-10-14T09:21:46.938 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-14T09:21:46.938 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7414.ko 2023-10-14T09:21:46.938 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7418.ko 2023-10-14T09:21:46.938 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adc128d818.ko 2023-10-14T09:21:46.939 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1025.ko 2023-10-14T09:21:46.939 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1026.ko 2023-10-14T09:21:46.939 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1029.ko 2023-10-14T09:21:46.939 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1031.ko 2023-10-14T09:21:46.939 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm9240.ko 2023-10-14T09:21:46.940 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ads7828.ko 2023-10-14T09:21:46.940 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7410.ko 2023-10-14T09:21:46.940 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7411.ko 2023-10-14T09:21:46.940 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7462.ko 2023-10-14T09:21:46.940 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7470.ko 2023-10-14T09:21:46.940 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7475.ko 2023-10-14T09:21:46.941 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7x10.ko 2023-10-14T09:21:46.941 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/amc6821.ko 2023-10-14T09:21:46.941 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/applesmc.ko 2023-10-14T09:21:46.941 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asb100.ko 2023-10-14T09:21:46.941 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asc7621.ko 2023-10-14T09:21:46.941 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-14T09:21:46.942 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/atxp1.ko 2023-10-14T09:21:46.942 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/coretemp.ko 2023-10-14T09:21:46.942 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-14T09:21:46.942 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dme1737.ko 2023-10-14T09:21:46.943 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds1621.ko 2023-10-14T09:21:46.943 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds620.ko 2023-10-14T09:21:46.943 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc1403.ko 2023-10-14T09:21:46.943 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc6w201.ko 2023-10-14T09:21:46.943 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71805f.ko 2023-10-14T09:21:46.944 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71882fg.ko 2023-10-14T09:21:46.944 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f75375s.ko 2023-10-14T09:21:46.944 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-14T09:21:46.944 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fschmd.ko 2023-10-14T09:21:46.944 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g760a.ko 2023-10-14T09:21:46.945 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g762.ko 2023-10-14T09:21:46.945 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl518sm.ko 2023-10-14T09:21:46.945 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl520sm.ko 2023-10-14T09:21:46.945 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-14T09:21:46.945 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-14T09:21:46.945 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-14T09:21:46.946 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmaem.ko 2023-10-14T09:21:46.946 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmpex.ko 2023-10-14T09:21:46.946 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina209.ko 2023-10-14T09:21:46.946 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina2xx.ko 2023-10-14T09:21:46.946 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/it87.ko 2023-10-14T09:21:46.947 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k10temp.ko 2023-10-14T09:21:46.947 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k8temp.ko 2023-10-14T09:21:46.947 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-14T09:21:46.947 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm63.ko 2023-10-14T09:21:46.947 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm73.ko 2023-10-14T09:21:46.948 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm75.ko 2023-10-14T09:21:46.948 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm77.ko 2023-10-14T09:21:46.948 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm78.ko 2023-10-14T09:21:46.948 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm80.ko 2023-10-14T09:21:46.948 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm83.ko 2023-10-14T09:21:46.948 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm85.ko 2023-10-14T09:21:46.949 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm87.ko 2023-10-14T09:21:46.949 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm90.ko 2023-10-14T09:21:46.949 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm92.ko 2023-10-14T09:21:46.949 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm93.ko 2023-10-14T09:21:46.949 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95234.ko 2023-10-14T09:21:46.950 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95241.ko 2023-10-14T09:21:46.950 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95245.ko 2023-10-14T09:21:46.950 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc2945.ko 2023-10-14T09:21:46.950 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4151.ko 2023-10-14T09:21:46.950 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4215.ko 2023-10-14T09:21:46.951 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4222.ko 2023-10-14T09:21:46.951 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4245.ko 2023-10-14T09:21:46.951 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4260.ko 2023-10-14T09:21:46.951 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4261.ko 2023-10-14T09:21:46.951 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max16065.ko 2023-10-14T09:21:46.952 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1619.ko 2023-10-14T09:21:46.952 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1668.ko 2023-10-14T09:21:46.952 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max197.ko 2023-10-14T09:21:46.952 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6639.ko 2023-10-14T09:21:46.952 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6650.ko 2023-10-14T09:21:46.952 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6697.ko 2023-10-14T09:21:46.953 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mcp3021.ko 2023-10-14T09:21:46.953 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6683.ko 2023-10-14T09:21:46.953 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-14T09:21:46.953 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775.ko 2023-10-14T09:21:46.953 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct7802.ko 2023-10-14T09:21:46.954 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87360.ko 2023-10-14T09:21:46.954 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87427.ko 2023-10-14T09:21:46.954 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pcf8591.ko 2023-10-14T09:21:46.954 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus 2023-10-14T09:21:46.954 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-14T09:21:46.955 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-14T09:21:46.955 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-14T09:21:46.955 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-14T09:21:46.955 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-14T09:21:46.955 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-14T09:21:46.956 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-14T09:21:46.956 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-14T09:21:46.956 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-14T09:21:46.956 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-14T09:21:46.956 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-14T09:21:46.957 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-14T09:21:46.957 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/powr1220.ko 2023-10-14T09:21:46.957 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5627.ko 2023-10-14T09:21:46.957 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5636.ko 2023-10-14T09:21:46.957 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-14T09:21:46.958 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht15.ko 2023-10-14T09:21:46.958 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht21.ko 2023-10-14T09:21:46.958 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/shtc1.ko 2023-10-14T09:21:46.958 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sis5595.ko 2023-10-14T09:21:46.958 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-14T09:21:46.959 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-14T09:21:46.959 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-14T09:21:46.959 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/thmc50.ko 2023-10-14T09:21:46.959 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp102.ko 2023-10-14T09:21:46.959 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp103.ko 2023-10-14T09:21:46.959 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp401.ko 2023-10-14T09:21:46.960 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp421.ko 2023-10-14T09:21:46.960 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-14T09:21:46.960 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via686a.ko 2023-10-14T09:21:46.960 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt1211.ko 2023-10-14T09:21:46.960 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt8231.ko 2023-10-14T09:21:46.961 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-14T09:21:46.961 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627hf.ko 2023-10-14T09:21:46.961 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83781d.ko 2023-10-14T09:21:46.961 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83791d.ko 2023-10-14T09:21:46.961 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83792d.ko 2023-10-14T09:21:46.961 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83793.ko 2023-10-14T09:21:46.962 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83795.ko 2023-10-14T09:21:46.962 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-14T09:21:46.962 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-14T09:21:46.962 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c 2023-10-14T09:21:46.963 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos 2023-10-14T09:21:46.963 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-14T09:21:46.963 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-14T09:21:46.963 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses 2023-10-14T09:21:46.963 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-14T09:21:46.964 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-14T09:21:46.964 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-14T09:21:46.964 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-14T09:21:46.964 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-14T09:21:46.964 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-14T09:21:46.965 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-14T09:21:46.965 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-14T09:21:46.965 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-14T09:21:46.965 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-14T09:21:46.965 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-14T09:21:46.965 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-14T09:21:46.966 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-14T09:21:46.966 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-14T09:21:46.966 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-14T09:21:46.966 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-14T09:21:46.967 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-14T09:21:46.967 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-14T09:21:46.967 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-14T09:21:46.967 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-14T09:21:46.967 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-14T09:21:46.968 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-14T09:21:46.968 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-14T09:21:46.968 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-dev.ko 2023-10-14T09:21:46.968 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-mux.ko 2023-10-14T09:21:46.968 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-14T09:21:46.969 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-14T09:21:46.969 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-stub.ko 2023-10-14T09:21:46.969 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband 2023-10-14T09:21:46.969 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core 2023-10-14T09:21:46.969 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-14T09:21:46.969 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-14T09:21:46.970 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-14T09:21:46.970 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-14T09:21:46.970 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-14T09:21:46.970 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-14T09:21:46.970 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-14T09:21:46.971 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw 2023-10-14T09:21:46.971 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4 2023-10-14T09:21:46.971 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-14T09:21:46.971 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4 2023-10-14T09:21:46.971 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-14T09:21:46.972 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5 2023-10-14T09:21:46.972 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-14T09:21:46.972 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca 2023-10-14T09:21:46.972 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-14T09:21:46.972 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp 2023-10-14T09:21:46.972 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib 2023-10-14T09:21:46.973 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-14T09:21:46.973 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser 2023-10-14T09:21:46.973 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-14T09:21:46.973 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert 2023-10-14T09:21:46.973 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-14T09:21:46.974 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp 2023-10-14T09:21:46.974 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-14T09:21:46.974 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt 2023-10-14T09:21:46.974 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-14T09:21:46.974 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input 2023-10-14T09:21:46.975 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport 2023-10-14T09:21:46.975 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-14T09:21:46.975 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-14T09:21:46.975 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/gameport.ko 2023-10-14T09:21:46.975 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/joydev.ko 2023-10-14T09:21:46.975 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard 2023-10-14T09:21:46.976 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-14T09:21:46.976 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse 2023-10-14T09:21:46.976 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/appletouch.ko 2023-10-14T09:21:46.976 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-14T09:21:46.976 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-14T09:21:46.977 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-14T09:21:46.977 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/sermouse.ko 2023-10-14T09:21:46.977 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-14T09:21:46.977 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-14T09:21:46.977 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-14T09:21:46.977 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4 2023-10-14T09:21:46.978 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-14T09:21:46.978 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio 2023-10-14T09:21:46.978 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-14T09:21:46.978 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-14T09:21:46.978 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-14T09:21:46.979 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serio_raw.ko 2023-10-14T09:21:46.979 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/sparse-keymap.ko 2023-10-14T09:21:46.979 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu 2023-10-14T09:21:46.979 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd 2023-10-14T09:21:46.979 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-14T09:21:46.980 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds 2023-10-14T09:21:46.980 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-blinkm.ko 2023-10-14T09:21:46.980 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3530.ko 2023-10-14T09:21:46.980 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp3944.ko 2023-10-14T09:21:46.980 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-ss4200.ko 2023-10-14T09:21:46.981 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger 2023-10-14T09:21:46.981 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-14T09:21:46.981 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-14T09:21:46.981 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-14T09:21:46.981 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-14T09:21:46.981 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-14T09:21:46.982 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-14T09:21:46.982 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-14T09:21:46.982 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-14T09:21:46.982 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md 2023-10-14T09:21:46.982 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache 2023-10-14T09:21:46.983 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/bcache.ko 2023-10-14T09:21:46.983 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bio-prison.ko 2023-10-14T09:21:46.983 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache-smq.ko 2023-10-14T09:21:46.983 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache.ko 2023-10-14T09:21:46.983 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-crypt.ko 2023-10-14T09:21:46.984 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-delay.ko 2023-10-14T09:21:46.984 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-flakey.ko 2023-10-14T09:21:46.984 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log-userspace.ko 2023-10-14T09:21:46.984 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-multipath.ko 2023-10-14T09:21:46.984 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-queue-length.ko 2023-10-14T09:21:46.984 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-raid.ko 2023-10-14T09:21:46.985 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-round-robin.ko 2023-10-14T09:21:46.985 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-service-time.ko 2023-10-14T09:21:46.985 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-switch.ko 2023-10-14T09:21:46.985 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-thin-pool.ko 2023-10-14T09:21:46.985 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-verity.ko 2023-10-14T09:21:46.986 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/faulty.ko 2023-10-14T09:21:46.986 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/linear.ko 2023-10-14T09:21:46.986 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/multipath.ko 2023-10-14T09:21:46.986 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data 2023-10-14T09:21:46.986 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-14T09:21:46.987 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid0.ko 2023-10-14T09:21:46.987 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid1.ko 2023-10-14T09:21:46.987 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid10.ko 2023-10-14T09:21:46.987 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid456.ko 2023-10-14T09:21:46.987 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message 2023-10-14T09:21:46.988 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion 2023-10-14T09:21:46.988 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptbase.ko 2023-10-14T09:21:46.988 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptctl.ko 2023-10-14T09:21:46.988 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptfc.ko 2023-10-14T09:21:46.988 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptlan.ko 2023-10-14T09:21:46.989 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptsas.ko 2023-10-14T09:21:46.989 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-14T09:21:46.989 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptspi.ko 2023-10-14T09:21:46.989 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd 2023-10-14T09:21:46.989 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_ich.ko 2023-10-14T09:21:46.989 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_sch.ko 2023-10-14T09:21:46.990 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mfd-core.ko 2023-10-14T09:21:46.990 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/sm501.ko 2023-10-14T09:21:46.990 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/viperboard.ko 2023-10-14T09:21:46.990 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/vx855.ko 2023-10-14T09:21:46.990 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wl1273-core.ko 2023-10-14T09:21:46.991 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc 2023-10-14T09:21:46.991 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl 2023-10-14T09:21:46.991 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-14T09:21:46.991 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds9802als.ko 2023-10-14T09:21:46.991 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds990x.ko 2023-10-14T09:21:46.992 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/bh1770glc.ko 2023-10-14T09:21:46.992 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710 2023-10-14T09:21:46.992 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/cb710.ko 2023-10-14T09:21:46.992 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom 2023-10-14T09:21:46.992 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/at24.ko 2023-10-14T09:21:46.992 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-14T09:21:46.993 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-14T09:21:46.993 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-14T09:21:46.993 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/enclosure.ko 2023-10-14T09:21:46.993 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hpilo.ko 2023-10-14T09:21:46.993 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29003.ko 2023-10-14T09:21:46.994 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29020.ko 2023-10-14T09:21:46.994 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d 2023-10-14T09:21:46.994 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-14T09:21:46.994 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-14T09:21:46.994 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei 2023-10-14T09:21:46.995 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-me.ko 2023-10-14T09:21:46.995 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-14T09:21:46.995 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei.ko 2023-10-14T09:21:46.995 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru 2023-10-14T09:21:46.995 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-14T09:21:46.995 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp 2023-10-14T09:21:46.996 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-14T09:21:46.996 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-14T09:21:46.996 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-14T09:21:46.996 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-14T09:21:46.996 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_core.ko 2023-10-14T09:21:46.997 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tsl2550.ko 2023-10-14T09:21:46.997 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_balloon.ko 2023-10-14T09:21:46.997 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci 2023-10-14T09:21:46.997 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-14T09:21:46.997 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net 2023-10-14T09:21:46.998 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding 2023-10-14T09:21:46.998 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/bonding.ko 2023-10-14T09:21:46.998 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa 2023-10-14T09:21:46.998 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53 2023-10-14T09:21:46.998 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-14T09:21:46.998 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-14T09:21:46.999 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-14T09:21:46.999 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-14T09:21:46.999 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-14T09:21:46.999 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dummy.ko 2023-10-14T09:21:46.999 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/eql.ko 2023-10-14T09:21:47.000 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet 2023-10-14T09:21:47.000 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com 2023-10-14T09:21:47.000 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-14T09:21:47.000 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-14T09:21:47.000 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-14T09:21:47.001 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-14T09:21:47.001 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390 2023-10-14T09:21:47.001 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-14T09:21:47.001 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-14T09:21:47.001 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-14T09:21:47.001 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-14T09:21:47.002 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec 2023-10-14T09:21:47.002 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-14T09:21:47.002 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere 2023-10-14T09:21:47.002 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-14T09:21:47.002 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon 2023-10-14T09:21:47.003 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-14T09:21:47.003 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera 2023-10-14T09:21:47.003 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-14T09:21:47.003 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd 2023-10-14T09:21:47.003 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-14T09:21:47.004 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-14T09:21:47.004 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-14T09:21:47.004 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros 2023-10-14T09:21:47.004 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx 2023-10-14T09:21:47.004 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-14T09:21:47.004 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-14T09:21:47.005 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-14T09:21:47.005 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-14T09:21:47.005 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-14T09:21:47.005 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-14T09:21:47.005 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-14T09:21:47.006 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-14T09:21:47.006 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom 2023-10-14T09:21:47.006 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-14T09:21:47.006 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-14T09:21:47.006 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-14T09:21:47.007 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-14T09:21:47.007 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-14T09:21:47.007 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-14T09:21:47.007 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-14T09:21:47.007 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-14T09:21:47.008 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade 2023-10-14T09:21:47.008 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna 2023-10-14T09:21:47.008 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-14T09:21:47.008 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio 2023-10-14T09:21:47.008 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-14T09:21:47.009 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-14T09:21:47.009 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-14T09:21:47.009 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-14T09:21:47.009 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-14T09:21:47.009 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-14T09:21:47.009 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-14T09:21:47.010 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-14T09:21:47.010 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-14T09:21:47.010 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-14T09:21:47.010 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco 2023-10-14T09:21:47.010 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic 2023-10-14T09:21:47.011 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-14T09:21:47.011 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec 2023-10-14T09:21:47.011 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip 2023-10-14T09:21:47.011 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-14T09:21:47.011 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-14T09:21:47.012 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-14T09:21:47.012 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-14T09:21:47.012 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-14T09:21:47.012 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-14T09:21:47.012 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink 2023-10-14T09:21:47.013 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-14T09:21:47.013 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-14T09:21:47.013 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dnet.ko 2023-10-14T09:21:47.013 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex 2023-10-14T09:21:47.013 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet 2023-10-14T09:21:47.014 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-14T09:21:47.014 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-14T09:21:47.014 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-14T09:21:47.014 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel 2023-10-14T09:21:47.014 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-14T09:21:47.015 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000 2023-10-14T09:21:47.015 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-14T09:21:47.015 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-14T09:21:47.015 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-14T09:21:47.015 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-14T09:21:47.015 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-14T09:21:47.016 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e 2023-10-14T09:21:47.016 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-14T09:21:47.016 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf 2023-10-14T09:21:47.016 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-14T09:21:47.016 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb 2023-10-14T09:21:47.017 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-14T09:21:47.017 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-14T09:21:47.017 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-14T09:21:47.017 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-14T09:21:47.017 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-14T09:21:47.017 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-14T09:21:47.018 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-14T09:21:47.018 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/jme.ko 2023-10-14T09:21:47.018 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell 2023-10-14T09:21:47.018 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-14T09:21:47.018 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-14T09:21:47.019 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-14T09:21:47.019 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox 2023-10-14T09:21:47.019 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-14T09:21:47.019 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-14T09:21:47.019 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-14T09:21:47.020 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-14T09:21:47.020 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-14T09:21:47.020 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-14T09:21:47.020 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel 2023-10-14T09:21:47.020 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-14T09:21:47.021 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom 2023-10-14T09:21:47.021 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-14T09:21:47.021 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-14T09:21:47.021 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi 2023-10-14T09:21:47.021 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-14T09:21:47.021 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-14T09:21:47.022 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion 2023-10-14T09:21:47.022 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-14T09:21:47.022 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia 2023-10-14T09:21:47.022 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-14T09:21:47.022 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines 2023-10-14T09:21:47.023 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-14T09:21:47.023 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-14T09:21:47.023 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic 2023-10-14T09:21:47.023 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-14T09:21:47.023 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-14T09:21:47.024 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-14T09:21:47.024 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-14T09:21:47.024 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-14T09:21:47.024 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc 2023-10-14T09:21:47.024 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-14T09:21:47.024 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek 2023-10-14T09:21:47.025 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-14T09:21:47.025 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-14T09:21:47.025 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-14T09:21:47.025 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-14T09:21:47.025 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker 2023-10-14T09:21:47.026 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-14T09:21:47.026 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc 2023-10-14T09:21:47.026 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-14T09:21:47.026 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan 2023-10-14T09:21:47.026 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-14T09:21:47.027 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis 2023-10-14T09:21:47.027 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-14T09:21:47.027 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-14T09:21:47.027 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc 2023-10-14T09:21:47.027 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-14T09:21:47.028 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-14T09:21:47.028 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-14T09:21:47.028 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-14T09:21:47.028 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro 2023-10-14T09:21:47.028 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-14T09:21:47.028 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-14T09:21:47.029 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-14T09:21:47.029 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun 2023-10-14T09:21:47.029 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-14T09:21:47.029 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-14T09:21:47.029 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-14T09:21:47.030 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-14T09:21:47.030 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti 2023-10-14T09:21:47.030 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-14T09:21:47.030 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti 2023-10-14T09:21:47.030 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-14T09:21:47.031 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via 2023-10-14T09:21:47.031 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-14T09:21:47.031 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-14T09:21:47.031 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet 2023-10-14T09:21:47.031 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-14T09:21:47.031 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-14T09:21:47.032 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom 2023-10-14T09:21:47.032 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-14T09:21:47.032 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/geneve.ko 2023-10-14T09:21:47.032 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv 2023-10-14T09:21:47.032 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-14T09:21:47.033 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154 2023-10-14T09:21:47.033 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-14T09:21:47.033 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ifb.ko 2023-10-14T09:21:47.033 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan 2023-10-14T09:21:47.033 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-14T09:21:47.034 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvlan.ko 2023-10-14T09:21:47.034 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvtap.ko 2023-10-14T09:21:47.034 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio 2023-10-14T09:21:47.034 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio.ko 2023-10-14T09:21:47.034 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-14T09:21:47.034 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-14T09:21:47.035 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-14T09:21:47.035 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mii.ko 2023-10-14T09:21:47.035 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/net_failover.ko 2023-10-14T09:21:47.035 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/netconsole.ko 2023-10-14T09:21:47.035 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/nlmon.ko 2023-10-14T09:21:47.036 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs 2023-10-14T09:21:47.036 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-14T09:21:47.036 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-14T09:21:47.036 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy 2023-10-14T09:21:47.036 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/amd.ko 2023-10-14T09:21:47.037 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-14T09:21:47.037 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-14T09:21:47.037 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-14T09:21:47.037 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-14T09:21:47.037 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/broadcom.ko 2023-10-14T09:21:47.037 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/cicada.ko 2023-10-14T09:21:47.038 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/davicom.ko 2023-10-14T09:21:47.038 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/dp83640.ko 2023-10-14T09:21:47.038 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/et1011c.ko 2023-10-14T09:21:47.038 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/icplus.ko 2023-10-14T09:21:47.038 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/lxt.ko 2023-10-14T09:21:47.039 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/marvell.ko 2023-10-14T09:21:47.039 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/micrel.ko 2023-10-14T09:21:47.039 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/national.ko 2023-10-14T09:21:47.039 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/phylink.ko 2023-10-14T09:21:47.039 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/qsemi.ko 2023-10-14T09:21:47.040 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/realtek.ko 2023-10-14T09:21:47.040 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/smsc.ko 2023-10-14T09:21:47.040 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-14T09:21:47.040 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/vitesse.ko 2023-10-14T09:21:47.040 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp 2023-10-14T09:21:47.040 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-14T09:21:47.041 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-14T09:21:47.041 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-14T09:21:47.041 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-14T09:21:47.041 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-14T09:21:47.041 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-14T09:21:47.042 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppoe.ko 2023-10-14T09:21:47.042 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppox.ko 2023-10-14T09:21:47.042 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pptp.ko 2023-10-14T09:21:47.042 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip 2023-10-14T09:21:47.042 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slhc.ko 2023-10-14T09:21:47.043 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slip.ko 2023-10-14T09:21:47.043 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sungem_phy.ko 2023-10-14T09:21:47.043 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tap.ko 2023-10-14T09:21:47.043 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team 2023-10-14T09:21:47.043 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team.ko 2023-10-14T09:21:47.043 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-14T09:21:47.044 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-14T09:21:47.044 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-14T09:21:47.044 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_random.ko 2023-10-14T09:21:47.044 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-14T09:21:47.044 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tun.ko 2023-10-14T09:21:47.045 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/veth.ko 2023-10-14T09:21:47.045 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/virtio_net.ko 2023-10-14T09:21:47.045 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3 2023-10-14T09:21:47.045 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-14T09:21:47.045 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan 2023-10-14T09:21:47.046 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-14T09:21:47.046 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback 2023-10-14T09:21:47.046 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-14T09:21:47.046 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netfront.ko 2023-10-14T09:21:47.046 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb 2023-10-14T09:21:47.046 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ntb.ko 2023-10-14T09:21:47.047 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme 2023-10-14T09:21:47.047 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host 2023-10-14T09:21:47.047 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-14T09:21:47.047 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme.ko 2023-10-14T09:21:47.047 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport 2023-10-14T09:21:47.048 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport.ko 2023-10-14T09:21:47.048 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_cs.ko 2023-10-14T09:21:47.048 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_pc.ko 2023-10-14T09:21:47.048 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_serial.ko 2023-10-14T09:21:47.048 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci 2023-10-14T09:21:47.049 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug 2023-10-14T09:21:47.049 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-14T09:21:47.049 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie 2023-10-14T09:21:47.049 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-14T09:21:47.049 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/xen-pcifront.ko 2023-10-14T09:21:47.050 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia 2023-10-14T09:21:47.050 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/i82092.ko 2023-10-14T09:21:47.050 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pd6729.ko 2023-10-14T09:21:47.050 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-14T09:21:47.050 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl 2023-10-14T09:21:47.051 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel 2023-10-14T09:21:47.051 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-14T09:21:47.051 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform 2023-10-14T09:21:47.051 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86 2023-10-14T09:21:47.051 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-14T09:21:47.052 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-14T09:21:47.052 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-14T09:21:47.052 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-14T09:21:47.052 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-14T09:21:47.052 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-14T09:21:47.052 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-14T09:21:47.053 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-14T09:21:47.053 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-14T09:21:47.053 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-14T09:21:47.053 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-14T09:21:47.053 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/hdaps.ko 2023-10-14T09:21:47.054 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel 2023-10-14T09:21:47.054 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-14T09:21:47.054 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-14T09:21:47.054 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-14T09:21:47.054 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-14T09:21:47.054 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-14T09:21:47.055 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-14T09:21:47.055 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-14T09:21:47.055 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-14T09:21:47.055 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-14T09:21:47.055 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-14T09:21:47.056 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-14T09:21:47.056 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi.ko 2023-10-14T09:21:47.056 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap 2023-10-14T09:21:47.056 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-14T09:21:47.056 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-14T09:21:47.057 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps 2023-10-14T09:21:47.057 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients 2023-10-14T09:21:47.057 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-14T09:21:47.057 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-14T09:21:47.057 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-14T09:21:47.057 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/pps_core.ko 2023-10-14T09:21:47.058 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp 2023-10-14T09:21:47.058 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp.ko 2023-10-14T09:21:47.058 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-14T09:21:47.058 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc 2023-10-14T09:21:47.058 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-14T09:21:47.059 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-14T09:21:47.059 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-14T09:21:47.059 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-14T09:21:47.059 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-14T09:21:47.059 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-14T09:21:47.060 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-14T09:21:47.060 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-14T09:21:47.060 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-14T09:21:47.060 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-14T09:21:47.060 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-14T09:21:47.061 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-14T09:21:47.061 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-14T09:21:47.061 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-14T09:21:47.061 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-14T09:21:47.061 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-14T09:21:47.061 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-14T09:21:47.062 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-14T09:21:47.062 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-14T09:21:47.062 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-14T09:21:47.062 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-14T09:21:47.062 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-14T09:21:47.063 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-14T09:21:47.063 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-14T09:21:47.063 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-14T09:21:47.063 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-14T09:21:47.063 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-14T09:21:47.064 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-14T09:21:47.064 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-14T09:21:47.064 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-14T09:21:47.064 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-14T09:21:47.064 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi 2023-10-14T09:21:47.064 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-14T09:21:47.065 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-sas.ko 2023-10-14T09:21:47.065 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-14T09:21:47.065 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/BusLogic.ko 2023-10-14T09:21:47.065 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/a100u2w.ko 2023-10-14T09:21:47.065 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid 2023-10-14T09:21:47.066 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-14T09:21:47.066 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/advansys.ko 2023-10-14T09:21:47.066 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx 2023-10-14T09:21:47.066 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-14T09:21:47.066 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-14T09:21:47.066 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/am53c974.ko 2023-10-14T09:21:47.067 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr 2023-10-14T09:21:47.067 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-14T09:21:47.067 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/atp870u.ko 2023-10-14T09:21:47.067 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi 2023-10-14T09:21:47.067 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-14T09:21:47.068 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa 2023-10-14T09:21:47.068 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-14T09:21:47.068 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc 2023-10-14T09:21:47.068 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-14T09:21:47.068 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i 2023-10-14T09:21:47.069 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-14T09:21:47.069 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ch.ko 2023-10-14T09:21:47.069 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor 2023-10-14T09:21:47.069 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-14T09:21:47.069 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi 2023-10-14T09:21:47.069 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-14T09:21:47.070 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-14T09:21:47.070 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-14T09:21:47.070 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-14T09:21:47.070 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-14T09:21:47.070 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dc395x.ko 2023-10-14T09:21:47.071 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler 2023-10-14T09:21:47.071 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-14T09:21:47.071 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-14T09:21:47.071 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-14T09:21:47.071 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-14T09:21:47.072 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dmx3191d.ko 2023-10-14T09:21:47.072 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r 2023-10-14T09:21:47.072 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-14T09:21:47.072 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esp_scsi.ko 2023-10-14T09:21:47.072 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe 2023-10-14T09:21:47.073 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-14T09:21:47.073 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-14T09:21:47.073 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic 2023-10-14T09:21:47.073 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-14T09:21:47.073 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hpsa.ko 2023-10-14T09:21:47.073 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hptiop.ko 2023-10-14T09:21:47.074 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-14T09:21:47.074 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/initio.ko 2023-10-14T09:21:47.074 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ipr.ko 2023-10-14T09:21:47.074 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ips.ko 2023-10-14T09:21:47.074 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci 2023-10-14T09:21:47.075 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/isci.ko 2023-10-14T09:21:47.075 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-14T09:21:47.075 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-14T09:21:47.075 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc 2023-10-14T09:21:47.075 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-14T09:21:47.075 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi.ko 2023-10-14T09:21:47.076 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-14T09:21:47.076 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas 2023-10-14T09:21:47.076 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-14T09:21:47.076 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc 2023-10-14T09:21:47.076 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-14T09:21:47.077 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid 2023-10-14T09:21:47.077 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid.ko 2023-10-14T09:21:47.077 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-14T09:21:47.077 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-14T09:21:47.077 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-14T09:21:47.078 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas 2023-10-14T09:21:47.078 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-14T09:21:47.078 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas 2023-10-14T09:21:47.078 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-14T09:21:47.078 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvumi.ko 2023-10-14T09:21:47.078 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001 2023-10-14T09:21:47.079 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-14T09:21:47.079 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pmcraid.ko 2023-10-14T09:21:47.079 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla1280.ko 2023-10-14T09:21:47.079 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx 2023-10-14T09:21:47.079 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-14T09:21:47.080 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-14T09:21:47.080 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx 2023-10-14T09:21:47.080 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-14T09:21:47.080 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/raid_class.ko 2023-10-14T09:21:47.080 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_debug.ko 2023-10-14T09:21:47.080 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-14T09:21:47.081 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-14T09:21:47.081 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-14T09:21:47.081 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-14T09:21:47.081 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-14T09:21:47.081 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ses.ko 2023-10-14T09:21:47.082 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/st.ko 2023-10-14T09:21:47.082 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/stex.ko 2023-10-14T09:21:47.082 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2 2023-10-14T09:21:47.082 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-14T09:21:47.082 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-14T09:21:47.083 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-14T09:21:47.083 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/wd719x.ko 2023-10-14T09:21:47.083 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb 2023-10-14T09:21:47.083 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ssb.ko 2023-10-14T09:21:47.083 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target 2023-10-14T09:21:47.084 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi 2023-10-14T09:21:47.084 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-14T09:21:47.084 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback 2023-10-14T09:21:47.084 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-14T09:21:47.084 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_file.ko 2023-10-14T09:21:47.084 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_iblock.ko 2023-10-14T09:21:47.085 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_mod.ko 2023-10-14T09:21:47.085 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_pscsi.ko 2023-10-14T09:21:47.085 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_user.ko 2023-10-14T09:21:47.085 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc 2023-10-14T09:21:47.085 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-14T09:21:47.086 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal 2023-10-14T09:21:47.086 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel 2023-10-14T09:21:47.086 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-14T09:21:47.086 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-14T09:21:47.086 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-14T09:21:47.086 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-14T09:21:47.087 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-14T09:21:47.087 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-14T09:21:47.087 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-14T09:21:47.087 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-14T09:21:47.087 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-14T09:21:47.088 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-14T09:21:47.088 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-14T09:21:47.088 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-14T09:21:47.088 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-14T09:21:47.088 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-14T09:21:47.089 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-14T09:21:47.089 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-14T09:21:47.089 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty 2023-10-14T09:21:47.089 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless 2023-10-14T09:21:47.089 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-14T09:21:47.090 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_gsm.ko 2023-10-14T09:21:47.090 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_hdlc.ko 2023-10-14T09:21:47.090 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/nozomi.ko 2023-10-14T09:21:47.090 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial 2023-10-14T09:21:47.090 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250 2023-10-14T09:21:47.091 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-14T09:21:47.091 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-14T09:21:47.091 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm 2023-10-14T09:21:47.091 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-14T09:21:47.091 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs 2023-10-14T09:21:47.092 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core 2023-10-14T09:21:47.092 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-14T09:21:47.092 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host 2023-10-14T09:21:47.092 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-14T09:21:47.092 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio 2023-10-14T09:21:47.092 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio.ko 2023-10-14T09:21:47.093 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_aec.ko 2023-10-14T09:21:47.093 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_cif.ko 2023-10-14T09:21:47.093 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-14T09:21:47.093 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_sercos3.ko 2023-10-14T09:21:47.093 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb 2023-10-14T09:21:47.094 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class 2023-10-14T09:21:47.094 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-14T09:21:47.094 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-14T09:21:47.094 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usblp.ko 2023-10-14T09:21:47.094 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usbtmc.ko 2023-10-14T09:21:47.095 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host 2023-10-14T09:21:47.095 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-14T09:21:47.095 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image 2023-10-14T09:21:47.095 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/mdc800.ko 2023-10-14T09:21:47.095 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/microtek.ko 2023-10-14T09:21:47.096 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc 2023-10-14T09:21:47.096 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/adutux.ko 2023-10-14T09:21:47.096 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-14T09:21:47.096 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi26.ko 2023-10-14T09:21:47.096 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi62.ko 2023-10-14T09:21:47.097 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ezusb.ko 2023-10-14T09:21:47.097 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/idmouse.ko 2023-10-14T09:21:47.097 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-14T09:21:47.097 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-14T09:21:47.097 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ldusb.ko 2023-10-14T09:21:47.097 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-14T09:21:47.098 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga 2023-10-14T09:21:47.098 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-14T09:21:47.098 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-14T09:21:47.098 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usb3503.ko 2023-10-14T09:21:47.098 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usblcd.ko 2023-10-14T09:21:47.099 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-14T09:21:47.099 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/uss720.ko 2023-10-14T09:21:47.099 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/yurex.ko 2023-10-14T09:21:47.099 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy 2023-10-14T09:21:47.099 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-14T09:21:47.100 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial 2023-10-14T09:21:47.100 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/aircable.ko 2023-10-14T09:21:47.100 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ark3116.ko 2023-10-14T09:21:47.100 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-14T09:21:47.100 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ch341.ko 2023-10-14T09:21:47.100 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cp210x.ko 2023-10-14T09:21:47.101 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-14T09:21:47.101 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-14T09:21:47.101 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-14T09:21:47.101 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/empeg.ko 2023-10-14T09:21:47.101 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-14T09:21:47.102 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-14T09:21:47.102 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-14T09:21:47.102 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_ti.ko 2023-10-14T09:21:47.102 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipaq.ko 2023-10-14T09:21:47.102 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipw.ko 2023-10-14T09:21:47.103 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-14T09:21:47.103 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-14T09:21:47.103 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan.ko 2023-10-14T09:21:47.103 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-14T09:21:47.103 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-14T09:21:47.103 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-14T09:21:47.104 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-14T09:21:47.104 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7720.ko 2023-10-14T09:21:47.104 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7840.ko 2023-10-14T09:21:47.104 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/navman.ko 2023-10-14T09:21:47.104 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/omninet.ko 2023-10-14T09:21:47.105 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/opticon.ko 2023-10-14T09:21:47.105 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/option.ko 2023-10-14T09:21:47.105 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/oti6858.ko 2023-10-14T09:21:47.105 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/pl2303.ko 2023-10-14T09:21:47.105 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcaux.ko 2023-10-14T09:21:47.106 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcserial.ko 2023-10-14T09:21:47.106 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/quatech2.ko 2023-10-14T09:21:47.106 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-14T09:21:47.106 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/sierra.ko 2023-10-14T09:21:47.106 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-14T09:21:47.106 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ssu100.ko 2023-10-14T09:21:47.107 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-14T09:21:47.107 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-14T09:21:47.107 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-14T09:21:47.107 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-14T09:21:47.107 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-14T09:21:47.108 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/visor.ko 2023-10-14T09:21:47.108 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-14T09:21:47.108 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-14T09:21:47.108 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage 2023-10-14T09:21:47.108 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/uas.ko 2023-10-14T09:21:47.108 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-14T09:21:47.109 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-14T09:21:47.109 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-14T09:21:47.109 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-14T09:21:47.109 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-14T09:21:47.109 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-14T09:21:47.110 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-14T09:21:47.110 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-14T09:21:47.110 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-14T09:21:47.110 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-14T09:21:47.110 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-14T09:21:47.111 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-14T09:21:47.111 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-14T09:21:47.111 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-14T09:21:47.111 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip 2023-10-14T09:21:47.111 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-14T09:21:47.112 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-14T09:21:47.112 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-14T09:21:47.112 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio 2023-10-14T09:21:47.112 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci 2023-10-14T09:21:47.112 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-14T09:21:47.113 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-14T09:21:47.113 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio.ko 2023-10-14T09:21:47.113 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-14T09:21:47.113 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost 2023-10-14T09:21:47.113 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost.ko 2023-10-14T09:21:47.113 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-14T09:21:47.114 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_net.ko 2023-10-14T09:21:47.114 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-14T09:21:47.114 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video 2023-10-14T09:21:47.114 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight 2023-10-14T09:21:47.114 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-14T09:21:47.115 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lcd.ko 2023-10-14T09:21:47.115 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-14T09:21:47.115 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio 2023-10-14T09:21:47.115 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio.ko 2023-10-14T09:21:47.115 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-14T09:21:47.116 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-14T09:21:47.116 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci.ko 2023-10-14T09:21:47.116 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-14T09:21:47.116 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-14T09:21:47.116 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_ring.ko 2023-10-14T09:21:47.116 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1 2023-10-14T09:21:47.117 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters 2023-10-14T09:21:47.117 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2482.ko 2023-10-14T09:21:47.117 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2490.ko 2023-10-14T09:21:47.117 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves 2023-10-14T09:21:47.117 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-14T09:21:47.118 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-14T09:21:47.118 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-14T09:21:47.118 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-14T09:21:47.118 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-14T09:21:47.118 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-14T09:21:47.119 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-14T09:21:47.119 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-14T09:21:47.119 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-14T09:21:47.119 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-14T09:21:47.119 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-14T09:21:47.119 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/wire.ko 2023-10-14T09:21:47.120 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog 2023-10-14T09:21:47.120 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-14T09:21:47.120 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-14T09:21:47.120 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-14T09:21:47.120 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/hpwdt.ko 2023-10-14T09:21:47.121 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/i6300esb.ko 2023-10-14T09:21:47.121 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-14T09:21:47.121 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-14T09:21:47.121 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-14T09:21:47.121 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ibmasr.ko 2023-10-14T09:21:47.122 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-14T09:21:47.122 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-14T09:21:47.122 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-14T09:21:47.122 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/machzwd.ko 2023-10-14T09:21:47.122 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/nv_tco.ko 2023-10-14T09:21:47.126 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-14T09:21:47.126 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-14T09:21:47.126 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-14T09:21:47.126 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-14T09:21:47.126 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/softdog.ko 2023-10-14T09:21:47.127 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-14T09:21:47.127 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/via_wdt.ko 2023-10-14T09:21:47.127 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-14T09:21:47.127 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-14T09:21:47.127 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-14T09:21:47.128 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-14T09:21:47.128 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-14T09:21:47.128 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen 2023-10-14T09:21:47.128 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-14T09:21:47.128 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-evtchn.ko 2023-10-14T09:21:47.129 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-14T09:21:47.129 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntdev.ko 2023-10-14T09:21:47.129 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback 2023-10-14T09:21:47.129 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-14T09:21:47.129 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-privcmd.ko 2023-10-14T09:21:47.129 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs 2023-10-14T09:21:47.130 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-14T09:21:47.130 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs 2023-10-14T09:21:47.130 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p 2023-10-14T09:21:47.130 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/9p.ko 2023-10-14T09:21:47.130 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs 2023-10-14T09:21:47.131 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/affs.ko 2023-10-14T09:21:47.131 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs 2023-10-14T09:21:47.131 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/befs.ko 2023-10-14T09:21:47.131 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/binfmt_misc.ko 2023-10-14T09:21:47.131 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs 2023-10-14T09:21:47.132 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/btrfs.ko 2023-10-14T09:21:47.132 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles 2023-10-14T09:21:47.132 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/cachefiles.ko 2023-10-14T09:21:47.132 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph 2023-10-14T09:21:47.132 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ceph.ko 2023-10-14T09:21:47.132 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda 2023-10-14T09:21:47.133 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/coda.ko 2023-10-14T09:21:47.133 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs 2023-10-14T09:21:47.133 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/cramfs.ko 2023-10-14T09:21:47.133 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm 2023-10-14T09:21:47.133 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/dlm.ko 2023-10-14T09:21:47.134 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs 2023-10-14T09:21:47.134 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-14T09:21:47.134 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs 2023-10-14T09:21:47.134 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/f2fs.ko 2023-10-14T09:21:47.134 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat 2023-10-14T09:21:47.135 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/fat.ko 2023-10-14T09:21:47.135 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/msdos.ko 2023-10-14T09:21:47.135 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/vfat.ko 2023-10-14T09:21:47.135 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache 2023-10-14T09:21:47.135 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/fscache.ko 2023-10-14T09:21:47.135 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse 2023-10-14T09:21:47.136 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/cuse.ko 2023-10-14T09:21:47.136 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/fuse.ko 2023-10-14T09:21:47.136 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2 2023-10-14T09:21:47.136 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/gfs2.ko 2023-10-14T09:21:47.136 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs 2023-10-14T09:21:47.137 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/hfs.ko 2023-10-14T09:21:47.137 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus 2023-10-14T09:21:47.137 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/hfsplus.ko 2023-10-14T09:21:47.137 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs 2023-10-14T09:21:47.137 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/isofs.ko 2023-10-14T09:21:47.138 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs 2023-10-14T09:21:47.138 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/jfs.ko 2023-10-14T09:21:47.138 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd 2023-10-14T09:21:47.138 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/lockd.ko 2023-10-14T09:21:47.138 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix 2023-10-14T09:21:47.138 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/minix.ko 2023-10-14T09:21:47.139 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs 2023-10-14T09:21:47.139 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/netfs.ko 2023-10-14T09:21:47.139 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs 2023-10-14T09:21:47.139 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout 2023-10-14T09:21:47.139 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-14T09:21:47.140 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout 2023-10-14T09:21:47.140 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-14T09:21:47.140 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout 2023-10-14T09:21:47.140 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-14T09:21:47.140 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfs.ko 2023-10-14T09:21:47.141 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv3.ko 2023-10-14T09:21:47.141 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv4.ko 2023-10-14T09:21:47.141 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common 2023-10-14T09:21:47.141 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/grace.ko 2023-10-14T09:21:47.141 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-14T09:21:47.141 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd 2023-10-14T09:21:47.142 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/nfsd.ko 2023-10-14T09:21:47.142 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2 2023-10-14T09:21:47.142 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/nilfs2.ko 2023-10-14T09:21:47.142 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls 2023-10-14T09:21:47.142 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-celtic.ko 2023-10-14T09:21:47.143 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-centeuro.ko 2023-10-14T09:21:47.143 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-croatian.ko 2023-10-14T09:21:47.143 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-cyrillic.ko 2023-10-14T09:21:47.143 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-gaelic.ko 2023-10-14T09:21:47.143 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-greek.ko 2023-10-14T09:21:47.144 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-iceland.ko 2023-10-14T09:21:47.144 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-inuit.ko 2023-10-14T09:21:47.144 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-roman.ko 2023-10-14T09:21:47.144 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-romanian.ko 2023-10-14T09:21:47.144 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-turkish.ko 2023-10-14T09:21:47.144 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1250.ko 2023-10-14T09:21:47.145 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1251.ko 2023-10-14T09:21:47.145 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1255.ko 2023-10-14T09:21:47.145 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp737.ko 2023-10-14T09:21:47.145 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp775.ko 2023-10-14T09:21:47.145 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp850.ko 2023-10-14T09:21:47.146 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp852.ko 2023-10-14T09:21:47.146 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp855.ko 2023-10-14T09:21:47.146 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp857.ko 2023-10-14T09:21:47.146 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp860.ko 2023-10-14T09:21:47.146 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp861.ko 2023-10-14T09:21:47.147 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp862.ko 2023-10-14T09:21:47.147 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp863.ko 2023-10-14T09:21:47.147 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp864.ko 2023-10-14T09:21:47.147 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp865.ko 2023-10-14T09:21:47.147 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp866.ko 2023-10-14T09:21:47.147 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp869.ko 2023-10-14T09:21:47.148 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp874.ko 2023-10-14T09:21:47.148 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp932.ko 2023-10-14T09:21:47.148 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp936.ko 2023-10-14T09:21:47.148 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp949.ko 2023-10-14T09:21:47.148 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp950.ko 2023-10-14T09:21:47.149 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_euc-jp.ko 2023-10-14T09:21:47.149 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-14T09:21:47.149 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-14T09:21:47.149 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-14T09:21:47.149 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-14T09:21:47.149 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-14T09:21:47.150 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-14T09:21:47.150 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-14T09:21:47.150 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-14T09:21:47.150 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-14T09:21:47.150 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-14T09:21:47.151 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-14T09:21:47.151 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-r.ko 2023-10-14T09:21:47.151 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-14T09:21:47.151 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-u.ko 2023-10-14T09:21:47.151 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ucs2_utils.ko 2023-10-14T09:21:47.151 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_utf8.ko 2023-10-14T09:21:47.152 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2 2023-10-14T09:21:47.152 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster 2023-10-14T09:21:47.152 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-14T09:21:47.152 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm 2023-10-14T09:21:47.152 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-14T09:21:47.153 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs 2023-10-14T09:21:47.153 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-14T09:21:47.153 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2.ko 2023-10-14T09:21:47.153 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-14T09:21:47.153 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-14T09:21:47.154 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-14T09:21:47.154 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs 2023-10-14T09:21:47.154 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/overlay.ko 2023-10-14T09:21:47.154 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore 2023-10-14T09:21:47.154 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ramoops.ko 2023-10-14T09:21:47.154 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs 2023-10-14T09:21:47.155 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/reiserfs.ko 2023-10-14T09:21:47.155 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs 2023-10-14T09:21:47.155 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/romfs.ko 2023-10-14T09:21:47.155 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb 2023-10-14T09:21:47.155 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client 2023-10-14T09:21:47.156 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/cifs.ko 2023-10-14T09:21:47.156 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common 2023-10-14T09:21:47.156 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-14T09:21:47.156 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_md4.ko 2023-10-14T09:21:47.156 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs 2023-10-14T09:21:47.156 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/squashfs.ko 2023-10-14T09:21:47.157 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv 2023-10-14T09:21:47.157 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/sysv.ko 2023-10-14T09:21:47.157 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf 2023-10-14T09:21:47.157 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/udf.ko 2023-10-14T09:21:47.157 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs 2023-10-14T09:21:47.158 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ufs.ko 2023-10-14T09:21:47.158 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs 2023-10-14T09:21:47.158 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/xfs.ko 2023-10-14T09:21:47.158 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel 2023-10-14T09:21:47.158 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu 2023-10-14T09:21:47.159 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu/rcutorture.ko 2023-10-14T09:21:47.159 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/torture.ko 2023-10-14T09:21:47.159 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace 2023-10-14T09:21:47.159 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-14T09:21:47.159 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib 2023-10-14T09:21:47.159 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/asn1_encoder.ko 2023-10-14T09:21:47.160 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc-itu-t.ko 2023-10-14T09:21:47.160 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc8.ko 2023-10-14T09:21:47.160 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto 2023-10-14T09:21:47.160 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libarc4.ko 2023-10-14T09:21:47.160 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libdes.ko 2023-10-14T09:21:47.161 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/libcrc32c.ko 2023-10-14T09:21:47.161 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lru_cache.ko 2023-10-14T09:21:47.161 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4 2023-10-14T09:21:47.161 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4_compress.ko 2023-10-14T09:21:47.161 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-14T09:21:47.162 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math 2023-10-14T09:21:47.162 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/cordic.ko 2023-10-14T09:21:47.162 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6 2023-10-14T09:21:47.162 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/raid6_pq.ko 2023-10-14T09:21:47.162 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon 2023-10-14T09:21:47.163 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-14T09:21:47.163 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_bm.ko 2023-10-14T09:21:47.163 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_fsm.ko 2023-10-14T09:21:47.163 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_kmp.ko 2023-10-14T09:21:47.163 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd 2023-10-14T09:21:47.163 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd/zstd_compress.ko 2023-10-14T09:21:47.164 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm 2023-10-14T09:21:47.164 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/hwpoison-inject.ko 2023-10-14T09:21:47.164 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net 2023-10-14T09:21:47.164 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan 2023-10-14T09:21:47.164 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/6lowpan.ko 2023-10-14T09:21:47.165 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_dest.ko 2023-10-14T09:21:47.165 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-14T09:21:47.165 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_hop.ko 2023-10-14T09:21:47.165 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-14T09:21:47.165 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-14T09:21:47.166 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_routing.ko 2023-10-14T09:21:47.166 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_udp.ko 2023-10-14T09:21:47.166 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802 2023-10-14T09:21:47.166 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/garp.ko 2023-10-14T09:21:47.167 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/mrp.ko 2023-10-14T09:21:47.167 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/p8022.ko 2023-10-14T09:21:47.167 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/psnap.ko 2023-10-14T09:21:47.167 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/stp.ko 2023-10-14T09:21:47.167 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q 2023-10-14T09:21:47.168 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/8021q.ko 2023-10-14T09:21:47.168 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p 2023-10-14T09:21:47.168 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet.ko 2023-10-14T09:21:47.168 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_fd.ko 2023-10-14T09:21:47.168 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_rdma.ko 2023-10-14T09:21:47.168 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_virtio.ko 2023-10-14T09:21:47.169 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv 2023-10-14T09:21:47.169 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/batman-adv.ko 2023-10-14T09:21:47.169 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge 2023-10-14T09:21:47.169 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/br_netfilter.ko 2023-10-14T09:21:47.169 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/bridge.ko 2023-10-14T09:21:47.170 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter 2023-10-14T09:21:47.170 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-14T09:21:47.170 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-14T09:21:47.170 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-14T09:21:47.170 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-14T09:21:47.171 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-14T09:21:47.171 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-14T09:21:47.171 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-14T09:21:47.171 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-14T09:21:47.171 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-14T09:21:47.172 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-14T09:21:47.172 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-14T09:21:47.172 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-14T09:21:47.172 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-14T09:21:47.172 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-14T09:21:47.173 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-14T09:21:47.173 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-14T09:21:47.173 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-14T09:21:47.173 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-14T09:21:47.173 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-14T09:21:47.173 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-14T09:21:47.174 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-14T09:21:47.174 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-14T09:21:47.174 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-14T09:21:47.174 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-14T09:21:47.174 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph 2023-10-14T09:21:47.175 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/libceph.ko 2023-10-14T09:21:47.175 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core 2023-10-14T09:21:47.175 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/failover.ko 2023-10-14T09:21:47.175 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/pktgen.ko 2023-10-14T09:21:47.175 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp 2023-10-14T09:21:47.176 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp.ko 2023-10-14T09:21:47.176 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_diag.ko 2023-10-14T09:21:47.176 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv4.ko 2023-10-14T09:21:47.176 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv6.ko 2023-10-14T09:21:47.176 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver 2023-10-14T09:21:47.177 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-14T09:21:47.177 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa 2023-10-14T09:21:47.177 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/dsa_core.ko 2023-10-14T09:21:47.177 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_brcm.ko 2023-10-14T09:21:47.177 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_dsa.ko 2023-10-14T09:21:47.177 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_none.ko 2023-10-14T09:21:47.178 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_trailer.ko 2023-10-14T09:21:47.178 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154 2023-10-14T09:21:47.178 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan 2023-10-14T09:21:47.178 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-14T09:21:47.178 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154.ko 2023-10-14T09:21:47.179 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-14T09:21:47.179 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4 2023-10-14T09:21:47.179 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ah4.ko 2023-10-14T09:21:47.179 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/esp4.ko 2023-10-14T09:21:47.179 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/fou.ko 2023-10-14T09:21:47.180 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/gre.ko 2023-10-14T09:21:47.180 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/inet_diag.ko 2023-10-14T09:21:47.180 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_gre.ko 2023-10-14T09:21:47.180 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_tunnel.ko 2023-10-14T09:21:47.180 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_vti.ko 2023-10-14T09:21:47.180 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipcomp.ko 2023-10-14T09:21:47.181 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipip.ko 2023-10-14T09:21:47.181 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter 2023-10-14T09:21:47.181 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-14T09:21:47.181 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-14T09:21:47.181 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-14T09:21:47.182 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-14T09:21:47.182 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-14T09:21:47.182 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-14T09:21:47.182 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-14T09:21:47.182 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-14T09:21:47.183 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-14T09:21:47.183 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-14T09:21:47.183 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-14T09:21:47.183 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-14T09:21:47.183 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-14T09:21:47.183 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-14T09:21:47.184 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-14T09:21:47.184 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-14T09:21:47.184 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-14T09:21:47.184 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-14T09:21:47.184 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-14T09:21:47.185 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-14T09:21:47.185 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-14T09:21:47.185 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_bic.ko 2023-10-14T09:21:47.185 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-14T09:21:47.185 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_diag.ko 2023-10-14T09:21:47.186 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-14T09:21:47.186 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_htcp.ko 2023-10-14T09:21:47.186 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_hybla.ko 2023-10-14T09:21:47.186 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_illinois.ko 2023-10-14T09:21:47.186 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_lp.ko 2023-10-14T09:21:47.187 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_scalable.ko 2023-10-14T09:21:47.187 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_vegas.ko 2023-10-14T09:21:47.187 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_veno.ko 2023-10-14T09:21:47.187 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_westwood.ko 2023-10-14T09:21:47.187 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_yeah.ko 2023-10-14T09:21:47.188 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tunnel4.ko 2023-10-14T09:21:47.188 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_diag.ko 2023-10-14T09:21:47.188 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_tunnel.ko 2023-10-14T09:21:47.188 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-14T09:21:47.188 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6 2023-10-14T09:21:47.188 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ah6.ko 2023-10-14T09:21:47.189 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/esp6.ko 2023-10-14T09:21:47.189 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/fou6.ko 2023-10-14T09:21:47.189 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-14T09:21:47.189 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-14T09:21:47.189 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_vti.ko 2023-10-14T09:21:47.190 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ipcomp6.ko 2023-10-14T09:21:47.190 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter 2023-10-14T09:21:47.190 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-14T09:21:47.190 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-14T09:21:47.190 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-14T09:21:47.191 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-14T09:21:47.191 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-14T09:21:47.191 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-14T09:21:47.191 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-14T09:21:47.191 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-14T09:21:47.191 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-14T09:21:47.192 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-14T09:21:47.192 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-14T09:21:47.192 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-14T09:21:47.192 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-14T09:21:47.192 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-14T09:21:47.193 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-14T09:21:47.193 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-14T09:21:47.193 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-14T09:21:47.193 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-14T09:21:47.193 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-14T09:21:47.194 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-14T09:21:47.194 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-14T09:21:47.194 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-14T09:21:47.194 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-14T09:21:47.194 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-14T09:21:47.194 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/sit.ko 2023-10-14T09:21:47.195 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/tunnel6.ko 2023-10-14T09:21:47.195 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-14T09:21:47.195 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key 2023-10-14T09:21:47.195 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/af_key.ko 2023-10-14T09:21:47.195 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp 2023-10-14T09:21:47.196 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_core.ko 2023-10-14T09:21:47.196 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-14T09:21:47.196 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_eth.ko 2023-10-14T09:21:47.196 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip.ko 2023-10-14T09:21:47.196 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-14T09:21:47.197 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-14T09:21:47.197 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-14T09:21:47.197 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc 2023-10-14T09:21:47.197 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc.ko 2023-10-14T09:21:47.197 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154 2023-10-14T09:21:47.198 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/mac802154.ko 2023-10-14T09:21:47.198 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls 2023-10-14T09:21:47.198 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/mpls_gso.ko 2023-10-14T09:21:47.198 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter 2023-10-14T09:21:47.198 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset 2023-10-14T09:21:47.199 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-14T09:21:47.199 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-14T09:21:47.199 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-14T09:21:47.199 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-14T09:21:47.199 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-14T09:21:47.200 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-14T09:21:47.200 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-14T09:21:47.200 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-14T09:21:47.200 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-14T09:21:47.200 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-14T09:21:47.201 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-14T09:21:47.201 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-14T09:21:47.201 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-14T09:21:47.201 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-14T09:21:47.201 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-14T09:21:47.201 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-14T09:21:47.202 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs 2023-10-14T09:21:47.202 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-14T09:21:47.202 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-14T09:21:47.202 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-14T09:21:47.203 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-14T09:21:47.203 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-14T09:21:47.203 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-14T09:21:47.203 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-14T09:21:47.203 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-14T09:21:47.203 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-14T09:21:47.204 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-14T09:21:47.204 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-14T09:21:47.204 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-14T09:21:47.204 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-14T09:21:47.204 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-14T09:21:47.205 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conncount.ko 2023-10-14T09:21:47.205 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack.ko 2023-10-14T09:21:47.205 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-14T09:21:47.205 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-14T09:21:47.205 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-14T09:21:47.206 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-14T09:21:47.206 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-14T09:21:47.206 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-14T09:21:47.206 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-14T09:21:47.206 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-14T09:21:47.207 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-14T09:21:47.207 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-14T09:21:47.207 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-14T09:21:47.207 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-14T09:21:47.207 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-14T09:21:47.208 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table.ko 2023-10-14T09:21:47.208 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-14T09:21:47.208 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-14T09:21:47.208 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat.ko 2023-10-14T09:21:47.208 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-14T09:21:47.208 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-14T09:21:47.209 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-14T09:21:47.209 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-14T09:21:47.209 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-14T09:21:47.209 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-14T09:21:47.209 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_tables.ko 2023-10-14T09:21:47.210 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink.ko 2023-10-14T09:21:47.210 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-14T09:21:47.210 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-14T09:21:47.210 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-14T09:21:47.210 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-14T09:21:47.211 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-14T09:21:47.211 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_compat.ko 2023-10-14T09:21:47.211 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_ct.ko 2023-10-14T09:21:47.211 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-14T09:21:47.211 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fib.ko 2023-10-14T09:21:47.212 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-14T09:21:47.212 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_hash.ko 2023-10-14T09:21:47.212 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_limit.ko 2023-10-14T09:21:47.212 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_log.ko 2023-10-14T09:21:47.212 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_masq.ko 2023-10-14T09:21:47.212 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_nat.ko 2023-10-14T09:21:47.213 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_numgen.ko 2023-10-14T09:21:47.213 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_queue.ko 2023-10-14T09:21:47.213 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_quota.ko 2023-10-14T09:21:47.213 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_redir.ko 2023-10-14T09:21:47.213 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject.ko 2023-10-14T09:21:47.214 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-14T09:21:47.214 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_socket.ko 2023-10-14T09:21:47.214 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_tunnel.ko 2023-10-14T09:21:47.214 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-14T09:21:47.214 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-14T09:21:47.215 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-14T09:21:47.215 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-14T09:21:47.215 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CT.ko 2023-10-14T09:21:47.215 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_DSCP.ko 2023-10-14T09:21:47.215 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HL.ko 2023-10-14T09:21:47.215 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HMARK.ko 2023-10-14T09:21:47.216 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-14T09:21:47.216 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LED.ko 2023-10-14T09:21:47.216 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LOG.ko 2023-10-14T09:21:47.216 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-14T09:21:47.216 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-14T09:21:47.217 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-14T09:21:47.217 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-14T09:21:47.217 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-14T09:21:47.217 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-14T09:21:47.217 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-14T09:21:47.217 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-14T09:21:47.218 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-14T09:21:47.218 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TEE.ko 2023-10-14T09:21:47.218 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-14T09:21:47.218 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TRACE.ko 2023-10-14T09:21:47.218 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_addrtype.ko 2023-10-14T09:21:47.219 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_bpf.ko 2023-10-14T09:21:47.219 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cgroup.ko 2023-10-14T09:21:47.219 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cluster.ko 2023-10-14T09:21:47.219 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_comment.ko 2023-10-14T09:21:47.219 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connbytes.ko 2023-10-14T09:21:47.220 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlabel.ko 2023-10-14T09:21:47.220 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlimit.ko 2023-10-14T09:21:47.220 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connmark.ko 2023-10-14T09:21:47.220 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_conntrack.ko 2023-10-14T09:21:47.220 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cpu.ko 2023-10-14T09:21:47.220 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dccp.ko 2023-10-14T09:21:47.221 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_devgroup.ko 2023-10-14T09:21:47.221 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dscp.ko 2023-10-14T09:21:47.221 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ecn.ko 2023-10-14T09:21:47.221 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_esp.ko 2023-10-14T09:21:47.221 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-14T09:21:47.222 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_helper.ko 2023-10-14T09:21:47.222 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hl.ko 2023-10-14T09:21:47.222 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-14T09:21:47.222 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_iprange.ko 2023-10-14T09:21:47.222 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipvs.ko 2023-10-14T09:21:47.223 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_l2tp.ko 2023-10-14T09:21:47.223 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_length.ko 2023-10-14T09:21:47.223 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_limit.ko 2023-10-14T09:21:47.223 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mac.ko 2023-10-14T09:21:47.223 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mark.ko 2023-10-14T09:21:47.223 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_multiport.ko 2023-10-14T09:21:47.224 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nat.ko 2023-10-14T09:21:47.224 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nfacct.ko 2023-10-14T09:21:47.224 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_osf.ko 2023-10-14T09:21:47.224 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_owner.ko 2023-10-14T09:21:47.224 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_physdev.ko 2023-10-14T09:21:47.225 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_pkttype.ko 2023-10-14T09:21:47.225 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_policy.ko 2023-10-14T09:21:47.225 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_quota.ko 2023-10-14T09:21:47.225 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_rateest.ko 2023-10-14T09:21:47.225 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_realm.ko 2023-10-14T09:21:47.226 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_recent.ko 2023-10-14T09:21:47.226 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_sctp.ko 2023-10-14T09:21:47.226 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_set.ko 2023-10-14T09:21:47.226 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_socket.ko 2023-10-14T09:21:47.226 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_state.ko 2023-10-14T09:21:47.227 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_statistic.ko 2023-10-14T09:21:47.227 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_string.ko 2023-10-14T09:21:47.227 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-14T09:21:47.227 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_time.ko 2023-10-14T09:21:47.227 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_u32.ko 2023-10-14T09:21:47.228 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink 2023-10-14T09:21:47.228 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/netlink_diag.ko 2023-10-14T09:21:47.228 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh 2023-10-14T09:21:47.228 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/nsh.ko 2023-10-14T09:21:47.228 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch 2023-10-14T09:21:47.229 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/openvswitch.ko 2023-10-14T09:21:47.229 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-geneve.ko 2023-10-14T09:21:47.229 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-gre.ko 2023-10-14T09:21:47.229 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-14T09:21:47.229 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet 2023-10-14T09:21:47.229 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/af_packet_diag.ko 2023-10-14T09:21:47.230 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds 2023-10-14T09:21:47.230 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds.ko 2023-10-14T09:21:47.230 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_rdma.ko 2023-10-14T09:21:47.230 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_tcp.ko 2023-10-14T09:21:47.230 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched 2023-10-14T09:21:47.231 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_csum.ko 2023-10-14T09:21:47.231 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_gact.ko 2023-10-14T09:21:47.231 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_ipt.ko 2023-10-14T09:21:47.231 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_mirred.ko 2023-10-14T09:21:47.231 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_nat.ko 2023-10-14T09:21:47.232 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_pedit.ko 2023-10-14T09:21:47.232 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_police.ko 2023-10-14T09:21:47.232 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_simple.ko 2023-10-14T09:21:47.232 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_skbedit.ko 2023-10-14T09:21:47.232 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_vlan.ko 2023-10-14T09:21:47.233 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_basic.ko 2023-10-14T09:21:47.233 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_bpf.ko 2023-10-14T09:21:47.233 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_flow.ko 2023-10-14T09:21:47.233 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_fw.ko 2023-10-14T09:21:47.233 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_route.ko 2023-10-14T09:21:47.233 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_u32.ko 2023-10-14T09:21:47.234 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_cmp.ko 2023-10-14T09:21:47.234 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_ipset.ko 2023-10-14T09:21:47.234 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_meta.ko 2023-10-14T09:21:47.234 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_nbyte.ko 2023-10-14T09:21:47.234 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_text.ko 2023-10-14T09:21:47.235 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_u32.ko 2023-10-14T09:21:47.235 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_choke.ko 2023-10-14T09:21:47.235 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_codel.ko 2023-10-14T09:21:47.235 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_drr.ko 2023-10-14T09:21:47.235 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq.ko 2023-10-14T09:21:47.236 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_gred.ko 2023-10-14T09:21:47.236 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hfsc.ko 2023-10-14T09:21:47.236 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hhf.ko 2023-10-14T09:21:47.236 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_htb.ko 2023-10-14T09:21:47.236 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_ingress.ko 2023-10-14T09:21:47.236 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio.ko 2023-10-14T09:21:47.237 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-14T09:21:47.237 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_multiq.ko 2023-10-14T09:21:47.237 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_netem.ko 2023-10-14T09:21:47.237 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_pie.ko 2023-10-14T09:21:47.237 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_plug.ko 2023-10-14T09:21:47.238 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_prio.ko 2023-10-14T09:21:47.238 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_qfq.ko 2023-10-14T09:21:47.238 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_red.ko 2023-10-14T09:21:47.238 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfb.ko 2023-10-14T09:21:47.238 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfq.ko 2023-10-14T09:21:47.239 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_tbf.ko 2023-10-14T09:21:47.239 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_teql.ko 2023-10-14T09:21:47.239 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp 2023-10-14T09:21:47.239 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp.ko 2023-10-14T09:21:47.239 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp_diag.ko 2023-10-14T09:21:47.239 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc 2023-10-14T09:21:47.240 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss 2023-10-14T09:21:47.240 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-14T09:21:47.240 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-14T09:21:47.240 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/sunrpc.ko 2023-10-14T09:21:47.240 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma 2023-10-14T09:21:47.241 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-14T09:21:47.241 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc 2023-10-14T09:21:47.241 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/diag.ko 2023-10-14T09:21:47.241 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/tipc.ko 2023-10-14T09:21:47.241 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix 2023-10-14T09:21:47.241 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/unix_diag.ko 2023-10-14T09:21:47.242 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock 2023-10-14T09:21:47.242 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-14T09:21:47.242 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-14T09:21:47.242 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock.ko 2023-10-14T09:21:47.242 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-14T09:21:47.243 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-14T09:21:47.243 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm 2023-10-14T09:21:47.243 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-14T09:21:47.243 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security 2023-10-14T09:21:47.243 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys 2023-10-14T09:21:47.244 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys 2023-10-14T09:21:47.244 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-14T09:21:47.244 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys 2023-10-14T09:21:47.244 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-14T09:21:47.244 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt 2023-10-14T09:21:47.244 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib 2023-10-14T09:21:47.245 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/irqbypass.ko 2023-10-14T09:21:47.245 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias 2023-10-14T09:21:47.245 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias.bin 2023-10-14T09:21:47.245 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin 2023-10-14T09:21:47.245 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.alias.bin 2023-10-14T09:21:47.246 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.bin 2023-10-14T09:21:47.246 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.modinfo 2023-10-14T09:21:47.246 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep 2023-10-14T09:21:47.246 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep.bin 2023-10-14T09:21:47.246 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.devname 2023-10-14T09:21:47.247 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.order 2023-10-14T09:21:47.247 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.softdep 2023-10-14T09:21:47.247 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols 2023-10-14T09:21:47.247 INFO:teuthology.orchestra.run.smithi102.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols.bin 2023-10-14T09:21:47.248 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g47672119149b 2023-10-14T09:21:47.248 DEBUG:teuthology.orchestra.run.smithi102:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-14T09:21:47.271 INFO:teuthology.orchestra.run.smithi102.stdout:postinstall scriptlet (using /bin/sh): 2023-10-14T09:21:47.271 INFO:teuthology.orchestra.run.smithi102.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-rc5-g47672119149b -a -r /boot/System.map-6.6.0-rc5-g47672119149b ]; then 2023-10-14T09:21:47.271 INFO:teuthology.orchestra.run.smithi102.stdout:cp /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm 2023-10-14T09:21:47.271 INFO:teuthology.orchestra.run.smithi102.stdout:cp /boot/System.map-6.6.0-rc5-g47672119149b /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-14T09:21:47.272 INFO:teuthology.orchestra.run.smithi102.stdout:rm -f /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/System.map-6.6.0-rc5-g47672119149b 2023-10-14T09:21:47.272 INFO:teuthology.orchestra.run.smithi102.stdout:/sbin/installkernel 6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-14T09:21:47.272 INFO:teuthology.orchestra.run.smithi102.stdout:rm -f /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-14T09:21:47.272 INFO:teuthology.orchestra.run.smithi102.stdout:fi 2023-10-14T09:21:47.273 INFO:teuthology.orchestra.run.smithi102.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-14T09:21:47.273 INFO:teuthology.orchestra.run.smithi102.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-14T09:21:47.273 INFO:teuthology.orchestra.run.smithi102.stdout:new-kernel-pkg --remove 6.6.0-rc5-g47672119149b --rminitrd --initrdfile=/boot/initramfs-6.6.0-rc5-g47672119149b.img 2023-10-14T09:21:47.273 INFO:teuthology.orchestra.run.smithi102.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-14T09:21:47.273 INFO:teuthology.orchestra.run.smithi102.stdout:kernel-install remove 6.6.0-rc5-g47672119149b 2023-10-14T09:21:47.274 INFO:teuthology.orchestra.run.smithi102.stdout:fi 2023-10-14T09:21:47.274 INFO:teuthology.orchestra.run.smithi102.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-14T09:21:47.274 INFO:teuthology.orchestra.run.smithi102.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-14T09:21:47.274 INFO:teuthology.orchestra.run.smithi102.stdout:/sbin/update-bootloader --remove 6.6.0-rc5-g47672119149b 2023-10-14T09:21:47.274 INFO:teuthology.orchestra.run.smithi102.stdout:fi 2023-10-14T09:21:47.276 DEBUG:teuthology.orchestra.run.smithi102:> sudo rpm -qi grub2-tools 2023-10-14T09:21:47.350 INFO:teuthology.orchestra.run.smithi102.stdout:Name : grub2-tools 2023-10-14T09:21:47.351 INFO:teuthology.orchestra.run.smithi102.stdout:Epoch : 1 2023-10-14T09:21:47.351 INFO:teuthology.orchestra.run.smithi102.stdout:Version : 2.06 2023-10-14T09:21:47.351 INFO:teuthology.orchestra.run.smithi102.stdout:Release : 68.el9 2023-10-14T09:21:47.351 INFO:teuthology.orchestra.run.smithi102.stdout:Architecture: x86_64 2023-10-14T09:21:47.352 INFO:teuthology.orchestra.run.smithi102.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-10-14T09:21:47.352 INFO:teuthology.orchestra.run.smithi102.stdout:Group : Unspecified 2023-10-14T09:21:47.352 INFO:teuthology.orchestra.run.smithi102.stdout:Size : 8264254 2023-10-14T09:21:47.352 INFO:teuthology.orchestra.run.smithi102.stdout:License : GPLv3+ 2023-10-14T09:21:47.352 INFO:teuthology.orchestra.run.smithi102.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-10-14T09:21:47.353 INFO:teuthology.orchestra.run.smithi102.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-10-14T09:21:47.353 INFO:teuthology.orchestra.run.smithi102.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-10-14T09:21:47.353 INFO:teuthology.orchestra.run.smithi102.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-10-14T09:21:47.353 INFO:teuthology.orchestra.run.smithi102.stdout:Packager : builder@centos.org 2023-10-14T09:21:47.353 INFO:teuthology.orchestra.run.smithi102.stdout:Vendor : CentOS 2023-10-14T09:21:47.354 INFO:teuthology.orchestra.run.smithi102.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-14T09:21:47.354 INFO:teuthology.orchestra.run.smithi102.stdout:Summary : Support tools for GRUB. 2023-10-14T09:21:47.354 INFO:teuthology.orchestra.run.smithi102.stdout:Description : 2023-10-14T09:21:47.354 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:21:47.354 INFO:teuthology.orchestra.run.smithi102.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-14T09:21:47.355 INFO:teuthology.orchestra.run.smithi102.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-14T09:21:47.355 INFO:teuthology.orchestra.run.smithi102.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-14T09:21:47.355 INFO:teuthology.orchestra.run.smithi102.stdout:hardware devices. 2023-10-14T09:21:47.355 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:21:47.355 INFO:teuthology.orchestra.run.smithi102.stdout:This subpackage provides tools for support of all platforms. 2023-10-14T09:21:47.356 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-14T09:21:47.357 INFO:teuthology.task.kernel:Updating grub on smithi102 to boot 6.6.0-rc5-g47672119149b 2023-10-14T09:21:47.357 DEBUG:teuthology.orchestra.run.smithi102:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-14T09:21:48.062 INFO:teuthology.orchestra.run.smithi102.stderr:Generating grub configuration file ... 2023-10-14T09:21:49.400 INFO:teuthology.orchestra.run.smithi102.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-10-14T09:21:49.428 INFO:teuthology.orchestra.run.smithi102.stderr:done 2023-10-14T09:21:49.430 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2023-10-14T09:21:49.445 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.DU4Tu9OMIC 2023-10-14T09:21:49.445 DEBUG:teuthology.orchestra.run.smithi102:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.DU4Tu9OMIC 2023-10-14T09:21:49.513 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.DU4Tu9OMIC 2023-10-14T09:21:49.649 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.DU4Tu9OMIC is 6KB 2023-10-14T09:21:49.698 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.DU4Tu9OMIC 2023-10-14T09:21:49.713 DEBUG:teuthology.orchestra.run.smithi102:> sudo /bin/ls /boot/loader/entries || true 2023-10-14T09:21:49.777 INFO:teuthology.orchestra.run.smithi102.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-10-14T09:21:49.778 INFO:teuthology.orchestra.run.smithi102.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-10-14T09:21:49.778 INFO:teuthology.orchestra.run.smithi102.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-10-14T09:21:49.778 INFO:teuthology.orchestra.run.smithi102.stdout:15949e3c88704300882482eddfd7baae-6.6.0-rc5-g47672119149b.conf 2023-10-14T09:21:49.779 DEBUG:teuthology.orchestra.run.smithi102:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-rc5-g47672119149b 2023-10-14T09:21:49.930 DEBUG:teuthology.orchestra.run.smithi102:> sudo shutdown -r now 2023-10-14T09:22:16.489 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-14T09:22:16.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2023-10-14T09:22:16.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:22:19.934 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-14T09:22:19.935 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-10-14T09:22:19.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:22:35.002 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-10-14T09:22:38.330 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-10-14T09:22:44.009 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2023-10-14T09:22:44.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:22:47.066 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-10-14T09:22:47.332 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-10-14T09:22:47.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:22:50.398 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-10-14T09:22:59.075 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2023-10-14T09:22:59.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:23:02.403 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-10-14T09:23:02.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:23:05.470 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-10-14T09:23:17.498 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-10-14T09:23:20.474 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-10-14T09:23:20.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:23:32.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2023-10-14T09:23:32.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:23:34.290 DEBUG:teuthology.orchestra.run.smithi129:> true 2023-10-14T09:23:34.968 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2023-10-14T09:23:34.968 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-rc5-g47672119149b"... 2023-10-14T09:23:34.969 DEBUG:teuthology.orchestra.run.smithi129:> uname -r 2023-10-14T09:23:35.007 INFO:teuthology.orchestra.run.smithi129.stdout:6.6.0-rc5-g47672119149b 2023-10-14T09:23:35.007 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g47672119149b vs 6.6.0-rc5-g47672119149b 2023-10-14T09:23:35.008 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-14T09:23:35.008 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-14T09:23:36.009 DEBUG:teuthology.parallel:result is None 2023-10-14T09:23:39.002 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-10-14T09:23:57.004 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-10-14T09:23:57.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:23:57.464 DEBUG:teuthology.orchestra.run.smithi102:> true 2023-10-14T09:23:58.151 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-10-14T09:23:58.151 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-rc5-g47672119149b"... 2023-10-14T09:23:58.152 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2023-10-14T09:23:58.193 INFO:teuthology.orchestra.run.smithi102.stdout:6.6.0-rc5-g47672119149b 2023-10-14T09:23:58.194 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g47672119149b vs 6.6.0-rc5-g47672119149b 2023-10-14T09:23:58.194 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-14T09:23:58.194 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-14T09:23:59.195 DEBUG:teuthology.parallel:result is None 2023-10-14T09:23:59.196 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-14T09:23:59.204 INFO:teuthology.task.internal:Creating test directory... 2023-10-14T09:23:59.205 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-14T09:23:59.214 DEBUG:teuthology.orchestra.run.smithi129:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-14T09:23:59.276 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-14T09:23:59.284 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-14T09:23:59.292 INFO:teuthology.task.internal:Creating archive directory... 2023-10-14T09:23:59.292 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-14T09:23:59.297 DEBUG:teuthology.orchestra.run.smithi129:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-14T09:23:59.370 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-14T09:23:59.377 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-14T09:23:59.378 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-14T09:23:59.386 DEBUG:teuthology.orchestra.run.smithi129:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-14T09:23:59.508 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T09:23:59.550 INFO:teuthology.orchestra.run.smithi129.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T09:23:59.584 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T09:23:59.618 INFO:teuthology.orchestra.run.smithi129.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T09:23:59.623 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-14T09:23:59.630 INFO:teuthology.task.internal:Configuring sudo... 2023-10-14T09:23:59.631 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-14T09:23:59.639 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-14T09:23:59.737 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-14T09:23:59.747 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-14T09:23:59.747 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-14T09:23:59.752 DEBUG:teuthology.orchestra.run.smithi129:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-14T09:23:59.805 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T09:23:59.881 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T09:23:59.975 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T09:24:00.045 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T09:24:00.121 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-10-14T09:24:00.122 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-14T09:24:00.200 DEBUG:teuthology.orchestra.run.smithi129:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T09:24:00.289 DEBUG:teuthology.orchestra.run.smithi129:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T09:24:00.400 DEBUG:teuthology.orchestra.run.smithi129:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T09:24:00.489 DEBUG:teuthology.orchestra.run.smithi129:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T09:24:00.592 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2023-10-14T09:24:00.593 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-14T09:24:00.688 DEBUG:teuthology.orchestra.run.smithi102:> sudo service rsyslog restart 2023-10-14T09:24:00.694 DEBUG:teuthology.orchestra.run.smithi129:> sudo service rsyslog restart 2023-10-14T09:24:00.799 INFO:teuthology.orchestra.run.smithi102.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T09:24:00.852 INFO:teuthology.orchestra.run.smithi129.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T09:24:01.071 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-14T09:24:01.087 INFO:teuthology.task.internal:Starting timer... 2023-10-14T09:24:01.087 INFO:teuthology.run_tasks:Running task pcp... 2023-10-14T09:24:01.117 INFO:teuthology.run_tasks:Running task selinux... 2023-10-14T09:24:01.139 DEBUG:teuthology.orchestra.run.smithi102:> sudo service auditd rotate 2023-10-14T09:24:01.256 INFO:teuthology.orchestra.run.smithi102.stdout:Rotating logs: 2023-10-14T09:24:01.262 DEBUG:teuthology.orchestra.run.smithi129:> sudo service auditd rotate 2023-10-14T09:24:01.395 INFO:teuthology.orchestra.run.smithi129.stdout:Rotating logs: 2023-10-14T09:24:01.399 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-14T09:24:01.399 DEBUG:teuthology.orchestra.run.smithi102:> /usr/sbin/getenforce 2023-10-14T09:24:01.474 INFO:teuthology.orchestra.run.smithi102.stdout:Permissive 2023-10-14T09:24:01.476 DEBUG:teuthology.orchestra.run.smithi129:> /usr/sbin/getenforce 2023-10-14T09:24:01.537 INFO:teuthology.orchestra.run.smithi129.stdout:Permissive 2023-10-14T09:24:01.537 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi102.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi129.front.sepia.ceph.com': 'permissive'} 2023-10-14T09:24:01.538 DEBUG:teuthology.orchestra.run.smithi102:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T09:24:01.619 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:24:01.620 DEBUG:teuthology.orchestra.run.smithi129:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T09:24:01.715 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:24:01.716 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-14T09:24:01.717 DEBUG:teuthology.orchestra.run.smithi102:> sudo /usr/sbin/setenforce permissive 2023-10-14T09:24:01.795 DEBUG:teuthology.orchestra.run.smithi129:> sudo /usr/sbin/setenforce permissive 2023-10-14T09:24:01.918 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-14T09:24:01.930 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-14T09:24:01.930 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-14T09:24:01.950 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-14T09:24:01.952 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi102.front.sepia.ceph.com,smithi129.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-14T09:33:51.677 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi102.front.sepia.ceph.com'), Remote(name='ubuntu@smithi129.front.sepia.ceph.com')] 2023-10-14T09:33:51.678 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-10-14T09:33:51.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:33:51.822 DEBUG:teuthology.orchestra.run.smithi102:> true 2023-10-14T09:33:51.981 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-10-14T09:33:51.982 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2023-10-14T09:33:51.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:33:52.121 DEBUG:teuthology.orchestra.run.smithi129:> true 2023-10-14T09:33:52.284 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2023-10-14T09:33:52.285 INFO:teuthology.run_tasks:Running task clock... 2023-10-14T09:33:52.298 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-14T09:33:52.299 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-14T09:33:52.299 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T09:33:52.308 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-14T09:33:52.309 DEBUG:teuthology.orchestra.run.smithi129:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T09:33:52.408 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-14T09:33:52.410 INFO:teuthology.orchestra.run.smithi129.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-14T09:33:52.459 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-14T09:33:52.465 INFO:teuthology.orchestra.run.smithi129.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-14T09:33:52.547 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: ntpd: command not found 2023-10-14T09:33:52.555 INFO:teuthology.orchestra.run.smithi129.stderr:sudo: ntpd: command not found 2023-10-14T09:33:52.589 INFO:teuthology.orchestra.run.smithi102.stdout:506 Cannot talk to daemon 2023-10-14T09:33:52.597 INFO:teuthology.orchestra.run.smithi129.stdout:506 Cannot talk to daemon 2023-10-14T09:33:52.642 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-14T09:33:52.649 INFO:teuthology.orchestra.run.smithi129.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-14T09:33:52.693 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-14T09:33:52.702 INFO:teuthology.orchestra.run.smithi129.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-14T09:33:52.814 INFO:teuthology.orchestra.run.smithi102.stderr:bash: line 1: ntpq: command not found 2023-10-14T09:33:52.822 INFO:teuthology.orchestra.run.smithi102.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T09:33:52.822 INFO:teuthology.orchestra.run.smithi102.stdout:=============================================================================== 2023-10-14T09:33:52.822 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T09:33:52.823 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T09:33:52.823 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T09:33:52.823 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T09:33:52.826 INFO:teuthology.orchestra.run.smithi129.stderr:bash: line 1: ntpq: command not found 2023-10-14T09:33:52.834 INFO:teuthology.orchestra.run.smithi129.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T09:33:52.834 INFO:teuthology.orchestra.run.smithi129.stdout:=============================================================================== 2023-10-14T09:33:52.834 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T09:33:52.834 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T09:33:52.835 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T09:33:52.835 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T09:33:52.836 INFO:teuthology.run_tasks:Running task install... 2023-10-14T09:33:52.845 DEBUG:teuthology.task.install:project ceph 2023-10-14T09:33:52.846 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}} 2023-10-14T09:33:52.846 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'} 2023-10-14T09:33:52.846 INFO:teuthology.task.install:Using flavor: default 2023-10-14T09:33:52.853 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-14T09:33:52.853 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-14T09:33:52.854 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'tag': None, 'wait_for_package': False} 2023-10-14T09:33:52.855 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T09:33:52.857 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'tag': None, 'wait_for_package': False} 2023-10-14T09:33:52.857 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T09:33:53.278 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/ 2023-10-14T09:33:53.279 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6730.g4ba8a190 2023-10-14T09:33:53.284 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/ 2023-10-14T09:33:53.284 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6730.g4ba8a190 2023-10-14T09:33:53.404 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-14T09:33:53.405 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2023-10-14T09:33:53.405 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-14T09:33:53.508 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-14T09:33:53.508 DEBUG:teuthology.orchestra.run.smithi129:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-14T09:33:53.594 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-14T09:33:53.594 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-10-14T09:33:53.594 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-14T09:33:53.652 DEBUG:teuthology.orchestra.run.smithi129:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-14T09:33:53.694 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-14T09:33:53.695 DEBUG:teuthology.orchestra.run.smithi102:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-14T09:33:53.788 DEBUG:teuthology.orchestra.run.smithi129:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-14T09:33:53.837 DEBUG:teuthology.orchestra.run.smithi102:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-14T09:33:53.877 INFO:teuthology.orchestra.run.smithi129.stdout:check_obsoletes = 1 2023-10-14T09:33:53.882 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum clean all 2023-10-14T09:33:53.967 DEBUG:teuthology.orchestra.run.smithi102:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-14T09:33:54.055 INFO:teuthology.orchestra.run.smithi102.stdout:check_obsoletes = 1 2023-10-14T09:33:54.059 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum clean all 2023-10-14T09:33:54.226 INFO:teuthology.orchestra.run.smithi129.stdout:70 files removed 2023-10-14T09:33:54.264 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-14T09:33:54.401 INFO:teuthology.orchestra.run.smithi102.stdout:70 files removed 2023-10-14T09:33:54.444 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-14T09:33:55.415 INFO:teuthology.orchestra.run.smithi129.stdout:ceph packages for x86_64 121 kB/s | 78 kB 00:00 2023-10-14T09:33:55.601 INFO:teuthology.orchestra.run.smithi102.stdout:ceph packages for x86_64 119 kB/s | 78 kB 00:00 2023-10-14T09:33:56.057 INFO:teuthology.orchestra.run.smithi129.stdout:ceph noarch packages 17 kB/s | 9.4 kB 00:00 2023-10-14T09:33:56.068 INFO:teuthology.orchestra.run.smithi102.stdout:ceph noarch packages 25 kB/s | 9.4 kB 00:00 2023-10-14T09:33:56.852 INFO:teuthology.orchestra.run.smithi102.stdout:ceph source packages 2.6 kB/s | 1.9 kB 00:00 2023-10-14T09:33:56.891 INFO:teuthology.orchestra.run.smithi129.stdout:ceph source packages 2.5 kB/s | 1.9 kB 00:00 2023-10-14T09:33:58.003 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS-9 - AppStream 6.1 MB/s | 6.3 MB 00:01 2023-10-14T09:33:58.057 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS-9 - AppStream 5.6 MB/s | 6.3 MB 00:01 2023-10-14T09:33:59.979 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS-9 - BaseOS 2.5 MB/s | 2.0 MB 00:00 2023-10-14T09:34:00.040 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS-9 - BaseOS 2.6 MB/s | 2.0 MB 00:00 2023-10-14T09:34:03.991 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - BaseOS 2.2 MB/s | 7.9 MB 00:03 2023-10-14T09:34:04.985 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - BaseOS 1.7 MB/s | 7.9 MB 00:04 2023-10-14T09:34:07.442 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - AppStream 7.7 MB/s | 18 MB 00:02 2023-10-14T09:34:12.951 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 5.7 MB 00:01 2023-10-14T09:34:13.594 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - AppStream 2.4 MB/s | 18 MB 00:07 2023-10-14T09:34:15.596 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - Extras packages 11 kB/s | 14 kB 00:01 2023-10-14T09:34:17.942 INFO:teuthology.orchestra.run.smithi129.stdout:Extra Packages for Enterprise Linux 8.8 MB/s | 19 MB 00:02 2023-10-14T09:34:19.187 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - CRB 2.8 MB/s | 5.7 MB 00:02 2023-10-14T09:34:20.788 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 14 kB 00:00 2023-10-14T09:34:22.195 INFO:teuthology.orchestra.run.smithi102.stdout:Extra Packages for Enterprise Linux 15 MB/s | 19 MB 00:01 2023-10-14T09:34:23.120 INFO:teuthology.orchestra.run.smithi129.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2023-10-14T09:34:25.580 INFO:teuthology.orchestra.run.smithi129.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-10-14T09:34:25.582 INFO:teuthology.orchestra.run.smithi129.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-10-14T09:34:25.602 INFO:teuthology.orchestra.run.smithi129.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-10-14T09:34:25.604 INFO:teuthology.orchestra.run.smithi129.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-10-14T09:34:25.605 INFO:teuthology.orchestra.run.smithi129.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-10-14T09:34:25.607 INFO:teuthology.orchestra.run.smithi129.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-10-14T09:34:25.609 INFO:teuthology.orchestra.run.smithi129.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-10-14T09:34:25.613 INFO:teuthology.orchestra.run.smithi129.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-10-14T09:34:25.614 INFO:teuthology.orchestra.run.smithi129.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-10-14T09:34:25.690 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2023-10-14T09:34:25.709 INFO:teuthology.orchestra.run.smithi129.stdout:============================================================================================ 2023-10-14T09:34:25.710 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2023-10-14T09:34:25.710 INFO:teuthology.orchestra.run.smithi129.stdout:============================================================================================ 2023-10-14T09:34:25.710 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2023-10-14T09:34:25.710 INFO:teuthology.orchestra.run.smithi129.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-10-14T09:34:25.711 INFO:teuthology.orchestra.run.smithi129.stdout: ceph x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 6.5 k 2023-10-14T09:34:25.711 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-base x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 5.2 M 2023-10-14T09:34:25.711 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-fuse x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 855 k 2023-10-14T09:34:25.711 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 141 k 2023-10-14T09:34:25.711 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 1.5 M 2023-10-14T09:34:25.712 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 132 k 2023-10-14T09:34:25.712 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 1.8 M 2023-10-14T09:34:25.712 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 7.4 M 2023-10-14T09:34:25.712 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-rook noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 47 k 2023-10-14T09:34:25.712 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-radosgw x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 8.6 M 2023-10-14T09:34:25.713 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-test x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 41 M 2023-10-14T09:34:25.713 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-volume noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 262 k 2023-10-14T09:34:25.713 INFO:teuthology.orchestra.run.smithi129.stdout: cephadm noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 269 k 2023-10-14T09:34:25.713 INFO:teuthology.orchestra.run.smithi129.stdout: cephfs-mirror x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 218 k 2023-10-14T09:34:25.713 INFO:teuthology.orchestra.run.smithi129.stdout: cephfs-top noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 18 k 2023-10-14T09:34:25.714 INFO:teuthology.orchestra.run.smithi129.stdout: elfutils-libelf-devel x86_64 0.189-3.el9 appstream 22 k 2023-10-14T09:34:25.714 INFO:teuthology.orchestra.run.smithi129.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-10-14T09:34:25.714 INFO:teuthology.orchestra.run.smithi129.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-10-14T09:34:25.714 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs-devel x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 31 k 2023-10-14T09:34:25.715 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs2 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 715 k 2023-10-14T09:34:25.715 INFO:teuthology.orchestra.run.smithi129.stdout: librados-devel x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 127 k 2023-10-14T09:34:25.715 INFO:teuthology.orchestra.run.smithi129.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-10-14T09:34:25.715 INFO:teuthology.orchestra.run.smithi129.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2023-10-14T09:34:25.715 INFO:teuthology.orchestra.run.smithi129.stdout: openssl-devel x86_64 1:3.0.7-24.el9 appstream 4.1 M 2023-10-14T09:34:25.716 INFO:teuthology.orchestra.run.smithi129.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-10-14T09:34:25.716 INFO:teuthology.orchestra.run.smithi129.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-10-14T09:34:25.716 INFO:teuthology.orchestra.run.smithi129.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-10-14T09:34:25.716 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cephfs x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 162 k 2023-10-14T09:34:25.717 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rados x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 321 k 2023-10-14T09:34:25.717 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rbd x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 298 k 2023-10-14T09:34:25.717 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rgw x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 99 k 2023-10-14T09:34:25.717 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-fuse x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 85 k 2023-10-14T09:34:25.717 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-mirror x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 3.0 M 2023-10-14T09:34:25.718 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-nbd x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 169 k 2023-10-14T09:34:25.718 INFO:teuthology.orchestra.run.smithi129.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 appstream 86 k 2023-10-14T09:34:25.718 INFO:teuthology.orchestra.run.smithi129.stdout:Upgrading: 2023-10-14T09:34:25.718 INFO:teuthology.orchestra.run.smithi129.stdout: NetworkManager x86_64 1:1.45.4-1.el9 CentOS-BaseOS 2.2 M 2023-10-14T09:34:25.718 INFO:teuthology.orchestra.run.smithi129.stdout: NetworkManager-libnm x86_64 1:1.45.4-1.el9 CentOS-BaseOS 1.8 M 2023-10-14T09:34:25.719 INFO:teuthology.orchestra.run.smithi129.stdout: NetworkManager-team x86_64 1:1.45.4-1.el9 CentOS-BaseOS 41 k 2023-10-14T09:34:25.719 INFO:teuthology.orchestra.run.smithi129.stdout: NetworkManager-tui x86_64 1:1.45.4-1.el9 CentOS-BaseOS 244 k 2023-10-14T09:34:25.719 INFO:teuthology.orchestra.run.smithi129.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-10-14T09:34:25.719 INFO:teuthology.orchestra.run.smithi129.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-10-14T09:34:25.719 INFO:teuthology.orchestra.run.smithi129.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-10-14T09:34:25.720 INFO:teuthology.orchestra.run.smithi129.stdout: librados2 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 3.3 M 2023-10-14T09:34:25.720 INFO:teuthology.orchestra.run.smithi129.stdout: librbd1 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 3.0 M 2023-10-14T09:34:25.720 INFO:teuthology.orchestra.run.smithi129.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-10-14T09:34:25.720 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2023-10-14T09:34:25.720 INFO:teuthology.orchestra.run.smithi129.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2023-10-14T09:34:25.721 INFO:teuthology.orchestra.run.smithi129.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-10-14T09:34:25.721 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 19 M 2023-10-14T09:34:25.721 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 23 k 2023-10-14T09:34:25.721 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mds x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 2.1 M 2023-10-14T09:34:25.721 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 242 k 2023-10-14T09:34:25.722 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mon x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 4.4 M 2023-10-14T09:34:25.722 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-osd x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 18 M 2023-10-14T09:34:25.722 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 15 k 2023-10-14T09:34:25.722 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-selinux x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 24 k 2023-10-14T09:34:25.722 INFO:teuthology.orchestra.run.smithi129.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-10-14T09:34:25.723 INFO:teuthology.orchestra.run.smithi129.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-10-14T09:34:25.723 INFO:teuthology.orchestra.run.smithi129.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-10-14T09:34:25.723 INFO:teuthology.orchestra.run.smithi129.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-10-14T09:34:25.723 INFO:teuthology.orchestra.run.smithi129.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-10-14T09:34:25.723 INFO:teuthology.orchestra.run.smithi129.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-10-14T09:34:25.724 INFO:teuthology.orchestra.run.smithi129.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-10-14T09:34:25.724 INFO:teuthology.orchestra.run.smithi129.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-10-14T09:34:25.724 INFO:teuthology.orchestra.run.smithi129.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-10-14T09:34:25.724 INFO:teuthology.orchestra.run.smithi129.stdout: libcephsqlite x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 163 k 2023-10-14T09:34:25.725 INFO:teuthology.orchestra.run.smithi129.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-10-14T09:34:25.725 INFO:teuthology.orchestra.run.smithi129.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-10-14T09:34:25.725 INFO:teuthology.orchestra.run.smithi129.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-10-14T09:34:25.725 INFO:teuthology.orchestra.run.smithi129.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-10-14T09:34:25.725 INFO:teuthology.orchestra.run.smithi129.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-10-14T09:34:25.726 INFO:teuthology.orchestra.run.smithi129.stdout: libradosstriper1 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 472 k 2023-10-14T09:34:25.726 INFO:teuthology.orchestra.run.smithi129.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-10-14T09:34:25.726 INFO:teuthology.orchestra.run.smithi129.stdout: librgw2 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 4.8 M 2023-10-14T09:34:25.726 INFO:teuthology.orchestra.run.smithi129.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-10-14T09:34:25.726 INFO:teuthology.orchestra.run.smithi129.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-10-14T09:34:25.727 INFO:teuthology.orchestra.run.smithi129.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-10-14T09:34:25.727 INFO:teuthology.orchestra.run.smithi129.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-10-14T09:34:25.727 INFO:teuthology.orchestra.run.smithi129.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-10-14T09:34:25.727 INFO:teuthology.orchestra.run.smithi129.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-10-14T09:34:25.727 INFO:teuthology.orchestra.run.smithi129.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-10-14T09:34:25.728 INFO:teuthology.orchestra.run.smithi129.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-10-14T09:34:25.728 INFO:teuthology.orchestra.run.smithi129.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-10-14T09:34:25.728 INFO:teuthology.orchestra.run.smithi129.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-10-14T09:34:25.728 INFO:teuthology.orchestra.run.smithi129.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-10-14T09:34:25.728 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-10-14T09:34:25.729 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-argparse x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 45 k 2023-10-14T09:34:25.729 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 127 k 2023-10-14T09:34:25.729 INFO:teuthology.orchestra.run.smithi129.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-10-14T09:34:25.729 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-10-14T09:34:25.729 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-10-14T09:34:25.730 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-10-14T09:34:25.730 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-10-14T09:34:25.730 INFO:teuthology.orchestra.run.smithi129.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-10-14T09:34:25.730 INFO:teuthology.orchestra.run.smithi129.stdout: python3-google-auth noarch 1:2.23.2-1.el9 epel 196 k 2023-10-14T09:34:25.730 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-10-14T09:34:25.731 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-10-14T09:34:25.731 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-10-14T09:34:25.731 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-10-14T09:34:25.731 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-10-14T09:34:25.731 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-10-14T09:34:25.732 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-10-14T09:34:25.732 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-10-14T09:34:25.732 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-10-14T09:34:25.732 INFO:teuthology.orchestra.run.smithi129.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-10-14T09:34:25.732 INFO:teuthology.orchestra.run.smithi129.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-10-14T09:34:25.733 INFO:teuthology.orchestra.run.smithi129.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-10-14T09:34:25.733 INFO:teuthology.orchestra.run.smithi129.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-10-14T09:34:25.733 INFO:teuthology.orchestra.run.smithi129.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-10-14T09:34:25.733 INFO:teuthology.orchestra.run.smithi129.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-10-14T09:34:25.733 INFO:teuthology.orchestra.run.smithi129.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-10-14T09:34:25.734 INFO:teuthology.orchestra.run.smithi129.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-10-14T09:34:25.734 INFO:teuthology.orchestra.run.smithi129.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-10-14T09:34:25.734 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-10-14T09:34:25.734 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-10-14T09:34:25.735 INFO:teuthology.orchestra.run.smithi129.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-10-14T09:34:25.735 INFO:teuthology.orchestra.run.smithi129.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-10-14T09:34:25.735 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-10-14T09:34:25.735 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-10-14T09:34:25.735 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-10-14T09:34:25.736 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-10-14T09:34:25.736 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-10-14T09:34:25.736 INFO:teuthology.orchestra.run.smithi129.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-10-14T09:34:25.736 INFO:teuthology.orchestra.run.smithi129.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-10-14T09:34:25.737 INFO:teuthology.orchestra.run.smithi129.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-10-14T09:34:25.737 INFO:teuthology.orchestra.run.smithi129.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-10-14T09:34:25.737 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-10-14T09:34:25.737 INFO:teuthology.orchestra.run.smithi129.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-10-14T09:34:25.737 INFO:teuthology.orchestra.run.smithi129.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-10-14T09:34:25.738 INFO:teuthology.orchestra.run.smithi129.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-10-14T09:34:25.738 INFO:teuthology.orchestra.run.smithi129.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-10-14T09:34:25.738 INFO:teuthology.orchestra.run.smithi129.stdout: python3-urllib3 noarch 1.26.5-3.el9 CentOS-BaseOS 188 k 2023-10-14T09:34:25.738 INFO:teuthology.orchestra.run.smithi129.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-10-14T09:34:25.738 INFO:teuthology.orchestra.run.smithi129.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-10-14T09:34:25.739 INFO:teuthology.orchestra.run.smithi129.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-10-14T09:34:25.739 INFO:teuthology.orchestra.run.smithi129.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-10-14T09:34:25.739 INFO:teuthology.orchestra.run.smithi129.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-10-14T09:34:25.739 INFO:teuthology.orchestra.run.smithi129.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-10-14T09:34:25.740 INFO:teuthology.orchestra.run.smithi129.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-10-14T09:34:25.740 INFO:teuthology.orchestra.run.smithi129.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-10-14T09:34:25.740 INFO:teuthology.orchestra.run.smithi129.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-10-14T09:34:25.740 INFO:teuthology.orchestra.run.smithi129.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2023-10-14T09:34:25.740 INFO:teuthology.orchestra.run.smithi129.stdout:Installing weak dependencies: 2023-10-14T09:34:25.741 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-10-14T09:34:25.741 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:34:25.741 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2023-10-14T09:34:25.741 INFO:teuthology.orchestra.run.smithi129.stdout:============================================================================================ 2023-10-14T09:34:25.741 INFO:teuthology.orchestra.run.smithi129.stdout:Install 133 Packages 2023-10-14T09:34:25.742 INFO:teuthology.orchestra.run.smithi129.stdout:Upgrade 10 Packages 2023-10-14T09:34:25.742 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:34:25.743 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 199 M 2023-10-14T09:34:25.743 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2023-10-14T09:34:26.504 INFO:teuthology.orchestra.run.smithi129.stdout:(1/143): ceph-18.0.0-6730.g4ba8a190.el9.x86_64. 26 kB/s | 6.5 kB 00:00 2023-10-14T09:34:26.746 INFO:teuthology.orchestra.run.smithi129.stdout:(2/143): ceph-fuse-18.0.0-6730.g4ba8a190.el9.x8 3.5 MB/s | 855 kB 00:00 2023-10-14T09:34:26.822 INFO:teuthology.orchestra.run.smithi129.stdout:(3/143): ceph-immutable-object-cache-18.0.0-673 1.9 MB/s | 141 kB 00:00 2023-10-14T09:34:27.272 INFO:teuthology.orchestra.run.smithi129.stdout:(4/143): ceph-mds-18.0.0-6730.g4ba8a190.el9.x86 4.6 MB/s | 2.1 MB 00:00 2023-10-14T09:34:27.512 INFO:teuthology.orchestra.run.smithi102.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2023-10-14T09:34:27.622 INFO:teuthology.orchestra.run.smithi129.stdout:(5/143): ceph-common-18.0.0-6730.g4ba8a190.el9. 14 MB/s | 19 MB 00:01 2023-10-14T09:34:27.689 INFO:teuthology.orchestra.run.smithi129.stdout:(6/143): ceph-mgr-18.0.0-6730.g4ba8a190.el9.x86 3.5 MB/s | 1.5 MB 00:00 2023-10-14T09:34:27.939 INFO:teuthology.orchestra.run.smithi129.stdout:(7/143): ceph-mon-18.0.0-6730.g4ba8a190.el9.x86 14 MB/s | 4.4 MB 00:00 2023-10-14T09:34:28.507 INFO:teuthology.orchestra.run.smithi129.stdout:(8/143): ceph-radosgw-18.0.0-6730.g4ba8a190.el9 15 MB/s | 8.6 MB 00:00 2023-10-14T09:34:28.565 INFO:teuthology.orchestra.run.smithi129.stdout:(9/143): ceph-selinux-18.0.0-6730.g4ba8a190.el9 421 kB/s | 24 kB 00:00 2023-10-14T09:34:30.002 INFO:teuthology.orchestra.run.smithi102.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-10-14T09:34:30.004 INFO:teuthology.orchestra.run.smithi102.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-10-14T09:34:30.024 INFO:teuthology.orchestra.run.smithi102.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-10-14T09:34:30.026 INFO:teuthology.orchestra.run.smithi102.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-10-14T09:34:30.027 INFO:teuthology.orchestra.run.smithi102.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-10-14T09:34:30.028 INFO:teuthology.orchestra.run.smithi102.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-10-14T09:34:30.031 INFO:teuthology.orchestra.run.smithi102.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-10-14T09:34:30.035 INFO:teuthology.orchestra.run.smithi102.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-10-14T09:34:30.036 INFO:teuthology.orchestra.run.smithi102.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-10-14T09:34:30.111 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2023-10-14T09:34:30.127 INFO:teuthology.orchestra.run.smithi102.stdout:============================================================================================ 2023-10-14T09:34:30.128 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2023-10-14T09:34:30.128 INFO:teuthology.orchestra.run.smithi102.stdout:============================================================================================ 2023-10-14T09:34:30.128 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2023-10-14T09:34:30.128 INFO:teuthology.orchestra.run.smithi102.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-10-14T09:34:30.128 INFO:teuthology.orchestra.run.smithi102.stdout: ceph x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 6.5 k 2023-10-14T09:34:30.129 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 5.2 M 2023-10-14T09:34:30.129 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-fuse x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 855 k 2023-10-14T09:34:30.129 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 141 k 2023-10-14T09:34:30.129 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 1.5 M 2023-10-14T09:34:30.129 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 132 k 2023-10-14T09:34:30.130 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 1.8 M 2023-10-14T09:34:30.130 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 7.4 M 2023-10-14T09:34:30.130 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-rook noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 47 k 2023-10-14T09:34:30.130 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-radosgw x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 8.6 M 2023-10-14T09:34:30.130 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-test x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 41 M 2023-10-14T09:34:30.131 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-volume noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 262 k 2023-10-14T09:34:30.131 INFO:teuthology.orchestra.run.smithi102.stdout: cephadm noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 269 k 2023-10-14T09:34:30.131 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-mirror x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 218 k 2023-10-14T09:34:30.131 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-top noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 18 k 2023-10-14T09:34:30.131 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libelf-devel x86_64 0.189-3.el9 appstream 22 k 2023-10-14T09:34:30.132 INFO:teuthology.orchestra.run.smithi102.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-10-14T09:34:30.132 INFO:teuthology.orchestra.run.smithi102.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-10-14T09:34:30.132 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-devel x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 31 k 2023-10-14T09:34:30.132 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 715 k 2023-10-14T09:34:30.132 INFO:teuthology.orchestra.run.smithi102.stdout: librados-devel x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 127 k 2023-10-14T09:34:30.133 INFO:teuthology.orchestra.run.smithi102.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-10-14T09:34:30.133 INFO:teuthology.orchestra.run.smithi102.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2023-10-14T09:34:30.133 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-devel x86_64 1:3.0.7-24.el9 appstream 4.1 M 2023-10-14T09:34:30.133 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-10-14T09:34:30.133 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-10-14T09:34:30.134 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-10-14T09:34:30.134 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cephfs x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 162 k 2023-10-14T09:34:30.134 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 321 k 2023-10-14T09:34:30.134 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rbd x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 298 k 2023-10-14T09:34:30.134 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 99 k 2023-10-14T09:34:30.135 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-fuse x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 85 k 2023-10-14T09:34:30.135 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-mirror x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 3.0 M 2023-10-14T09:34:30.135 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-nbd x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 169 k 2023-10-14T09:34:30.135 INFO:teuthology.orchestra.run.smithi102.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 appstream 86 k 2023-10-14T09:34:30.135 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrading: 2023-10-14T09:34:30.135 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager x86_64 1:1.45.4-1.el9 CentOS-BaseOS 2.2 M 2023-10-14T09:34:30.136 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-libnm x86_64 1:1.45.4-1.el9 CentOS-BaseOS 1.8 M 2023-10-14T09:34:30.136 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-team x86_64 1:1.45.4-1.el9 CentOS-BaseOS 41 k 2023-10-14T09:34:30.136 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-tui x86_64 1:1.45.4-1.el9 CentOS-BaseOS 244 k 2023-10-14T09:34:30.136 INFO:teuthology.orchestra.run.smithi102.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-10-14T09:34:30.136 INFO:teuthology.orchestra.run.smithi102.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-10-14T09:34:30.137 INFO:teuthology.orchestra.run.smithi102.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-10-14T09:34:30.137 INFO:teuthology.orchestra.run.smithi102.stdout: librados2 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 3.3 M 2023-10-14T09:34:30.137 INFO:teuthology.orchestra.run.smithi102.stdout: librbd1 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 3.0 M 2023-10-14T09:34:30.137 INFO:teuthology.orchestra.run.smithi102.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-10-14T09:34:30.138 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2023-10-14T09:34:30.138 INFO:teuthology.orchestra.run.smithi102.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2023-10-14T09:34:30.138 INFO:teuthology.orchestra.run.smithi102.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-10-14T09:34:30.138 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 19 M 2023-10-14T09:34:30.138 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 23 k 2023-10-14T09:34:30.139 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mds x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 2.1 M 2023-10-14T09:34:30.139 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 242 k 2023-10-14T09:34:30.139 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 4.4 M 2023-10-14T09:34:30.139 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-osd x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 18 M 2023-10-14T09:34:30.139 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 15 k 2023-10-14T09:34:30.140 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-selinux x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 24 k 2023-10-14T09:34:30.140 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-10-14T09:34:30.140 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-10-14T09:34:30.140 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-10-14T09:34:30.140 INFO:teuthology.orchestra.run.smithi102.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-10-14T09:34:30.141 INFO:teuthology.orchestra.run.smithi102.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-10-14T09:34:30.141 INFO:teuthology.orchestra.run.smithi102.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-10-14T09:34:30.141 INFO:teuthology.orchestra.run.smithi102.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-10-14T09:34:30.141 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-10-14T09:34:30.142 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-10-14T09:34:30.142 INFO:teuthology.orchestra.run.smithi102.stdout: libcephsqlite x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 163 k 2023-10-14T09:34:30.142 INFO:teuthology.orchestra.run.smithi102.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-10-14T09:34:30.142 INFO:teuthology.orchestra.run.smithi102.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-10-14T09:34:30.142 INFO:teuthology.orchestra.run.smithi102.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-10-14T09:34:30.143 INFO:teuthology.orchestra.run.smithi102.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-10-14T09:34:30.143 INFO:teuthology.orchestra.run.smithi102.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-10-14T09:34:30.143 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 472 k 2023-10-14T09:34:30.143 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-10-14T09:34:30.143 INFO:teuthology.orchestra.run.smithi102.stdout: librgw2 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 4.8 M 2023-10-14T09:34:30.143 INFO:teuthology.orchestra.run.smithi102.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-10-14T09:34:30.144 INFO:teuthology.orchestra.run.smithi102.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-10-14T09:34:30.144 INFO:teuthology.orchestra.run.smithi102.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-10-14T09:34:30.144 INFO:teuthology.orchestra.run.smithi102.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-10-14T09:34:30.144 INFO:teuthology.orchestra.run.smithi102.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-10-14T09:34:30.144 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-10-14T09:34:30.145 INFO:teuthology.orchestra.run.smithi102.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-10-14T09:34:30.145 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-10-14T09:34:30.145 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-10-14T09:34:30.145 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-10-14T09:34:30.145 INFO:teuthology.orchestra.run.smithi102.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-10-14T09:34:30.146 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-10-14T09:34:30.146 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 45 k 2023-10-14T09:34:30.146 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 127 k 2023-10-14T09:34:30.146 INFO:teuthology.orchestra.run.smithi102.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-10-14T09:34:30.146 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-10-14T09:34:30.147 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-10-14T09:34:30.147 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-10-14T09:34:30.147 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-10-14T09:34:30.147 INFO:teuthology.orchestra.run.smithi102.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-10-14T09:34:30.147 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth noarch 1:2.23.2-1.el9 epel 196 k 2023-10-14T09:34:30.148 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-10-14T09:34:30.148 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-10-14T09:34:30.148 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-10-14T09:34:30.148 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-10-14T09:34:30.148 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-10-14T09:34:30.149 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-10-14T09:34:30.149 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-10-14T09:34:30.149 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-10-14T09:34:30.149 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-10-14T09:34:30.149 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-10-14T09:34:30.150 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-10-14T09:34:30.150 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-10-14T09:34:30.150 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-10-14T09:34:30.150 INFO:teuthology.orchestra.run.smithi102.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-10-14T09:34:30.150 INFO:teuthology.orchestra.run.smithi102.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-10-14T09:34:30.151 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-10-14T09:34:30.151 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-10-14T09:34:30.151 INFO:teuthology.orchestra.run.smithi102.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-10-14T09:34:30.152 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-10-14T09:34:30.152 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-10-14T09:34:30.152 INFO:teuthology.orchestra.run.smithi102.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-10-14T09:34:30.152 INFO:teuthology.orchestra.run.smithi102.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-10-14T09:34:30.152 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-10-14T09:34:30.153 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-10-14T09:34:30.153 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-10-14T09:34:30.153 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-10-14T09:34:30.153 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-10-14T09:34:30.153 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-10-14T09:34:30.154 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-10-14T09:34:30.154 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-10-14T09:34:30.154 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-10-14T09:34:30.154 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-10-14T09:34:30.154 INFO:teuthology.orchestra.run.smithi102.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-10-14T09:34:30.155 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-10-14T09:34:30.155 INFO:teuthology.orchestra.run.smithi102.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-10-14T09:34:30.155 INFO:teuthology.orchestra.run.smithi102.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-10-14T09:34:30.155 INFO:teuthology.orchestra.run.smithi102.stdout: python3-urllib3 noarch 1.26.5-3.el9 CentOS-BaseOS 188 k 2023-10-14T09:34:30.155 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-10-14T09:34:30.155 INFO:teuthology.orchestra.run.smithi102.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-10-14T09:34:30.156 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-10-14T09:34:30.156 INFO:teuthology.orchestra.run.smithi102.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-10-14T09:34:30.156 INFO:teuthology.orchestra.run.smithi102.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-10-14T09:34:30.156 INFO:teuthology.orchestra.run.smithi102.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-10-14T09:34:30.156 INFO:teuthology.orchestra.run.smithi102.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-10-14T09:34:30.157 INFO:teuthology.orchestra.run.smithi102.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-10-14T09:34:30.157 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-10-14T09:34:30.157 INFO:teuthology.orchestra.run.smithi102.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2023-10-14T09:34:30.157 INFO:teuthology.orchestra.run.smithi102.stdout:Installing weak dependencies: 2023-10-14T09:34:30.157 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-10-14T09:34:30.158 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:34:30.158 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2023-10-14T09:34:30.158 INFO:teuthology.orchestra.run.smithi102.stdout:============================================================================================ 2023-10-14T09:34:30.158 INFO:teuthology.orchestra.run.smithi102.stdout:Install 133 Packages 2023-10-14T09:34:30.158 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrade 10 Packages 2023-10-14T09:34:30.159 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:34:30.160 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 199 M 2023-10-14T09:34:30.160 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2023-10-14T09:34:30.257 INFO:teuthology.orchestra.run.smithi129.stdout:(10/143): ceph-osd-18.0.0-6730.g4ba8a190.el9.x8 6.9 MB/s | 18 MB 00:02 2023-10-14T09:34:30.316 INFO:teuthology.orchestra.run.smithi129.stdout:(11/143): cephfs-mirror-18.0.0-6730.g4ba8a190.e 3.7 MB/s | 218 kB 00:00 2023-10-14T09:34:30.357 INFO:teuthology.orchestra.run.smithi129.stdout:(12/143): libcephfs-devel-18.0.0-6730.g4ba8a190 769 kB/s | 31 kB 00:00 2023-10-14T09:34:30.483 INFO:teuthology.orchestra.run.smithi129.stdout:(13/143): libcephfs2-18.0.0-6730.g4ba8a190.el9. 5.6 MB/s | 715 kB 00:00 2023-10-14T09:34:30.566 INFO:teuthology.orchestra.run.smithi129.stdout:(14/143): libcephsqlite-18.0.0-6730.g4ba8a190.e 1.9 MB/s | 163 kB 00:00 2023-10-14T09:34:31.025 INFO:teuthology.orchestra.run.smithi129.stdout:(15/143): ceph-test-18.0.0-6730.g4ba8a190.el9.x 17 MB/s | 41 MB 00:02 2023-10-14T09:34:31.050 INFO:teuthology.orchestra.run.smithi129.stdout:(16/143): librados-devel-18.0.0-6730.g4ba8a190. 262 kB/s | 127 kB 00:00 2023-10-14T09:34:31.175 INFO:teuthology.orchestra.run.smithi129.stdout:(17/143): ceph-base-18.0.0-6730.g4ba8a190.el9.x 1.1 MB/s | 5.2 MB 00:04 2023-10-14T09:34:31.217 INFO:teuthology.orchestra.run.smithi129.stdout:(18/143): libradosstriper1-18.0.0-6730.g4ba8a19 2.4 MB/s | 472 kB 00:00 2023-10-14T09:34:31.276 INFO:teuthology.orchestra.run.smithi129.stdout:(19/143): python3-ceph-common-18.0.0-6730.g4ba8 2.1 MB/s | 127 kB 00:00 2023-10-14T09:34:31.301 INFO:teuthology.orchestra.run.smithi129.stdout:(20/143): python3-ceph-argparse-18.0.0-6730.g4b 362 kB/s | 45 kB 00:00 2023-10-14T09:34:31.335 INFO:teuthology.orchestra.run.smithi129.stdout:(21/143): python3-cephfs-18.0.0-6730.g4ba8a190. 2.8 MB/s | 162 kB 00:00 2023-10-14T09:34:31.410 INFO:teuthology.orchestra.run.smithi129.stdout:(22/143): python3-rbd-18.0.0-6730.g4ba8a190.el9 3.9 MB/s | 298 kB 00:00 2023-10-14T09:34:31.510 INFO:teuthology.orchestra.run.smithi129.stdout:(23/143): librgw2-18.0.0-6730.g4ba8a190.el9.x86 10 MB/s | 4.8 MB 00:00 2023-10-14T09:34:31.544 INFO:teuthology.orchestra.run.smithi129.stdout:(24/143): python3-rgw-18.0.0-6730.g4ba8a190.el9 750 kB/s | 99 kB 00:00 2023-10-14T09:34:31.569 INFO:teuthology.orchestra.run.smithi129.stdout:(25/143): rbd-fuse-18.0.0-6730.g4ba8a190.el9.x8 1.4 MB/s | 85 kB 00:00 2023-10-14T09:34:31.581 INFO:teuthology.orchestra.run.smithi102.stdout:(1/143): ceph-18.0.0-6730.g4ba8a190.el9.x86_64. 16 kB/s | 6.5 kB 00:00 2023-10-14T09:34:31.611 INFO:teuthology.orchestra.run.smithi129.stdout:(26/143): python3-rados-18.0.0-6730.g4ba8a190.e 1.0 MB/s | 321 kB 00:00 2023-10-14T09:34:31.645 INFO:teuthology.orchestra.run.smithi129.stdout:(27/143): rbd-nbd-18.0.0-6730.g4ba8a190.el9.x86 2.2 MB/s | 169 kB 00:00 2023-10-14T09:34:31.745 INFO:teuthology.orchestra.run.smithi129.stdout:(28/143): ceph-mgr-cephadm-18.0.0-6730.g4ba8a19 1.3 MB/s | 132 kB 00:00 2023-10-14T09:34:31.889 INFO:teuthology.orchestra.run.smithi102.stdout:(2/143): ceph-base-18.0.0-6730.g4ba8a190.el9.x8 7.2 MB/s | 5.2 MB 00:00 2023-10-14T09:34:31.912 INFO:teuthology.orchestra.run.smithi129.stdout:(29/143): rbd-mirror-18.0.0-6730.g4ba8a190.el9. 8.2 MB/s | 3.0 MB 00:00 2023-10-14T09:34:31.939 INFO:teuthology.orchestra.run.smithi102.stdout:(3/143): ceph-immutable-object-cache-18.0.0-673 2.8 MB/s | 141 kB 00:00 2023-10-14T09:34:31.981 INFO:teuthology.orchestra.run.smithi129.stdout:(30/143): ceph-mgr-dashboard-18.0.0-6730.g4ba8a 7.5 MB/s | 1.8 MB 00:00 2023-10-14T09:34:32.206 INFO:teuthology.orchestra.run.smithi102.stdout:(4/143): ceph-mds-18.0.0-6730.g4ba8a190.el9.x86 7.8 MB/s | 2.1 MB 00:00 2023-10-14T09:34:32.398 INFO:teuthology.orchestra.run.smithi129.stdout:(31/143): ceph-mgr-diskprediction-local-18.0.0- 15 MB/s | 7.4 MB 00:00 2023-10-14T09:34:32.423 INFO:teuthology.orchestra.run.smithi102.stdout:(5/143): ceph-mgr-18.0.0-6730.g4ba8a190.el9.x86 6.8 MB/s | 1.5 MB 00:00 2023-10-14T09:34:32.424 INFO:teuthology.orchestra.run.smithi129.stdout:(32/143): ceph-grafana-dashboards-18.0.0-6730.g 29 kB/s | 23 kB 00:00 2023-10-14T09:34:32.474 INFO:teuthology.orchestra.run.smithi129.stdout:(33/143): ceph-mgr-modules-core-18.0.0-6730.g4b 493 kB/s | 242 kB 00:00 2023-10-14T09:34:32.491 INFO:teuthology.orchestra.run.smithi129.stdout:(34/143): ceph-prometheus-alerts-18.0.0-6730.g4 227 kB/s | 15 kB 00:00 2023-10-14T09:34:32.508 INFO:teuthology.orchestra.run.smithi129.stdout:(35/143): ceph-mgr-rook-18.0.0-6730.g4ba8a190.e 438 kB/s | 47 kB 00:00 2023-10-14T09:34:32.542 INFO:teuthology.orchestra.run.smithi129.stdout:(36/143): ceph-volume-18.0.0-6730.g4ba8a190.el9 3.8 MB/s | 262 kB 00:00 2023-10-14T09:34:32.576 INFO:teuthology.orchestra.run.smithi129.stdout:(37/143): cephadm-18.0.0-6730.g4ba8a190.el9.noa 3.2 MB/s | 269 kB 00:00 2023-10-14T09:34:32.807 INFO:teuthology.orchestra.run.smithi102.stdout:(6/143): ceph-mon-18.0.0-6730.g4ba8a190.el9.x86 11 MB/s | 4.4 MB 00:00 2023-10-14T09:34:32.834 INFO:teuthology.orchestra.run.smithi129.stdout:(38/143): cephfs-top-18.0.0-6730.g4ba8a190.el9. 56 kB/s | 18 kB 00:00 2023-10-14T09:34:32.857 INFO:teuthology.orchestra.run.smithi102.stdout:(7/143): ceph-fuse-18.0.0-6730.g4ba8a190.el9.x8 671 kB/s | 855 kB 00:01 2023-10-14T09:34:32.901 INFO:teuthology.orchestra.run.smithi129.stdout:(39/143): boost-program-options-1.75.0-8.el9.x8 326 kB/s | 106 kB 00:00 2023-10-14T09:34:33.060 INFO:teuthology.orchestra.run.smithi129.stdout:(40/143): bison-3.7.4-5.el9.x86_64.rpm 1.7 MB/s | 920 kB 00:00 2023-10-14T09:34:33.093 INFO:teuthology.orchestra.run.smithi129.stdout:(41/143): flex-2.6.4-9.el9.x86_64.rpm 1.2 MB/s | 307 kB 00:00 2023-10-14T09:34:33.119 INFO:teuthology.orchestra.run.smithi129.stdout:(42/143): flexiblas-3.0.4-8.el9.x86_64.rpm 147 kB/s | 32 kB 00:00 2023-10-14T09:34:33.353 INFO:teuthology.orchestra.run.smithi129.stdout:(43/143): flexiblas-netlib-3.0.4-8.el9.x86_64.r 10 MB/s | 3.0 MB 00:00 2023-10-14T09:34:33.377 INFO:teuthology.orchestra.run.smithi129.stdout:(44/143): flexiblas-openblas-openmp-3.0.4-8.el9 67 kB/s | 17 kB 00:00 2023-10-14T09:34:33.402 INFO:teuthology.orchestra.run.smithi129.stdout:(45/143): libaio-devel-0.3.111-13.el9.x86_64.rp 36 kB/s | 10 kB 00:00 2023-10-14T09:34:33.503 INFO:teuthology.orchestra.run.smithi129.stdout:(46/143): libtool-2.4.6-45.el9.x86_64.rpm 5.7 MB/s | 578 kB 00:00 2023-10-14T09:34:33.536 INFO:teuthology.orchestra.run.smithi129.stdout:(47/143): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 159 kB 00:00 2023-10-14T09:34:33.578 INFO:teuthology.orchestra.run.smithi129.stdout:(48/143): librdkafka-1.6.1-102.el9.x86_64.rpm 3.7 MB/s | 661 kB 00:00 2023-10-14T09:34:33.604 INFO:teuthology.orchestra.run.smithi129.stdout:(49/143): libzstd-devel-1.5.1-2.el9.x86_64.rpm 477 kB/s | 46 kB 00:00 2023-10-14T09:34:33.654 INFO:teuthology.orchestra.run.smithi129.stdout:(50/143): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 282 kB 00:00 2023-10-14T09:34:33.687 INFO:teuthology.orchestra.run.smithi129.stdout:(51/143): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.0 MB/s | 217 kB 00:00 2023-10-14T09:34:33.713 INFO:teuthology.orchestra.run.smithi129.stdout:(52/143): openblas-0.3.21-2.el9.x86_64.rpm 315 kB/s | 34 kB 00:00 2023-10-14T09:34:33.941 INFO:teuthology.orchestra.run.smithi102.stdout:(8/143): ceph-osd-18.0.0-6730.g4ba8a190.el9.x86 16 MB/s | 18 MB 00:01 2023-10-14T09:34:33.963 INFO:teuthology.orchestra.run.smithi129.stdout:(53/143): openblas-openmp-0.3.21-2.el9.x86_64.r 15 MB/s | 4.7 MB 00:00 2023-10-14T09:34:33.991 INFO:teuthology.orchestra.run.smithi102.stdout:(9/143): ceph-selinux-18.0.0-6730.g4ba8a190.el9 491 kB/s | 24 kB 00:00 2023-10-14T09:34:34.013 INFO:teuthology.orchestra.run.smithi129.stdout:(54/143): postgresql-contrib-13.11-1.el9.x86_64 2.8 MB/s | 811 kB 00:00 2023-10-14T09:34:34.105 INFO:teuthology.orchestra.run.smithi129.stdout:(55/143): postgresql-13.11-1.el9.x86_64.rpm 4.0 MB/s | 1.5 MB 00:00 2023-10-14T09:34:34.130 INFO:teuthology.orchestra.run.smithi129.stdout:(56/143): postgresql-private-libs-13.11-1.el9.x 813 kB/s | 134 kB 00:00 2023-10-14T09:34:34.305 INFO:teuthology.orchestra.run.smithi129.stdout:(57/143): postgresql-server-13.11-1.el9.x86_64. 20 MB/s | 5.7 MB 00:00 2023-10-14T09:34:34.339 INFO:teuthology.orchestra.run.smithi129.stdout:(58/143): python3-devel-3.9.17-2.el9.x86_64.rpm 1.0 MB/s | 205 kB 00:00 2023-10-14T09:34:34.514 INFO:teuthology.orchestra.run.smithi129.stdout:(59/143): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 5.8 MB 00:00 2023-10-14T09:34:34.539 INFO:teuthology.orchestra.run.smithi129.stdout:(60/143): python3-jinja2-2.11.3-4.el9.noarch.rp 986 kB/s | 228 kB 00:00 2023-10-14T09:34:34.565 INFO:teuthology.orchestra.run.smithi129.stdout:(61/143): python3-jsonpatch-1.21-16.el9.noarch. 115 kB/s | 24 kB 00:00 2023-10-14T09:34:34.590 INFO:teuthology.orchestra.run.smithi129.stdout:(62/143): python3-jsonpointer-2.0-4.el9.noarch. 250 kB/s | 18 kB 00:00 2023-10-14T09:34:34.624 INFO:teuthology.orchestra.run.smithi129.stdout:(63/143): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 144 kB 00:00 2023-10-14T09:34:34.649 INFO:teuthology.orchestra.run.smithi129.stdout:(64/143): python3-markupsafe-1.1.1-12.el9.x86_6 383 kB/s | 32 kB 00:00 2023-10-14T09:34:34.883 INFO:teuthology.orchestra.run.smithi129.stdout:(65/143): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 4.8 MB 00:00 2023-10-14T09:34:34.908 INFO:teuthology.orchestra.run.smithi129.stdout:(66/143): python3-numpy-f2py-1.20.1-5.el9.x86_6 772 kB/s | 217 kB 00:00 2023-10-14T09:34:35.014 INFO:teuthology.orchestra.run.smithi129.stdout:(67/143): python3-oauthlib-3.1.1-5.el9.noarch.r 650 kB/s | 174 kB 00:00 2023-10-14T09:34:35.014 INFO:teuthology.orchestra.run.smithi129.stdout:(68/143): python3-prettytable-0.7.2-27.el9.noar 841 kB/s | 41 kB 00:00 2023-10-14T09:34:35.017 INFO:teuthology.orchestra.run.smithi129.stdout:(69/143): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 132 kB 00:00 2023-10-14T09:34:35.042 INFO:teuthology.orchestra.run.smithi129.stdout:(70/143): python3-pyasn1-modules-0.4.8-6.el9.no 1.9 MB/s | 211 kB 00:00 2023-10-14T09:34:35.059 INFO:teuthology.orchestra.run.smithi129.stdout:(71/143): python3-requests-oauthlib-1.3.0-12.el 594 kB/s | 43 kB 00:00 2023-10-14T09:34:35.109 INFO:teuthology.orchestra.run.smithi129.stdout:(72/143): python3-toml-0.10.2-6.el9.noarch.rpm 592 kB/s | 39 kB 00:00 2023-10-14T09:34:35.418 INFO:teuthology.orchestra.run.smithi129.stdout:(73/143): socat-1.7.4.1-5.el9.x86_64.rpm 837 kB/s | 300 kB 00:00 2023-10-14T09:34:35.727 INFO:teuthology.orchestra.run.smithi129.stdout:(74/143): python3-scipy-1.6.2-8.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2023-10-14T09:34:35.752 INFO:teuthology.orchestra.run.smithi129.stdout:(75/143): uuid-1.6.2-55.el9.x86_64.rpm 90 kB/s | 56 kB 00:00 2023-10-14T09:34:35.777 INFO:teuthology.orchestra.run.smithi129.stdout:(76/143): xmlstarlet-1.6.1-20.el9.x86_64.rpm 181 kB/s | 63 kB 00:00 2023-10-14T09:34:35.794 INFO:teuthology.orchestra.run.smithi129.stdout:(77/143): fuse-2.9.9-15.el9.x86_64.rpm 1.2 MB/s | 79 kB 00:00 2023-10-14T09:34:35.853 INFO:teuthology.orchestra.run.smithi129.stdout:(78/143): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.6 MB/s | 195 kB 00:00 2023-10-14T09:34:35.894 INFO:teuthology.orchestra.run.smithi129.stdout:(79/143): libgfortran-11.4.1-2.3.el9.x86_64.rpm 6.8 MB/s | 803 kB 00:00 2023-10-14T09:34:35.919 INFO:teuthology.orchestra.run.smithi129.stdout:(80/143): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.9 MB/s | 241 kB 00:00 2023-10-14T09:34:35.945 INFO:teuthology.orchestra.run.smithi129.stdout:(81/143): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2023-10-14T09:34:35.987 INFO:teuthology.orchestra.run.smithi129.stdout:(82/143): python3-requests-2.25.1-7.el9.noarch. 1.7 MB/s | 113 kB 00:00 2023-10-14T09:34:36.017 INFO:teuthology.orchestra.run.smithi102.stdout:(10/143): ceph-test-18.0.0-6730.g4ba8a190.el9.x 20 MB/s | 41 MB 00:02 2023-10-14T09:34:36.020 INFO:teuthology.orchestra.run.smithi129.stdout:(83/143): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 124 kB 00:00 2023-10-14T09:34:36.046 INFO:teuthology.orchestra.run.smithi129.stdout:(84/143): python3-urllib3-1.26.5-3.el9.noarch.r 1.8 MB/s | 188 kB 00:00 2023-10-14T09:34:36.083 INFO:teuthology.orchestra.run.smithi102.stdout:(11/143): cephfs-mirror-18.0.0-6730.g4ba8a190.e 3.3 MB/s | 218 kB 00:00 2023-10-14T09:34:36.125 INFO:teuthology.orchestra.run.smithi102.stdout:(12/143): libcephfs-devel-18.0.0-6730.g4ba8a190 768 kB/s | 31 kB 00:00 2023-10-14T09:34:36.137 INFO:teuthology.orchestra.run.smithi129.stdout:(85/143): elfutils-libelf-devel-0.189-3.el9.x86 247 kB/s | 22 kB 00:00 2023-10-14T09:34:36.209 INFO:teuthology.orchestra.run.smithi102.stdout:(13/143): libcephfs2-18.0.0-6730.g4ba8a190.el9. 8.4 MB/s | 715 kB 00:00 2023-10-14T09:34:36.246 INFO:teuthology.orchestra.run.smithi129.stdout:(86/143): jq-1.6-15.el9.x86_64.rpm 1.7 MB/s | 187 kB 00:00 2023-10-14T09:34:36.259 INFO:teuthology.orchestra.run.smithi102.stdout:(14/143): libcephsqlite-18.0.0-6730.g4ba8a190.e 3.2 MB/s | 163 kB 00:00 2023-10-14T09:34:36.288 INFO:teuthology.orchestra.run.smithi129.stdout:(87/143): automake-1.16.2-8.el9.noarch.rpm 2.8 MB/s | 689 kB 00:00 2023-10-14T09:34:36.310 INFO:teuthology.orchestra.run.smithi102.stdout:(15/143): librados-devel-18.0.0-6730.g4ba8a190. 2.5 MB/s | 127 kB 00:00 2023-10-14T09:34:36.314 INFO:teuthology.orchestra.run.smithi129.stdout:(88/143): librabbitmq-0.11.0-7.el9.x86_64.rpm 684 kB/s | 45 kB 00:00 2023-10-14T09:34:36.339 INFO:teuthology.orchestra.run.smithi129.stdout:(89/143): libuuid-devel-2.37.4-15.el9.x86_64.rp 515 kB/s | 26 kB 00:00 2023-10-14T09:34:36.368 INFO:teuthology.orchestra.run.smithi102.stdout:(16/143): libradosstriper1-18.0.0-6730.g4ba8a19 8.0 MB/s | 472 kB 00:00 2023-10-14T09:34:36.389 INFO:teuthology.orchestra.run.smithi129.stdout:(90/143): python3-cryptography-36.0.1-4.el9.x86 3.1 MB/s | 1.2 MB 00:00 2023-10-14T09:34:36.415 INFO:teuthology.orchestra.run.smithi129.stdout:(91/143): python3-pytz-2021.1-5.el9.noarch.rpm 685 kB/s | 51 kB 00:00 2023-10-14T09:34:36.440 INFO:teuthology.orchestra.run.smithi129.stdout:(92/143): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.7 MB/s | 86 kB 00:00 2023-10-14T09:34:36.465 INFO:teuthology.orchestra.run.smithi129.stdout:(93/143): zlib-devel-1.2.11-40.el9.x86_64.rpm 913 kB/s | 45 kB 00:00 2023-10-14T09:34:36.591 INFO:teuthology.orchestra.run.smithi129.stdout:(94/143): openssl-devel-3.0.7-24.el9.x86_64.rpm 15 MB/s | 4.1 MB 00:00 2023-10-14T09:34:36.660 INFO:teuthology.orchestra.run.smithi102.stdout:(17/143): librgw2-18.0.0-6730.g4ba8a190.el9.x86 16 MB/s | 4.8 MB 00:00 2023-10-14T09:34:36.710 INFO:teuthology.orchestra.run.smithi102.stdout:(18/143): python3-ceph-argparse-18.0.0-6730.g4b 922 kB/s | 45 kB 00:00 2023-10-14T09:34:36.761 INFO:teuthology.orchestra.run.smithi102.stdout:(19/143): python3-ceph-common-18.0.0-6730.g4ba8 2.5 MB/s | 127 kB 00:00 2023-10-14T09:34:36.811 INFO:teuthology.orchestra.run.smithi102.stdout:(20/143): python3-cephfs-18.0.0-6730.g4ba8a190. 3.2 MB/s | 162 kB 00:00 2023-10-14T09:34:36.869 INFO:teuthology.orchestra.run.smithi102.stdout:(21/143): python3-rados-18.0.0-6730.g4ba8a190.e 5.5 MB/s | 321 kB 00:00 2023-10-14T09:34:36.899 INFO:teuthology.orchestra.run.smithi129.stdout:(95/143): fmt-8.1.1-5.el9.x86_64.rpm 242 kB/s | 111 kB 00:00 2023-10-14T09:34:36.928 INFO:teuthology.orchestra.run.smithi102.stdout:(22/143): python3-rbd-18.0.0-6730.g4ba8a190.el9 5.0 MB/s | 298 kB 00:00 2023-10-14T09:34:36.979 INFO:teuthology.orchestra.run.smithi102.stdout:(23/143): python3-rgw-18.0.0-6730.g4ba8a190.el9 2.0 MB/s | 99 kB 00:00 2023-10-14T09:34:37.008 INFO:teuthology.orchestra.run.smithi129.stdout:(96/143): libarrow-doc-9.0.0-9.el9.noarch.rpm 226 kB/s | 24 kB 00:00 2023-10-14T09:34:37.029 INFO:teuthology.orchestra.run.smithi102.stdout:(24/143): rbd-fuse-18.0.0-6730.g4ba8a190.el9.x8 1.7 MB/s | 85 kB 00:00 2023-10-14T09:34:37.041 INFO:teuthology.orchestra.run.smithi129.stdout:(97/143): gperftools-libs-2.9.1-2.el9.x86_64.rp 537 kB/s | 309 kB 00:00 2023-10-14T09:34:37.166 INFO:teuthology.orchestra.run.smithi129.stdout:(98/143): liboath-2.6.7-2.el9.x86_64.rpm 309 kB/s | 49 kB 00:00 2023-10-14T09:34:37.192 INFO:teuthology.orchestra.run.smithi129.stdout:(99/143): libunwind-1.6.2-1.el9.x86_64.rpm 450 kB/s | 67 kB 00:00 2023-10-14T09:34:37.229 INFO:teuthology.orchestra.run.smithi102.stdout:(25/143): rbd-mirror-18.0.0-6730.g4ba8a190.el9. 15 MB/s | 3.0 MB 00:00 2023-10-14T09:34:37.280 INFO:teuthology.orchestra.run.smithi102.stdout:(26/143): rbd-nbd-18.0.0-6730.g4ba8a190.el9.x86 3.4 MB/s | 169 kB 00:00 2023-10-14T09:34:37.330 INFO:teuthology.orchestra.run.smithi102.stdout:(27/143): ceph-grafana-dashboards-18.0.0-6730.g 473 kB/s | 23 kB 00:00 2023-10-14T09:34:37.380 INFO:teuthology.orchestra.run.smithi102.stdout:(28/143): ceph-mgr-cephadm-18.0.0-6730.g4ba8a19 2.6 MB/s | 132 kB 00:00 2023-10-14T09:34:37.442 INFO:teuthology.orchestra.run.smithi129.stdout:(100/143): python3-asyncssh-2.13.2-3.el9.noarch 2.1 MB/s | 548 kB 00:00 2023-10-14T09:34:37.505 INFO:teuthology.orchestra.run.smithi102.stdout:(29/143): ceph-mgr-dashboard-18.0.0-6730.g4ba8a 14 MB/s | 1.8 MB 00:00 2023-10-14T09:34:37.551 INFO:teuthology.orchestra.run.smithi129.stdout:(101/143): libarrow-9.0.0-9.el9.x86_64.rpm 4.6 MB/s | 4.4 MB 00:00 2023-10-14T09:34:37.585 INFO:teuthology.orchestra.run.smithi129.stdout:(102/143): python3-bcrypt-3.2.2-1.el9.x86_64.rp 307 kB/s | 43 kB 00:00 2023-10-14T09:34:37.635 INFO:teuthology.orchestra.run.smithi129.stdout:(103/143): parquet-libs-9.0.0-9.el9.x86_64.rpm 1.7 MB/s | 837 kB 00:00 2023-10-14T09:34:37.652 INFO:teuthology.orchestra.run.smithi129.stdout:(104/143): python3-cachetools-4.2.4-1.el9.noarc 322 kB/s | 32 kB 00:00 2023-10-14T09:34:37.669 INFO:teuthology.orchestra.run.smithi129.stdout:(105/143): python3-certifi-2021.10.8-2.el9.noar 180 kB/s | 15 kB 00:00 2023-10-14T09:34:37.752 INFO:teuthology.orchestra.run.smithi129.stdout:(106/143): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2023-10-14T09:34:37.786 INFO:teuthology.orchestra.run.smithi129.stdout:(107/143): python3-google-auth-2.23.2-1.el9.noa 1.6 MB/s | 196 kB 00:00 2023-10-14T09:34:37.820 INFO:teuthology.orchestra.run.smithi129.stdout:(108/143): python3-cherrypy-18.6.1-2.el9.noarch 2.1 MB/s | 358 kB 00:00 2023-10-14T09:34:37.837 INFO:teuthology.orchestra.run.smithi129.stdout:(109/143): python3-jaraco-8.2.1-3.el9.noarch.rp 129 kB/s | 11 kB 00:00 2023-10-14T09:34:37.862 INFO:teuthology.orchestra.run.smithi129.stdout:(110/143): python3-jaraco-classes-3.2.1-5.el9.n 236 kB/s | 18 kB 00:00 2023-10-14T09:34:37.895 INFO:teuthology.orchestra.run.smithi129.stdout:(111/143): python3-jaraco-collections-3.0.0-8.e 309 kB/s | 23 kB 00:00 2023-10-14T09:34:37.906 INFO:teuthology.orchestra.run.smithi102.stdout:(30/143): ceph-mgr-diskprediction-local-18.0.0- 19 MB/s | 7.4 MB 00:00 2023-10-14T09:34:37.921 INFO:teuthology.orchestra.run.smithi129.stdout:(112/143): python3-jaraco-functools-3.5.0-2.el9 233 kB/s | 19 kB 00:00 2023-10-14T09:34:37.946 INFO:teuthology.orchestra.run.smithi129.stdout:(113/143): python3-jaraco-text-3.2.0-6.el9.noar 236 kB/s | 20 kB 00:00 2023-10-14T09:34:37.956 INFO:teuthology.orchestra.run.smithi102.stdout:(31/143): ceph-mgr-modules-core-18.0.0-6730.g4b 4.8 MB/s | 242 kB 00:00 2023-10-14T09:34:37.971 INFO:teuthology.orchestra.run.smithi129.stdout:(114/143): python3-jwt+crypto-2.4.0-1.el9.noarc 121 kB/s | 9.0 kB 00:00 2023-10-14T09:34:37.997 INFO:teuthology.orchestra.run.smithi129.stdout:(115/143): python3-jwt-2.4.0-1.el9.noarch.rpm 547 kB/s | 41 kB 00:00 2023-10-14T09:34:38.006 INFO:teuthology.orchestra.run.smithi102.stdout:(32/143): ceph-mgr-rook-18.0.0-6730.g4ba8a190.e 964 kB/s | 47 kB 00:00 2023-10-14T09:34:38.057 INFO:teuthology.orchestra.run.smithi102.stdout:(33/143): ceph-prometheus-alerts-18.0.0-6730.g4 307 kB/s | 15 kB 00:00 2023-10-14T09:34:38.072 INFO:teuthology.orchestra.run.smithi129.stdout:(116/143): python3-kubernetes-26.1.0-2.el9.noar 8.2 MB/s | 1.0 MB 00:00 2023-10-14T09:34:38.097 INFO:teuthology.orchestra.run.smithi129.stdout:(117/143): python3-logutils-0.3.5-21.el9.noarch 370 kB/s | 46 kB 00:00 2023-10-14T09:34:38.115 INFO:teuthology.orchestra.run.smithi102.stdout:(34/143): ceph-volume-18.0.0-6730.g4ba8a190.el9 4.4 MB/s | 262 kB 00:00 2023-10-14T09:34:38.122 INFO:teuthology.orchestra.run.smithi129.stdout:(118/143): python3-more-itertools-8.12.0-2.el9. 630 kB/s | 79 kB 00:00 2023-10-14T09:34:38.156 INFO:teuthology.orchestra.run.smithi129.stdout:(119/143): python3-natsort-7.1.1-5.el9.noarch.r 695 kB/s | 58 kB 00:00 2023-10-14T09:34:38.174 INFO:teuthology.orchestra.run.smithi102.stdout:(35/143): cephadm-18.0.0-6730.g4ba8a190.el9.noa 4.6 MB/s | 269 kB 00:00 2023-10-14T09:34:38.198 INFO:teuthology.orchestra.run.smithi129.stdout:(120/143): python3-pecan-1.4.2-3.el9.noarch.rpm 2.7 MB/s | 272 kB 00:00 2023-10-14T09:34:38.224 INFO:teuthology.orchestra.run.smithi102.stdout:(36/143): cephfs-top-18.0.0-6730.g4ba8a190.el9. 368 kB/s | 18 kB 00:00 2023-10-14T09:34:38.240 INFO:teuthology.orchestra.run.smithi129.stdout:(121/143): python3-portend-3.1.0-2.el9.noarch.r 141 kB/s | 16 kB 00:00 2023-10-14T09:34:38.265 INFO:teuthology.orchestra.run.smithi129.stdout:(122/143): python3-pyOpenSSL-21.0.0-1.el9.noarc 831 kB/s | 90 kB 00:00 2023-10-14T09:34:38.290 INFO:teuthology.orchestra.run.smithi129.stdout:(123/143): python3-repoze-lru-0.7-16.el9.noarch 336 kB/s | 31 kB 00:00 2023-10-14T09:34:38.349 INFO:teuthology.orchestra.run.smithi129.stdout:(124/143): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2023-10-14T09:34:38.374 INFO:teuthology.orchestra.run.smithi129.stdout:(125/143): python3-tempora-5.0.0-2.el9.noarch.r 430 kB/s | 36 kB 00:00 2023-10-14T09:34:38.400 INFO:teuthology.orchestra.run.smithi129.stdout:(126/143): python3-rsa-4.9-2.el9.noarch.rpm 443 kB/s | 59 kB 00:00 2023-10-14T09:34:38.433 INFO:teuthology.orchestra.run.smithi129.stdout:(127/143): python3-typing-extensions-4.4.0-2.el 613 kB/s | 51 kB 00:00 2023-10-14T09:34:38.475 INFO:teuthology.orchestra.run.smithi129.stdout:(128/143): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2023-10-14T09:34:38.500 INFO:teuthology.orchestra.run.smithi129.stdout:(129/143): python3-websocket-client-1.2.3-2.el9 897 kB/s | 90 kB 00:00 2023-10-14T09:34:38.559 INFO:teuthology.orchestra.run.smithi129.stdout:(130/143): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2023-10-14T09:34:38.584 INFO:teuthology.orchestra.run.smithi129.stdout:(131/143): python3-zc-lockfile-2.0-10.el9.noarc 185 kB/s | 20 kB 00:00 2023-10-14T09:34:38.618 INFO:teuthology.orchestra.run.smithi129.stdout:(132/143): re2-20211101-3.el9.x86_64.rpm 1.6 MB/s | 192 kB 00:00 2023-10-14T09:34:38.669 INFO:teuthology.orchestra.run.smithi102.stdout:(37/143): bison-3.7.4-5.el9.x86_64.rpm 2.0 MB/s | 920 kB 00:00 2023-10-14T09:34:38.735 INFO:teuthology.orchestra.run.smithi102.stdout:(38/143): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 106 kB 00:00 2023-10-14T09:34:38.810 INFO:teuthology.orchestra.run.smithi129.stdout:(133/143): thrift-0.15.0-2.el9.x86_64.rpm 6.3 MB/s | 1.6 MB 00:00 2023-10-14T09:34:38.835 INFO:teuthology.orchestra.run.smithi102.stdout:(39/143): flex-2.6.4-9.el9.x86_64.rpm 3.1 MB/s | 307 kB 00:00 2023-10-14T09:34:38.877 INFO:teuthology.orchestra.run.smithi129.stdout:(134/143): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.0 MB/s | 68 kB 00:00 2023-10-14T09:34:39.002 INFO:teuthology.orchestra.run.smithi129.stdout:(135/143): librados2-18.0.0-6730.g4ba8a190.el9. 7.9 MB/s | 3.3 MB 00:00 2023-10-14T09:34:39.011 INFO:teuthology.orchestra.run.smithi102.stdout:(40/143): flexiblas-3.0.4-8.el9.x86_64.rpm 187 kB/s | 32 kB 00:00 2023-10-14T09:34:39.119 INFO:teuthology.orchestra.run.smithi129.stdout:(136/143): NetworkManager-1.45.4-1.el9.x86_64.r 9.3 MB/s | 2.2 MB 00:00 2023-10-14T09:34:39.278 INFO:teuthology.orchestra.run.smithi102.stdout:(41/143): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2023-10-14T09:34:39.286 INFO:teuthology.orchestra.run.smithi129.stdout:(137/143): NetworkManager-libnm-1.45.4-1.el9.x8 6.6 MB/s | 1.8 MB 00:00 2023-10-14T09:34:39.311 INFO:teuthology.orchestra.run.smithi129.stdout:(138/143): NetworkManager-team-1.45.4-1.el9.x86 222 kB/s | 41 kB 00:00 2023-10-14T09:34:39.328 INFO:teuthology.orchestra.run.smithi102.stdout:(42/143): flexiblas-openblas-openmp-3.0.4-8.el9 349 kB/s | 17 kB 00:00 2023-10-14T09:34:39.378 INFO:teuthology.orchestra.run.smithi129.stdout:(139/143): NetworkManager-tui-1.45.4-1.el9.x86_ 3.6 MB/s | 244 kB 00:00 2023-10-14T09:34:39.386 INFO:teuthology.orchestra.run.smithi102.stdout:(43/143): libaio-devel-0.3.111-13.el9.x86_64.rp 175 kB/s | 10 kB 00:00 2023-10-14T09:34:39.404 INFO:teuthology.orchestra.run.smithi129.stdout:(140/143): acl-2.3.1-4.el9.x86_64.rpm 759 kB/s | 69 kB 00:00 2023-10-14T09:34:39.429 INFO:teuthology.orchestra.run.smithi129.stdout:(141/143): libacl-2.3.1-4.el9.x86_64.rpm 447 kB/s | 22 kB 00:00 2023-10-14T09:34:39.453 INFO:teuthology.orchestra.run.smithi102.stdout:(44/143): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.4 MB/s | 159 kB 00:00 2023-10-14T09:34:39.479 INFO:teuthology.orchestra.run.smithi129.stdout:(142/143): xfsdump-3.1.12-4.el9.x86_64.rpm 4.2 MB/s | 321 kB 00:00 2023-10-14T09:34:39.529 INFO:teuthology.orchestra.run.smithi102.stdout:(45/143): librdkafka-1.6.1-102.el9.x86_64.rpm 8.7 MB/s | 661 kB 00:00 2023-10-14T09:34:39.596 INFO:teuthology.orchestra.run.smithi102.stdout:(46/143): libtool-2.4.6-45.el9.x86_64.rpm 8.6 MB/s | 578 kB 00:00 2023-10-14T09:34:39.646 INFO:teuthology.orchestra.run.smithi102.stdout:(47/143): libzstd-devel-1.5.1-2.el9.x86_64.rpm 944 kB/s | 46 kB 00:00 2023-10-14T09:34:39.705 INFO:teuthology.orchestra.run.smithi102.stdout:(48/143): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2023-10-14T09:34:39.763 INFO:teuthology.orchestra.run.smithi102.stdout:(49/143): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.7 MB/s | 217 kB 00:00 2023-10-14T09:34:39.814 INFO:teuthology.orchestra.run.smithi102.stdout:(50/143): openblas-0.3.21-2.el9.x86_64.rpm 695 kB/s | 34 kB 00:00 2023-10-14T09:34:40.056 INFO:teuthology.orchestra.run.smithi102.stdout:(51/143): openblas-openmp-0.3.21-2.el9.x86_64.r 20 MB/s | 4.7 MB 00:00 2023-10-14T09:34:40.165 INFO:teuthology.orchestra.run.smithi102.stdout:(52/143): postgresql-13.11-1.el9.x86_64.rpm 14 MB/s | 1.5 MB 00:00 2023-10-14T09:34:40.248 INFO:teuthology.orchestra.run.smithi102.stdout:(53/143): postgresql-contrib-13.11-1.el9.x86_64 9.7 MB/s | 811 kB 00:00 2023-10-14T09:34:40.308 INFO:teuthology.orchestra.run.smithi102.stdout:(54/143): postgresql-private-libs-13.11-1.el9.x 2.3 MB/s | 134 kB 00:00 2023-10-14T09:34:40.598 INFO:teuthology.orchestra.run.smithi102.stdout:(55/143): postgresql-server-13.11-1.el9.x86_64. 20 MB/s | 5.7 MB 00:00 2023-10-14T09:34:40.857 INFO:teuthology.orchestra.run.smithi102.stdout:(56/143): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 5.8 MB 00:00 2023-10-14T09:34:40.909 INFO:teuthology.orchestra.run.smithi102.stdout:(57/143): python3-devel-3.9.17-2.el9.x86_64.rpm 4.0 MB/s | 205 kB 00:00 2023-10-14T09:34:40.975 INFO:teuthology.orchestra.run.smithi102.stdout:(58/143): python3-jinja2-2.11.3-4.el9.noarch.rp 3.4 MB/s | 228 kB 00:00 2023-10-14T09:34:41.126 INFO:teuthology.orchestra.run.smithi102.stdout:(59/143): ceph-radosgw-18.0.0-6730.g4ba8a190.el 1.0 MB/s | 8.6 MB 00:08 2023-10-14T09:34:41.175 INFO:teuthology.orchestra.run.smithi102.stdout:(60/143): python3-jsonpatch-1.21-16.el9.noarch. 122 kB/s | 24 kB 00:00 2023-10-14T09:34:41.209 INFO:teuthology.orchestra.run.smithi102.stdout:(61/143): python3-jsonpointer-2.0-4.el9.noarch. 218 kB/s | 18 kB 00:00 2023-10-14T09:34:41.234 INFO:teuthology.orchestra.run.smithi102.stdout:(62/143): python3-mako-1.1.4-6.el9.noarch.rpm 2.4 MB/s | 144 kB 00:00 2023-10-14T09:34:41.260 INFO:teuthology.orchestra.run.smithi102.stdout:(63/143): python3-markupsafe-1.1.1-12.el9.x86_6 654 kB/s | 32 kB 00:00 2023-10-14T09:34:41.443 INFO:teuthology.orchestra.run.smithi102.stdout:(64/143): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 4.8 MB 00:00 2023-10-14T09:34:41.477 INFO:teuthology.orchestra.run.smithi102.stdout:(65/143): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.0 MB/s | 217 kB 00:00 2023-10-14T09:34:41.510 INFO:teuthology.orchestra.run.smithi102.stdout:(66/143): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 174 kB 00:00 2023-10-14T09:34:41.536 INFO:teuthology.orchestra.run.smithi102.stdout:(67/143): python3-prettytable-0.7.2-27.el9.noar 732 kB/s | 41 kB 00:00 2023-10-14T09:34:41.561 INFO:teuthology.orchestra.run.smithi102.stdout:(68/143): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2023-10-14T09:34:41.595 INFO:teuthology.orchestra.run.smithi102.stdout:(69/143): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 211 kB 00:00 2023-10-14T09:34:41.612 INFO:teuthology.orchestra.run.smithi102.stdout:(70/143): python3-requests-oauthlib-1.3.0-12.el 859 kB/s | 43 kB 00:00 2023-10-14T09:34:41.646 INFO:teuthology.orchestra.run.smithi129.stdout:(143/143): librbd1-18.0.0-6730.g4ba8a190.el9.x8 1.0 MB/s | 3.0 MB 00:03 2023-10-14T09:34:41.653 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2023-10-14T09:34:41.654 INFO:teuthology.orchestra.run.smithi129.stdout:Total 13 MB/s | 199 MB 00:15 2023-10-14T09:34:41.987 INFO:teuthology.orchestra.run.smithi102.stdout:(71/143): python3-toml-0.10.2-6.el9.noarch.rpm 103 kB/s | 39 kB 00:00 2023-10-14T09:34:42.087 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2023-10-14T09:34:42.290 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2023-10-14T09:34:42.290 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2023-10-14T09:34:42.337 INFO:teuthology.orchestra.run.smithi102.stdout:(72/143): python3-scipy-1.6.2-8.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2023-10-14T09:34:42.371 INFO:teuthology.orchestra.run.smithi102.stdout:(73/143): socat-1.7.4.1-5.el9.x86_64.rpm 797 kB/s | 300 kB 00:00 2023-10-14T09:34:42.404 INFO:teuthology.orchestra.run.smithi102.stdout:(74/143): uuid-1.6.2-55.el9.x86_64.rpm 865 kB/s | 56 kB 00:00 2023-10-14T09:34:42.430 INFO:teuthology.orchestra.run.smithi102.stdout:(75/143): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 63 kB 00:00 2023-10-14T09:34:42.455 INFO:teuthology.orchestra.run.smithi102.stdout:(76/143): fuse-2.9.9-15.el9.x86_64.rpm 1.6 MB/s | 79 kB 00:00 2023-10-14T09:34:42.514 INFO:teuthology.orchestra.run.smithi102.stdout:(77/143): libgfortran-11.4.1-2.3.el9.x86_64.rpm 9.6 MB/s | 803 kB 00:00 2023-10-14T09:34:42.547 INFO:teuthology.orchestra.run.smithi102.stdout:(78/143): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2023-10-14T09:34:42.581 INFO:teuthology.orchestra.run.smithi102.stdout:(79/143): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 241 kB 00:00 2023-10-14T09:34:42.606 INFO:teuthology.orchestra.run.smithi102.stdout:(80/143): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2023-10-14T09:34:42.623 INFO:teuthology.orchestra.run.smithi102.stdout:(81/143): python3-pycparser-2.20-6.el9.noarch.r 3.0 MB/s | 124 kB 00:00 2023-10-14T09:34:42.665 INFO:teuthology.orchestra.run.smithi102.stdout:(82/143): python3-requests-2.25.1-7.el9.noarch. 1.9 MB/s | 113 kB 00:00 2023-10-14T09:34:42.698 INFO:teuthology.orchestra.run.smithi102.stdout:(83/143): python3-urllib3-1.26.5-3.el9.noarch.r 2.5 MB/s | 188 kB 00:00 2023-10-14T09:34:43.157 INFO:teuthology.orchestra.run.smithi102.stdout:(84/143): automake-1.16.2-8.el9.noarch.rpm 1.5 MB/s | 689 kB 00:00 2023-10-14T09:34:43.249 INFO:teuthology.orchestra.run.smithi102.stdout:(85/143): elfutils-libelf-devel-0.189-3.el9.x86 246 kB/s | 22 kB 00:00 2023-10-14T09:34:43.341 INFO:teuthology.orchestra.run.smithi102.stdout:(86/143): jq-1.6-15.el9.x86_64.rpm 2.0 MB/s | 187 kB 00:00 2023-10-14T09:34:43.417 INFO:teuthology.orchestra.run.smithi102.stdout:(87/143): librabbitmq-0.11.0-7.el9.x86_64.rpm 608 kB/s | 45 kB 00:00 2023-10-14T09:34:43.500 INFO:teuthology.orchestra.run.smithi102.stdout:(88/143): libuuid-devel-2.37.4-15.el9.x86_64.rp 309 kB/s | 26 kB 00:00 2023-10-14T09:34:43.584 INFO:teuthology.orchestra.run.smithi102.stdout:(89/143): python3-cryptography-36.0.1-4.el9.x86 1.3 MB/s | 1.2 MB 00:00 2023-10-14T09:34:43.818 INFO:teuthology.orchestra.run.smithi102.stdout:(90/143): python3-pytz-2021.1-5.el9.noarch.rpm 219 kB/s | 51 kB 00:00 2023-10-14T09:34:43.951 INFO:teuthology.orchestra.run.smithi102.stdout:(91/143): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 650 kB/s | 86 kB 00:00 2023-10-14T09:34:44.060 INFO:teuthology.orchestra.run.smithi102.stdout:(92/143): zlib-devel-1.2.11-40.el9.x86_64.rpm 420 kB/s | 45 kB 00:00 2023-10-14T09:34:44.368 INFO:teuthology.orchestra.run.smithi102.stdout:(93/143): openssl-devel-3.0.7-24.el9.x86_64.rpm 4.8 MB/s | 4.1 MB 00:00 2023-10-14T09:34:44.373 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2023-10-14T09:34:44.374 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2023-10-14T09:34:44.702 INFO:teuthology.orchestra.run.smithi102.stdout:(94/143): fmt-8.1.1-5.el9.x86_64.rpm 173 kB/s | 111 kB 00:00 2023-10-14T09:34:45.077 INFO:teuthology.orchestra.run.smithi102.stdout:(95/143): gperftools-libs-2.9.1-2.el9.x86_64.rp 438 kB/s | 309 kB 00:00 2023-10-14T09:34:45.211 INFO:teuthology.orchestra.run.smithi102.stdout:(96/143): libarrow-doc-9.0.0-9.el9.noarch.rpm 184 kB/s | 24 kB 00:00 2023-10-14T09:34:45.328 INFO:teuthology.orchestra.run.smithi102.stdout:(97/143): liboath-2.6.7-2.el9.x86_64.rpm 420 kB/s | 49 kB 00:00 2023-10-14T09:34:45.437 INFO:teuthology.orchestra.run.smithi102.stdout:(98/143): libarrow-9.0.0-9.el9.x86_64.rpm 6.0 MB/s | 4.4 MB 00:00 2023-10-14T09:34:45.462 INFO:teuthology.orchestra.run.smithi102.stdout:(99/143): libunwind-1.6.2-1.el9.x86_64.rpm 507 kB/s | 67 kB 00:00 2023-10-14T09:34:45.595 INFO:teuthology.orchestra.run.smithi102.stdout:(100/143): parquet-libs-9.0.0-9.el9.x86_64.rpm 5.2 MB/s | 837 kB 00:00 2023-10-14T09:34:45.696 INFO:teuthology.orchestra.run.smithi102.stdout:(101/143): python3-bcrypt-3.2.2-1.el9.x86_64.rp 438 kB/s | 43 kB 00:00 2023-10-14T09:34:45.729 INFO:teuthology.orchestra.run.smithi102.stdout:(102/143): python3-asyncssh-2.13.2-3.el9.noarch 2.0 MB/s | 548 kB 00:00 2023-10-14T09:34:45.796 INFO:teuthology.orchestra.run.smithi102.stdout:(103/143): python3-cachetools-4.2.4-1.el9.noarc 323 kB/s | 32 kB 00:00 2023-10-14T09:34:45.830 INFO:teuthology.orchestra.run.smithi102.stdout:(104/143): python3-certifi-2021.10.8-2.el9.noar 150 kB/s | 15 kB 00:00 2023-10-14T09:34:45.905 INFO:teuthology.orchestra.run.smithi102.stdout:(105/143): python3-cheroot-8.6.0-4.el9.noarch.r 1.6 MB/s | 172 kB 00:00 2023-10-14T09:34:45.989 INFO:teuthology.orchestra.run.smithi102.stdout:(106/143): python3-cherrypy-18.6.1-2.el9.noarch 2.2 MB/s | 358 kB 00:00 2023-10-14T09:34:46.022 INFO:teuthology.orchestra.run.smithi102.stdout:(107/143): python3-google-auth-2.23.2-1.el9.noa 1.7 MB/s | 196 kB 00:00 2023-10-14T09:34:46.089 INFO:teuthology.orchestra.run.smithi102.stdout:(108/143): python3-jaraco-8.2.1-3.el9.noarch.rp 107 kB/s | 11 kB 00:00 2023-10-14T09:34:46.131 INFO:teuthology.orchestra.run.smithi102.stdout:(109/143): python3-jaraco-classes-3.2.1-5.el9.n 164 kB/s | 18 kB 00:00 2023-10-14T09:34:46.198 INFO:teuthology.orchestra.run.smithi102.stdout:(110/143): python3-jaraco-collections-3.0.0-8.e 214 kB/s | 23 kB 00:00 2023-10-14T09:34:46.242 INFO:teuthology.orchestra.run.smithi102.stdout:(111/143): python3-jaraco-functools-3.5.0-2.el9 180 kB/s | 19 kB 00:00 2023-10-14T09:34:46.307 INFO:teuthology.orchestra.run.smithi102.stdout:(112/143): python3-jaraco-text-3.2.0-6.el9.noar 182 kB/s | 20 kB 00:00 2023-10-14T09:34:46.366 INFO:teuthology.orchestra.run.smithi102.stdout:(113/143): python3-jwt+crypto-2.4.0-1.el9.noarc 72 kB/s | 9.0 kB 00:00 2023-10-14T09:34:46.418 INFO:teuthology.orchestra.run.smithi102.stdout:(114/143): python3-jwt-2.4.0-1.el9.noarch.rpm 371 kB/s | 41 kB 00:00 2023-10-14T09:34:46.510 INFO:teuthology.orchestra.run.smithi102.stdout:(115/143): python3-kubernetes-26.1.0-2.el9.noar 7.1 MB/s | 1.0 MB 00:00 2023-10-14T09:34:46.535 INFO:teuthology.orchestra.run.smithi102.stdout:(116/143): python3-logutils-0.3.5-21.el9.noarch 398 kB/s | 46 kB 00:00 2023-10-14T09:34:46.619 INFO:teuthology.orchestra.run.smithi102.stdout:(117/143): python3-more-itertools-8.12.0-2.el9. 732 kB/s | 79 kB 00:00 2023-10-14T09:34:46.644 INFO:teuthology.orchestra.run.smithi102.stdout:(118/143): python3-natsort-7.1.1-5.el9.noarch.r 534 kB/s | 58 kB 00:00 2023-10-14T09:34:46.728 INFO:teuthology.orchestra.run.smithi102.stdout:(119/143): python3-pecan-1.4.2-3.el9.noarch.rpm 2.5 MB/s | 272 kB 00:00 2023-10-14T09:34:46.753 INFO:teuthology.orchestra.run.smithi102.stdout:(120/143): python3-portend-3.1.0-2.el9.noarch.r 152 kB/s | 16 kB 00:00 2023-10-14T09:34:46.837 INFO:teuthology.orchestra.run.smithi102.stdout:(121/143): python3-pyOpenSSL-21.0.0-1.el9.noarc 835 kB/s | 90 kB 00:00 2023-10-14T09:34:46.862 INFO:teuthology.orchestra.run.smithi102.stdout:(122/143): python3-repoze-lru-0.7-16.el9.noarch 285 kB/s | 31 kB 00:00 2023-10-14T09:34:46.954 INFO:teuthology.orchestra.run.smithi102.stdout:(123/143): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2023-10-14T09:34:46.979 INFO:teuthology.orchestra.run.smithi102.stdout:(124/143): python3-rsa-4.9-2.el9.noarch.rpm 508 kB/s | 59 kB 00:00 2023-10-14T09:34:47.064 INFO:teuthology.orchestra.run.smithi102.stdout:(125/143): python3-tempora-5.0.0-2.el9.noarch.r 330 kB/s | 36 kB 00:00 2023-10-14T09:34:47.097 INFO:teuthology.orchestra.run.smithi102.stdout:(126/143): python3-typing-extensions-4.4.0-2.el 438 kB/s | 51 kB 00:00 2023-10-14T09:34:47.180 INFO:teuthology.orchestra.run.smithi102.stdout:(127/143): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2023-10-14T09:34:47.214 INFO:teuthology.orchestra.run.smithi102.stdout:(128/143): python3-websocket-client-1.2.3-2.el9 771 kB/s | 90 kB 00:00 2023-10-14T09:34:47.306 INFO:teuthology.orchestra.run.smithi102.stdout:(129/143): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2023-10-14T09:34:47.331 INFO:teuthology.orchestra.run.smithi102.stdout:(130/143): python3-zc-lockfile-2.0-10.el9.noarc 171 kB/s | 20 kB 00:00 2023-10-14T09:34:47.423 INFO:teuthology.orchestra.run.smithi102.stdout:(131/143): re2-20211101-3.el9.x86_64.rpm 1.6 MB/s | 192 kB 00:00 2023-10-14T09:34:47.732 INFO:teuthology.orchestra.run.smithi102.stdout:(132/143): thrift-0.15.0-2.el9.x86_64.rpm 4.0 MB/s | 1.6 MB 00:00 2023-10-14T09:34:48.015 INFO:teuthology.orchestra.run.smithi102.stdout:(133/143): librbd1-18.0.0-6730.g4ba8a190.el9.x8 11 MB/s | 3.0 MB 00:00 2023-10-14T09:34:48.099 INFO:teuthology.orchestra.run.smithi102.stdout:(134/143): libacl-devel-2.3.1-4.el9.x86_64.rpm 820 kB/s | 68 kB 00:00 2023-10-14T09:34:48.349 INFO:teuthology.orchestra.run.smithi102.stdout:(135/143): NetworkManager-1.45.4-1.el9.x86_64.r 9.0 MB/s | 2.2 MB 00:00 2023-10-14T09:34:48.516 INFO:teuthology.orchestra.run.smithi102.stdout:(136/143): NetworkManager-libnm-1.45.4-1.el9.x8 11 MB/s | 1.8 MB 00:00 2023-10-14T09:34:48.583 INFO:teuthology.orchestra.run.smithi102.stdout:(137/143): NetworkManager-team-1.45.4-1.el9.x86 629 kB/s | 41 kB 00:00 2023-10-14T09:34:48.675 INFO:teuthology.orchestra.run.smithi102.stdout:(138/143): NetworkManager-tui-1.45.4-1.el9.x86_ 2.6 MB/s | 244 kB 00:00 2023-10-14T09:34:48.767 INFO:teuthology.orchestra.run.smithi102.stdout:(139/143): acl-2.3.1-4.el9.x86_64.rpm 757 kB/s | 69 kB 00:00 2023-10-14T09:34:48.842 INFO:teuthology.orchestra.run.smithi102.stdout:(140/143): libacl-2.3.1-4.el9.x86_64.rpm 295 kB/s | 22 kB 00:00 2023-10-14T09:34:48.918 INFO:teuthology.orchestra.run.smithi102.stdout:(141/143): xfsdump-3.1.12-4.el9.x86_64.rpm 4.2 MB/s | 321 kB 00:00 2023-10-14T09:34:50.153 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2023-10-14T09:34:50.246 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/153 2023-10-14T09:34:50.283 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/153 2023-10-14T09:34:50.405 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/153 2023-10-14T09:34:50.507 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/153 2023-10-14T09:34:50.924 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 5/153 2023-10-14T09:34:50.977 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 6/153 2023-10-14T09:34:51.131 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 6/153 2023-10-14T09:34:51.177 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 7/153 2023-10-14T09:34:51.299 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 7/153 2023-10-14T09:34:51.319 INFO:teuthology.orchestra.run.smithi102.stdout:(142/143): ceph-common-18.0.0-6730.g4ba8a190.el 965 kB/s | 19 MB 00:20 2023-10-14T09:34:51.366 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-rados-2:18.0.0-6730.g4ba8a190.el9.x86_64 8/153 2023-10-14T09:34:51.406 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/153 2023-10-14T09:34:51.667 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 10/153 2023-10-14T09:34:51.713 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : postgresql-13.11-1.el9.x86_64 11/153 2023-10-14T09:34:51.739 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 12/153 2023-10-14T09:34:51.872 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 12/153 2023-10-14T09:34:51.907 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86 13/153 2023-10-14T09:34:51.990 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86 13/153 2023-10-14T09:34:52.301 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 14/153 2023-10-14T09:34:52.437 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : NetworkManager-libnm-1:1.45.4-1.el9.x86_64 15/153 2023-10-14T09:34:52.516 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.4-1.el9.x86_64 15/153 2023-10-14T09:34:52.672 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: NetworkManager-1:1.45.4-1.el9.x86_64 16/153 2023-10-14T09:34:52.723 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : NetworkManager-1:1.45.4-1.el9.x86_64 16/153 2023-10-14T09:34:53.134 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: NetworkManager-1:1.45.4-1.el9.x86_64 16/153 2023-10-14T09:34:53.186 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/153 2023-10-14T09:34:53.241 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/153 2023-10-14T09:34:53.353 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/153 2023-10-14T09:34:53.422 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-urllib3-1.26.5-3.el9.noarch 20/153 2023-10-14T09:34:53.461 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 21/153 2023-10-14T09:34:53.517 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 22/153 2023-10-14T09:34:53.625 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 23/153 2023-10-14T09:34:53.671 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/153 2023-10-14T09:34:53.704 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/153 2023-10-14T09:34:53.814 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/153 2023-10-14T09:34:53.859 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el9. 27/153 2023-10-14T09:34:53.910 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 28/153 2023-10-14T09:34:54.016 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cephfs-2:18.0.0-6730.g4ba8a190.el9.x86_6 29/153 2023-10-14T09:34:54.191 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/153 2023-10-14T09:34:54.253 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/153 2023-10-14T09:34:54.860 INFO:teuthology.orchestra.run.smithi102.stdout:(143/143): librados2-18.0.0-6730.g4ba8a190.el9. 456 kB/s | 3.3 MB 00:07 2023-10-14T09:34:54.873 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2023-10-14T09:34:54.874 INFO:teuthology.orchestra.run.smithi102.stdout:Total 8.1 MB/s | 199 MB 00:24 2023-10-14T09:34:54.961 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/153 2023-10-14T09:34:55.068 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/153 2023-10-14T09:34:55.120 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 34/153 2023-10-14T09:34:55.160 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : librados-devel-2:18.0.0-6730.g4ba8a190.el9.x86_6 35/153 2023-10-14T09:34:55.200 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/153 2023-10-14T09:34:55.310 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2023-10-14T09:34:55.350 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : re2-1:20211101-3.el9.x86_64 37/153 2023-10-14T09:34:55.385 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 38/153 2023-10-14T09:34:55.452 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 39/153 2023-10-14T09:34:55.514 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2023-10-14T09:34:55.514 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2023-10-14T09:34:55.538 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 40/153 2023-10-14T09:34:55.578 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 41/153 2023-10-14T09:34:55.617 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 42/153 2023-10-14T09:34:55.887 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 43/153 2023-10-14T09:34:55.945 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 44/153 2023-10-14T09:34:56.003 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 45/153 2023-10-14T09:34:56.200 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 46/153 2023-10-14T09:34:56.252 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 47/153 2023-10-14T09:34:56.298 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 48/153 2023-10-14T09:34:56.428 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 49/153 2023-10-14T09:34:56.470 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-google-auth-1:2.23.2-1.el9.noarch 50/153 2023-10-14T09:34:56.519 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 51/153 2023-10-14T09:34:56.551 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 52/153 2023-10-14T09:34:56.589 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 53/153 2023-10-14T09:34:56.632 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : fmt-8.1.1-5.el9.x86_64 54/153 2023-10-14T09:34:56.718 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 55/153 2023-10-14T09:34:56.877 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 56/153 2023-10-14T09:34:56.928 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : automake-1.16.2-8.el9.noarch 57/153 2023-10-14T09:34:57.010 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-ply-3.11-14.el9.noarch 58/153 2023-10-14T09:34:57.111 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 59/153 2023-10-14T09:34:57.384 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 60/153 2023-10-14T09:34:57.438 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 61/153 2023-10-14T09:34:57.607 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2023-10-14T09:34:57.608 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2023-10-14T09:34:57.618 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 62/153 2023-10-14T09:34:57.674 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 63/153 2023-10-14T09:34:57.707 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 64/153 2023-10-14T09:34:57.746 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 65/153 2023-10-14T09:34:57.790 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 66/153 2023-10-14T09:34:57.832 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : fuse-2.9.9-15.el9.x86_64 67/153 2023-10-14T09:34:57.881 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/153 2023-10-14T09:34:57.955 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/153 2023-10-14T09:34:58.007 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 70/153 2023-10-14T09:34:58.049 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/153 2023-10-14T09:34:58.177 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/153 2023-10-14T09:34:58.221 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 73/153 2023-10-14T09:34:58.256 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 74/153 2023-10-14T09:34:58.310 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 75/153 2023-10-14T09:34:58.351 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 76/153 2023-10-14T09:34:58.496 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 77/153 2023-10-14T09:34:58.533 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/153 2023-10-14T09:34:58.677 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/153 2023-10-14T09:34:58.772 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 80/153 2023-10-14T09:34:59.781 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/153 2023-10-14T09:34:59.829 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 82/153 2023-10-14T09:34:59.862 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 83/153 2023-10-14T09:34:59.986 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 84/153 2023-10-14T09:35:00.038 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 85/153 2023-10-14T09:35:00.270 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : openblas-0.3.21-2.el9.x86_64 86/153 2023-10-14T09:35:00.302 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 87/153 2023-10-14T09:35:00.395 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 88/153 2023-10-14T09:35:01.204 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 89/153 2023-10-14T09:35:01.342 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 90/153 2023-10-14T09:35:02.913 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 91/153 2023-10-14T09:35:03.016 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 92/153 2023-10-14T09:35:03.062 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 93/153 2023-10-14T09:35:03.093 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : jq-1.6-15.el9.x86_64 94/153 2023-10-14T09:35:03.133 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 95/153 2023-10-14T09:35:03.502 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2023-10-14T09:35:03.505 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/153 2023-10-14T09:35:03.548 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 97/153 2023-10-14T09:35:03.583 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/153 2023-10-14T09:35:03.650 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/153 2023-10-14T09:35:03.667 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 97/153 2023-10-14T09:35:03.685 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/153 2023-10-14T09:35:03.696 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-rbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 98/153 2023-10-14T09:35:03.752 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/153 2023-10-14T09:35:03.784 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/153 2023-10-14T09:35:04.187 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 5/153 2023-10-14T09:35:04.241 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 100/153 2023-10-14T09:35:04.256 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 6/153 2023-10-14T09:35:04.276 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 101/153 2023-10-14T09:35:04.367 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 101/153 2023-10-14T09:35:04.394 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-rgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 102/153 2023-10-14T09:35:04.405 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 6/153 2023-10-14T09:35:04.441 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 7/153 2023-10-14T09:35:04.563 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 7/153 2023-10-14T09:35:04.622 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rados-2:18.0.0-6730.g4ba8a190.el9.x86_64 8/153 2023-10-14T09:35:04.659 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/153 2023-10-14T09:35:04.897 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 10/153 2023-10-14T09:35:04.953 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-13.11-1.el9.x86_64 11/153 2023-10-14T09:35:04.987 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 12/153 2023-10-14T09:35:05.132 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 12/153 2023-10-14T09:35:05.163 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86 13/153 2023-10-14T09:35:05.245 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86 13/153 2023-10-14T09:35:05.634 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 14/153 2023-10-14T09:35:05.752 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : NetworkManager-libnm-1:1.45.4-1.el9.x86_64 15/153 2023-10-14T09:35:05.840 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.4-1.el9.x86_64 15/153 2023-10-14T09:35:06.059 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-1:1.45.4-1.el9.x86_64 16/153 2023-10-14T09:35:06.105 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : NetworkManager-1:1.45.4-1.el9.x86_64 16/153 2023-10-14T09:35:06.499 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-1:1.45.4-1.el9.x86_64 16/153 2023-10-14T09:35:06.542 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/153 2023-10-14T09:35:06.582 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/153 2023-10-14T09:35:06.679 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/153 2023-10-14T09:35:06.746 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-urllib3-1.26.5-3.el9.noarch 20/153 2023-10-14T09:35:06.790 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 21/153 2023-10-14T09:35:06.845 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 22/153 2023-10-14T09:35:06.910 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 103/153 2023-10-14T09:35:06.950 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 23/153 2023-10-14T09:35:06.966 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 103/153 2023-10-14T09:35:07.000 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/153 2023-10-14T09:35:07.033 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/153 2023-10-14T09:35:07.133 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/153 2023-10-14T09:35:07.170 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el9. 27/153 2023-10-14T09:35:07.220 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 28/153 2023-10-14T09:35:07.337 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cephfs-2:18.0.0-6730.g4ba8a190.el9.x86_6 29/153 2023-10-14T09:35:07.517 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/153 2023-10-14T09:35:07.581 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/153 2023-10-14T09:35:07.607 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 103/153 2023-10-14T09:35:07.704 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 104/153 2023-10-14T09:35:07.873 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 104/153 2023-10-14T09:35:07.874 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-10-14T09:35:07.874 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-10-14T09:35:07.874 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:35:07.921 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 105/153 2023-10-14T09:35:08.260 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/153 2023-10-14T09:35:08.363 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/153 2023-10-14T09:35:08.407 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 34/153 2023-10-14T09:35:08.446 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librados-devel-2:18.0.0-6730.g4ba8a190.el9.x86_6 35/153 2023-10-14T09:35:08.478 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/153 2023-10-14T09:35:08.623 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : re2-1:20211101-3.el9.x86_64 37/153 2023-10-14T09:35:08.663 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 38/153 2023-10-14T09:35:08.728 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 39/153 2023-10-14T09:35:08.813 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 40/153 2023-10-14T09:35:08.855 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 41/153 2023-10-14T09:35:08.894 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 42/153 2023-10-14T09:35:08.959 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 43/153 2023-10-14T09:35:09.019 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 44/153 2023-10-14T09:35:09.079 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 45/153 2023-10-14T09:35:09.266 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 46/153 2023-10-14T09:35:09.312 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 47/153 2023-10-14T09:35:09.357 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 48/153 2023-10-14T09:35:09.498 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 49/153 2023-10-14T09:35:09.537 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-google-auth-1:2.23.2-1.el9.noarch 50/153 2023-10-14T09:35:09.580 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 51/153 2023-10-14T09:35:09.610 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 52/153 2023-10-14T09:35:09.648 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 53/153 2023-10-14T09:35:09.682 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : fmt-8.1.1-5.el9.x86_64 54/153 2023-10-14T09:35:09.726 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 55/153 2023-10-14T09:35:09.869 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 56/153 2023-10-14T09:35:09.926 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : automake-1.16.2-8.el9.noarch 57/153 2023-10-14T09:35:10.027 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ply-3.11-14.el9.noarch 58/153 2023-10-14T09:35:10.118 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 59/153 2023-10-14T09:35:10.370 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 60/153 2023-10-14T09:35:10.422 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 61/153 2023-10-14T09:35:10.584 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 62/153 2023-10-14T09:35:10.633 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 63/153 2023-10-14T09:35:10.659 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 64/153 2023-10-14T09:35:10.697 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 65/153 2023-10-14T09:35:10.740 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 66/153 2023-10-14T09:35:10.783 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : fuse-2.9.9-15.el9.x86_64 67/153 2023-10-14T09:35:10.834 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/153 2023-10-14T09:35:10.910 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/153 2023-10-14T09:35:10.960 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 70/153 2023-10-14T09:35:11.001 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/153 2023-10-14T09:35:11.126 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/153 2023-10-14T09:35:11.166 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 73/153 2023-10-14T09:35:11.200 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 74/153 2023-10-14T09:35:11.262 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 75/153 2023-10-14T09:35:11.304 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 76/153 2023-10-14T09:35:11.448 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 77/153 2023-10-14T09:35:11.494 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/153 2023-10-14T09:35:11.636 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/153 2023-10-14T09:35:11.691 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 80/153 2023-10-14T09:35:12.685 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/153 2023-10-14T09:35:12.741 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 82/153 2023-10-14T09:35:12.774 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 83/153 2023-10-14T09:35:12.898 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 84/153 2023-10-14T09:35:12.941 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 85/153 2023-10-14T09:35:13.169 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openblas-0.3.21-2.el9.x86_64 86/153 2023-10-14T09:35:13.205 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 87/153 2023-10-14T09:35:13.299 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 88/153 2023-10-14T09:35:14.095 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 89/153 2023-10-14T09:35:14.241 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 90/153 2023-10-14T09:35:15.774 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 91/153 2023-10-14T09:35:15.867 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 92/153 2023-10-14T09:35:15.914 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 93/153 2023-10-14T09:35:15.944 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : jq-1.6-15.el9.x86_64 94/153 2023-10-14T09:35:15.985 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 95/153 2023-10-14T09:35:16.350 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/153 2023-10-14T09:35:16.382 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 97/153 2023-10-14T09:35:16.503 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 97/153 2023-10-14T09:35:16.539 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 98/153 2023-10-14T09:35:16.595 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/153 2023-10-14T09:35:17.087 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 100/153 2023-10-14T09:35:17.119 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 101/153 2023-10-14T09:35:17.211 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 101/153 2023-10-14T09:35:17.237 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 102/153 2023-10-14T09:35:19.786 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 103/153 2023-10-14T09:35:19.834 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 103/153 2023-10-14T09:35:20.442 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 105/153 2023-10-14T09:35:20.442 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /sys 2023-10-14T09:35:20.443 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /proc 2023-10-14T09:35:20.443 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /mnt 2023-10-14T09:35:20.443 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /var/tmp 2023-10-14T09:35:20.443 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /home 2023-10-14T09:35:20.443 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /root 2023-10-14T09:35:20.444 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /tmp 2023-10-14T09:35:20.444 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:35:20.469 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 103/153 2023-10-14T09:35:20.513 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 104/153 2023-10-14T09:35:20.690 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 104/153 2023-10-14T09:35:20.691 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-10-14T09:35:20.691 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-10-14T09:35:20.691 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:35:20.694 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 106/153 2023-10-14T09:35:20.730 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 105/153 2023-10-14T09:35:20.743 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 106/153 2023-10-14T09:35:20.743 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T09:35:20.743 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-10-14T09:35:20.743 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:35:22.482 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 107/153 2023-10-14T09:35:22.579 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 107/153 2023-10-14T09:35:22.579 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T09:35:22.580 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-10-14T09:35:22.580 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-14T09:35:22.580 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-14T09:35:22.580 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:35:22.832 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 108/153 2023-10-14T09:35:22.901 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 108/153 2023-10-14T09:35:22.901 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T09:35:22.902 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-10-14T09:35:22.902 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-14T09:35:22.902 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-14T09:35:22.902 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:35:23.399 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 109/153 2023-10-14T09:35:23.471 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 109/153 2023-10-14T09:35:23.471 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T09:35:23.471 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-10-14T09:35:23.472 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-14T09:35:23.472 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-14T09:35:23.472 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:35:24.098 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 110/153 2023-10-14T09:35:24.127 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 110/153 2023-10-14T09:35:24.175 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 111/153 2023-10-14T09:35:24.277 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 112/153 2023-10-14T09:35:24.305 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noa 113/153 2023-10-14T09:35:24.627 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noa 113/153 2023-10-14T09:35:24.665 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.n 114/153 2023-10-14T09:35:25.797 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.n 114/153 2023-10-14T09:35:25.832 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 115/153 2023-10-14T09:35:25.973 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 115/153 2023-10-14T09:35:26.140 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 116/153 2023-10-14T09:35:26.167 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 117/153 2023-10-14T09:35:26.267 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 117/153 2023-10-14T09:35:26.268 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T09:35:26.268 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-10-14T09:35:26.268 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-14T09:35:26.268 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-14T09:35:26.268 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:35:26.318 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 118/153 2023-10-14T09:35:26.356 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 118/153 2023-10-14T09:35:27.234 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-2:18.0.0-6730.g4ba8a190.el9.x86_64 119/153 2023-10-14T09:35:27.269 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 120/153 2023-10-14T09:35:27.341 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 120/153 2023-10-14T09:35:27.341 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T09:35:27.341 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-10-14T09:35:27.342 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-14T09:35:27.342 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-14T09:35:27.342 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:35:27.390 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 121/153 2023-10-14T09:35:27.466 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 121/153 2023-10-14T09:35:27.466 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T09:35:27.467 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-10-14T09:35:27.467 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:35:27.529 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 122/153 2023-10-14T09:35:27.631 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 122/153 2023-10-14T09:35:27.633 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T09:35:27.633 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-10-14T09:35:27.634 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-10-14T09:35:27.634 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-10-14T09:35:27.634 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:35:28.015 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 123/153 2023-10-14T09:35:28.098 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 123/153 2023-10-14T09:35:28.099 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T09:35:28.099 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-10-14T09:35:28.099 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-14T09:35:28.099 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-14T09:35:28.100 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:35:32.236 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-test-2:18.0.0-6730.g4ba8a190.el9.x86_64 124/153 2023-10-14T09:35:32.292 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : rbd-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 125/153 2023-10-14T09:35:32.325 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : rbd-nbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 126/153 2023-10-14T09:35:32.595 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : elfutils-libelf-devel-0.189-3.el9.x86_64 127/153 2023-10-14T09:35:32.717 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 128/153 2023-10-14T09:35:32.782 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 129/153 2023-10-14T09:35:32.828 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libtool-2.4.6-45.el9.x86_64 130/153 2023-10-14T09:35:32.866 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 131/153 2023-10-14T09:35:32.896 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el9.x86_ 132/153 2023-10-14T09:35:32.941 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : NetworkManager-team-1:1.45.4-1.el9.x86_64 133/153 2023-10-14T09:35:33.067 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : NetworkManager-tui-1:1.45.4-1.el9.x86_64 134/153 2023-10-14T09:35:33.153 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 135/153 2023-10-14T09:35:33.217 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 136/153 2023-10-14T09:35:33.292 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 105/153 2023-10-14T09:35:33.293 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /sys 2023-10-14T09:35:33.293 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /proc 2023-10-14T09:35:33.293 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /mnt 2023-10-14T09:35:33.293 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /var/tmp 2023-10-14T09:35:33.294 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /home 2023-10-14T09:35:33.294 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /root 2023-10-14T09:35:33.294 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /tmp 2023-10-14T09:35:33.294 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:35:33.529 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 106/153 2023-10-14T09:35:33.573 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 106/153 2023-10-14T09:35:33.573 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T09:35:33.573 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-10-14T09:35:33.574 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:35:34.120 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 137/153 2023-10-14T09:35:34.191 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 137/153 2023-10-14T09:35:34.248 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 137/153 2023-10-14T09:35:34.334 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : cephfs-top-2:18.0.0-6730.g4ba8a190.el9.noarch 138/153 2023-10-14T09:35:35.231 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 107/153 2023-10-14T09:35:35.333 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 107/153 2023-10-14T09:35:35.333 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T09:35:35.333 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-10-14T09:35:35.333 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-14T09:35:35.334 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-14T09:35:35.334 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:35:35.573 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 108/153 2023-10-14T09:35:35.659 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 108/153 2023-10-14T09:35:35.659 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T09:35:35.659 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-10-14T09:35:35.660 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-14T09:35:35.660 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-14T09:35:35.660 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:35:35.749 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 139/153 2023-10-14T09:35:35.847 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 140/153 2023-10-14T09:35:35.894 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 141/153 2023-10-14T09:35:36.022 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : flex-2.6.4-9.el9.x86_64 142/153 2023-10-14T09:35:36.059 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : bison-3.7.4-5.el9.x86_64 143/153 2023-10-14T09:35:36.096 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 144/153 2023-10-14T09:35:36.096 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 145/153 2023-10-14T09:35:36.141 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 109/153 2023-10-14T09:35:36.218 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 109/153 2023-10-14T09:35:36.219 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T09:35:36.219 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-10-14T09:35:36.219 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-14T09:35:36.219 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-14T09:35:36.220 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:35:36.240 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 145/153 2023-10-14T09:35:36.272 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 146/153 2023-10-14T09:35:36.304 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 147/153 2023-10-14T09:35:36.337 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 148/153 2023-10-14T09:35:36.377 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 149/153 2023-10-14T09:35:36.377 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 149/153 2023-10-14T09:35:36.712 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 149/153 2023-10-14T09:35:36.712 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 150/153 2023-10-14T09:35:36.831 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 110/153 2023-10-14T09:35:36.850 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 150/153 2023-10-14T09:35:36.877 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 110/153 2023-10-14T09:35:36.882 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 151/153 2023-10-14T09:35:36.882 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/153 2023-10-14T09:35:36.923 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 111/153 2023-10-14T09:35:37.012 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/153 2023-10-14T09:35:37.025 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 112/153 2023-10-14T09:35:37.055 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noa 113/153 2023-10-14T09:35:37.136 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 153/153 2023-10-14T09:35:37.375 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 153/153 2023-10-14T09:35:37.375 INFO:teuthology.orchestra.run.smithi129.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-14T09:35:37.375 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:35:37.379 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noa 113/153 2023-10-14T09:35:37.439 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.n 114/153 2023-10-14T09:35:38.591 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.n 114/153 2023-10-14T09:35:38.623 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 115/153 2023-10-14T09:35:38.767 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 115/153 2023-10-14T09:35:38.940 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 116/153 2023-10-14T09:35:38.975 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 117/153 2023-10-14T09:35:39.052 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 117/153 2023-10-14T09:35:39.052 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T09:35:39.052 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-10-14T09:35:39.052 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-14T09:35:39.053 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-14T09:35:39.053 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:35:39.109 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 118/153 2023-10-14T09:35:39.149 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 118/153 2023-10-14T09:35:40.057 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-2:18.0.0-6730.g4ba8a190.el9.x86_64 119/153 2023-10-14T09:35:40.094 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 120/153 2023-10-14T09:35:40.161 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 120/153 2023-10-14T09:35:40.162 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T09:35:40.162 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-10-14T09:35:40.162 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-14T09:35:40.162 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-14T09:35:40.163 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:35:40.211 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 121/153 2023-10-14T09:35:40.282 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 121/153 2023-10-14T09:35:40.282 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T09:35:40.283 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-10-14T09:35:40.283 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:35:40.345 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 122/153 2023-10-14T09:35:40.419 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 122/153 2023-10-14T09:35:40.420 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T09:35:40.420 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-10-14T09:35:40.420 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-10-14T09:35:40.420 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-10-14T09:35:40.420 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:35:40.770 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 123/153 2023-10-14T09:35:40.845 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 123/153 2023-10-14T09:35:40.845 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T09:35:40.846 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-10-14T09:35:40.846 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-14T09:35:40.846 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-14T09:35:40.846 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:35:41.946 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-2:18.0.0-6730.g4ba8a190.el9.x86_64 1/153 2023-10-14T09:35:41.947 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 2/153 2023-10-14T09:35:41.947 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 3/153 2023-10-14T09:35:41.947 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 4/153 2023-10-14T09:35:41.947 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 5/153 2023-10-14T09:35:41.947 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 6/153 2023-10-14T09:35:41.948 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 7/153 2023-10-14T09:35:41.948 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 8/153 2023-10-14T09:35:41.948 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 9/153 2023-10-14T09:35:41.948 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 10/153 2023-10-14T09:35:41.948 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 11/153 2023-10-14T09:35:41.949 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-test-2:18.0.0-6730.g4ba8a190.el9.x86_64 12/153 2023-10-14T09:35:41.949 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 13/153 2023-10-14T09:35:41.949 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el9.x86_ 14/153 2023-10-14T09:35:41.949 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 15/153 2023-10-14T09:35:41.949 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 16/153 2023-10-14T09:35:41.950 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librados-devel-2:18.0.0-6730.g4ba8a190.el9.x86_6 17/153 2023-10-14T09:35:41.950 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86 18/153 2023-10-14T09:35:41.950 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 19/153 2023-10-14T09:35:41.950 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 20/153 2023-10-14T09:35:41.951 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el9. 21/153 2023-10-14T09:35:41.951 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cephfs-2:18.0.0-6730.g4ba8a190.el9.x86_6 22/153 2023-10-14T09:35:41.951 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-rados-2:18.0.0-6730.g4ba8a190.el9.x86_64 23/153 2023-10-14T09:35:41.951 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-rbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 24/153 2023-10-14T09:35:41.951 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-rgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 25/153 2023-10-14T09:35:41.952 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : rbd-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 26/153 2023-10-14T09:35:41.952 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 27/153 2023-10-14T09:35:41.952 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : rbd-nbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 28/153 2023-10-14T09:35:41.963 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 29/153 2023-10-14T09:35:41.963 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noa 30/153 2023-10-14T09:35:41.963 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.n 31/153 2023-10-14T09:35:41.963 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 32/153 2023-10-14T09:35:41.963 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 33/153 2023-10-14T09:35:41.964 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 34/153 2023-10-14T09:35:41.964 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 35/153 2023-10-14T09:35:41.964 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 36/153 2023-10-14T09:35:41.964 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 37/153 2023-10-14T09:35:41.965 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : cephfs-top-2:18.0.0-6730.g4ba8a190.el9.noarch 38/153 2023-10-14T09:35:41.965 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : bison-3.7.4-5.el9.x86_64 39/153 2023-10-14T09:35:41.965 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 40/153 2023-10-14T09:35:41.965 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : flex-2.6.4-9.el9.x86_64 41/153 2023-10-14T09:35:41.965 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 42/153 2023-10-14T09:35:41.965 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 43/153 2023-10-14T09:35:41.966 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 44/153 2023-10-14T09:35:41.966 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 45/153 2023-10-14T09:35:41.966 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 46/153 2023-10-14T09:35:41.966 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 47/153 2023-10-14T09:35:41.966 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 48/153 2023-10-14T09:35:41.967 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 49/153 2023-10-14T09:35:41.967 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 50/153 2023-10-14T09:35:41.967 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 51/153 2023-10-14T09:35:41.967 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 52/153 2023-10-14T09:35:41.967 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 53/153 2023-10-14T09:35:41.968 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : postgresql-13.11-1.el9.x86_64 54/153 2023-10-14T09:35:41.968 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 55/153 2023-10-14T09:35:41.968 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 56/153 2023-10-14T09:35:41.968 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 57/153 2023-10-14T09:35:41.968 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 58/153 2023-10-14T09:35:41.969 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 59/153 2023-10-14T09:35:41.969 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 60/153 2023-10-14T09:35:41.969 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/153 2023-10-14T09:35:41.969 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/153 2023-10-14T09:35:41.970 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/153 2023-10-14T09:35:41.970 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/153 2023-10-14T09:35:41.970 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/153 2023-10-14T09:35:41.970 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/153 2023-10-14T09:35:41.970 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/153 2023-10-14T09:35:41.971 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 68/153 2023-10-14T09:35:41.971 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 69/153 2023-10-14T09:35:41.971 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 70/153 2023-10-14T09:35:41.971 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 71/153 2023-10-14T09:35:41.972 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 72/153 2023-10-14T09:35:41.972 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 73/153 2023-10-14T09:35:41.972 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 74/153 2023-10-14T09:35:41.972 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 75/153 2023-10-14T09:35:41.972 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 76/153 2023-10-14T09:35:41.973 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 77/153 2023-10-14T09:35:41.973 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 78/153 2023-10-14T09:35:41.973 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 79/153 2023-10-14T09:35:41.973 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 80/153 2023-10-14T09:35:41.973 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-ply-3.11-14.el9.noarch 81/153 2023-10-14T09:35:41.974 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 82/153 2023-10-14T09:35:41.974 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 83/153 2023-10-14T09:35:41.974 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-urllib3-1.26.5-3.el9.noarch 84/153 2023-10-14T09:35:41.974 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 85/153 2023-10-14T09:35:41.974 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : automake-1.16.2-8.el9.noarch 86/153 2023-10-14T09:35:41.974 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : elfutils-libelf-devel-0.189-3.el9.x86_64 87/153 2023-10-14T09:35:41.975 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : jq-1.6-15.el9.x86_64 88/153 2023-10-14T09:35:41.975 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 89/153 2023-10-14T09:35:41.975 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 90/153 2023-10-14T09:35:41.975 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 91/153 2023-10-14T09:35:41.975 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/153 2023-10-14T09:35:41.976 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 93/153 2023-10-14T09:35:41.976 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 94/153 2023-10-14T09:35:41.976 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 95/153 2023-10-14T09:35:41.976 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 96/153 2023-10-14T09:35:41.976 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 97/153 2023-10-14T09:35:41.977 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 98/153 2023-10-14T09:35:41.977 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 99/153 2023-10-14T09:35:41.977 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 100/153 2023-10-14T09:35:41.977 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 101/153 2023-10-14T09:35:41.977 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 102/153 2023-10-14T09:35:41.978 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 103/153 2023-10-14T09:35:41.978 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 104/153 2023-10-14T09:35:41.978 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 105/153 2023-10-14T09:35:41.978 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 106/153 2023-10-14T09:35:41.978 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 107/153 2023-10-14T09:35:41.979 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-google-auth-1:2.23.2-1.el9.noarch 108/153 2023-10-14T09:35:41.979 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 109/153 2023-10-14T09:35:41.979 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 110/153 2023-10-14T09:35:41.979 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 111/153 2023-10-14T09:35:41.979 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 112/153 2023-10-14T09:35:41.980 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 113/153 2023-10-14T09:35:41.980 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 114/153 2023-10-14T09:35:41.980 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 115/153 2023-10-14T09:35:41.980 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 116/153 2023-10-14T09:35:41.980 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 117/153 2023-10-14T09:35:41.981 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 118/153 2023-10-14T09:35:41.981 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 119/153 2023-10-14T09:35:41.981 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 120/153 2023-10-14T09:35:41.981 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 121/153 2023-10-14T09:35:41.981 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/153 2023-10-14T09:35:41.981 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 123/153 2023-10-14T09:35:41.982 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 124/153 2023-10-14T09:35:41.982 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 125/153 2023-10-14T09:35:41.982 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 126/153 2023-10-14T09:35:41.982 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 127/153 2023-10-14T09:35:41.982 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 128/153 2023-10-14T09:35:41.983 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 129/153 2023-10-14T09:35:41.983 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 130/153 2023-10-14T09:35:41.983 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 131/153 2023-10-14T09:35:41.983 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : re2-1:20211101-3.el9.x86_64 132/153 2023-10-14T09:35:41.983 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 133/153 2023-10-14T09:35:41.984 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 134/153 2023-10-14T09:35:41.984 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 135/153 2023-10-14T09:35:41.984 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 136/153 2023-10-14T09:35:41.984 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 137/153 2023-10-14T09:35:41.984 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 138/153 2023-10-14T09:35:41.985 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 139/153 2023-10-14T09:35:41.985 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : NetworkManager-1:1.45.4-1.el9.x86_64 140/153 2023-10-14T09:35:41.985 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 141/153 2023-10-14T09:35:41.985 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : NetworkManager-libnm-1:1.45.4-1.el9.x86_64 142/153 2023-10-14T09:35:41.985 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 143/153 2023-10-14T09:35:41.986 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : NetworkManager-team-1:1.45.4-1.el9.x86_64 144/153 2023-10-14T09:35:41.986 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 145/153 2023-10-14T09:35:41.986 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : NetworkManager-tui-1:1.45.4-1.el9.x86_64 146/153 2023-10-14T09:35:41.986 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 147/153 2023-10-14T09:35:41.986 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : acl-2.3.1-4.el9.x86_64 148/153 2023-10-14T09:35:41.986 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : acl-2.3.1-3.el9.x86_64 149/153 2023-10-14T09:35:41.987 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 150/153 2023-10-14T09:35:41.987 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 151/153 2023-10-14T09:35:41.987 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 152/153 2023-10-14T09:35:44.023 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 153/153 2023-10-14T09:35:44.024 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:35:44.024 INFO:teuthology.orchestra.run.smithi129.stdout:Upgraded: 2023-10-14T09:35:44.024 INFO:teuthology.orchestra.run.smithi129.stdout: NetworkManager-1:1.45.4-1.el9.x86_64 2023-10-14T09:35:44.024 INFO:teuthology.orchestra.run.smithi129.stdout: NetworkManager-libnm-1:1.45.4-1.el9.x86_64 2023-10-14T09:35:44.025 INFO:teuthology.orchestra.run.smithi129.stdout: NetworkManager-team-1:1.45.4-1.el9.x86_64 2023-10-14T09:35:44.025 INFO:teuthology.orchestra.run.smithi129.stdout: NetworkManager-tui-1:1.45.4-1.el9.x86_64 2023-10-14T09:35:44.025 INFO:teuthology.orchestra.run.smithi129.stdout: acl-2.3.1-4.el9.x86_64 2023-10-14T09:35:44.025 INFO:teuthology.orchestra.run.smithi129.stdout: libacl-2.3.1-4.el9.x86_64 2023-10-14T09:35:44.025 INFO:teuthology.orchestra.run.smithi129.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-10-14T09:35:44.026 INFO:teuthology.orchestra.run.smithi129.stdout: librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:44.026 INFO:teuthology.orchestra.run.smithi129.stdout: librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:44.026 INFO:teuthology.orchestra.run.smithi129.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-10-14T09:35:44.026 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2023-10-14T09:35:44.027 INFO:teuthology.orchestra.run.smithi129.stdout: automake-1.16.2-8.el9.noarch 2023-10-14T09:35:44.027 INFO:teuthology.orchestra.run.smithi129.stdout: bison-3.7.4-5.el9.x86_64 2023-10-14T09:35:44.027 INFO:teuthology.orchestra.run.smithi129.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-10-14T09:35:44.027 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:44.027 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:44.028 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:44.028 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:44.028 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T09:35:44.028 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:44.028 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:44.029 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:44.029 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T09:35:44.029 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T09:35:44.029 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T09:35:44.029 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T09:35:44.030 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T09:35:44.030 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:44.030 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:44.030 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T09:35:44.030 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:44.031 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:44.031 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-test-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:44.031 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T09:35:44.031 INFO:teuthology.orchestra.run.smithi129.stdout: cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T09:35:44.031 INFO:teuthology.orchestra.run.smithi129.stdout: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:44.032 INFO:teuthology.orchestra.run.smithi129.stdout: cephfs-top-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T09:35:44.032 INFO:teuthology.orchestra.run.smithi129.stdout: elfutils-libelf-devel-0.189-3.el9.x86_64 2023-10-14T09:35:44.032 INFO:teuthology.orchestra.run.smithi129.stdout: flex-2.6.4-9.el9.x86_64 2023-10-14T09:35:44.032 INFO:teuthology.orchestra.run.smithi129.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-10-14T09:35:44.032 INFO:teuthology.orchestra.run.smithi129.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-10-14T09:35:44.033 INFO:teuthology.orchestra.run.smithi129.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-10-14T09:35:44.033 INFO:teuthology.orchestra.run.smithi129.stdout: fmt-8.1.1-5.el9.x86_64 2023-10-14T09:35:44.033 INFO:teuthology.orchestra.run.smithi129.stdout: fuse-2.9.9-15.el9.x86_64 2023-10-14T09:35:44.033 INFO:teuthology.orchestra.run.smithi129.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-10-14T09:35:44.033 INFO:teuthology.orchestra.run.smithi129.stdout: jq-1.6-15.el9.x86_64 2023-10-14T09:35:44.033 INFO:teuthology.orchestra.run.smithi129.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-10-14T09:35:44.034 INFO:teuthology.orchestra.run.smithi129.stdout: libarrow-9.0.0-9.el9.x86_64 2023-10-14T09:35:44.034 INFO:teuthology.orchestra.run.smithi129.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-10-14T09:35:44.034 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs-devel-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:44.034 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:44.034 INFO:teuthology.orchestra.run.smithi129.stdout: libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:44.035 INFO:teuthology.orchestra.run.smithi129.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-10-14T09:35:44.035 INFO:teuthology.orchestra.run.smithi129.stdout: liboath-2.6.7-2.el9.x86_64 2023-10-14T09:35:44.035 INFO:teuthology.orchestra.run.smithi129.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-10-14T09:35:44.035 INFO:teuthology.orchestra.run.smithi129.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-10-14T09:35:44.035 INFO:teuthology.orchestra.run.smithi129.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-10-14T09:35:44.036 INFO:teuthology.orchestra.run.smithi129.stdout: librados-devel-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:44.036 INFO:teuthology.orchestra.run.smithi129.stdout: libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:44.036 INFO:teuthology.orchestra.run.smithi129.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-10-14T09:35:44.036 INFO:teuthology.orchestra.run.smithi129.stdout: librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:44.036 INFO:teuthology.orchestra.run.smithi129.stdout: libtool-2.4.6-45.el9.x86_64 2023-10-14T09:35:44.037 INFO:teuthology.orchestra.run.smithi129.stdout: libunwind-1.6.2-1.el9.x86_64 2023-10-14T09:35:44.037 INFO:teuthology.orchestra.run.smithi129.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-10-14T09:35:44.037 INFO:teuthology.orchestra.run.smithi129.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-10-14T09:35:44.037 INFO:teuthology.orchestra.run.smithi129.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-10-14T09:35:44.037 INFO:teuthology.orchestra.run.smithi129.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-10-14T09:35:44.038 INFO:teuthology.orchestra.run.smithi129.stdout: openblas-0.3.21-2.el9.x86_64 2023-10-14T09:35:44.038 INFO:teuthology.orchestra.run.smithi129.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-10-14T09:35:44.038 INFO:teuthology.orchestra.run.smithi129.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-10-14T09:35:44.038 INFO:teuthology.orchestra.run.smithi129.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-10-14T09:35:44.038 INFO:teuthology.orchestra.run.smithi129.stdout: postgresql-13.11-1.el9.x86_64 2023-10-14T09:35:44.039 INFO:teuthology.orchestra.run.smithi129.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-10-14T09:35:44.039 INFO:teuthology.orchestra.run.smithi129.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-10-14T09:35:44.039 INFO:teuthology.orchestra.run.smithi129.stdout: postgresql-server-13.11-1.el9.x86_64 2023-10-14T09:35:44.039 INFO:teuthology.orchestra.run.smithi129.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-10-14T09:35:44.039 INFO:teuthology.orchestra.run.smithi129.stdout: python3-babel-2.9.1-2.el9.noarch 2023-10-14T09:35:44.040 INFO:teuthology.orchestra.run.smithi129.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-10-14T09:35:44.040 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-10-14T09:35:44.040 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:44.040 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:44.040 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cephfs-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:44.041 INFO:teuthology.orchestra.run.smithi129.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-10-14T09:35:44.041 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-10-14T09:35:44.041 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-10-14T09:35:44.041 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-10-14T09:35:44.041 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-10-14T09:35:44.041 INFO:teuthology.orchestra.run.smithi129.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-10-14T09:35:44.042 INFO:teuthology.orchestra.run.smithi129.stdout: python3-google-auth-1:2.23.2-1.el9.noarch 2023-10-14T09:35:44.042 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-10-14T09:35:44.042 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-10-14T09:35:44.042 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-10-14T09:35:44.042 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-10-14T09:35:44.043 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-10-14T09:35:44.043 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-10-14T09:35:44.043 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-10-14T09:35:44.043 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-10-14T09:35:44.043 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-10-14T09:35:44.043 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-10-14T09:35:44.044 INFO:teuthology.orchestra.run.smithi129.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-10-14T09:35:44.044 INFO:teuthology.orchestra.run.smithi129.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-10-14T09:35:44.044 INFO:teuthology.orchestra.run.smithi129.stdout: python3-mako-1.1.4-6.el9.noarch 2023-10-14T09:35:44.044 INFO:teuthology.orchestra.run.smithi129.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-10-14T09:35:44.044 INFO:teuthology.orchestra.run.smithi129.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-10-14T09:35:44.045 INFO:teuthology.orchestra.run.smithi129.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-10-14T09:35:44.045 INFO:teuthology.orchestra.run.smithi129.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-10-14T09:35:44.045 INFO:teuthology.orchestra.run.smithi129.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-10-14T09:35:44.045 INFO:teuthology.orchestra.run.smithi129.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-10-14T09:35:44.046 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-10-14T09:35:44.046 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ply-3.11-14.el9.noarch 2023-10-14T09:35:44.046 INFO:teuthology.orchestra.run.smithi129.stdout: python3-portend-3.1.0-2.el9.noarch 2023-10-14T09:35:44.046 INFO:teuthology.orchestra.run.smithi129.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-10-14T09:35:44.046 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-10-14T09:35:44.047 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-10-14T09:35:44.047 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-10-14T09:35:44.047 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pycparser-2.20-6.el9.noarch 2023-10-14T09:35:44.047 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pytz-2021.1-5.el9.noarch 2023-10-14T09:35:44.047 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rados-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:44.048 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:44.048 INFO:teuthology.orchestra.run.smithi129.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-10-14T09:35:44.048 INFO:teuthology.orchestra.run.smithi129.stdout: python3-requests-2.25.1-7.el9.noarch 2023-10-14T09:35:44.048 INFO:teuthology.orchestra.run.smithi129.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-10-14T09:35:44.048 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:44.049 INFO:teuthology.orchestra.run.smithi129.stdout: python3-routes-2.5.1-5.el9.noarch 2023-10-14T09:35:44.049 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rsa-4.9-2.el9.noarch 2023-10-14T09:35:44.049 INFO:teuthology.orchestra.run.smithi129.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-10-14T09:35:44.049 INFO:teuthology.orchestra.run.smithi129.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-10-14T09:35:44.049 INFO:teuthology.orchestra.run.smithi129.stdout: python3-toml-0.10.2-6.el9.noarch 2023-10-14T09:35:44.050 INFO:teuthology.orchestra.run.smithi129.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-10-14T09:35:44.050 INFO:teuthology.orchestra.run.smithi129.stdout: python3-urllib3-1.26.5-3.el9.noarch 2023-10-14T09:35:44.050 INFO:teuthology.orchestra.run.smithi129.stdout: python3-webob-1.8.7-6.el9.noarch 2023-10-14T09:35:44.050 INFO:teuthology.orchestra.run.smithi129.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-10-14T09:35:44.051 INFO:teuthology.orchestra.run.smithi129.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-10-14T09:35:44.052 INFO:teuthology.orchestra.run.smithi129.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-10-14T09:35:44.052 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:44.052 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:44.052 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-nbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:44.052 INFO:teuthology.orchestra.run.smithi129.stdout: re2-1:20211101-3.el9.x86_64 2023-10-14T09:35:44.053 INFO:teuthology.orchestra.run.smithi129.stdout: socat-1.7.4.1-5.el9.x86_64 2023-10-14T09:35:44.053 INFO:teuthology.orchestra.run.smithi129.stdout: thrift-0.15.0-2.el9.x86_64 2023-10-14T09:35:44.053 INFO:teuthology.orchestra.run.smithi129.stdout: uuid-1.6.2-55.el9.x86_64 2023-10-14T09:35:44.053 INFO:teuthology.orchestra.run.smithi129.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-10-14T09:35:44.053 INFO:teuthology.orchestra.run.smithi129.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-10-14T09:35:44.054 INFO:teuthology.orchestra.run.smithi129.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-10-14T09:35:44.054 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:35:44.055 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2023-10-14T09:35:44.569 DEBUG:teuthology.parallel:result is None 2023-10-14T09:35:44.976 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-test-2:18.0.0-6730.g4ba8a190.el9.x86_64 124/153 2023-10-14T09:35:45.033 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 125/153 2023-10-14T09:35:45.063 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-nbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 126/153 2023-10-14T09:35:45.335 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : elfutils-libelf-devel-0.189-3.el9.x86_64 127/153 2023-10-14T09:35:45.457 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 128/153 2023-10-14T09:35:45.541 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 129/153 2023-10-14T09:35:45.583 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libtool-2.4.6-45.el9.x86_64 130/153 2023-10-14T09:35:45.614 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 131/153 2023-10-14T09:35:45.645 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el9.x86_ 132/153 2023-10-14T09:35:45.681 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : NetworkManager-team-1:1.45.4-1.el9.x86_64 133/153 2023-10-14T09:35:45.769 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : NetworkManager-tui-1:1.45.4-1.el9.x86_64 134/153 2023-10-14T09:35:45.845 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 135/153 2023-10-14T09:35:45.906 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 136/153 2023-10-14T09:35:46.872 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 137/153 2023-10-14T09:35:46.921 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 137/153 2023-10-14T09:35:46.985 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 137/153 2023-10-14T09:35:47.046 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephfs-top-2:18.0.0-6730.g4ba8a190.el9.noarch 138/153 2023-10-14T09:35:48.420 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 139/153 2023-10-14T09:35:48.512 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 140/153 2023-10-14T09:35:48.559 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 141/153 2023-10-14T09:35:48.677 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flex-2.6.4-9.el9.x86_64 142/153 2023-10-14T09:35:48.714 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : bison-3.7.4-5.el9.x86_64 143/153 2023-10-14T09:35:48.743 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 144/153 2023-10-14T09:35:48.743 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 145/153 2023-10-14T09:35:48.861 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 145/153 2023-10-14T09:35:48.894 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 146/153 2023-10-14T09:35:48.960 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 147/153 2023-10-14T09:35:49.001 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 148/153 2023-10-14T09:35:49.039 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 149/153 2023-10-14T09:35:49.040 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 149/153 2023-10-14T09:35:49.377 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 149/153 2023-10-14T09:35:49.378 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 150/153 2023-10-14T09:35:49.532 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 150/153 2023-10-14T09:35:49.562 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 151/153 2023-10-14T09:35:49.563 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/153 2023-10-14T09:35:49.684 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/153 2023-10-14T09:35:49.806 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 153/153 2023-10-14T09:35:50.064 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 153/153 2023-10-14T09:35:50.065 INFO:teuthology.orchestra.run.smithi102.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-14T09:35:50.065 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:35:54.844 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-2:18.0.0-6730.g4ba8a190.el9.x86_64 1/153 2023-10-14T09:35:54.844 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 2/153 2023-10-14T09:35:54.844 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 3/153 2023-10-14T09:35:54.845 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 4/153 2023-10-14T09:35:54.845 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 5/153 2023-10-14T09:35:54.845 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 6/153 2023-10-14T09:35:54.845 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 7/153 2023-10-14T09:35:54.845 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 8/153 2023-10-14T09:35:54.846 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 9/153 2023-10-14T09:35:54.846 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 10/153 2023-10-14T09:35:54.846 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 11/153 2023-10-14T09:35:54.846 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-test-2:18.0.0-6730.g4ba8a190.el9.x86_64 12/153 2023-10-14T09:35:54.846 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 13/153 2023-10-14T09:35:54.847 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el9.x86_ 14/153 2023-10-14T09:35:54.847 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 15/153 2023-10-14T09:35:54.847 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 16/153 2023-10-14T09:35:54.847 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados-devel-2:18.0.0-6730.g4ba8a190.el9.x86_6 17/153 2023-10-14T09:35:54.847 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86 18/153 2023-10-14T09:35:54.847 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 19/153 2023-10-14T09:35:54.848 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 20/153 2023-10-14T09:35:54.848 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el9. 21/153 2023-10-14T09:35:54.848 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cephfs-2:18.0.0-6730.g4ba8a190.el9.x86_6 22/153 2023-10-14T09:35:54.848 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rados-2:18.0.0-6730.g4ba8a190.el9.x86_64 23/153 2023-10-14T09:35:54.848 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 24/153 2023-10-14T09:35:54.848 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 25/153 2023-10-14T09:35:54.849 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 26/153 2023-10-14T09:35:54.849 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 27/153 2023-10-14T09:35:54.849 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-nbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 28/153 2023-10-14T09:35:54.849 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 29/153 2023-10-14T09:35:54.849 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noa 30/153 2023-10-14T09:35:54.859 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.n 31/153 2023-10-14T09:35:54.859 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 32/153 2023-10-14T09:35:54.859 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 33/153 2023-10-14T09:35:54.860 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 34/153 2023-10-14T09:35:54.860 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 35/153 2023-10-14T09:35:54.860 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 36/153 2023-10-14T09:35:54.860 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 37/153 2023-10-14T09:35:54.860 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephfs-top-2:18.0.0-6730.g4ba8a190.el9.noarch 38/153 2023-10-14T09:35:54.861 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : bison-3.7.4-5.el9.x86_64 39/153 2023-10-14T09:35:54.861 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 40/153 2023-10-14T09:35:54.861 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flex-2.6.4-9.el9.x86_64 41/153 2023-10-14T09:35:54.861 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 42/153 2023-10-14T09:35:54.861 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 43/153 2023-10-14T09:35:54.861 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 44/153 2023-10-14T09:35:54.862 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 45/153 2023-10-14T09:35:54.862 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 46/153 2023-10-14T09:35:54.862 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 47/153 2023-10-14T09:35:54.862 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 48/153 2023-10-14T09:35:54.862 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 49/153 2023-10-14T09:35:54.863 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 50/153 2023-10-14T09:35:54.863 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 51/153 2023-10-14T09:35:54.863 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 52/153 2023-10-14T09:35:54.863 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 53/153 2023-10-14T09:35:54.863 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-13.11-1.el9.x86_64 54/153 2023-10-14T09:35:54.864 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 55/153 2023-10-14T09:35:54.864 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 56/153 2023-10-14T09:35:54.864 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 57/153 2023-10-14T09:35:54.864 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 58/153 2023-10-14T09:35:54.864 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 59/153 2023-10-14T09:35:54.865 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 60/153 2023-10-14T09:35:54.865 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/153 2023-10-14T09:35:54.865 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/153 2023-10-14T09:35:54.865 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/153 2023-10-14T09:35:54.865 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/153 2023-10-14T09:35:54.866 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/153 2023-10-14T09:35:54.866 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/153 2023-10-14T09:35:54.866 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/153 2023-10-14T09:35:54.866 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 68/153 2023-10-14T09:35:54.866 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 69/153 2023-10-14T09:35:54.867 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 70/153 2023-10-14T09:35:54.867 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 71/153 2023-10-14T09:35:54.867 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 72/153 2023-10-14T09:35:54.867 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 73/153 2023-10-14T09:35:54.867 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 74/153 2023-10-14T09:35:54.867 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 75/153 2023-10-14T09:35:54.868 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 76/153 2023-10-14T09:35:54.869 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 77/153 2023-10-14T09:35:54.870 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 78/153 2023-10-14T09:35:54.870 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 79/153 2023-10-14T09:35:54.870 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 80/153 2023-10-14T09:35:54.870 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ply-3.11-14.el9.noarch 81/153 2023-10-14T09:35:54.870 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 82/153 2023-10-14T09:35:54.871 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 83/153 2023-10-14T09:35:54.871 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-urllib3-1.26.5-3.el9.noarch 84/153 2023-10-14T09:35:54.871 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 85/153 2023-10-14T09:35:54.871 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : automake-1.16.2-8.el9.noarch 86/153 2023-10-14T09:35:54.871 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : elfutils-libelf-devel-0.189-3.el9.x86_64 87/153 2023-10-14T09:35:54.872 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : jq-1.6-15.el9.x86_64 88/153 2023-10-14T09:35:54.872 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 89/153 2023-10-14T09:35:54.872 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 90/153 2023-10-14T09:35:54.872 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 91/153 2023-10-14T09:35:54.872 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/153 2023-10-14T09:35:54.873 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 93/153 2023-10-14T09:35:54.873 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 94/153 2023-10-14T09:35:54.873 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 95/153 2023-10-14T09:35:54.873 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 96/153 2023-10-14T09:35:54.873 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 97/153 2023-10-14T09:35:54.874 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 98/153 2023-10-14T09:35:54.874 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 99/153 2023-10-14T09:35:54.874 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 100/153 2023-10-14T09:35:54.874 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 101/153 2023-10-14T09:35:54.874 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 102/153 2023-10-14T09:35:54.875 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 103/153 2023-10-14T09:35:54.875 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 104/153 2023-10-14T09:35:54.875 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 105/153 2023-10-14T09:35:54.875 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 106/153 2023-10-14T09:35:54.875 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 107/153 2023-10-14T09:35:54.875 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-google-auth-1:2.23.2-1.el9.noarch 108/153 2023-10-14T09:35:54.876 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 109/153 2023-10-14T09:35:54.876 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 110/153 2023-10-14T09:35:54.876 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 111/153 2023-10-14T09:35:54.876 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 112/153 2023-10-14T09:35:54.876 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 113/153 2023-10-14T09:35:54.876 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 114/153 2023-10-14T09:35:54.877 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 115/153 2023-10-14T09:35:54.877 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 116/153 2023-10-14T09:35:54.877 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 117/153 2023-10-14T09:35:54.877 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 118/153 2023-10-14T09:35:54.877 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 119/153 2023-10-14T09:35:54.878 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 120/153 2023-10-14T09:35:54.878 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 121/153 2023-10-14T09:35:54.878 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/153 2023-10-14T09:35:54.878 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 123/153 2023-10-14T09:35:54.878 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 124/153 2023-10-14T09:35:54.879 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 125/153 2023-10-14T09:35:54.879 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 126/153 2023-10-14T09:35:54.879 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 127/153 2023-10-14T09:35:54.879 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 128/153 2023-10-14T09:35:54.879 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 129/153 2023-10-14T09:35:54.880 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 130/153 2023-10-14T09:35:54.880 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 131/153 2023-10-14T09:35:54.880 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : re2-1:20211101-3.el9.x86_64 132/153 2023-10-14T09:35:54.880 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 133/153 2023-10-14T09:35:54.880 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 134/153 2023-10-14T09:35:54.881 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 135/153 2023-10-14T09:35:54.881 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 136/153 2023-10-14T09:35:54.881 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 137/153 2023-10-14T09:35:54.881 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 138/153 2023-10-14T09:35:54.881 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 139/153 2023-10-14T09:35:54.881 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-1:1.45.4-1.el9.x86_64 140/153 2023-10-14T09:35:54.882 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 141/153 2023-10-14T09:35:54.882 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-libnm-1:1.45.4-1.el9.x86_64 142/153 2023-10-14T09:35:54.882 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 143/153 2023-10-14T09:35:54.882 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-team-1:1.45.4-1.el9.x86_64 144/153 2023-10-14T09:35:54.882 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 145/153 2023-10-14T09:35:54.883 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-tui-1:1.45.4-1.el9.x86_64 146/153 2023-10-14T09:35:54.883 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 147/153 2023-10-14T09:35:54.883 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : acl-2.3.1-4.el9.x86_64 148/153 2023-10-14T09:35:54.883 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : acl-2.3.1-3.el9.x86_64 149/153 2023-10-14T09:35:54.883 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 150/153 2023-10-14T09:35:54.884 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 151/153 2023-10-14T09:35:54.884 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 152/153 2023-10-14T09:35:57.057 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 153/153 2023-10-14T09:35:57.057 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:35:57.057 INFO:teuthology.orchestra.run.smithi102.stdout:Upgraded: 2023-10-14T09:35:57.057 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-1:1.45.4-1.el9.x86_64 2023-10-14T09:35:57.058 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-libnm-1:1.45.4-1.el9.x86_64 2023-10-14T09:35:57.058 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-team-1:1.45.4-1.el9.x86_64 2023-10-14T09:35:57.058 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-tui-1:1.45.4-1.el9.x86_64 2023-10-14T09:35:57.058 INFO:teuthology.orchestra.run.smithi102.stdout: acl-2.3.1-4.el9.x86_64 2023-10-14T09:35:57.058 INFO:teuthology.orchestra.run.smithi102.stdout: libacl-2.3.1-4.el9.x86_64 2023-10-14T09:35:57.059 INFO:teuthology.orchestra.run.smithi102.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-10-14T09:35:57.059 INFO:teuthology.orchestra.run.smithi102.stdout: librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:57.059 INFO:teuthology.orchestra.run.smithi102.stdout: librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:57.059 INFO:teuthology.orchestra.run.smithi102.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-10-14T09:35:57.059 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2023-10-14T09:35:57.060 INFO:teuthology.orchestra.run.smithi102.stdout: automake-1.16.2-8.el9.noarch 2023-10-14T09:35:57.060 INFO:teuthology.orchestra.run.smithi102.stdout: bison-3.7.4-5.el9.x86_64 2023-10-14T09:35:57.060 INFO:teuthology.orchestra.run.smithi102.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-10-14T09:35:57.060 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:57.060 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:57.061 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:57.061 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:57.061 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T09:35:57.061 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:57.061 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:57.062 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:57.062 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T09:35:57.062 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T09:35:57.062 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T09:35:57.062 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T09:35:57.063 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T09:35:57.063 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:57.063 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:57.063 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T09:35:57.064 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:57.064 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:57.064 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-test-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:57.064 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T09:35:57.064 INFO:teuthology.orchestra.run.smithi102.stdout: cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T09:35:57.065 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:57.065 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-top-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T09:35:57.065 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libelf-devel-0.189-3.el9.x86_64 2023-10-14T09:35:57.065 INFO:teuthology.orchestra.run.smithi102.stdout: flex-2.6.4-9.el9.x86_64 2023-10-14T09:35:57.065 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-10-14T09:35:57.065 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-10-14T09:35:57.066 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-10-14T09:35:57.066 INFO:teuthology.orchestra.run.smithi102.stdout: fmt-8.1.1-5.el9.x86_64 2023-10-14T09:35:57.066 INFO:teuthology.orchestra.run.smithi102.stdout: fuse-2.9.9-15.el9.x86_64 2023-10-14T09:35:57.066 INFO:teuthology.orchestra.run.smithi102.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-10-14T09:35:57.067 INFO:teuthology.orchestra.run.smithi102.stdout: jq-1.6-15.el9.x86_64 2023-10-14T09:35:57.067 INFO:teuthology.orchestra.run.smithi102.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-10-14T09:35:57.067 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-9.0.0-9.el9.x86_64 2023-10-14T09:35:57.067 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-10-14T09:35:57.067 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-devel-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:57.067 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:57.068 INFO:teuthology.orchestra.run.smithi102.stdout: libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:57.068 INFO:teuthology.orchestra.run.smithi102.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-10-14T09:35:57.068 INFO:teuthology.orchestra.run.smithi102.stdout: liboath-2.6.7-2.el9.x86_64 2023-10-14T09:35:57.068 INFO:teuthology.orchestra.run.smithi102.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-10-14T09:35:57.069 INFO:teuthology.orchestra.run.smithi102.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-10-14T09:35:57.069 INFO:teuthology.orchestra.run.smithi102.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-10-14T09:35:57.069 INFO:teuthology.orchestra.run.smithi102.stdout: librados-devel-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:57.069 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:57.069 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-10-14T09:35:57.070 INFO:teuthology.orchestra.run.smithi102.stdout: librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:57.070 INFO:teuthology.orchestra.run.smithi102.stdout: libtool-2.4.6-45.el9.x86_64 2023-10-14T09:35:57.070 INFO:teuthology.orchestra.run.smithi102.stdout: libunwind-1.6.2-1.el9.x86_64 2023-10-14T09:35:57.070 INFO:teuthology.orchestra.run.smithi102.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-10-14T09:35:57.070 INFO:teuthology.orchestra.run.smithi102.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-10-14T09:35:57.071 INFO:teuthology.orchestra.run.smithi102.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-10-14T09:35:57.071 INFO:teuthology.orchestra.run.smithi102.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-10-14T09:35:57.071 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-0.3.21-2.el9.x86_64 2023-10-14T09:35:57.071 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-10-14T09:35:57.071 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-10-14T09:35:57.072 INFO:teuthology.orchestra.run.smithi102.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-10-14T09:35:57.072 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-13.11-1.el9.x86_64 2023-10-14T09:35:57.072 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-10-14T09:35:57.072 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-10-14T09:35:57.072 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-server-13.11-1.el9.x86_64 2023-10-14T09:35:57.072 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-10-14T09:35:57.073 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel-2.9.1-2.el9.noarch 2023-10-14T09:35:57.073 INFO:teuthology.orchestra.run.smithi102.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-10-14T09:35:57.073 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-10-14T09:35:57.073 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:57.073 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:57.074 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cephfs-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:57.074 INFO:teuthology.orchestra.run.smithi102.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-10-14T09:35:57.074 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-10-14T09:35:57.074 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-10-14T09:35:57.074 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-10-14T09:35:57.075 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-10-14T09:35:57.075 INFO:teuthology.orchestra.run.smithi102.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-10-14T09:35:57.075 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth-1:2.23.2-1.el9.noarch 2023-10-14T09:35:57.075 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-10-14T09:35:57.075 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-10-14T09:35:57.076 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-10-14T09:35:57.076 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-10-14T09:35:57.076 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-10-14T09:35:57.076 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-10-14T09:35:57.076 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-10-14T09:35:57.077 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-10-14T09:35:57.077 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-10-14T09:35:57.077 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-10-14T09:35:57.077 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-10-14T09:35:57.077 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-10-14T09:35:57.078 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako-1.1.4-6.el9.noarch 2023-10-14T09:35:57.078 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-10-14T09:35:57.078 INFO:teuthology.orchestra.run.smithi102.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-10-14T09:35:57.078 INFO:teuthology.orchestra.run.smithi102.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-10-14T09:35:57.078 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-10-14T09:35:57.079 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-10-14T09:35:57.079 INFO:teuthology.orchestra.run.smithi102.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-10-14T09:35:57.079 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-10-14T09:35:57.079 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ply-3.11-14.el9.noarch 2023-10-14T09:35:57.079 INFO:teuthology.orchestra.run.smithi102.stdout: python3-portend-3.1.0-2.el9.noarch 2023-10-14T09:35:57.080 INFO:teuthology.orchestra.run.smithi102.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-10-14T09:35:57.080 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-10-14T09:35:57.080 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-10-14T09:35:57.080 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-10-14T09:35:57.080 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pycparser-2.20-6.el9.noarch 2023-10-14T09:35:57.081 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytz-2021.1-5.el9.noarch 2023-10-14T09:35:57.081 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:57.081 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:57.081 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-10-14T09:35:57.081 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-2.25.1-7.el9.noarch 2023-10-14T09:35:57.081 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-10-14T09:35:57.082 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:57.082 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes-2.5.1-5.el9.noarch 2023-10-14T09:35:57.082 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rsa-4.9-2.el9.noarch 2023-10-14T09:35:57.082 INFO:teuthology.orchestra.run.smithi102.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-10-14T09:35:57.082 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-10-14T09:35:57.083 INFO:teuthology.orchestra.run.smithi102.stdout: python3-toml-0.10.2-6.el9.noarch 2023-10-14T09:35:57.083 INFO:teuthology.orchestra.run.smithi102.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-10-14T09:35:57.083 INFO:teuthology.orchestra.run.smithi102.stdout: python3-urllib3-1.26.5-3.el9.noarch 2023-10-14T09:35:57.083 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob-1.8.7-6.el9.noarch 2023-10-14T09:35:57.083 INFO:teuthology.orchestra.run.smithi102.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-10-14T09:35:57.084 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-10-14T09:35:57.084 INFO:teuthology.orchestra.run.smithi102.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-10-14T09:35:57.084 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:57.084 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:57.084 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-nbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T09:35:57.085 INFO:teuthology.orchestra.run.smithi102.stdout: re2-1:20211101-3.el9.x86_64 2023-10-14T09:35:57.085 INFO:teuthology.orchestra.run.smithi102.stdout: socat-1.7.4.1-5.el9.x86_64 2023-10-14T09:35:57.085 INFO:teuthology.orchestra.run.smithi102.stdout: thrift-0.15.0-2.el9.x86_64 2023-10-14T09:35:57.085 INFO:teuthology.orchestra.run.smithi102.stdout: uuid-1.6.2-55.el9.x86_64 2023-10-14T09:35:57.085 INFO:teuthology.orchestra.run.smithi102.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-10-14T09:35:57.085 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-10-14T09:35:57.086 INFO:teuthology.orchestra.run.smithi102.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-10-14T09:35:57.086 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:35:57.086 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2023-10-14T09:35:57.687 DEBUG:teuthology.parallel:result is None 2023-10-14T09:35:57.688 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T09:35:57.919 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-14T09:35:57.975 INFO:teuthology.orchestra.run.smithi102.stdout:18.0.0-6730.g4ba8a190.el9 2023-10-14T09:35:57.975 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730.g4ba8a190.el9 2023-10-14T09:35:57.976 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730.g4ba8a190 is installed. 2023-10-14T09:35:57.976 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T09:35:58.119 DEBUG:teuthology.orchestra.run.smithi129:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-14T09:35:58.193 INFO:teuthology.orchestra.run.smithi129.stdout:18.0.0-6730.g4ba8a190.el9 2023-10-14T09:35:58.194 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730.g4ba8a190.el9 2023-10-14T09:35:58.194 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730.g4ba8a190 is installed. 2023-10-14T09:35:58.195 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-14T09:35:58.195 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-10-14T09:35:58.195 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-14T09:35:58.275 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2023-10-14T09:35:58.275 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-14T09:35:58.381 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-14T09:35:58.381 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-10-14T09:35:58.382 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/daemon-helper 2023-10-14T09:35:58.464 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-14T09:35:58.583 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2023-10-14T09:35:58.584 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/usr/bin/daemon-helper 2023-10-14T09:35:58.684 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-14T09:35:58.810 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-14T09:35:58.811 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-10-14T09:35:58.811 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-14T09:35:58.897 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-14T09:35:59.012 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2023-10-14T09:35:59.012 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-14T09:35:59.100 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-14T09:35:59.221 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-14T09:35:59.222 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-10-14T09:35:59.222 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/stdin-killer 2023-10-14T09:35:59.302 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-14T09:35:59.420 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2023-10-14T09:35:59.421 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/usr/bin/stdin-killer 2023-10-14T09:35:59.515 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-14T09:35:59.649 INFO:teuthology.run_tasks:Running task ceph... 2023-10-14T09:35:59.711 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-14T09:35:59.711 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 777 /var/log/ceph 2023-10-14T09:35:59.717 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 777 /var/log/ceph 2023-10-14T09:35:59.803 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-14T09:35:59.803 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-14T09:35:59.808 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-14T09:35:59.888 INFO:tasks.ceph:Creating extra log directories... 2023-10-14T09:35:59.889 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-14T09:35:59.893 DEBUG:teuthology.orchestra.run.smithi129:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-14T09:35:59.981 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-14T09:35:59.982 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-14T09:35:59.982 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-14T09:35:59.983 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-10-14T09:35:59.983 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-14T09:36:00.023 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-14T09:36:00.266 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-14T09:36:00.350 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2023-10-14T09:36:00.350 DEBUG:teuthology.orchestra.run.smithi129:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-14T09:36:00.407 DEBUG:teuthology.orchestra.run.smithi129:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-14T09:36:00.685 DEBUG:teuthology.orchestra.run.smithi129:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-14T09:36:00.797 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-14T09:36:00.798 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-14T09:36:00.798 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425164', 'branch': 'rishabh-2023oct13', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}}', 'email': None, 'first_in_suite': False, 'job_id': '7425164', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'rishabh-2023oct13'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-2023oct13', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6006, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'sleep_before_teardown': 0, 'subset': '402/512', 'suite': 'fs', 'suite_branch': 'rishabh-2023oct13', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi102.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFwh5NEmomLdH1twgM0mFjSdTELICqTtUwIwr5b+COO+24s2altP7MGFi3jSA2PfHs9EFjfsxWBbDbY2MHU1oe4=', 'smithi129.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCjJDbPyB/hulx2E9LwE3smeu/3pBngA8xVUoG2ZWnTy2bz9+39RnLbFTKciGkGMs/h7kdN6UjCdyI4AEIG0oMo='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestMisc']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '8cdab074dcca9a68965bc5a50e9c30b691949723', 'timestamp': '2023-10-13_18:04:14', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-14T09:36:00.799 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-14T09:36:00.805 DEBUG:teuthology.orchestra.run.smithi129:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-14T09:36:00.864 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/run/ceph 2023-10-14T09:36:00.892 DEBUG:teuthology.orchestra.run.smithi129:> sudo install -d -m0777 -- /var/run/ceph 2023-10-14T09:36:00.993 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-10-14T09:36:00.994 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/scratch_devs of=/dev/stdout 2023-10-14T09:36:01.051 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-14T09:36:01.052 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_1 2023-10-14T09:36:01.099 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-14T09:36:01.099 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T09:36:01.099 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 634 Links: 1 2023-10-14T09:36:01.100 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T09:36:01.100 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T09:36:01.100 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2023-10-14 09:35:50.564315502 +0000 2023-10-14T09:36:01.100 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2023-10-14 09:33:08.819607141 +0000 2023-10-14T09:36:01.100 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2023-10-14 09:33:08.819607141 +0000 2023-10-14T09:36:01.100 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2023-10-14 09:33:08.819607141 +0000 2023-10-14T09:36:01.101 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-14T09:36:01.229 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2023-10-14T09:36:01.229 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2023-10-14T09:36:01.229 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000389072 s, 1.3 MB/s 2023-10-14T09:36:01.231 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-14T09:36:01.289 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_2 2023-10-14T09:36:01.339 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-14T09:36:01.339 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T09:36:01.339 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 651 Links: 1 2023-10-14T09:36:01.339 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T09:36:01.340 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T09:36:01.340 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2023-10-14 09:35:50.565315482 +0000 2023-10-14T09:36:01.340 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2023-10-14 09:33:09.856586417 +0000 2023-10-14T09:36:01.340 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2023-10-14 09:33:09.856586417 +0000 2023-10-14T09:36:01.340 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2023-10-14 09:33:09.856586417 +0000 2023-10-14T09:36:01.341 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-14T09:36:01.420 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2023-10-14T09:36:01.421 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2023-10-14T09:36:01.421 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000326405 s, 1.6 MB/s 2023-10-14T09:36:01.424 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-14T09:36:01.479 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_3 2023-10-14T09:36:01.526 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-14T09:36:01.526 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T09:36:01.527 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 672 Links: 1 2023-10-14T09:36:01.527 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T09:36:01.527 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T09:36:01.527 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2023-10-14 09:35:50.567315442 +0000 2023-10-14T09:36:01.527 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2023-10-14 09:33:10.859566372 +0000 2023-10-14T09:36:01.528 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2023-10-14 09:33:10.859566372 +0000 2023-10-14T09:36:01.528 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2023-10-14 09:33:10.859566372 +0000 2023-10-14T09:36:01.528 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-14T09:36:01.611 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2023-10-14T09:36:01.612 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2023-10-14T09:36:01.612 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000295977 s, 1.7 MB/s 2023-10-14T09:36:01.615 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-14T09:36:01.673 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_4 2023-10-14T09:36:01.723 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-14T09:36:01.724 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T09:36:01.724 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 690 Links: 1 2023-10-14T09:36:01.724 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T09:36:01.724 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T09:36:01.724 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2023-10-14 09:35:50.568315422 +0000 2023-10-14T09:36:01.725 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2023-10-14 09:33:11.855546467 +0000 2023-10-14T09:36:01.725 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2023-10-14 09:33:11.855546467 +0000 2023-10-14T09:36:01.725 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2023-10-14 09:33:11.855546467 +0000 2023-10-14T09:36:01.725 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-14T09:36:01.812 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2023-10-14T09:36:01.813 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2023-10-14T09:36:01.813 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000308133 s, 1.7 MB/s 2023-10-14T09:36:01.817 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-14T09:36:01.867 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T09:36:01.868 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2023-10-14T09:36:01.868 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/scratch_devs of=/dev/stdout 2023-10-14T09:36:01.927 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-14T09:36:01.928 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_1 2023-10-14T09:36:01.983 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-14T09:36:01.983 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T09:36:01.983 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 5h/5d Inode: 634 Links: 1 2023-10-14T09:36:01.983 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T09:36:01.983 INFO:teuthology.orchestra.run.smithi129.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T09:36:01.984 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2023-10-14 09:35:37.835725967 +0000 2023-10-14T09:36:01.984 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2023-10-14 09:33:08.038265098 +0000 2023-10-14T09:36:01.984 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2023-10-14 09:33:08.038265098 +0000 2023-10-14T09:36:01.984 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: 2023-10-14 09:33:08.038265098 +0000 2023-10-14T09:36:01.985 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-14T09:36:02.072 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2023-10-14T09:36:02.073 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2023-10-14T09:36:02.073 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000339971 s, 1.5 MB/s 2023-10-14T09:36:02.077 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-14T09:36:02.137 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_2 2023-10-14T09:36:02.189 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-14T09:36:02.190 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T09:36:02.190 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 5h/5d Inode: 651 Links: 1 2023-10-14T09:36:02.190 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T09:36:02.190 INFO:teuthology.orchestra.run.smithi129.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T09:36:02.190 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2023-10-14 09:35:37.836725944 +0000 2023-10-14T09:36:02.191 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2023-10-14 09:33:09.066242227 +0000 2023-10-14T09:36:02.191 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2023-10-14 09:33:09.066242227 +0000 2023-10-14T09:36:02.191 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: 2023-10-14 09:33:09.066242227 +0000 2023-10-14T09:36:02.191 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-14T09:36:02.279 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2023-10-14T09:36:02.280 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2023-10-14T09:36:02.280 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000341662 s, 1.5 MB/s 2023-10-14T09:36:02.282 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-14T09:36:02.336 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_3 2023-10-14T09:36:02.386 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-14T09:36:02.386 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T09:36:02.386 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 5h/5d Inode: 670 Links: 1 2023-10-14T09:36:02.387 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T09:36:02.387 INFO:teuthology.orchestra.run.smithi129.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T09:36:02.387 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2023-10-14 09:35:37.837725922 +0000 2023-10-14T09:36:02.387 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2023-10-14 09:33:10.098219266 +0000 2023-10-14T09:36:02.387 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2023-10-14 09:33:10.098219266 +0000 2023-10-14T09:36:02.387 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: 2023-10-14 09:33:10.098219266 +0000 2023-10-14T09:36:02.388 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-14T09:36:02.478 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2023-10-14T09:36:02.479 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2023-10-14T09:36:02.479 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000327903 s, 1.6 MB/s 2023-10-14T09:36:02.483 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-14T09:36:02.541 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_4 2023-10-14T09:36:02.591 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-14T09:36:02.591 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T09:36:02.591 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 5h/5d Inode: 689 Links: 1 2023-10-14T09:36:02.592 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T09:36:02.592 INFO:teuthology.orchestra.run.smithi129.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T09:36:02.592 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2023-10-14 09:35:37.838725900 +0000 2023-10-14T09:36:02.592 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2023-10-14 09:33:11.099196996 +0000 2023-10-14T09:36:02.592 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2023-10-14 09:33:11.099196996 +0000 2023-10-14T09:36:02.592 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: 2023-10-14 09:33:11.099196996 +0000 2023-10-14T09:36:02.593 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-14T09:36:02.678 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2023-10-14T09:36:02.679 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2023-10-14T09:36:02.679 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000306617 s, 1.7 MB/s 2023-10-14T09:36:02.682 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-14T09:36:02.736 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T09:36:02.737 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi102.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi129.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-14T09:36:02.737 INFO:tasks.ceph:Generating config... 2023-10-14T09:36:02.738 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-14T09:36:02.739 INFO:tasks.ceph:[client] debug client = 20 2023-10-14T09:36:02.739 INFO:tasks.ceph:[client] debug ms = 1 2023-10-14T09:36:02.739 INFO:tasks.ceph:[client] pid file = 2023-10-14T09:36:02.740 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-14T09:36:02.740 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-14T09:36:02.740 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-14T09:36:02.740 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-14T09:36:02.741 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-10-14T09:36:02.741 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-14T09:36:02.741 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-14T09:36:02.741 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-14T09:36:02.742 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-14T09:36:02.742 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-14T09:36:02.742 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-14T09:36:02.742 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-14T09:36:02.743 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-14T09:36:02.743 INFO:tasks.ceph:[mgr] debug client = 20 2023-10-14T09:36:02.743 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-10-14T09:36:02.743 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-14T09:36:02.744 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-14T09:36:02.744 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-14T09:36:02.744 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-14T09:36:02.744 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-14T09:36:02.745 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-14T09:36:02.745 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-14T09:36:02.745 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-14T09:36:02.745 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-14T09:36:02.746 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-14T09:36:02.746 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-14T09:36:02.746 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-14T09:36:02.747 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-14T09:36:02.747 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-14T09:36:02.747 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-14T09:36:02.747 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-14T09:36:02.748 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-14T09:36:02.748 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-14T09:36:02.748 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-14T09:36:02.748 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-14T09:36:02.749 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-14T09:36:02.749 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-14T09:36:02.749 INFO:tasks.ceph:Setting up mon.a... 2023-10-14T09:36:02.749 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-14T09:36:02.885 INFO:teuthology.orchestra.run.smithi102.stdout:creating /etc/ceph/ceph.keyring 2023-10-14T09:36:02.893 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-14T09:36:03.020 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-14T09:36:03.106 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.102'), ('mon.b', '172.21.15.129'), ('mon.c', '[v2:172.21.15.129:3301,v1:172.21.15.129:6790]')] 2023-10-14T09:36:03.107 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.102,172.21.15.129,[v2:172.21.15.129:3301,v1:172.21.15.129:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-14T09:36:03.108 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-10-14T09:36:03.108 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-14T09:36:03.161 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.102 --add b 172.21.15.129 --addv c '[v2:172.21.15.129:3301,v1:172.21.15.129:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-14T09:36:03.314 INFO:teuthology.orchestra.run.smithi102.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-14T09:36:03.315 INFO:teuthology.orchestra.run.smithi102.stdout:monmaptool: generated fsid 8a6cd69d-7f5b-4f2a-806a-0176c10aed50 2023-10-14T09:36:03.315 INFO:teuthology.orchestra.run.smithi102.stdout:setting min_mon_release = pacific 2023-10-14T09:36:03.315 INFO:teuthology.orchestra.run.smithi102.stdout:epoch 0 2023-10-14T09:36:03.315 INFO:teuthology.orchestra.run.smithi102.stdout:fsid 8a6cd69d-7f5b-4f2a-806a-0176c10aed50 2023-10-14T09:36:03.315 INFO:teuthology.orchestra.run.smithi102.stdout:last_changed 2023-10-14T09:36:03.313773+0000 2023-10-14T09:36:03.316 INFO:teuthology.orchestra.run.smithi102.stdout:created 2023-10-14T09:36:03.313773+0000 2023-10-14T09:36:03.316 INFO:teuthology.orchestra.run.smithi102.stdout:min_mon_release 16 (pacific) 2023-10-14T09:36:03.316 INFO:teuthology.orchestra.run.smithi102.stdout:election_strategy: 1 2023-10-14T09:36:03.316 INFO:teuthology.orchestra.run.smithi102.stdout:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2023-10-14T09:36:03.316 INFO:teuthology.orchestra.run.smithi102.stdout:1: [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] mon.b 2023-10-14T09:36:03.317 INFO:teuthology.orchestra.run.smithi102.stdout:2: [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] mon.c 2023-10-14T09:36:03.317 INFO:teuthology.orchestra.run.smithi102.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-14T09:36:03.318 DEBUG:teuthology.orchestra.run.smithi102:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-14T09:36:03.367 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 8a6cd69d-7f5b-4f2a-806a-0176c10aed50... 2023-10-14T09:36:03.368 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-14T09:36:03.374 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-14T09:36:03.540 INFO:teuthology.orchestra.run.smithi102.stdout:[global] 2023-10-14T09:36:03.540 INFO:teuthology.orchestra.run.smithi102.stdout: chdir = "" 2023-10-14T09:36:03.541 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-14T09:36:03.541 INFO:teuthology.orchestra.run.smithi102.stdout: auth supported = cephx 2023-10-14T09:36:03.541 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:36:03.541 INFO:teuthology.orchestra.run.smithi102.stdout: filestore xattr use omap = true 2023-10-14T09:36:03.541 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:36:03.542 INFO:teuthology.orchestra.run.smithi102.stdout: mon clock drift allowed = 1.000 2023-10-14T09:36:03.542 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:36:03.542 INFO:teuthology.orchestra.run.smithi102.stdout: osd crush chooseleaf type = 0 2023-10-14T09:36:03.542 INFO:teuthology.orchestra.run.smithi102.stdout: auth debug = true 2023-10-14T09:36:03.542 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:36:03.543 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on old message = true 2023-10-14T09:36:03.543 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on bug = true 2023-10-14T09:36:03.543 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:36:03.543 INFO:teuthology.orchestra.run.smithi102.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-14T09:36:03.543 INFO:teuthology.orchestra.run.smithi102.stdout: mon pg warn max object skew = 0 2023-10-14T09:36:03.544 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:36:03.544 INFO:teuthology.orchestra.run.smithi102.stdout: # disable pg_autoscaler by default for new pools 2023-10-14T09:36:03.544 INFO:teuthology.orchestra.run.smithi102.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-14T09:36:03.544 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:36:03.544 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default size = 2 2023-10-14T09:36:03.545 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:36:03.545 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow primary affinity = true 2023-10-14T09:36:03.545 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow pg remap = true 2023-10-14T09:36:03.545 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on legacy crush tunables = false 2023-10-14T09:36:03.545 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on crush straw calc version zero = false 2023-10-14T09:36:03.545 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on no sortbitwise = false 2023-10-14T09:36:03.546 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on osd down out interval zero = false 2023-10-14T09:36:03.546 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on too few osds = false 2023-10-14T09:36:03.546 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-14T09:36:03.546 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-14T09:36:03.547 INFO:teuthology.orchestra.run.smithi102.stdout: mon_allow_pool_size_one = true 2023-10-14T09:36:03.547 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:36:03.547 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-14T09:36:03.547 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:36:03.547 INFO:teuthology.orchestra.run.smithi102.stdout: osd default data pool replay window = 5 2023-10-14T09:36:03.547 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:36:03.548 INFO:teuthology.orchestra.run.smithi102.stdout: mon allow pool delete = true 2023-10-14T09:36:03.548 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:36:03.548 INFO:teuthology.orchestra.run.smithi102.stdout: mon cluster log file level = debug 2023-10-14T09:36:03.548 INFO:teuthology.orchestra.run.smithi102.stdout: debug asserts on shutdown = true 2023-10-14T09:36:03.548 INFO:teuthology.orchestra.run.smithi102.stdout: mon health detail to clog = false 2023-10-14T09:36:03.549 INFO:teuthology.orchestra.run.smithi102.stdout: mon host = "172.21.15.102,172.21.15.129,[v2:172.21.15.129:3301,v1:172.21.15.129:6790]" 2023-10-14T09:36:03.549 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on skipped message = False 2023-10-14T09:36:03.549 INFO:teuthology.orchestra.run.smithi102.stdout: fsid = 8a6cd69d-7f5b-4f2a-806a-0176c10aed50 2023-10-14T09:36:03.549 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:36:03.549 INFO:teuthology.orchestra.run.smithi102.stdout:[osd] 2023-10-14T09:36:03.550 INFO:teuthology.orchestra.run.smithi102.stdout: osd journal size = 100 2023-10-14T09:36:03.550 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:36:03.550 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub load threshold = 5.0 2023-10-14T09:36:03.550 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub max interval = 600 2023-10-14T09:36:03.550 INFO:teuthology.orchestra.run.smithi102.stdout: osd mclock profile = high_recovery_ops 2023-10-14T09:36:03.551 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:36:03.551 INFO:teuthology.orchestra.run.smithi102.stdout: osd recover clone overlap = true 2023-10-14T09:36:03.551 INFO:teuthology.orchestra.run.smithi102.stdout: osd recovery max chunk = 1048576 2023-10-14T09:36:03.551 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:36:03.551 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug shutdown = true 2023-10-14T09:36:03.551 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug op order = true 2023-10-14T09:36:03.552 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug verify stray on activate = true 2023-10-14T09:36:03.552 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:36:03.552 INFO:teuthology.orchestra.run.smithi102.stdout: osd open classes on start = true 2023-10-14T09:36:03.552 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug pg log writeout = true 2023-10-14T09:36:03.552 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:36:03.553 INFO:teuthology.orchestra.run.smithi102.stdout: osd deep scrub update digest min age = 30 2023-10-14T09:36:03.553 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:36:03.553 INFO:teuthology.orchestra.run.smithi102.stdout: osd map max advance = 10 2023-10-14T09:36:03.553 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:36:03.553 INFO:teuthology.orchestra.run.smithi102.stdout: journal zero on create = true 2023-10-14T09:36:03.554 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:36:03.554 INFO:teuthology.orchestra.run.smithi102.stdout: filestore ondisk finisher threads = 3 2023-10-14T09:36:03.554 INFO:teuthology.orchestra.run.smithi102.stdout: filestore apply finisher threads = 3 2023-10-14T09:36:03.554 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:36:03.554 INFO:teuthology.orchestra.run.smithi102.stdout: bdev debug aio = true 2023-10-14T09:36:03.554 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug misdirected ops = true 2023-10-14T09:36:03.555 INFO:teuthology.orchestra.run.smithi102.stdout: bdev async discard = True 2023-10-14T09:36:03.555 INFO:teuthology.orchestra.run.smithi102.stdout: bdev enable discard = True 2023-10-14T09:36:03.555 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore allocator = bitmap 2023-10-14T09:36:03.555 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore block size = 96636764160 2023-10-14T09:36:03.555 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore fsck on mount = True 2023-10-14T09:36:03.556 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluefs = 1/20 2023-10-14T09:36:03.556 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluestore = 1/20 2023-10-14T09:36:03.556 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2023-10-14T09:36:03.556 INFO:teuthology.orchestra.run.smithi102.stdout: debug osd = 20 2023-10-14T09:36:03.556 INFO:teuthology.orchestra.run.smithi102.stdout: debug rocksdb = 4/10 2023-10-14T09:36:03.557 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd backfillfull_ratio = 0.85 2023-10-14T09:36:03.557 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd full ratio = 0.9 2023-10-14T09:36:03.557 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd nearfull ratio = 0.8 2023-10-14T09:36:03.557 INFO:teuthology.orchestra.run.smithi102.stdout: osd failsafe full ratio = 0.95 2023-10-14T09:36:03.557 INFO:teuthology.orchestra.run.smithi102.stdout: osd objectstore = bluestore 2023-10-14T09:36:03.557 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2023-10-14T09:36:03.558 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:36:03.558 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr] 2023-10-14T09:36:03.558 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2023-10-14T09:36:03.558 INFO:teuthology.orchestra.run.smithi102.stdout: debug mgr = 20 2023-10-14T09:36:03.558 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2023-10-14T09:36:03.559 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2023-10-14T09:36:03.559 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2023-10-14T09:36:03.559 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2023-10-14T09:36:03.559 INFO:teuthology.orchestra.run.smithi102.stdout: mgr/telemetry/nag = false 2023-10-14T09:36:03.559 INFO:teuthology.orchestra.run.smithi102.stdout: debug client = 20 2023-10-14T09:36:03.560 INFO:teuthology.orchestra.run.smithi102.stdout: debug finisher = 20 2023-10-14T09:36:03.560 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:36:03.560 INFO:teuthology.orchestra.run.smithi102.stdout:[mon] 2023-10-14T09:36:03.560 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2023-10-14T09:36:03.560 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2023-10-14T09:36:03.560 INFO:teuthology.orchestra.run.smithi102.stdout: debug paxos = 20 2023-10-14T09:36:03.561 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2023-10-14T09:36:03.561 INFO:teuthology.orchestra.run.smithi102.stdout: mon data avail warn = 5 2023-10-14T09:36:03.561 INFO:teuthology.orchestra.run.smithi102.stdout: mon mgr mkfs grace = 240 2023-10-14T09:36:03.561 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2023-10-14T09:36:03.561 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd reporter subtree level = osd 2023-10-14T09:36:03.562 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd prime pg temp = true 2023-10-14T09:36:03.562 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2023-10-14T09:36:03.562 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:36:03.562 INFO:teuthology.orchestra.run.smithi102.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-14T09:36:03.562 INFO:teuthology.orchestra.run.smithi102.stdout: auth mon ticket ttl = 660 # 11m 2023-10-14T09:36:03.563 INFO:teuthology.orchestra.run.smithi102.stdout: auth service ticket ttl = 240 # 4m 2023-10-14T09:36:03.563 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:36:03.563 INFO:teuthology.orchestra.run.smithi102.stdout: # don't complain about insecure global_id in the test suite 2023-10-14T09:36:03.563 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-14T09:36:03.563 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-14T09:36:03.563 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:36:03.564 INFO:teuthology.orchestra.run.smithi102.stdout: # 1m isn't quite enough 2023-10-14T09:36:03.564 INFO:teuthology.orchestra.run.smithi102.stdout: mon_down_mkfs_grace = 2m 2023-10-14T09:36:03.564 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:36:03.564 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_filestore_osds = false 2023-10-14T09:36:03.564 INFO:teuthology.orchestra.run.smithi102.stdout: mon op complaint time = 120 2023-10-14T09:36:03.565 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:36:03.565 INFO:teuthology.orchestra.run.smithi102.stdout:[client] 2023-10-14T09:36:03.565 INFO:teuthology.orchestra.run.smithi102.stdout: rgw cache enabled = true 2023-10-14T09:36:03.565 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable ops log = true 2023-10-14T09:36:03.565 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable usage log = true 2023-10-14T09:36:03.566 INFO:teuthology.orchestra.run.smithi102.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-14T09:36:03.566 INFO:teuthology.orchestra.run.smithi102.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-14T09:36:03.566 INFO:teuthology.orchestra.run.smithi102.stdout: client mount timeout = 600 2023-10-14T09:36:03.566 INFO:teuthology.orchestra.run.smithi102.stdout: debug client = 20 2023-10-14T09:36:03.566 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2023-10-14T09:36:03.567 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = "" 2023-10-14T09:36:03.567 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 900 2023-10-14T09:36:03.567 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 900 2023-10-14T09:36:03.567 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.a] 2023-10-14T09:36:03.567 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.b] 2023-10-14T09:36:03.567 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.c] 2023-10-14T09:36:03.568 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.a] 2023-10-14T09:36:03.568 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.c] 2023-10-14T09:36:03.568 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.b] 2023-10-14T09:36:03.568 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.d] 2023-10-14T09:36:03.568 INFO:teuthology.orchestra.run.smithi102.stdout:[mds] 2023-10-14T09:36:03.569 INFO:teuthology.orchestra.run.smithi102.stdout: debug mds = 20 2023-10-14T09:36:03.569 INFO:teuthology.orchestra.run.smithi102.stdout: debug mds balancer = 20 2023-10-14T09:36:03.569 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2023-10-14T09:36:03.569 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug frag = True 2023-10-14T09:36:03.569 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug scatterstat = True 2023-10-14T09:36:03.570 INFO:teuthology.orchestra.run.smithi102.stdout: mds op complaint time = 180 2023-10-14T09:36:03.570 INFO:teuthology.orchestra.run.smithi102.stdout: mds verify scatter = True 2023-10-14T09:36:03.570 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2023-10-14T09:36:03.570 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 900 2023-10-14T09:36:03.570 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 900 2023-10-14T09:36:03.571 INFO:teuthology.orchestra.run.smithi129.stdout:[global] 2023-10-14T09:36:03.571 INFO:teuthology.orchestra.run.smithi129.stdout: chdir = "" 2023-10-14T09:36:03.571 INFO:teuthology.orchestra.run.smithi129.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-14T09:36:03.572 INFO:teuthology.orchestra.run.smithi129.stdout: auth supported = cephx 2023-10-14T09:36:03.572 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:36:03.572 INFO:teuthology.orchestra.run.smithi129.stdout: filestore xattr use omap = true 2023-10-14T09:36:03.572 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:36:03.572 INFO:teuthology.orchestra.run.smithi129.stdout: mon clock drift allowed = 1.000 2023-10-14T09:36:03.572 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:36:03.573 INFO:teuthology.orchestra.run.smithi129.stdout: osd crush chooseleaf type = 0 2023-10-14T09:36:03.573 INFO:teuthology.orchestra.run.smithi129.stdout: auth debug = true 2023-10-14T09:36:03.573 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:36:03.573 INFO:teuthology.orchestra.run.smithi129.stdout: ms die on old message = true 2023-10-14T09:36:03.573 INFO:teuthology.orchestra.run.smithi129.stdout: ms die on bug = true 2023-10-14T09:36:03.574 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:36:03.574 INFO:teuthology.orchestra.run.smithi129.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-14T09:36:03.574 INFO:teuthology.orchestra.run.smithi129.stdout: mon pg warn max object skew = 0 2023-10-14T09:36:03.574 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:36:03.574 INFO:teuthology.orchestra.run.smithi129.stdout: # disable pg_autoscaler by default for new pools 2023-10-14T09:36:03.575 INFO:teuthology.orchestra.run.smithi129.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-14T09:36:03.575 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:36:03.575 INFO:teuthology.orchestra.run.smithi129.stdout: osd pool default size = 2 2023-10-14T09:36:03.575 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:36:03.575 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd allow primary affinity = true 2023-10-14T09:36:03.576 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd allow pg remap = true 2023-10-14T09:36:03.576 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on legacy crush tunables = false 2023-10-14T09:36:03.576 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on crush straw calc version zero = false 2023-10-14T09:36:03.576 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on no sortbitwise = false 2023-10-14T09:36:03.576 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on osd down out interval zero = false 2023-10-14T09:36:03.576 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on too few osds = false 2023-10-14T09:36:03.577 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-14T09:36:03.577 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-14T09:36:03.577 INFO:teuthology.orchestra.run.smithi129.stdout: mon_allow_pool_size_one = true 2023-10-14T09:36:03.577 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:36:03.577 INFO:teuthology.orchestra.run.smithi129.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-14T09:36:03.578 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:36:03.578 INFO:teuthology.orchestra.run.smithi129.stdout: osd default data pool replay window = 5 2023-10-14T09:36:03.578 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:36:03.578 INFO:teuthology.orchestra.run.smithi129.stdout: mon allow pool delete = true 2023-10-14T09:36:03.578 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:36:03.579 INFO:teuthology.orchestra.run.smithi129.stdout: mon cluster log file level = debug 2023-10-14T09:36:03.579 INFO:teuthology.orchestra.run.smithi129.stdout: debug asserts on shutdown = true 2023-10-14T09:36:03.579 INFO:teuthology.orchestra.run.smithi129.stdout: mon health detail to clog = false 2023-10-14T09:36:03.579 INFO:teuthology.orchestra.run.smithi129.stdout: mon host = "172.21.15.102,172.21.15.129,[v2:172.21.15.129:3301,v1:172.21.15.129:6790]" 2023-10-14T09:36:03.579 INFO:teuthology.orchestra.run.smithi129.stdout: ms die on skipped message = False 2023-10-14T09:36:03.579 INFO:teuthology.orchestra.run.smithi129.stdout: fsid = 8a6cd69d-7f5b-4f2a-806a-0176c10aed50 2023-10-14T09:36:03.580 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:36:03.580 INFO:teuthology.orchestra.run.smithi129.stdout:[osd] 2023-10-14T09:36:03.580 INFO:teuthology.orchestra.run.smithi129.stdout: osd journal size = 100 2023-10-14T09:36:03.580 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:36:03.580 INFO:teuthology.orchestra.run.smithi129.stdout: osd scrub load threshold = 5.0 2023-10-14T09:36:03.581 INFO:teuthology.orchestra.run.smithi129.stdout: osd scrub max interval = 600 2023-10-14T09:36:03.581 INFO:teuthology.orchestra.run.smithi129.stdout: osd mclock profile = high_recovery_ops 2023-10-14T09:36:03.581 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:36:03.581 INFO:teuthology.orchestra.run.smithi129.stdout: osd recover clone overlap = true 2023-10-14T09:36:03.581 INFO:teuthology.orchestra.run.smithi129.stdout: osd recovery max chunk = 1048576 2023-10-14T09:36:03.582 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:36:03.582 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug shutdown = true 2023-10-14T09:36:03.582 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug op order = true 2023-10-14T09:36:03.582 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug verify stray on activate = true 2023-10-14T09:36:03.582 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:36:03.583 INFO:teuthology.orchestra.run.smithi129.stdout: osd open classes on start = true 2023-10-14T09:36:03.583 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug pg log writeout = true 2023-10-14T09:36:03.583 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:36:03.583 INFO:teuthology.orchestra.run.smithi129.stdout: osd deep scrub update digest min age = 30 2023-10-14T09:36:03.583 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:36:03.583 INFO:teuthology.orchestra.run.smithi129.stdout: osd map max advance = 10 2023-10-14T09:36:03.584 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:36:03.584 INFO:teuthology.orchestra.run.smithi129.stdout: journal zero on create = true 2023-10-14T09:36:03.584 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:36:03.584 INFO:teuthology.orchestra.run.smithi129.stdout: filestore ondisk finisher threads = 3 2023-10-14T09:36:03.584 INFO:teuthology.orchestra.run.smithi129.stdout: filestore apply finisher threads = 3 2023-10-14T09:36:03.585 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:36:03.585 INFO:teuthology.orchestra.run.smithi129.stdout: bdev debug aio = true 2023-10-14T09:36:03.585 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug misdirected ops = true 2023-10-14T09:36:03.585 INFO:teuthology.orchestra.run.smithi129.stdout: bdev async discard = True 2023-10-14T09:36:03.585 INFO:teuthology.orchestra.run.smithi129.stdout: bdev enable discard = True 2023-10-14T09:36:03.585 INFO:teuthology.orchestra.run.smithi129.stdout: bluestore allocator = bitmap 2023-10-14T09:36:03.586 INFO:teuthology.orchestra.run.smithi129.stdout: bluestore block size = 96636764160 2023-10-14T09:36:03.586 INFO:teuthology.orchestra.run.smithi129.stdout: bluestore fsck on mount = True 2023-10-14T09:36:03.586 INFO:teuthology.orchestra.run.smithi129.stdout: debug bluefs = 1/20 2023-10-14T09:36:03.586 INFO:teuthology.orchestra.run.smithi129.stdout: debug bluestore = 1/20 2023-10-14T09:36:03.586 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2023-10-14T09:36:03.587 INFO:teuthology.orchestra.run.smithi129.stdout: debug osd = 20 2023-10-14T09:36:03.587 INFO:teuthology.orchestra.run.smithi129.stdout: debug rocksdb = 4/10 2023-10-14T09:36:03.587 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd backfillfull_ratio = 0.85 2023-10-14T09:36:03.587 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd full ratio = 0.9 2023-10-14T09:36:03.587 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd nearfull ratio = 0.8 2023-10-14T09:36:03.587 INFO:teuthology.orchestra.run.smithi129.stdout: osd failsafe full ratio = 0.95 2023-10-14T09:36:03.588 INFO:teuthology.orchestra.run.smithi129.stdout: osd objectstore = bluestore 2023-10-14T09:36:03.588 INFO:teuthology.orchestra.run.smithi129.stdout: osd op complaint time = 180 2023-10-14T09:36:03.588 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:36:03.588 INFO:teuthology.orchestra.run.smithi129.stdout:[mgr] 2023-10-14T09:36:03.588 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2023-10-14T09:36:03.589 INFO:teuthology.orchestra.run.smithi129.stdout: debug mgr = 20 2023-10-14T09:36:03.589 INFO:teuthology.orchestra.run.smithi129.stdout: debug mon = 20 2023-10-14T09:36:03.589 INFO:teuthology.orchestra.run.smithi129.stdout: debug auth = 20 2023-10-14T09:36:03.589 INFO:teuthology.orchestra.run.smithi129.stdout: mon reweight min pgs per osd = 4 2023-10-14T09:36:03.589 INFO:teuthology.orchestra.run.smithi129.stdout: mon reweight min bytes per osd = 10 2023-10-14T09:36:03.590 INFO:teuthology.orchestra.run.smithi129.stdout: mgr/telemetry/nag = false 2023-10-14T09:36:03.590 INFO:teuthology.orchestra.run.smithi129.stdout: debug client = 20 2023-10-14T09:36:03.590 INFO:teuthology.orchestra.run.smithi129.stdout: debug finisher = 20 2023-10-14T09:36:03.590 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:36:03.590 INFO:teuthology.orchestra.run.smithi129.stdout:[mon] 2023-10-14T09:36:03.590 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2023-10-14T09:36:03.591 INFO:teuthology.orchestra.run.smithi129.stdout: debug mon = 20 2023-10-14T09:36:03.591 INFO:teuthology.orchestra.run.smithi129.stdout: debug paxos = 20 2023-10-14T09:36:03.591 INFO:teuthology.orchestra.run.smithi129.stdout: debug auth = 20 2023-10-14T09:36:03.591 INFO:teuthology.orchestra.run.smithi129.stdout: mon data avail warn = 5 2023-10-14T09:36:03.591 INFO:teuthology.orchestra.run.smithi129.stdout: mon mgr mkfs grace = 240 2023-10-14T09:36:03.592 INFO:teuthology.orchestra.run.smithi129.stdout: mon reweight min pgs per osd = 4 2023-10-14T09:36:03.592 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd reporter subtree level = osd 2023-10-14T09:36:03.592 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd prime pg temp = true 2023-10-14T09:36:03.592 INFO:teuthology.orchestra.run.smithi129.stdout: mon reweight min bytes per osd = 10 2023-10-14T09:36:03.592 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:36:03.592 INFO:teuthology.orchestra.run.smithi129.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-14T09:36:03.593 INFO:teuthology.orchestra.run.smithi129.stdout: auth mon ticket ttl = 660 # 11m 2023-10-14T09:36:03.593 INFO:teuthology.orchestra.run.smithi129.stdout: auth service ticket ttl = 240 # 4m 2023-10-14T09:36:03.593 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:36:03.593 INFO:teuthology.orchestra.run.smithi129.stdout: # don't complain about insecure global_id in the test suite 2023-10-14T09:36:03.593 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-14T09:36:03.594 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-14T09:36:03.594 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:36:03.594 INFO:teuthology.orchestra.run.smithi129.stdout: # 1m isn't quite enough 2023-10-14T09:36:03.594 INFO:teuthology.orchestra.run.smithi129.stdout: mon_down_mkfs_grace = 2m 2023-10-14T09:36:03.594 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:36:03.595 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_filestore_osds = false 2023-10-14T09:36:03.595 INFO:teuthology.orchestra.run.smithi129.stdout: mon op complaint time = 120 2023-10-14T09:36:03.595 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-14T09:36:03.595 INFO:teuthology.orchestra.run.smithi129.stdout:[client] 2023-10-14T09:36:03.595 INFO:teuthology.orchestra.run.smithi129.stdout: rgw cache enabled = true 2023-10-14T09:36:03.595 INFO:teuthology.orchestra.run.smithi129.stdout: rgw enable ops log = true 2023-10-14T09:36:03.596 INFO:teuthology.orchestra.run.smithi129.stdout: rgw enable usage log = true 2023-10-14T09:36:03.596 INFO:teuthology.orchestra.run.smithi129.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-14T09:36:03.596 INFO:teuthology.orchestra.run.smithi129.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-14T09:36:03.596 INFO:teuthology.orchestra.run.smithi129.stdout: client mount timeout = 600 2023-10-14T09:36:03.596 INFO:teuthology.orchestra.run.smithi129.stdout: debug client = 20 2023-10-14T09:36:03.597 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2023-10-14T09:36:03.597 INFO:teuthology.orchestra.run.smithi129.stdout: pid file = "" 2023-10-14T09:36:03.597 INFO:teuthology.orchestra.run.smithi129.stdout: rados mon op timeout = 900 2023-10-14T09:36:03.597 INFO:teuthology.orchestra.run.smithi129.stdout: rados osd op timeout = 900 2023-10-14T09:36:03.597 INFO:teuthology.orchestra.run.smithi129.stdout:[mon.a] 2023-10-14T09:36:03.597 INFO:teuthology.orchestra.run.smithi129.stdout:[mon.b] 2023-10-14T09:36:03.598 INFO:teuthology.orchestra.run.smithi129.stdout:[mon.c] 2023-10-14T09:36:03.598 INFO:teuthology.orchestra.run.smithi129.stdout:[mds.a] 2023-10-14T09:36:03.598 INFO:teuthology.orchestra.run.smithi129.stdout:[mds.c] 2023-10-14T09:36:03.598 INFO:teuthology.orchestra.run.smithi129.stdout:[mds.b] 2023-10-14T09:36:03.598 INFO:teuthology.orchestra.run.smithi129.stdout:[mds.d] 2023-10-14T09:36:03.599 INFO:teuthology.orchestra.run.smithi129.stdout:[mds] 2023-10-14T09:36:03.599 INFO:teuthology.orchestra.run.smithi129.stdout: debug mds = 20 2023-10-14T09:36:03.599 INFO:teuthology.orchestra.run.smithi129.stdout: debug mds balancer = 20 2023-10-14T09:36:03.599 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2023-10-14T09:36:03.599 INFO:teuthology.orchestra.run.smithi129.stdout: mds debug frag = True 2023-10-14T09:36:03.600 INFO:teuthology.orchestra.run.smithi129.stdout: mds debug scatterstat = True 2023-10-14T09:36:03.600 INFO:teuthology.orchestra.run.smithi129.stdout: mds op complaint time = 180 2023-10-14T09:36:03.600 INFO:teuthology.orchestra.run.smithi129.stdout: mds verify scatter = True 2023-10-14T09:36:03.600 INFO:teuthology.orchestra.run.smithi129.stdout: osd op complaint time = 180 2023-10-14T09:36:03.600 INFO:teuthology.orchestra.run.smithi129.stdout: rados mon op timeout = 900 2023-10-14T09:36:03.600 INFO:teuthology.orchestra.run.smithi129.stdout: rados osd op timeout = 900 2023-10-14T09:36:03.602 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-14T09:36:03.602 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-14T09:36:03.749 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-14T09:36:03.749 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-10-14T09:36:03.750 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-14T09:36:03.800 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-10-14T09:36:03.801 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-14T09:36:03.899 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi102.front.sepia.ceph.com 2023-10-14T09:36:03.899 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-10-14T09:36:03.899 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-14T09:36:03.900 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-14T09:36:04.043 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-10-14T09:36:04.044 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-14T09:36:04.142 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi129.front.sepia.ceph.com 2023-10-14T09:36:04.143 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2023-10-14T09:36:04.143 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-14T09:36:04.143 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-14T09:36:04.300 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2023-10-14T09:36:04.301 DEBUG:teuthology.orchestra.run.smithi129:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-14T09:36:04.400 INFO:tasks.ceph:Setting up mon nodes... 2023-10-14T09:36:04.400 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-14T09:36:04.400 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-14T09:36:04.578 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-14T09:36:04.588 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-14T09:36:04.784 INFO:teuthology.orchestra.run.smithi129.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-14T09:36:04.795 INFO:tasks.ceph:Setting up mds nodes... 2023-10-14T09:36:04.795 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-14T09:36:04.986 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-14T09:36:04.995 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-14T09:36:05.081 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-14T09:36:05.257 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-14T09:36:05.266 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-14T09:36:05.362 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-14T09:36:05.545 INFO:teuthology.orchestra.run.smithi129.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-14T09:36:05.554 DEBUG:teuthology.orchestra.run.smithi129:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-14T09:36:05.645 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-14T09:36:05.822 INFO:teuthology.orchestra.run.smithi129.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-14T09:36:05.828 DEBUG:teuthology.orchestra.run.smithi129:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-14T09:36:05.917 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-14T09:36:05.917 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-14T09:36:06.052 INFO:teuthology.orchestra.run.smithi102.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-14T09:36:06.102 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-14T09:36:06.224 INFO:teuthology.orchestra.run.smithi102.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-14T09:36:06.279 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-14T09:36:06.416 INFO:teuthology.orchestra.run.smithi129.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-14T09:36:06.483 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-14T09:36:06.609 INFO:teuthology.orchestra.run.smithi129.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-14T09:36:06.660 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-14T09:36:06.661 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi102.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi129.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-14T09:36:06.661 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-14T09:36:06.762 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T09:36:06.762 INFO:tasks.ceph:role: osd.0 2023-10-14T09:36:06.762 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi102.front.sepia.ceph.com 2023-10-14T09:36:06.763 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-14T09:36:06.861 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T09:36:06.862 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T09:36:06.862 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T09:36:06.862 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-14T09:36:06.862 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T09:36:06.863 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2023-10-14T09:36:06.863 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T09:36:06.863 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-14T09:36:06.863 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T09:36:06.863 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T09:36:07.381 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2023-10-14T09:36:07.390 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2023-10-14T09:36:07.390 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-14T09:36:07.570 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-14T09:36:07.677 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-14T09:36:07.756 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T09:36:07.757 INFO:tasks.ceph:role: osd.1 2023-10-14T09:36:07.757 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi102.front.sepia.ceph.com 2023-10-14T09:36:07.757 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-14T09:36:07.838 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T09:36:07.839 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T09:36:07.839 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T09:36:07.839 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-14T09:36:07.839 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T09:36:07.839 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2023-10-14T09:36:07.840 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T09:36:07.840 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-14T09:36:07.840 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T09:36:07.840 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T09:36:08.312 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2023-10-14T09:36:08.317 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2023-10-14T09:36:08.369 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-14T09:36:08.514 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-14T09:36:08.615 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-14T09:36:08.698 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T09:36:08.698 INFO:tasks.ceph:role: osd.2 2023-10-14T09:36:08.699 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi102.front.sepia.ceph.com 2023-10-14T09:36:08.699 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-14T09:36:08.790 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T09:36:08.791 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T09:36:08.791 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T09:36:08.791 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-14T09:36:08.791 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T09:36:08.791 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2023-10-14T09:36:08.792 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T09:36:08.792 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-14T09:36:08.792 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T09:36:08.792 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T09:36:09.313 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2023-10-14T09:36:09.320 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2023-10-14T09:36:09.320 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-14T09:36:09.497 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-14T09:36:09.591 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-14T09:36:09.681 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T09:36:09.681 INFO:tasks.ceph:role: osd.3 2023-10-14T09:36:09.681 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi102.front.sepia.ceph.com 2023-10-14T09:36:09.682 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-14T09:36:09.784 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T09:36:09.785 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T09:36:09.785 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T09:36:09.785 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-14T09:36:09.785 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T09:36:09.786 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2023-10-14T09:36:09.786 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T09:36:09.786 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-14T09:36:09.786 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T09:36:09.786 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T09:36:10.253 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2023-10-14T09:36:10.259 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2023-10-14T09:36:10.260 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-14T09:36:10.408 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-14T09:36:10.501 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T09:36:10.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:10.637+0000 7fdc96317500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-14T09:36:10.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:10.639+0000 7fdc96317500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-14T09:36:10.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:10.639+0000 7fdc96317500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-14T09:36:10.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:10.639+0000 7fdc96317500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-14T09:36:10.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:10.639+0000 7fdc96317500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-14T09:36:10.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:10.646+0000 7fdc96317500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-14T09:36:13.812 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-14T09:36:13.914 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T09:36:14.056 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:14.054+0000 7effdbf12500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-14T09:36:14.057 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:14.055+0000 7effdbf12500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-14T09:36:14.057 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:14.055+0000 7effdbf12500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-14T09:36:14.057 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:14.055+0000 7effdbf12500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-14T09:36:14.058 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:14.055+0000 7effdbf12500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-14T09:36:14.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:14.057+0000 7effdbf12500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-14T09:36:17.233 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-14T09:36:17.334 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T09:36:17.473 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:17.471+0000 7f8c7181f500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-14T09:36:17.474 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:17.471+0000 7f8c7181f500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-14T09:36:17.474 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:17.472+0000 7f8c7181f500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-14T09:36:17.474 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:17.472+0000 7f8c7181f500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-14T09:36:17.474 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:17.472+0000 7f8c7181f500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-14T09:36:17.475 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:17.474+0000 7f8c7181f500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-14T09:36:20.650 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-14T09:36:20.745 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T09:36:20.884 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:20.882+0000 7fd299412500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-14T09:36:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:20.883+0000 7fd299412500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-14T09:36:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:20.883+0000 7fd299412500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-14T09:36:20.886 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:20.883+0000 7fd299412500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-14T09:36:20.886 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:20.883+0000 7fd299412500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-14T09:36:20.887 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:20.885+0000 7fd299412500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-14T09:36:23.812 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-14T09:36:23.912 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-14T09:36:24.015 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T09:36:24.015 INFO:tasks.ceph:role: osd.4 2023-10-14T09:36:24.016 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi129.front.sepia.ceph.com 2023-10-14T09:36:24.016 DEBUG:teuthology.orchestra.run.smithi129:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-14T09:36:24.114 INFO:teuthology.orchestra.run.smithi129.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T09:36:24.115 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T09:36:24.115 INFO:teuthology.orchestra.run.smithi129.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T09:36:24.115 INFO:teuthology.orchestra.run.smithi129.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-14T09:36:24.115 INFO:teuthology.orchestra.run.smithi129.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T09:36:24.116 INFO:teuthology.orchestra.run.smithi129.stdout: = sunit=0 swidth=0 blks 2023-10-14T09:36:24.116 INFO:teuthology.orchestra.run.smithi129.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T09:36:24.116 INFO:teuthology.orchestra.run.smithi129.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-14T09:36:24.116 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T09:36:24.116 INFO:teuthology.orchestra.run.smithi129.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T09:36:24.634 INFO:teuthology.orchestra.run.smithi129.stdout:Discarding blocks...Done. 2023-10-14T09:36:24.640 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi129.front.sepia.ceph.com -o noatime 2023-10-14T09:36:24.641 DEBUG:teuthology.orchestra.run.smithi129:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-14T09:36:24.847 DEBUG:teuthology.orchestra.run.smithi129:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-14T09:36:24.950 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-14T09:36:25.044 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T09:36:25.044 INFO:tasks.ceph:role: osd.5 2023-10-14T09:36:25.045 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi129.front.sepia.ceph.com 2023-10-14T09:36:25.045 DEBUG:teuthology.orchestra.run.smithi129:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-14T09:36:25.144 INFO:teuthology.orchestra.run.smithi129.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T09:36:25.145 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T09:36:25.145 INFO:teuthology.orchestra.run.smithi129.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T09:36:25.145 INFO:teuthology.orchestra.run.smithi129.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-14T09:36:25.145 INFO:teuthology.orchestra.run.smithi129.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T09:36:25.145 INFO:teuthology.orchestra.run.smithi129.stdout: = sunit=0 swidth=0 blks 2023-10-14T09:36:25.146 INFO:teuthology.orchestra.run.smithi129.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T09:36:25.146 INFO:teuthology.orchestra.run.smithi129.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-14T09:36:25.146 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T09:36:25.146 INFO:teuthology.orchestra.run.smithi129.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T09:36:25.633 INFO:teuthology.orchestra.run.smithi129.stdout:Discarding blocks...Done. 2023-10-14T09:36:25.639 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi129.front.sepia.ceph.com -o noatime 2023-10-14T09:36:25.640 DEBUG:teuthology.orchestra.run.smithi129:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-14T09:36:25.787 DEBUG:teuthology.orchestra.run.smithi129:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-14T09:36:25.890 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-14T09:36:25.984 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T09:36:25.984 INFO:tasks.ceph:role: osd.6 2023-10-14T09:36:25.985 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi129.front.sepia.ceph.com 2023-10-14T09:36:25.985 DEBUG:teuthology.orchestra.run.smithi129:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-14T09:36:26.087 INFO:teuthology.orchestra.run.smithi129.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T09:36:26.088 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T09:36:26.088 INFO:teuthology.orchestra.run.smithi129.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T09:36:26.088 INFO:teuthology.orchestra.run.smithi129.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-14T09:36:26.088 INFO:teuthology.orchestra.run.smithi129.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T09:36:26.088 INFO:teuthology.orchestra.run.smithi129.stdout: = sunit=0 swidth=0 blks 2023-10-14T09:36:26.088 INFO:teuthology.orchestra.run.smithi129.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T09:36:26.089 INFO:teuthology.orchestra.run.smithi129.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-14T09:36:26.089 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T09:36:26.089 INFO:teuthology.orchestra.run.smithi129.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T09:36:26.613 INFO:teuthology.orchestra.run.smithi129.stdout:Discarding blocks...Done. 2023-10-14T09:36:26.618 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi129.front.sepia.ceph.com -o noatime 2023-10-14T09:36:26.618 DEBUG:teuthology.orchestra.run.smithi129:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-14T09:36:26.826 DEBUG:teuthology.orchestra.run.smithi129:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-14T09:36:26.936 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-14T09:36:27.034 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T09:36:27.035 INFO:tasks.ceph:role: osd.7 2023-10-14T09:36:27.035 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi129.front.sepia.ceph.com 2023-10-14T09:36:27.035 DEBUG:teuthology.orchestra.run.smithi129:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-14T09:36:27.134 INFO:teuthology.orchestra.run.smithi129.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T09:36:27.134 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T09:36:27.134 INFO:teuthology.orchestra.run.smithi129.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T09:36:27.134 INFO:teuthology.orchestra.run.smithi129.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-14T09:36:27.134 INFO:teuthology.orchestra.run.smithi129.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T09:36:27.135 INFO:teuthology.orchestra.run.smithi129.stdout: = sunit=0 swidth=0 blks 2023-10-14T09:36:27.135 INFO:teuthology.orchestra.run.smithi129.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T09:36:27.135 INFO:teuthology.orchestra.run.smithi129.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-14T09:36:27.135 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T09:36:27.135 INFO:teuthology.orchestra.run.smithi129.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T09:36:27.594 INFO:teuthology.orchestra.run.smithi129.stdout:Discarding blocks...Done. 2023-10-14T09:36:27.600 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi129.front.sepia.ceph.com -o noatime 2023-10-14T09:36:27.600 DEBUG:teuthology.orchestra.run.smithi129:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-14T09:36:27.739 DEBUG:teuthology.orchestra.run.smithi129:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-14T09:36:27.843 DEBUG:teuthology.orchestra.run.smithi129:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T09:36:28.010 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:28.008+0000 7f5cef40d500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-14T09:36:28.014 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:28.012+0000 7f5cef40d500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-14T09:36:28.014 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:28.012+0000 7f5cef40d500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-14T09:36:28.015 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:28.012+0000 7f5cef40d500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-14T09:36:28.015 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:28.012+0000 7f5cef40d500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-14T09:36:28.024 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:28.022+0000 7f5cef40d500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-14T09:36:30.801 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T09:36:30.810 DEBUG:teuthology.orchestra.run.smithi129:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T09:36:31.204 DEBUG:teuthology.orchestra.run.smithi129:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-14T09:36:31.296 DEBUG:teuthology.orchestra.run.smithi129:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T09:36:31.436 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:31.434+0000 7f8effa0d500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-14T09:36:31.437 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:31.434+0000 7f8effa0d500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-14T09:36:31.437 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:31.434+0000 7f8effa0d500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-14T09:36:31.437 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:31.434+0000 7f8effa0d500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-14T09:36:31.438 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:31.434+0000 7f8effa0d500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-14T09:36:31.438 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:31.436+0000 7f8effa0d500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-14T09:36:34.352 DEBUG:teuthology.orchestra.run.smithi129:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-14T09:36:34.449 DEBUG:teuthology.orchestra.run.smithi129:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T09:36:34.589 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:34.587+0000 7fcbad01f500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-14T09:36:34.590 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:34.588+0000 7fcbad01f500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-14T09:36:34.591 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:34.588+0000 7fcbad01f500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-14T09:36:34.591 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:34.588+0000 7fcbad01f500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-14T09:36:34.591 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:34.588+0000 7fcbad01f500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-14T09:36:34.592 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:34.590+0000 7fcbad01f500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-14T09:36:37.507 DEBUG:teuthology.orchestra.run.smithi129:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-14T09:36:37.605 DEBUG:teuthology.orchestra.run.smithi129:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T09:36:37.745 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:37.744+0000 7f627c0a5500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-14T09:36:37.746 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:37.745+0000 7f627c0a5500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-14T09:36:37.746 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:37.745+0000 7f627c0a5500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-14T09:36:37.747 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:37.745+0000 7f627c0a5500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-14T09:36:37.747 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:37.745+0000 7f627c0a5500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-14T09:36:37.748 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:37.747+0000 7f627c0a5500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-14T09:36:40.921 DEBUG:teuthology.orchestra.run.smithi129:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-14T09:36:41.020 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-14T09:36:41.020 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-10-14T09:36:41.020 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-14T09:36:41.123 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-10-14T09:36:41.123 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-14T09:36:41.218 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-10-14T09:36:41.218 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-14T09:36:41.313 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-10-14T09:36:41.314 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-14T09:36:41.409 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-10-14T09:36:41.409 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-14T09:36:41.501 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-10-14T09:36:41.501 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-14T09:36:41.594 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-10-14T09:36:41.595 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-14T09:36:41.691 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2023-10-14T09:36:41.692 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-14T09:36:41.794 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2023-10-14T09:36:41.794 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-14T09:36:41.891 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2023-10-14T09:36:41.892 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-14T09:36:41.982 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2023-10-14T09:36:41.982 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-14T09:36:42.077 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2023-10-14T09:36:42.078 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-14T09:36:42.173 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2023-10-14T09:36:42.173 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-14T09:36:42.274 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2023-10-14T09:36:42.274 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-14T09:36:42.372 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-10-14T09:36:42.372 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-14T09:36:42.431 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-10-14T09:36:42.432 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-14T09:36:42.483 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2023-10-14T09:36:42.483 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-14T09:36:42.543 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2023-10-14T09:36:42.543 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-14T09:36:42.596 INFO:tasks.ceph:Adding keys to all mons... 2023-10-14T09:36:42.596 DEBUG:teuthology.orchestra.run.smithi102:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-14T09:36:42.605 DEBUG:teuthology.orchestra.run.smithi129:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-14T09:36:42.694 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr.y] 2023-10-14T09:36:42.695 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAEYSplTJdoIhAAmvARMsPFNrkxMpLN6yAdow== 2023-10-14T09:36:42.695 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.a] 2023-10-14T09:36:42.695 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAEYSplQ3HFOhAAIRR1X2bfpcQHFqjJNFhepw== 2023-10-14T09:36:42.695 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.c] 2023-10-14T09:36:42.695 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAFYSpl0zxRDxAAYz/YthZ+SlPxOnZ3gQS6kQ== 2023-10-14T09:36:42.696 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.0] 2023-10-14T09:36:42.696 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAKYSplgQULJhAASp0Qj9mUparApl5+14q7Gw== 2023-10-14T09:36:42.696 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.1] 2023-10-14T09:36:42.696 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAOYSplo1RTAxAAuFOjANTkprmGZQdj1dGg7A== 2023-10-14T09:36:42.696 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.2] 2023-10-14T09:36:42.697 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQARYSplPdUqHBAA98qjri5P8qRC2smxLbYXEQ== 2023-10-14T09:36:42.697 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.3] 2023-10-14T09:36:42.697 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAUYSpl4sStNBAAALRjxGly0rb1CJssfJVlwQ== 2023-10-14T09:36:42.697 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr.x] 2023-10-14T09:36:42.697 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAEYSplgpm9LhAAgjpiQgywz13WKbx0sW/17A== 2023-10-14T09:36:42.698 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.b] 2023-10-14T09:36:42.698 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAFYSpljhZ0IBAAQ4kXIcEZ5AtZuNHZSodoSQ== 2023-10-14T09:36:42.698 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.d] 2023-10-14T09:36:42.698 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAFYSpl3zL4MBAAIgqLiZjASG93lFjjm+InWQ== 2023-10-14T09:36:42.698 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.4] 2023-10-14T09:36:42.699 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAcYSpl0V6VABAAFUyoKPsp29P+aJS9jH7kQw== 2023-10-14T09:36:42.699 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.5] 2023-10-14T09:36:42.699 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAfYSplGGb2GRAAajGsic4HZGXeM79Evmi73A== 2023-10-14T09:36:42.699 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.6] 2023-10-14T09:36:42.700 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAiYSplFT8bIxAAJ5vVKfGwmUIRmE2dt/5dcg== 2023-10-14T09:36:42.700 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.7] 2023-10-14T09:36:42.700 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAlYSplj79nLBAAK4kcWMbaehTiIAxhP+TXcQ== 2023-10-14T09:36:42.700 INFO:teuthology.orchestra.run.smithi102.stdout:[client.0] 2023-10-14T09:36:42.700 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAGYSpl2DQTAxAAccp2NglfLx6Vx/BGxH6+fA== 2023-10-14T09:36:42.701 INFO:teuthology.orchestra.run.smithi102.stdout:[client.2] 2023-10-14T09:36:42.701 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAGYSpl5m1SDRAAHmjaIyVqYyjfkMRSur+d9g== 2023-10-14T09:36:42.701 INFO:teuthology.orchestra.run.smithi102.stdout:[client.1] 2023-10-14T09:36:42.701 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAGYSplX8rGGBAASDrk/eBr51LDoFC7ZRhq8A== 2023-10-14T09:36:42.701 INFO:teuthology.orchestra.run.smithi102.stdout:[client.3] 2023-10-14T09:36:42.702 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAGYSpl3eFCJBAASpqlOy0ZdrRMDab2hUmAbg== 2023-10-14T09:36:42.702 INFO:teuthology.orchestra.run.smithi129.stdout:[mgr.y] 2023-10-14T09:36:42.702 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQAEYSplTJdoIhAAmvARMsPFNrkxMpLN6yAdow== 2023-10-14T09:36:42.703 INFO:teuthology.orchestra.run.smithi129.stdout:[mds.a] 2023-10-14T09:36:42.703 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQAEYSplQ3HFOhAAIRR1X2bfpcQHFqjJNFhepw== 2023-10-14T09:36:42.703 INFO:teuthology.orchestra.run.smithi129.stdout:[mds.c] 2023-10-14T09:36:42.703 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQAFYSpl0zxRDxAAYz/YthZ+SlPxOnZ3gQS6kQ== 2023-10-14T09:36:42.704 INFO:teuthology.orchestra.run.smithi129.stdout:[osd.0] 2023-10-14T09:36:42.704 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQAKYSplgQULJhAASp0Qj9mUparApl5+14q7Gw== 2023-10-14T09:36:42.704 INFO:teuthology.orchestra.run.smithi129.stdout:[osd.1] 2023-10-14T09:36:42.704 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQAOYSplo1RTAxAAuFOjANTkprmGZQdj1dGg7A== 2023-10-14T09:36:42.704 INFO:teuthology.orchestra.run.smithi129.stdout:[osd.2] 2023-10-14T09:36:42.704 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQARYSplPdUqHBAA98qjri5P8qRC2smxLbYXEQ== 2023-10-14T09:36:42.705 INFO:teuthology.orchestra.run.smithi129.stdout:[osd.3] 2023-10-14T09:36:42.705 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQAUYSpl4sStNBAAALRjxGly0rb1CJssfJVlwQ== 2023-10-14T09:36:42.705 INFO:teuthology.orchestra.run.smithi129.stdout:[mgr.x] 2023-10-14T09:36:42.705 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQAEYSplgpm9LhAAgjpiQgywz13WKbx0sW/17A== 2023-10-14T09:36:42.705 INFO:teuthology.orchestra.run.smithi129.stdout:[mds.b] 2023-10-14T09:36:42.706 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQAFYSpljhZ0IBAAQ4kXIcEZ5AtZuNHZSodoSQ== 2023-10-14T09:36:42.706 INFO:teuthology.orchestra.run.smithi129.stdout:[mds.d] 2023-10-14T09:36:42.706 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQAFYSpl3zL4MBAAIgqLiZjASG93lFjjm+InWQ== 2023-10-14T09:36:42.706 INFO:teuthology.orchestra.run.smithi129.stdout:[osd.4] 2023-10-14T09:36:42.706 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQAcYSpl0V6VABAAFUyoKPsp29P+aJS9jH7kQw== 2023-10-14T09:36:42.707 INFO:teuthology.orchestra.run.smithi129.stdout:[osd.5] 2023-10-14T09:36:42.707 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQAfYSplGGb2GRAAajGsic4HZGXeM79Evmi73A== 2023-10-14T09:36:42.707 INFO:teuthology.orchestra.run.smithi129.stdout:[osd.6] 2023-10-14T09:36:42.707 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQAiYSplFT8bIxAAJ5vVKfGwmUIRmE2dt/5dcg== 2023-10-14T09:36:42.707 INFO:teuthology.orchestra.run.smithi129.stdout:[osd.7] 2023-10-14T09:36:42.708 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQAlYSplj79nLBAAK4kcWMbaehTiIAxhP+TXcQ== 2023-10-14T09:36:42.708 INFO:teuthology.orchestra.run.smithi129.stdout:[client.0] 2023-10-14T09:36:42.708 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQAGYSpl2DQTAxAAccp2NglfLx6Vx/BGxH6+fA== 2023-10-14T09:36:42.708 INFO:teuthology.orchestra.run.smithi129.stdout:[client.2] 2023-10-14T09:36:42.708 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQAGYSpl5m1SDRAAHmjaIyVqYyjfkMRSur+d9g== 2023-10-14T09:36:42.709 INFO:teuthology.orchestra.run.smithi129.stdout:[client.1] 2023-10-14T09:36:42.709 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQAGYSplX8rGGBAASDrk/eBr51LDoFC7ZRhq8A== 2023-10-14T09:36:42.709 INFO:teuthology.orchestra.run.smithi129.stdout:[client.3] 2023-10-14T09:36:42.709 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQAGYSpl3eFCJBAASpqlOy0ZdrRMDab2hUmAbg== 2023-10-14T09:36:42.711 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T09:36:42.720 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T09:36:42.858 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T09:36:42.867 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T09:36:43.017 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T09:36:43.026 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T09:36:43.174 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T09:36:43.183 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T09:36:43.328 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T09:36:43.337 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T09:36:43.483 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T09:36:43.492 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T09:36:43.636 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T09:36:43.643 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T09:36:43.784 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T09:36:43.790 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T09:36:43.931 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T09:36:43.936 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T09:36:44.080 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T09:36:44.088 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T09:36:44.239 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T09:36:44.245 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T09:36:44.379 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T09:36:44.385 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T09:36:44.528 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T09:36:44.540 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T09:36:44.686 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T09:36:44.695 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T09:36:44.836 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T09:36:44.842 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T09:36:44.994 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T09:36:45.001 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T09:36:45.142 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T09:36:45.147 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T09:36:45.291 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T09:36:45.295 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T09:36:45.438 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-14T09:36:45.438 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-14T09:36:45.533 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-14T09:36:45.690 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-14T09:36:45.782 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-14T09:36:45.881 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-14T09:36:46.039 DEBUG:teuthology.orchestra.run.smithi129:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-14T09:36:46.120 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-14T09:36:46.211 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-14T09:36:46.368 DEBUG:teuthology.orchestra.run.smithi129:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-14T09:36:46.458 DEBUG:teuthology.orchestra.run.smithi102:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-14T09:36:46.467 DEBUG:teuthology.orchestra.run.smithi129:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-14T09:36:46.519 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-14T09:36:46.519 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-14T09:36:46.520 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-14T09:36:46.526 INFO:tasks.ceph.mon.a:Started 2023-10-14T09:36:46.526 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-14T09:36:46.527 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-14T09:36:46.532 INFO:tasks.ceph.mon.b:Started 2023-10-14T09:36:46.532 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-14T09:36:46.533 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-14T09:36:46.538 INFO:tasks.ceph.mon.c:Started 2023-10-14T09:36:46.538 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-14T09:36:46.539 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-14T09:36:46.539 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-14T09:36:46.545 INFO:tasks.ceph.mgr.y:Started 2023-10-14T09:36:46.545 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-14T09:36:46.545 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-14T09:36:46.551 INFO:tasks.ceph.mgr.x:Started 2023-10-14T09:36:46.551 INFO:tasks.ceph:Setting crush tunables to default 2023-10-14T09:36:46.552 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd crush tunables default 2023-10-14T09:36:46.727 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:46.725+0000 7f7b20e13640 1 Processor -- start 2023-10-14T09:36:46.727 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:46.725+0000 7f7b20e13640 1 -- start start 2023-10-14T09:36:46.728 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:46.726+0000 7f7b20e13640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 0x7f7b1c0d36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:36:46.729 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:46.726+0000 7f7b20e13640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b1c0cfc40 0x7f7b1c0b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:36:46.729 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:46.726+0000 7f7b20e13640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b1c0d0970 con 0x7f7b1c0b2080 2023-10-14T09:36:46.729 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:46.726+0000 7f7b20e13640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b1c0d0ea0 con 0x7f7b1c0b1ca0 2023-10-14T09:36:46.729 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:46.726+0000 7f7b20e13640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c0d0bc0 con 0x7f7b1c0cfc40 2023-10-14T09:36:46.729 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:46.726+0000 7f7b1b7fe640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 0x7f7b1c0d36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:46.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:46.726+0000 7f7b1bfff640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b1c0cfc40 0x7f7b1c0b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:46.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:46.726+0000 7f7b1b7fe640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 0x7f7b1c0d36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.102:37362/0 (socket says 172.21.15.102:37362) 2023-10-14T09:36:46.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:46.726+0000 7f7b1b7fe640 1 -- 172.21.15.102:0/1191196154 learned_addr learned my addr 172.21.15.102:0/1191196154 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:36:46.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:46.727+0000 7f7b1b7fe640 1 -- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 msgr2=0x7f7b1c0d36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-14T09:36:46.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:46.727+0000 7f7b1b7fe640 1 -- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 msgr2=0x7f7b1c0d36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T09:36:46.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:46.727+0000 7f7b1b7fe640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 0x7f7b1c0d36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T09:36:46.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:46.727+0000 7f7b1bfff640 1 -- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b1c0cfc40 msgr2=0x7f7b1c0b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-14T09:36:46.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:46.727+0000 7f7b1bfff640 1 -- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b1c0cfc40 msgr2=0x7f7b1c0b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T09:36:46.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:46.727+0000 7f7b1bfff640 1 --2- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b1c0cfc40 0x7f7b1c0b24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T09:36:46.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:46.727+0000 7f7b1b7fe640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 0x7f7b1c0d36b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T09:36:46.732 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:46.727+0000 7f7b1bfff640 1 --2- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b1c0cfc40 0x7f7b1c0b24c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T09:36:46.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:46.928+0000 7f7b1b7fe640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 0x7f7b1c0d36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:46.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:46.928+0000 7f7b1bfff640 1 --2- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b1c0cfc40 0x7f7b1c0b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:46.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:46.928+0000 7f7b1bfff640 1 -- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b1c0cfc40 msgr2=0x7f7b1c0b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-14T09:36:46.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:46.928+0000 7f7b1b7fe640 1 -- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 msgr2=0x7f7b1c0d36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-14T09:36:46.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:46.928+0000 7f7b1bfff640 1 -- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b1c0cfc40 msgr2=0x7f7b1c0b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T09:36:46.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:46.928+0000 7f7b1b7fe640 1 -- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 msgr2=0x7f7b1c0d36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T09:36:46.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:46.928+0000 7f7b1bfff640 1 --2- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b1c0cfc40 0x7f7b1c0b24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T09:36:46.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:46.928+0000 7f7b1b7fe640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 0x7f7b1c0d36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T09:36:46.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:46.928+0000 7f7b1b7fe640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 0x7f7b1c0d36b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-14T09:36:46.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:46.928+0000 7f7b1bfff640 1 --2- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b1c0cfc40 0x7f7b1c0b24c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-14T09:36:47.332 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:47.330+0000 7f7b1b7fe640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 0x7f7b1c0d36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:47.332 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:47.330+0000 7f7b1bfff640 1 --2- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b1c0cfc40 0x7f7b1c0b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:47.333 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:47.330+0000 7f7b1b7fe640 1 -- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 msgr2=0x7f7b1c0d36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-14T09:36:47.333 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:47.330+0000 7f7b1b7fe640 1 -- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 msgr2=0x7f7b1c0d36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T09:36:47.333 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:47.330+0000 7f7b1b7fe640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 0x7f7b1c0d36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T09:36:47.333 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:47.330+0000 7f7b1b7fe640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 0x7f7b1c0d36b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-14T09:36:47.333 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:47.330+0000 7f7b1bfff640 1 -- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b1c0cfc40 msgr2=0x7f7b1c0b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-14T09:36:47.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:47.330+0000 7f7b1bfff640 1 -- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b1c0cfc40 msgr2=0x7f7b1c0b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T09:36:47.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:47.330+0000 7f7b1bfff640 1 --2- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b1c0cfc40 0x7f7b1c0b24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T09:36:47.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:47.330+0000 7f7b1bfff640 1 --2- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b1c0cfc40 0x7f7b1c0b24c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-14T09:36:48.135 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:48.132+0000 7f7b1b7fe640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 0x7f7b1c0d36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:48.135 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:48.132+0000 7f7b1bfff640 1 --2- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b1c0cfc40 0x7f7b1c0b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:48.135 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:48.132+0000 7f7b1b7fe640 1 -- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 msgr2=0x7f7b1c0d36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-14T09:36:48.135 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:48.132+0000 7f7b1b7fe640 1 -- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 msgr2=0x7f7b1c0d36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T09:36:48.136 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:48.132+0000 7f7b1b7fe640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 0x7f7b1c0d36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T09:36:48.136 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:48.132+0000 7f7b1b7fe640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 0x7f7b1c0d36b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-14T09:36:48.136 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:48.133+0000 7f7b1bfff640 1 -- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b1c0cfc40 msgr2=0x7f7b1c0b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-14T09:36:48.136 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:48.133+0000 7f7b1bfff640 1 -- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b1c0cfc40 msgr2=0x7f7b1c0b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T09:36:48.136 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:48.133+0000 7f7b1bfff640 1 --2- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b1c0cfc40 0x7f7b1c0b24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T09:36:48.136 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:48.133+0000 7f7b1bfff640 1 --2- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b1c0cfc40 0x7f7b1c0b24c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-14T09:36:49.728 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:49.727+0000 7f7b197fa640 1 -- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b1c0cfc40 msgr2=0x7f7b1c0b24c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T09:36:49.729 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:49.727+0000 7f7b197fa640 1 --2- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b1c0cfc40 0x7f7b1c0b24c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:49.729 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:49.727+0000 7f7b197fa640 1 -- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 msgr2=0x7f7b1c0d36b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T09:36:49.729 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:49.727+0000 7f7b197fa640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 0x7f7b1c0d36b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:49.729 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:49.727+0000 7f7b197fa640 1 -- 172.21.15.102:0/1191196154 >> v1:172.21.15.129:6789/0 conn(0x7f7b1c0b2080 legacy=0x7f7b1c0ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:49.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:49.727+0000 7f7b197fa640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b080036e0 0x7f7b08005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:36:49.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:49.727+0000 7f7b197fa640 1 -- 172.21.15.102:0/1191196154 --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b1c0cd940 con 0x7f7b08006200 2023-10-14T09:36:49.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:49.727+0000 7f7b197fa640 1 -- 172.21.15.102:0/1191196154 --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b1c0d0ea0 con 0x7f7b080036e0 2023-10-14T09:36:49.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:49.727+0000 7f7b1b7fe640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b080036e0 0x7f7b08005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:49.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:49.728+0000 7f7b1b7fe640 1 -- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b080036e0 msgr2=0x7f7b08005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-14T09:36:49.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:49.728+0000 7f7b1b7fe640 1 -- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b080036e0 msgr2=0x7f7b08005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T09:36:49.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:49.728+0000 7f7b1b7fe640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b080036e0 0x7f7b08005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T09:36:49.732 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:49.728+0000 7f7b1b7fe640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b080036e0 0x7f7b08005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T09:36:49.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:49.929+0000 7f7b1b7fe640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b080036e0 0x7f7b08005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:49.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:49.930+0000 7f7b1b7fe640 1 -- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b080036e0 msgr2=0x7f7b08005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-14T09:36:49.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:49.930+0000 7f7b1b7fe640 1 -- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b080036e0 msgr2=0x7f7b08005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T09:36:49.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:49.930+0000 7f7b1b7fe640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b080036e0 0x7f7b08005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T09:36:49.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:49.930+0000 7f7b1b7fe640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b080036e0 0x7f7b08005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-14T09:36:50.333 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:50.331+0000 7f7b1b7fe640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b080036e0 0x7f7b08005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:50.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:50.332+0000 7f7b1b7fe640 1 -- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b080036e0 msgr2=0x7f7b08005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-14T09:36:50.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:50.332+0000 7f7b1b7fe640 1 -- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b080036e0 msgr2=0x7f7b08005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T09:36:50.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:50.332+0000 7f7b1b7fe640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b080036e0 0x7f7b08005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T09:36:50.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:50.332+0000 7f7b1b7fe640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b080036e0 0x7f7b08005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-14T09:36:51.136 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:51.134+0000 7f7b1b7fe640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b080036e0 0x7f7b08005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:51.136 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:51.134+0000 7f7b1b7fe640 1 -- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b080036e0 msgr2=0x7f7b08005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-14T09:36:51.136 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:51.134+0000 7f7b1b7fe640 1 -- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b080036e0 msgr2=0x7f7b08005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T09:36:51.136 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:51.134+0000 7f7b1b7fe640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b080036e0 0x7f7b08005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T09:36:51.136 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:51.134+0000 7f7b1b7fe640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b080036e0 0x7f7b08005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-14T09:36:52.729 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:52.727+0000 7f7b197fa640 1 -- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b080036e0 msgr2=0x7f7b08005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T09:36:52.729 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:52.727+0000 7f7b197fa640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b080036e0 0x7f7b08005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:52.729 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:52.727+0000 7f7b197fa640 1 -- 172.21.15.102:0/1191196154 >> v1:172.21.15.102:6789/0 conn(0x7f7b08006200 legacy=0x7f7b080086c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:52.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:52.727+0000 7f7b1bfff640 1 -- 172.21.15.102:0/1191196154 reap_dead start 2023-10-14T09:36:52.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:52.727+0000 7f7b197fa640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 0x7f7b080102a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:36:52.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:52.727+0000 7f7b197fa640 1 -- 172.21.15.102:0/1191196154 --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b0800af80 con 0x7f7b0800a050 2023-10-14T09:36:52.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:52.727+0000 7f7b197fa640 1 -- 172.21.15.102:0/1191196154 --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b0800ad70 con 0x7f7b1c0b2080 2023-10-14T09:36:52.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:52.727+0000 7f7b197fa640 1 -- 172.21.15.102:0/1191196154 --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b1c0d0ea0 con 0x7f7b1c0b1ca0 2023-10-14T09:36:52.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:52.728+0000 7f7b1affd640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 0x7f7b080102a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:52.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:52.729+0000 7f7b1affd640 1 -- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 msgr2=0x7f7b080102a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-14T09:36:52.732 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:52.729+0000 7f7b1affd640 1 -- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 msgr2=0x7f7b080102a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T09:36:52.732 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:52.729+0000 7f7b1affd640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 0x7f7b080102a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T09:36:52.732 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:52.729+0000 7f7b1affd640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 0x7f7b080102a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T09:36:52.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:52.930+0000 7f7b1affd640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 0x7f7b080102a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:52.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:52.931+0000 7f7b1affd640 1 -- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 msgr2=0x7f7b080102a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-14T09:36:52.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:52.931+0000 7f7b1affd640 1 -- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 msgr2=0x7f7b080102a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T09:36:52.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:52.931+0000 7f7b1affd640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 0x7f7b080102a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T09:36:52.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:52.931+0000 7f7b1affd640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 0x7f7b080102a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-14T09:36:53.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:53.333+0000 7f7b1affd640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 0x7f7b080102a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:53.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:53.333+0000 7f7b1affd640 1 -- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 msgr2=0x7f7b080102a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-14T09:36:53.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:53.333+0000 7f7b1affd640 1 -- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 msgr2=0x7f7b080102a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T09:36:53.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:53.333+0000 7f7b1affd640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 0x7f7b080102a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T09:36:53.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:53.333+0000 7f7b1affd640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 0x7f7b080102a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-14T09:36:54.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:54.135+0000 7f7b1affd640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 0x7f7b080102a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:54.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:54.135+0000 7f7b1affd640 1 -- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 msgr2=0x7f7b080102a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-14T09:36:54.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:54.135+0000 7f7b1affd640 1 -- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 msgr2=0x7f7b080102a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T09:36:54.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:54.135+0000 7f7b1affd640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 0x7f7b080102a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T09:36:54.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:54.135+0000 7f7b1affd640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 0x7f7b080102a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-14T09:36:55.729 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:55.728+0000 7f7b197fa640 1 -- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 msgr2=0x7f7b080102a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T09:36:55.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:55.728+0000 7f7b197fa640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.129:3300/0 conn(0x7f7b1c0b1ca0 0x7f7b080102a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:55.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:55.728+0000 7f7b197fa640 1 -- 172.21.15.102:0/1191196154 >> v1:172.21.15.129:6789/0 conn(0x7f7b1c0b2080 legacy=0x7f7b080127f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:55.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:55.728+0000 7f7b197fa640 1 -- 172.21.15.102:0/1191196154 >> v1:172.21.15.102:6789/0 conn(0x7f7b0800a050 legacy=0x7f7b0800a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:55.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:55.728+0000 7f7b197fa640 1 --2- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b08003ca0 0x7f7b080040e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:36:55.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:55.728+0000 7f7b197fa640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b08004d40 0x7f7b080051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:36:55.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:55.728+0000 7f7b197fa640 1 -- 172.21.15.102:0/1191196154 --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b1c0d0ea0 con 0x7f7b08004d40 2023-10-14T09:36:55.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:55.728+0000 7f7b197fa640 1 -- 172.21.15.102:0/1191196154 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c0d0bc0 con 0x7f7b08003ca0 2023-10-14T09:36:55.732 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:55.729+0000 7f7b1affd640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b08004d40 0x7f7b080051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:55.732 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:55.729+0000 7f7b1b7fe640 1 --2- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b08003ca0 0x7f7b080040e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:55.733 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:55.730+0000 7f7b1affd640 1 -- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b08004d40 msgr2=0x7f7b080051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-14T09:36:55.733 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:55.730+0000 7f7b1affd640 1 -- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b08004d40 msgr2=0x7f7b080051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T09:36:55.733 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:55.730+0000 7f7b1affd640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b08004d40 0x7f7b080051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T09:36:55.733 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:55.730+0000 7f7b1affd640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b08004d40 0x7f7b080051f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T09:36:55.733 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:55.730+0000 7f7b1b7fe640 1 -- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b08003ca0 msgr2=0x7f7b080040e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-14T09:36:55.734 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:55.730+0000 7f7b1b7fe640 1 -- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b08003ca0 msgr2=0x7f7b080040e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T09:36:55.734 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:55.730+0000 7f7b1b7fe640 1 --2- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b08003ca0 0x7f7b080040e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T09:36:55.734 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:55.730+0000 7f7b1b7fe640 1 --2- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b08003ca0 0x7f7b080040e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T09:36:55.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:55.931+0000 7f7b1affd640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b08004d40 0x7f7b080051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:55.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:55.932+0000 7f7b1b7fe640 1 --2- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b08003ca0 0x7f7b080040e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:55.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:55.932+0000 7f7b1affd640 1 -- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b08004d40 msgr2=0x7f7b080051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-14T09:36:55.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:55.932+0000 7f7b1affd640 1 -- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b08004d40 msgr2=0x7f7b080051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T09:36:55.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:55.932+0000 7f7b1affd640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b08004d40 0x7f7b080051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T09:36:55.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:55.932+0000 7f7b1affd640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b08004d40 0x7f7b080051f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-14T09:36:55.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:55.932+0000 7f7b1b7fe640 1 -- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b08003ca0 msgr2=0x7f7b080040e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-14T09:36:55.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:55.932+0000 7f7b1b7fe640 1 -- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b08003ca0 msgr2=0x7f7b080040e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T09:36:55.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:55.932+0000 7f7b1b7fe640 1 --2- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b08003ca0 0x7f7b080040e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T09:36:55.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:55.932+0000 7f7b1b7fe640 1 --2- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b08003ca0 0x7f7b080040e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-14T09:36:56.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:56.333+0000 7f7b1affd640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b08004d40 0x7f7b080051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:56.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:56.333+0000 7f7b1b7fe640 1 --2- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b08003ca0 0x7f7b080040e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:56.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:56.333+0000 7f7b1affd640 1 -- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b08004d40 msgr2=0x7f7b080051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-14T09:36:56.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:56.334+0000 7f7b1affd640 1 -- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b08004d40 msgr2=0x7f7b080051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T09:36:56.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:56.334+0000 7f7b1affd640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b08004d40 0x7f7b080051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T09:36:56.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:56.334+0000 7f7b1affd640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b08004d40 0x7f7b080051f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-14T09:36:56.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:56.334+0000 7f7b1b7fe640 1 -- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b08003ca0 msgr2=0x7f7b080040e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-14T09:36:56.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:56.334+0000 7f7b1b7fe640 1 -- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b08003ca0 msgr2=0x7f7b080040e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T09:36:56.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:56.334+0000 7f7b1b7fe640 1 --2- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b08003ca0 0x7f7b080040e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T09:36:56.337 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:56.334+0000 7f7b1b7fe640 1 --2- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b08003ca0 0x7f7b080040e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-14T09:36:57.136 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.134+0000 7f7b1affd640 1 --2- 172.21.15.102:0/1191196154 >> v2:172.21.15.102:3300/0 conn(0x7f7b08004d40 0x7f7b080051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:57.136 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.134+0000 7f7b1b7fe640 1 --2- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b08003ca0 0x7f7b080040e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:57.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.134+0000 7f7b1affd640 1 -- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b08003ca0 msgr2=0x7f7b080040e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:36:57.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.134+0000 7f7b1affd640 1 --2- 172.21.15.102:0/1191196154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b08003ca0 0x7f7b080040e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:57.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.134+0000 7f7b1affd640 1 -- 172.21.15.102:0/1191196154 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b08004b70 con 0x7f7b08004d40 2023-10-14T09:36:57.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.135+0000 7f7b1affd640 1 --2- 172.21.15.102:0/1191196154 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b08004d40 0x7f7b080051f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7b10007fd0 tx=0x7f7b1002ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e025606feeee5a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:36:57.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.136+0000 7f7b1a7fc640 1 -- 172.21.15.102:0/1191196154 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b10017320 con 0x7f7b08004d40 2023-10-14T09:36:57.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.136+0000 7f7b1a7fc640 1 -- 172.21.15.102:0/1191196154 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b100050d0 con 0x7f7b08004d40 2023-10-14T09:36:57.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.136+0000 7f7b1a7fc640 1 -- 172.21.15.102:0/1191196154 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b10007030 con 0x7f7b08004d40 2023-10-14T09:36:57.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.137+0000 7f7b20e13640 1 -- 172.21.15.102:0/1191196154 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b08004d40 msgr2=0x7f7b080051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:57.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.137+0000 7f7b20e13640 1 --2- 172.21.15.102:0/1191196154 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b08004d40 0x7f7b080051f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7b10007fd0 tx=0x7f7b1002ca60 comp rx=0 tx=0).stop 2023-10-14T09:36:57.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.137+0000 7f7b1bfff640 1 -- 172.21.15.102:0/1191196154 reap_dead start 2023-10-14T09:36:57.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.137+0000 7f7b20e13640 1 -- 172.21.15.102:0/1191196154 shutdown_connections 2023-10-14T09:36:57.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.137+0000 7f7b20e13640 1 --2- 172.21.15.102:0/1191196154 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b08004d40 0x7f7b080051f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:57.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.137+0000 7f7b20e13640 1 -- 172.21.15.102:0/1191196154 >> 172.21.15.102:0/1191196154 conn(0x7f7b1c0d2b90 msgr2=0x7f7b1c0d2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:36:57.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.137+0000 7f7b20e13640 1 -- 172.21.15.102:0/1191196154 shutdown_connections 2023-10-14T09:36:57.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.137+0000 7f7b20e13640 1 -- 172.21.15.102:0/1191196154 wait complete. 2023-10-14T09:36:57.141 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.140+0000 7f7b20e13640 1 Processor -- start 2023-10-14T09:36:57.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.140+0000 7f7b20e13640 1 -- start start 2023-10-14T09:36:57.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.141+0000 7f7b20e13640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b08004d40 0x7f7b1c06b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:36:57.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.141+0000 7f7b20e13640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7b1c15ce40 0x7f7b1c1f1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:36:57.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.141+0000 7f7b20e13640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b1c0cbdc0 0x7f7b1c0cc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:36:57.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.141+0000 7f7b20e13640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c15b470 con 0x7f7b08004d40 2023-10-14T09:36:57.144 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.141+0000 7f7b20e13640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c0cc780 con 0x7f7b1c15ce40 2023-10-14T09:36:57.144 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.141+0000 7f7b20e13640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c0ca670 con 0x7f7b1c0cbdc0 2023-10-14T09:36:57.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.142+0000 7f7b1b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b08004d40 0x7f7b1c06b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:57.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.142+0000 7f7b1bfff640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b1c0cbdc0 0x7f7b1c0cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:57.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.142+0000 7f7b1bfff640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b1c0cbdc0 0x7f7b1c0cc240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.102:60666/0 (socket says 172.21.15.102:60666) 2023-10-14T09:36:57.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.142+0000 7f7b1b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b08004d40 0x7f7b1c06b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60848/0 (socket says 172.21.15.102:60848) 2023-10-14T09:36:57.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.142+0000 7f7b1bfff640 1 -- 172.21.15.102:0/444577403 learned_addr learned my addr 172.21.15.102:0/444577403 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:36:57.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.142+0000 7f7b1affd640 1 --2- 172.21.15.102:0/444577403 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7b1c15ce40 0x7f7b1c1f1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:57.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.142+0000 7f7b1bfff640 1 -- 172.21.15.102:0/444577403 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7b1c15ce40 msgr2=0x7f7b1c1f1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:57.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.142+0000 7f7b1bfff640 1 --2- 172.21.15.102:0/444577403 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7b1c15ce40 0x7f7b1c1f1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:57.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.142+0000 7f7b1bfff640 1 -- 172.21.15.102:0/444577403 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b08004d40 msgr2=0x7f7b1c06b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:57.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.142+0000 7f7b1bfff640 1 --2- 172.21.15.102:0/444577403 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b08004d40 0x7f7b1c06b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:57.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.142+0000 7f7b1bfff640 1 -- 172.21.15.102:0/444577403 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1000f040 con 0x7f7b1c0cbdc0 2023-10-14T09:36:57.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.143+0000 7f7b1bfff640 1 --2- 172.21.15.102:0/444577403 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b1c0cbdc0 0x7f7b1c0cc240 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7b14009610 tx=0x7f7b1400ad80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:36:57.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.143+0000 7f7b03fff640 1 -- 172.21.15.102:0/444577403 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b14011ba0 con 0x7f7b1c0cbdc0 2023-10-14T09:36:57.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.143+0000 7f7b03fff640 1 -- 172.21.15.102:0/444577403 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1400f040 con 0x7f7b1c0cbdc0 2023-10-14T09:36:57.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.143+0000 7f7b03fff640 1 -- 172.21.15.102:0/444577403 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b14017460 con 0x7f7b1c0cbdc0 2023-10-14T09:36:57.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.143+0000 7f7b20e13640 1 -- 172.21.15.102:0/444577403 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b1c06ba10 con 0x7f7b1c0cbdc0 2023-10-14T09:36:57.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.143+0000 7f7b20e13640 1 -- 172.21.15.102:0/444577403 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b1c0ca8c0 con 0x7f7b1c0cbdc0 2023-10-14T09:36:57.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.143+0000 7f7b03fff640 1 -- 172.21.15.102:0/444577403 <== mon.2 v2:172.21.15.129:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7b140178c0 con 0x7f7b1c0cbdc0 2023-10-14T09:36:57.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.144+0000 7f7b03fff640 1 -- 172.21.15.102:0/444577403 <== mon.2 v2:172.21.15.129:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7b14022940 con 0x7f7b1c0cbdc0 2023-10-14T09:36:57.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.144+0000 7f7b20e13640 1 -- 172.21.15.102:0/444577403 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b1c15b5b0 con 0x7f7b1c0cbdc0 2023-10-14T09:36:57.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.150+0000 7f7b03fff640 1 -- 172.21.15.102:0/444577403 <== mon.2 v2:172.21.15.129:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f7b1c15b5b0 con 0x7f7b1c0cbdc0 2023-10-14T09:36:57.223 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.222+0000 7f7b20e13640 1 -- 172.21.15.102:0/444577403 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f7b1c04e9b0 con 0x7f7b1c0cbdc0 2023-10-14T09:36:57.235 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.233+0000 7f7b03fff640 1 -- 172.21.15.102:0/444577403 <== mon.2 v2:172.21.15.129:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f7b0800ad70 con 0x7f7b1c0cbdc0 2023-10-14T09:36:57.235 INFO:teuthology.orchestra.run.smithi102.stderr:adjusted tunables profile to default 2023-10-14T09:36:57.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.234+0000 7f7b20e13640 1 -- 172.21.15.102:0/444577403 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b1c0cbdc0 msgr2=0x7f7b1c0cc240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:57.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.234+0000 7f7b20e13640 1 --2- 172.21.15.102:0/444577403 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b1c0cbdc0 0x7f7b1c0cc240 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7b14009610 tx=0x7f7b1400ad80 comp rx=0 tx=0).stop 2023-10-14T09:36:57.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.235+0000 7f7b20e13640 1 -- 172.21.15.102:0/444577403 shutdown_connections 2023-10-14T09:36:57.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.235+0000 7f7b20e13640 1 --2- 172.21.15.102:0/444577403 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7b1c0cbdc0 0x7f7b1c0cc240 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:57.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.235+0000 7f7b20e13640 1 --2- 172.21.15.102:0/444577403 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7b1c15ce40 0x7f7b1c1f1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:57.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.235+0000 7f7b20e13640 1 --2- 172.21.15.102:0/444577403 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b08004d40 0x7f7b1c06b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:57.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.235+0000 7f7b20e13640 1 -- 172.21.15.102:0/444577403 >> 172.21.15.102:0/444577403 conn(0x7f7b1c0d2b90 msgr2=0x7f7b1c0ce420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:36:57.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.235+0000 7f7b20e13640 1 -- 172.21.15.102:0/444577403 shutdown_connections 2023-10-14T09:36:57.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:36:57.235+0000 7f7b20e13640 1 -- 172.21.15.102:0/444577403 wait complete. 2023-10-14T09:36:57.253 INFO:tasks.ceph:check_enable_crimson: False 2023-10-14T09:36:57.253 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-14T09:36:57.254 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-10-14T09:36:57.254 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-14T09:36:57.328 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-10-14T09:36:57.328 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-14T09:36:57.458 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-10-14T09:36:57.458 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-14T09:36:57.543 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-10-14T09:36:57.544 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-14T09:36:57.660 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-10-14T09:36:57.658+0000 7f0070e12040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-14T09:36:57.667 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2023-10-14T09:36:57.668 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-14T09:36:57.677 INFO:tasks.ceph.mgr.x.smithi129.stderr:2023-10-14T09:36:57.673+0000 7f06c3613040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-14T09:36:57.722 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-10-14T09:36:57.720+0000 7f0070e12040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-14T09:36:57.738 INFO:tasks.ceph.mgr.x.smithi129.stderr:2023-10-14T09:36:57.736+0000 7f06c3613040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-14T09:36:57.759 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2023-10-14T09:36:57.759 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-14T09:36:57.840 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2023-10-14T09:36:57.840 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-14T09:36:57.969 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2023-10-14T09:36:57.969 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-14T09:36:58.049 DEBUG:teuthology.orchestra.run.smithi129:> sudo ceph --cluster ceph osd new e5aef8f3-878f-482b-b522-9a5b958b90b1 0 2023-10-14T09:36:58.296 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.293+0000 7f38fd010640 1 Processor -- start 2023-10-14T09:36:58.296 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.294+0000 7f38fd010640 1 -- start start 2023-10-14T09:36:58.297 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.295+0000 7f38fd010640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f38f80cf710 0x7f38f80b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:36:58.297 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.295+0000 7f38fd010640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f38f80cfaf0 0x7f38f80b3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:36:58.298 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.295+0000 7f38fd010640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38f80d3980 con 0x7f38f80b38e0 2023-10-14T09:36:58.298 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.295+0000 7f38fd010640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38f80d3c60 con 0x7f38f80cfaf0 2023-10-14T09:36:58.298 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.295+0000 7f38fd010640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38f80ce630 con 0x7f38f80cf710 2023-10-14T09:36:58.298 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.295+0000 7f38f6d9d640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f38f80cf710 0x7f38f80b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:58.298 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.295+0000 7f38f6d9d640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f38f80cf710 0x7f38f80b2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:56234/0 (socket says 172.21.15.129:56234) 2023-10-14T09:36:58.299 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.295+0000 7f38f6d9d640 1 -- 172.21.15.129:0/146810053 learned_addr learned my addr 172.21.15.129:0/146810053 (peer_addr_for_me v2:172.21.15.129:0/0) 2023-10-14T09:36:58.300 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.296+0000 7f38effff640 1 --2- 172.21.15.129:0/146810053 >> v2:172.21.15.102:3300/0 conn(0x7f38f80cfaf0 0x7f38f80b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:58.300 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.296+0000 7f38f6d9d640 1 -- 172.21.15.129:0/146810053 >> v2:172.21.15.102:3300/0 conn(0x7f38f80cfaf0 msgr2=0x7f38f80b3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:36:58.300 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.296+0000 7f38f6d9d640 1 --2- 172.21.15.129:0/146810053 >> v2:172.21.15.102:3300/0 conn(0x7f38f80cfaf0 0x7f38f80b3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:58.301 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.296+0000 7f38f6d9d640 1 -- 172.21.15.129:0/146810053 >> v1:172.21.15.102:6789/0 conn(0x7f38f80b38e0 legacy=0x7f38f80d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:36:58.301 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.296+0000 7f38f6d9d640 1 -- 172.21.15.129:0/146810053 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f80ce910 con 0x7f38f80cf710 2023-10-14T09:36:58.301 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.297+0000 7f38f6d9d640 1 --2- 172.21.15.129:0/146810053 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f38f80cf710 0x7f38f80b2d10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f38f80d2c20 tx=0x7f38e802b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3260aa4e07499b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:36:58.301 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.297+0000 7f38f659c640 1 -- 172.21.15.129:0/146810053 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e8004230 con 0x7f38f80cf710 2023-10-14T09:36:58.301 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.297+0000 7f38f659c640 1 -- 172.21.15.129:0/146810053 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e8004390 con 0x7f38f80cf710 2023-10-14T09:36:58.302 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.297+0000 7f38f659c640 1 -- 172.21.15.129:0/146810053 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e8003810 con 0x7f38f80cf710 2023-10-14T09:36:58.302 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.298+0000 7f38fd010640 1 -- 172.21.15.129:0/146810053 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f38f80cf710 msgr2=0x7f38f80b2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:58.302 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.298+0000 7f38fd010640 1 --2- 172.21.15.129:0/146810053 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f38f80cf710 0x7f38f80b2d10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f38f80d2c20 tx=0x7f38e802b860 comp rx=0 tx=0).stop 2023-10-14T09:36:58.302 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.298+0000 7f38fd010640 1 -- 172.21.15.129:0/146810053 shutdown_connections 2023-10-14T09:36:58.302 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.298+0000 7f38fd010640 1 --2- 172.21.15.129:0/146810053 >> v2:172.21.15.102:3300/0 conn(0x7f38f80cfaf0 0x7f38f80b3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:58.303 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.298+0000 7f38fd010640 1 --2- 172.21.15.129:0/146810053 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f38f80cf710 0x7f38f80b2d10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:58.303 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.298+0000 7f38fd010640 1 -- 172.21.15.129:0/146810053 >> 172.21.15.129:0/146810053 conn(0x7f38f80d2cc0 msgr2=0x7f38f80d30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:36:58.303 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.298+0000 7f38fd010640 1 -- 172.21.15.129:0/146810053 shutdown_connections 2023-10-14T09:36:58.303 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.298+0000 7f38fd010640 1 -- 172.21.15.129:0/146810053 wait complete. 2023-10-14T09:36:58.305 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.300+0000 7f38fd010640 1 Processor -- start 2023-10-14T09:36:58.305 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.300+0000 7f38fd010640 1 -- start start 2023-10-14T09:36:58.306 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.301+0000 7f38fd010640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38f80b38e0 0x7f38f806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:36:58.306 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.301+0000 7f38fd010640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f38f80cf710 0x7f38f806b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:36:58.306 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.301+0000 7f38fd010640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f38f80cfaf0 0x7f38f814fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:36:58.306 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.301+0000 7f38fd010640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f8150cd0 con 0x7f38f80b38e0 2023-10-14T09:36:58.306 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.301+0000 7f38fd010640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f81f26b0 con 0x7f38f80cfaf0 2023-10-14T09:36:58.307 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.301+0000 7f38fd010640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f81f3680 con 0x7f38f80cf710 2023-10-14T09:36:58.307 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.301+0000 7f38f759e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f38f80cfaf0 0x7f38f814fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:58.307 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.301+0000 7f38f759e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f38f80cfaf0 0x7f38f814fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:56242/0 (socket says 172.21.15.129:56242) 2023-10-14T09:36:58.307 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.301+0000 7f38f759e640 1 -- 172.21.15.129:0/3431865720 learned_addr learned my addr 172.21.15.129:0/3431865720 (peer_addr_for_me v2:172.21.15.129:0/0) 2023-10-14T09:36:58.307 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.301+0000 7f38f6d9d640 1 --2- 172.21.15.129:0/3431865720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38f80b38e0 0x7f38f806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:58.308 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.301+0000 7f38effff640 1 --2- 172.21.15.129:0/3431865720 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f38f80cf710 0x7f38f806b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:58.308 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.302+0000 7f38f759e640 1 -- 172.21.15.129:0/3431865720 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f38f80cf710 msgr2=0x7f38f806b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:58.308 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.302+0000 7f38f759e640 1 --2- 172.21.15.129:0/3431865720 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f38f80cf710 0x7f38f806b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:58.308 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.302+0000 7f38f759e640 1 -- 172.21.15.129:0/3431865720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38f80b38e0 msgr2=0x7f38f806ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:58.308 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.302+0000 7f38f759e640 1 --2- 172.21.15.129:0/3431865720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38f80b38e0 0x7f38f806ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:58.309 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.302+0000 7f38f759e640 1 -- 172.21.15.129:0/3431865720 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e8009460 con 0x7f38f80cfaf0 2023-10-14T09:36:58.309 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.302+0000 7f38effff640 1 --2- 172.21.15.129:0/3431865720 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f38f80cf710 0x7f38f806b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:36:58.309 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.302+0000 7f38f759e640 1 --2- 172.21.15.129:0/3431865720 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f38f80cfaf0 0x7f38f814fb70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f38f000b970 tx=0x7f38f000be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:36:58.309 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.302+0000 7f38ef7fe640 1 -- 172.21.15.129:0/3431865720 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f000cb40 con 0x7f38f80cfaf0 2023-10-14T09:36:58.309 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.302+0000 7f38ef7fe640 1 -- 172.21.15.129:0/3431865720 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f000cca0 con 0x7f38f80cfaf0 2023-10-14T09:36:58.310 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.302+0000 7f38fd010640 1 -- 172.21.15.129:0/3431865720 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f81f28c0 con 0x7f38f80cfaf0 2023-10-14T09:36:58.310 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.302+0000 7f38ef7fe640 1 -- 172.21.15.129:0/3431865720 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f0014680 con 0x7f38f80cfaf0 2023-10-14T09:36:58.310 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.302+0000 7f38fd010640 1 -- 172.21.15.129:0/3431865720 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f81f2e80 con 0x7f38f80cfaf0 2023-10-14T09:36:58.310 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.303+0000 7f38ef7fe640 1 -- 172.21.15.129:0/3431865720 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f38f00147e0 con 0x7f38f80cfaf0 2023-10-14T09:36:58.310 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.303+0000 7f38ef7fe640 1 -- 172.21.15.129:0/3431865720 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f38f001ecf0 con 0x7f38f80cfaf0 2023-10-14T09:36:58.311 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.304+0000 7f38fd010640 1 -- 172.21.15.129:0/3431865720 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38f804e160 con 0x7f38f80cfaf0 2023-10-14T09:36:58.311 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.307+0000 7f38ef7fe640 1 -- 172.21.15.129:0/3431865720 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f38f0019070 con 0x7f38f80cfaf0 2023-10-14T09:36:58.348 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-10-14T09:36:58.346+0000 7f0070e12040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-14T09:36:58.389 INFO:tasks.ceph.mgr.x.smithi129.stderr:2023-10-14T09:36:58.387+0000 7f06c3613040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-14T09:36:58.403 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.401+0000 7f38fd010640 1 -- 172.21.15.129:0/3431865720 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e5aef8f3-878f-482b-b522-9a5b958b90b1", "id": 0} v 0) v1 -- 0x7f38f80d11b0 con 0x7f38f80cfaf0 2023-10-14T09:36:58.408 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-10-14T09:36:58.406+0000 7f0070e12040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-14T09:36:58.409 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.407+0000 7f38ef7fe640 1 -- 172.21.15.129:0/3431865720 <== mon.1 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e5aef8f3-878f-482b-b522-9a5b958b90b1", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f38f000ce50 con 0x7f38f80cfaf0 2023-10-14T09:36:58.410 INFO:teuthology.orchestra.run.smithi129.stdout:0 2023-10-14T09:36:58.411 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.408+0000 7f38fd010640 1 -- 172.21.15.129:0/3431865720 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f38f80cfaf0 msgr2=0x7f38f814fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:58.411 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.408+0000 7f38fd010640 1 --2- 172.21.15.129:0/3431865720 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f38f80cfaf0 0x7f38f814fb70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f38f000b970 tx=0x7f38f000be30 comp rx=0 tx=0).stop 2023-10-14T09:36:58.411 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.408+0000 7f38fd010640 1 -- 172.21.15.129:0/3431865720 shutdown_connections 2023-10-14T09:36:58.411 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.408+0000 7f38fd010640 1 --2- 172.21.15.129:0/3431865720 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f38f80cfaf0 0x7f38f814fb70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:58.412 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.408+0000 7f38fd010640 1 --2- 172.21.15.129:0/3431865720 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f38f80cf710 0x7f38f806b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:58.412 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.408+0000 7f38fd010640 1 --2- 172.21.15.129:0/3431865720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38f80b38e0 0x7f38f806ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:58.412 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.408+0000 7f38fd010640 1 -- 172.21.15.129:0/3431865720 >> 172.21.15.129:0/3431865720 conn(0x7f38f80d2cc0 msgr2=0x7f38f80b5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:36:58.412 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.409+0000 7f38fd010640 1 -- 172.21.15.129:0/3431865720 shutdown_connections 2023-10-14T09:36:58.412 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.409+0000 7f38fd010640 1 -- 172.21.15.129:0/3431865720 wait complete. 2023-10-14T09:36:58.426 DEBUG:teuthology.orchestra.run.smithi129:> sudo ceph --cluster ceph osd new 4a8cf50e-387b-4d47-9588-bd22e375a9ec 1 2023-10-14T09:36:58.454 INFO:tasks.ceph.mgr.x.smithi129.stderr:2023-10-14T09:36:58.452+0000 7f06c3613040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-14T09:36:58.459 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-10-14T09:36:58.457+0000 7f0070e12040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-14T09:36:58.511 INFO:tasks.ceph.mgr.x.smithi129.stderr:2023-10-14T09:36:58.509+0000 7f06c3613040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-14T09:36:58.521 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-10-14T09:36:58.519+0000 7f0070e12040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-14T09:36:58.570 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-10-14T09:36:58.568+0000 7f0070e12040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-14T09:36:58.577 INFO:tasks.ceph.mgr.x.smithi129.stderr:2023-10-14T09:36:58.574+0000 7f06c3613040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-14T09:36:58.618 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.616+0000 7f9921d42640 1 Processor -- start 2023-10-14T09:36:58.619 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.616+0000 7f9921d42640 1 -- start start 2023-10-14T09:36:58.621 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.618+0000 7f9921d42640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f991c15aa60 0x7f991c0af820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:36:58.622 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.618+0000 7f9921d42640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f991c0cc9f0 0x7f991c0b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:36:58.622 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.618+0000 7f9921d42640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f991c0b3730 con 0x7f991c0afd60 2023-10-14T09:36:58.622 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.618+0000 7f9921d42640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f991c0b3980 con 0x7f991c0cc9f0 2023-10-14T09:36:58.623 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.618+0000 7f9921d42640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f991c0b3c60 con 0x7f991c15aa60 2023-10-14T09:36:58.623 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.618+0000 7f9921541640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f991c0cc9f0 0x7f991c0b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:58.623 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.619+0000 7f9921541640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f991c0cc9f0 0x7f991c0b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:56254/0 (socket says 172.21.15.129:56254) 2023-10-14T09:36:58.624 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.619+0000 7f9921541640 1 -- 172.21.15.129:0/3350664356 learned_addr learned my addr 172.21.15.129:0/3350664356 (peer_addr_for_me v2:172.21.15.129:0/0) 2023-10-14T09:36:58.624 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.619+0000 7f9920d40640 1 --2- 172.21.15.129:0/3350664356 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f991c15aa60 0x7f991c0af820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:58.625 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.619+0000 7f9921541640 1 -- 172.21.15.129:0/3350664356 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f991c15aa60 msgr2=0x7f991c0af820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:36:58.625 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.619+0000 7f9921541640 1 --2- 172.21.15.129:0/3350664356 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f991c15aa60 0x7f991c0af820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:58.625 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.619+0000 7f9921541640 1 -- 172.21.15.129:0/3350664356 >> v1:172.21.15.129:6789/0 conn(0x7f991c0afd60 legacy=0x7f991c0cc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:58.625 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.619+0000 7f9921541640 1 -- 172.21.15.129:0/3350664356 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991c0b3f40 con 0x7f991c0cc9f0 2023-10-14T09:36:58.629 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.620+0000 7f9921541640 1 --2- 172.21.15.129:0/3350664356 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f991c0cc9f0 0x7f991c0b4740 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9914009e50 tx=0x7f991402bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8585d18612e8773d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:36:58.629 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.620+0000 7f991b7fe640 1 -- 172.21.15.129:0/3350664356 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991402ca80 con 0x7f991c0cc9f0 2023-10-14T09:36:58.629 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.620+0000 7f991b7fe640 1 -- 172.21.15.129:0/3350664356 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991402cbe0 con 0x7f991c0cc9f0 2023-10-14T09:36:58.629 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.620+0000 7f991b7fe640 1 -- 172.21.15.129:0/3350664356 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99140343f0 con 0x7f991c0cc9f0 2023-10-14T09:36:58.630 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.621+0000 7f9921d42640 1 -- 172.21.15.129:0/3350664356 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f991c0cc9f0 msgr2=0x7f991c0b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:58.630 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.621+0000 7f9921d42640 1 --2- 172.21.15.129:0/3350664356 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f991c0cc9f0 0x7f991c0b4740 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9914009e50 tx=0x7f991402bee0 comp rx=0 tx=0).stop 2023-10-14T09:36:58.630 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.621+0000 7f9921d42640 1 -- 172.21.15.129:0/3350664356 shutdown_connections 2023-10-14T09:36:58.630 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.621+0000 7f9921d42640 1 --2- 172.21.15.129:0/3350664356 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f991c0cc9f0 0x7f991c0b4740 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:58.631 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.621+0000 7f9921d42640 1 --2- 172.21.15.129:0/3350664356 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f991c15aa60 0x7f991c0af820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:58.631 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.621+0000 7f9921d42640 1 -- 172.21.15.129:0/3350664356 >> 172.21.15.129:0/3350664356 conn(0x7f991c065ed0 msgr2=0x7f991c0662e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:36:58.631 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.621+0000 7f9921d42640 1 -- 172.21.15.129:0/3350664356 shutdown_connections 2023-10-14T09:36:58.631 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.621+0000 7f9921d42640 1 -- 172.21.15.129:0/3350664356 wait complete. 2023-10-14T09:36:58.631 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.623+0000 7f9921d42640 1 Processor -- start 2023-10-14T09:36:58.631 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.623+0000 7f9921d42640 1 -- start start 2023-10-14T09:36:58.632 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.624+0000 7f9921d42640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f991c0afd60 0x7f991c06b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:36:58.632 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.624+0000 7f9921d42640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f991c0cc9f0 0x7f991c158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:36:58.632 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.624+0000 7f9921d42640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f991c15aa60 0x7f991c0b2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:36:58.632 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.624+0000 7f9921d42640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991c0c9fc0 con 0x7f991c0cc9f0 2023-10-14T09:36:58.632 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.624+0000 7f9921d42640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991c06bfa0 con 0x7f991c15aa60 2023-10-14T09:36:58.633 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.624+0000 7f9921d42640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f991c06c280 con 0x7f991c0afd60 2023-10-14T09:36:58.633 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.624+0000 7f9920d40640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f991c0afd60 0x7f991c06b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:58.633 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.624+0000 7f9920d40640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f991c0afd60 0x7f991c06b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.129:50548/0 (socket says 172.21.15.129:50548) 2023-10-14T09:36:58.633 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.624+0000 7f9920d40640 1 -- 172.21.15.129:0/2085496474 learned_addr learned my addr 172.21.15.129:0/2085496474 (peer_addr_for_me v2:172.21.15.129:0/0) 2023-10-14T09:36:58.633 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.624+0000 7f9921541640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f991c15aa60 0x7f991c0b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:58.633 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.624+0000 7f991bfff640 1 --2- 172.21.15.129:0/2085496474 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f991c0cc9f0 0x7f991c158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:58.634 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.625+0000 7f9920d40640 1 -- 172.21.15.129:0/2085496474 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f991c15aa60 msgr2=0x7f991c0b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:58.634 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.625+0000 7f9920d40640 1 --2- 172.21.15.129:0/2085496474 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f991c15aa60 0x7f991c0b2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:58.634 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.625+0000 7f9920d40640 1 -- 172.21.15.129:0/2085496474 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f991c0cc9f0 msgr2=0x7f991c158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:58.634 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.625+0000 7f9920d40640 1 --2- 172.21.15.129:0/2085496474 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f991c0cc9f0 0x7f991c158f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:58.634 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.625+0000 7f9920d40640 1 -- 172.21.15.129:0/2085496474 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9914009b30 con 0x7f991c0afd60 2023-10-14T09:36:58.635 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.625+0000 7f9921541640 1 --2- 172.21.15.129:0/2085496474 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f991c15aa60 0x7f991c0b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:36:58.635 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.625+0000 7f9920d40640 1 --2- 172.21.15.129:0/2085496474 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f991c0afd60 0x7f991c06b8c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f991000e9b0 tx=0x7f991000ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:36:58.635 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.625+0000 7f99197fa640 1 -- 172.21.15.129:0/2085496474 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9910009670 con 0x7f991c0afd60 2023-10-14T09:36:58.635 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.625+0000 7f99197fa640 1 -- 172.21.15.129:0/2085496474 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991000c9a0 con 0x7f991c0afd60 2023-10-14T09:36:58.635 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.625+0000 7f99197fa640 1 -- 172.21.15.129:0/2085496474 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991000cd50 con 0x7f991c0afd60 2023-10-14T09:36:58.635 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.625+0000 7f9921d42640 1 -- 172.21.15.129:0/2085496474 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f991c06c560 con 0x7f991c0afd60 2023-10-14T09:36:58.636 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.625+0000 7f9921d42640 1 -- 172.21.15.129:0/2085496474 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f991c1594d0 con 0x7f991c0afd60 2023-10-14T09:36:58.636 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.626+0000 7f99197fa640 1 -- 172.21.15.129:0/2085496474 <== mon.2 v2:172.21.15.129:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9910005c90 con 0x7f991c0afd60 2023-10-14T09:36:58.636 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.626+0000 7f99197fa640 1 -- 172.21.15.129:0/2085496474 <== mon.2 v2:172.21.15.129:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f9910013820 con 0x7f991c0afd60 2023-10-14T09:36:58.636 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.626+0000 7f9921d42640 1 -- 172.21.15.129:0/2085496474 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f991c04e9b0 con 0x7f991c0afd60 2023-10-14T09:36:58.637 INFO:tasks.ceph.mgr.x.smithi129.stderr:2023-10-14T09:36:58.628+0000 7f06c3613040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-14T09:36:58.637 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.629+0000 7f99197fa640 1 -- 172.21.15.129:0/2085496474 <== mon.2 v2:172.21.15.129:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f9910021060 con 0x7f991c0afd60 2023-10-14T09:36:58.681 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-10-14T09:36:58.680+0000 7f0070e12040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-14T09:36:58.708 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.706+0000 7f9921d42640 1 -- 172.21.15.129:0/2085496474 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4a8cf50e-387b-4d47-9588-bd22e375a9ec", "id": 1} v 0) v1 -- 0x7f991c071b70 con 0x7f991c0afd60 2023-10-14T09:36:58.717 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.715+0000 7f99197fa640 1 -- 172.21.15.129:0/2085496474 <== mon.2 v2:172.21.15.129:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4a8cf50e-387b-4d47-9588-bd22e375a9ec", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9910017070 con 0x7f991c0afd60 2023-10-14T09:36:58.717 INFO:teuthology.orchestra.run.smithi129.stdout:1 2023-10-14T09:36:58.719 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.716+0000 7f9921d42640 1 -- 172.21.15.129:0/2085496474 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f991c0afd60 msgr2=0x7f991c06b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:58.719 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.716+0000 7f9921d42640 1 --2- 172.21.15.129:0/2085496474 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f991c0afd60 0x7f991c06b8c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f991000e9b0 tx=0x7f991000ee70 comp rx=0 tx=0).stop 2023-10-14T09:36:58.720 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.716+0000 7f9921d42640 1 -- 172.21.15.129:0/2085496474 shutdown_connections 2023-10-14T09:36:58.720 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.716+0000 7f9921d42640 1 --2- 172.21.15.129:0/2085496474 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f991c15aa60 0x7f991c0b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:58.721 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.716+0000 7f9921d42640 1 --2- 172.21.15.129:0/2085496474 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f991c0cc9f0 0x7f991c158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:58.721 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.716+0000 7f9921d42640 1 --2- 172.21.15.129:0/2085496474 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f991c0afd60 0x7f991c06b8c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:58.721 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.716+0000 7f9921d42640 1 -- 172.21.15.129:0/2085496474 >> 172.21.15.129:0/2085496474 conn(0x7f991c065ed0 msgr2=0x7f991c0b5540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:36:58.721 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.716+0000 7f9921d42640 1 -- 172.21.15.129:0/2085496474 shutdown_connections 2023-10-14T09:36:58.722 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.717+0000 7f9921d42640 1 -- 172.21.15.129:0/2085496474 wait complete. 2023-10-14T09:36:58.735 DEBUG:teuthology.orchestra.run.smithi129:> sudo ceph --cluster ceph osd new 009ef55f-8a63-4219-bacd-d7c7b4500867 2 2023-10-14T09:36:58.749 INFO:tasks.ceph.mgr.x.smithi129.stderr:2023-10-14T09:36:58.747+0000 7f06c3613040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-14T09:36:58.762 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-10-14T09:36:58.760+0000 7f0070e12040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-14T09:36:58.816 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-10-14T09:36:58.814+0000 7f0070e12040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-14T09:36:58.835 INFO:tasks.ceph.mgr.x.smithi129.stderr:2023-10-14T09:36:58.833+0000 7f06c3613040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-14T09:36:58.876 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-10-14T09:36:58.874+0000 7f0070e12040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-14T09:36:58.891 INFO:tasks.ceph.mgr.x.smithi129.stderr:2023-10-14T09:36:58.889+0000 7f06c3613040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-14T09:36:58.929 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-10-14T09:36:58.928+0000 7f0070e12040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-14T09:36:58.937 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.935+0000 7fa67e5d0640 1 Processor -- start 2023-10-14T09:36:58.938 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.935+0000 7fa67e5d0640 1 -- start start 2023-10-14T09:36:58.939 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.937+0000 7fa67e5d0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa67815cd70 0x7fa6780d2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:36:58.940 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.937+0000 7fa67e5d0640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa67815d150 con 0x7fa6780b8480 2023-10-14T09:36:58.940 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.937+0000 7fa67e5d0640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6780d1180 con 0x7fa6780cded0 2023-10-14T09:36:58.940 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.937+0000 7fa67e5d0640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6780d1460 con 0x7fa67815cd70 2023-10-14T09:36:58.940 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.937+0000 7fa67ddcf640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fa6780cded0 0x7fa6780b5c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:42838/0 (socket says 172.21.15.129:42838) 2023-10-14T09:36:58.940 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.937+0000 7fa67ddcf640 1 -- 172.21.15.129:0/704087915 learned_addr learned my addr 172.21.15.129:0/704087915 (peer_addr_for_me v1:172.21.15.129:0/0) 2023-10-14T09:36:58.941 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.937+0000 7fa67d5ce640 1 --2- 172.21.15.129:0/704087915 >> v2:172.21.15.102:3300/0 conn(0x7fa67815cd70 0x7fa6780d2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:58.942 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.938+0000 7fa66ffff640 1 -- 172.21.15.129:0/704087915 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 879917992 0 0) 0x7fa6780d1180 con 0x7fa6780cded0 2023-10-14T09:36:58.942 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.938+0000 7fa66ffff640 1 -- 172.21.15.129:0/704087915 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa664003520 con 0x7fa6780cded0 2023-10-14T09:36:58.942 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.938+0000 7fa67d5ce640 1 -- 172.21.15.129:0/704087915 >> v1:172.21.15.129:6789/0 conn(0x7fa6780cded0 legacy=0x7fa6780b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:58.942 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.938+0000 7fa67d5ce640 1 -- 172.21.15.129:0/704087915 >> v1:172.21.15.102:6789/0 conn(0x7fa6780b8480 legacy=0x7fa6780cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:58.943 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.938+0000 7fa67d5ce640 1 -- 172.21.15.129:0/704087915 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6780d1740 con 0x7fa67815cd70 2023-10-14T09:36:58.943 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.939+0000 7fa67d5ce640 1 --2- 172.21.15.129:0/704087915 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa67815cd70 0x7fa6780d2220 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa6740097a0 tx=0x7fa67402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87102c1ed142b266 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:36:58.943 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.940+0000 7fa66ffff640 1 -- 172.21.15.129:0/704087915 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa674030610 con 0x7fa67815cd70 2023-10-14T09:36:58.943 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.940+0000 7fa66ffff640 1 -- 172.21.15.129:0/704087915 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa674030770 con 0x7fa67815cd70 2023-10-14T09:36:58.944 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.940+0000 7fa66ffff640 1 -- 172.21.15.129:0/704087915 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa674030ae0 con 0x7fa67815cd70 2023-10-14T09:36:58.947 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.940+0000 7fa67e5d0640 1 -- 172.21.15.129:0/704087915 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa67815cd70 msgr2=0x7fa6780d2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:58.947 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.940+0000 7fa67e5d0640 1 --2- 172.21.15.129:0/704087915 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa67815cd70 0x7fa6780d2220 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa6740097a0 tx=0x7fa67402b960 comp rx=0 tx=0).stop 2023-10-14T09:36:58.947 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.940+0000 7fa67e5d0640 1 -- 172.21.15.129:0/704087915 shutdown_connections 2023-10-14T09:36:58.947 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.940+0000 7fa67e5d0640 1 --2- 172.21.15.129:0/704087915 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa67815cd70 0x7fa6780d2220 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:58.948 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.940+0000 7fa67e5d0640 1 -- 172.21.15.129:0/704087915 >> 172.21.15.129:0/704087915 conn(0x7fa6780cf570 msgr2=0x7fa6780cf950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:36:58.948 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.940+0000 7fa67e5d0640 1 -- 172.21.15.129:0/704087915 shutdown_connections 2023-10-14T09:36:58.948 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.940+0000 7fa67e5d0640 1 -- 172.21.15.129:0/704087915 wait complete. 2023-10-14T09:36:58.948 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.942+0000 7fa67e5d0640 1 Processor -- start 2023-10-14T09:36:58.948 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.942+0000 7fa67e5d0640 1 -- start start 2023-10-14T09:36:58.949 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.943+0000 7fa67e5d0640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa6780b8480 0x7fa6780b3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:36:58.949 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.943+0000 7fa67e5d0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6780cded0 0x7fa6780c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:36:58.949 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.943+0000 7fa67e5d0640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa67815cd70 0x7fa6780ca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:36:58.949 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.943+0000 7fa67e5d0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6780b4b90 con 0x7fa6780cded0 2023-10-14T09:36:58.949 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.943+0000 7fa67e5d0640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6780b45d0 con 0x7fa67815cd70 2023-10-14T09:36:58.950 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.943+0000 7fa67e5d0640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6780b48b0 con 0x7fa6780b8480 2023-10-14T09:36:58.950 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.943+0000 7fa67d5ce640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa6780b8480 0x7fa6780b3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:58.950 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.943+0000 7fa67ddcf640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa67815cd70 0x7fa6780ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:58.950 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.943+0000 7fa67d5ce640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa6780b8480 0x7fa6780b3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.129:50556/0 (socket says 172.21.15.129:50556) 2023-10-14T09:36:58.951 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.943+0000 7fa67d5ce640 1 -- 172.21.15.129:0/4104062229 learned_addr learned my addr 172.21.15.129:0/4104062229 (peer_addr_for_me v2:172.21.15.129:0/0) 2023-10-14T09:36:58.951 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.944+0000 7fa67cdcd640 1 --2- 172.21.15.129:0/4104062229 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6780cded0 0x7fa6780c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:58.951 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.944+0000 7fa67d5ce640 1 -- 172.21.15.129:0/4104062229 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa67815cd70 msgr2=0x7fa6780ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:58.951 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.944+0000 7fa67d5ce640 1 --2- 172.21.15.129:0/4104062229 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa67815cd70 0x7fa6780ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:58.951 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.944+0000 7fa67d5ce640 1 -- 172.21.15.129:0/4104062229 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6780cded0 msgr2=0x7fa6780c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:58.952 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.944+0000 7fa67d5ce640 1 --2- 172.21.15.129:0/4104062229 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6780cded0 0x7fa6780c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:58.952 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.944+0000 7fa67d5ce640 1 -- 172.21.15.129:0/4104062229 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa674009400 con 0x7fa6780b8480 2023-10-14T09:36:58.952 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.944+0000 7fa67ddcf640 1 --2- 172.21.15.129:0/4104062229 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa67815cd70 0x7fa6780ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:36:58.952 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.944+0000 7fa67d5ce640 1 --2- 172.21.15.129:0/4104062229 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa6780b8480 0x7fa6780b3f40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa6740097a0 tx=0x7fa6740046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:36:58.952 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.944+0000 7fa66dffb640 1 -- 172.21.15.129:0/4104062229 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67403f070 con 0x7fa6780b8480 2023-10-14T09:36:58.953 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.945+0000 7fa66dffb640 1 -- 172.21.15.129:0/4104062229 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa674006e10 con 0x7fa6780b8480 2023-10-14T09:36:58.953 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.945+0000 7fa67e5d0640 1 -- 172.21.15.129:0/4104062229 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6781e55a0 con 0x7fa6780b8480 2023-10-14T09:36:58.953 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.945+0000 7fa66dffb640 1 -- 172.21.15.129:0/4104062229 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa674030ea0 con 0x7fa6780b8480 2023-10-14T09:36:58.953 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.945+0000 7fa67e5d0640 1 -- 172.21.15.129:0/4104062229 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa678151300 con 0x7fa6780b8480 2023-10-14T09:36:58.953 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.945+0000 7fa66dffb640 1 -- 172.21.15.129:0/4104062229 <== mon.2 v2:172.21.15.129:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa674003b10 con 0x7fa6780b8480 2023-10-14T09:36:58.954 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.945+0000 7fa66dffb640 1 -- 172.21.15.129:0/4104062229 <== mon.2 v2:172.21.15.129:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fa674003dc0 con 0x7fa6780b8480 2023-10-14T09:36:58.954 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.946+0000 7fa67e5d0640 1 -- 172.21.15.129:0/4104062229 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6781e5ac0 con 0x7fa6780b8480 2023-10-14T09:36:58.954 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:58.948+0000 7fa66dffb640 1 -- 172.21.15.129:0/4104062229 <== mon.2 v2:172.21.15.129:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fa6781e5ac0 con 0x7fa6780b8480 2023-10-14T09:36:58.955 INFO:tasks.ceph.mgr.x.smithi129.stderr:2023-10-14T09:36:58.953+0000 7f06c3613040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-14T09:36:59.011 INFO:tasks.ceph.mgr.x.smithi129.stderr:2023-10-14T09:36:59.009+0000 7f06c3613040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-14T09:36:59.027 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.025+0000 7fa67e5d0640 1 -- 172.21.15.129:0/4104062229 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "osd new", "uuid": "009ef55f-8a63-4219-bacd-d7c7b4500867", "id": 2} v 0) v1 -- 0x7fa67804e9b0 con 0x7fa6780b8480 2023-10-14T09:36:59.036 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.034+0000 7fa66dffb640 1 -- 172.21.15.129:0/4104062229 <== mon.2 v2:172.21.15.129:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "009ef55f-8a63-4219-bacd-d7c7b4500867", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa674051060 con 0x7fa6780b8480 2023-10-14T09:36:59.036 INFO:teuthology.orchestra.run.smithi129.stdout:2 2023-10-14T09:36:59.038 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.035+0000 7fa67e5d0640 1 -- 172.21.15.129:0/4104062229 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa6780b8480 msgr2=0x7fa6780b3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:59.038 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.035+0000 7fa67e5d0640 1 --2- 172.21.15.129:0/4104062229 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa6780b8480 0x7fa6780b3f40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa6740097a0 tx=0x7fa6740046c0 comp rx=0 tx=0).stop 2023-10-14T09:36:59.038 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.035+0000 7fa67e5d0640 1 -- 172.21.15.129:0/4104062229 shutdown_connections 2023-10-14T09:36:59.039 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.035+0000 7fa67e5d0640 1 --2- 172.21.15.129:0/4104062229 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa67815cd70 0x7fa6780ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:59.039 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.036+0000 7fa67e5d0640 1 --2- 172.21.15.129:0/4104062229 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6780cded0 0x7fa6780c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:59.039 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.036+0000 7fa67e5d0640 1 --2- 172.21.15.129:0/4104062229 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa6780b8480 0x7fa6780b3f40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:59.039 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.036+0000 7fa67e5d0640 1 -- 172.21.15.129:0/4104062229 >> 172.21.15.129:0/4104062229 conn(0x7fa6780cf570 msgr2=0x7fa67815bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:36:59.039 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.036+0000 7fa67e5d0640 1 -- 172.21.15.129:0/4104062229 shutdown_connections 2023-10-14T09:36:59.039 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.036+0000 7fa67e5d0640 1 -- 172.21.15.129:0/4104062229 wait complete. 2023-10-14T09:36:59.053 DEBUG:teuthology.orchestra.run.smithi129:> sudo ceph --cluster ceph osd new f2110eae-2ff9-4ed9-93d6-bd2361618211 3 2023-10-14T09:36:59.246 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.244+0000 7fa12dba5640 1 Processor -- start 2023-10-14T09:36:59.246 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.244+0000 7fa12dba5640 1 -- start start 2023-10-14T09:36:59.248 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.245+0000 7fa12dba5640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa1280b8480 0x7fa1280cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:36:59.248 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.245+0000 7fa12dba5640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa12815d150 con 0x7fa12815cd70 2023-10-14T09:36:59.248 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.245+0000 7fa12dba5640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1280d1180 con 0x7fa1280d0be0 2023-10-14T09:36:59.248 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.245+0000 7fa12dba5640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1280d1460 con 0x7fa1280b8480 2023-10-14T09:36:59.248 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.246+0000 7fa127fff640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa1280b8480 0x7fa1280cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:59.249 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.246+0000 7fa12d3a4640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fa1280d0be0 0x7fa1280b5c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:42846/0 (socket says 172.21.15.129:42846) 2023-10-14T09:36:59.249 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.246+0000 7fa12d3a4640 1 -- 172.21.15.129:0/2972221217 learned_addr learned my addr 172.21.15.129:0/2972221217 (peer_addr_for_me v1:172.21.15.129:0/0) 2023-10-14T09:36:59.250 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.246+0000 7fa127fff640 1 -- 172.21.15.129:0/2972221217 >> v1:172.21.15.129:6789/0 conn(0x7fa1280d0be0 legacy=0x7fa1280b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:59.251 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.246+0000 7fa127fff640 1 -- 172.21.15.129:0/2972221217 >> v1:172.21.15.102:6789/0 conn(0x7fa12815cd70 legacy=0x7fa1280d2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:59.251 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.246+0000 7fa127fff640 1 -- 172.21.15.129:0/2972221217 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1280d1740 con 0x7fa1280b8480 2023-10-14T09:36:59.251 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.246+0000 7fa1277fe640 1 -- 172.21.15.129:0/2972221217 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3206070727 0 0) 0x7fa1280d1180 con 0x7fa1280d0be0 2023-10-14T09:36:59.251 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.247+0000 7fa127fff640 1 --2- 172.21.15.129:0/2972221217 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa1280b8480 0x7fa1280cd7c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa1140097d0 tx=0x7fa11402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df5f6b0c655fccba server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:36:59.251 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.247+0000 7fa1277fe640 1 -- 172.21.15.129:0/2972221217 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa114031890 con 0x7fa1280b8480 2023-10-14T09:36:59.252 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.247+0000 7fa1277fe640 1 -- 172.21.15.129:0/2972221217 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1140319f0 con 0x7fa1280b8480 2023-10-14T09:36:59.252 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.247+0000 7fa1277fe640 1 -- 172.21.15.129:0/2972221217 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa114031d80 con 0x7fa1280b8480 2023-10-14T09:36:59.252 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.248+0000 7fa12dba5640 1 -- 172.21.15.129:0/2972221217 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa1280b8480 msgr2=0x7fa1280cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:59.252 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.248+0000 7fa12dba5640 1 --2- 172.21.15.129:0/2972221217 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa1280b8480 0x7fa1280cd7c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa1140097d0 tx=0x7fa11402b930 comp rx=0 tx=0).stop 2023-10-14T09:36:59.252 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.248+0000 7fa12dba5640 1 -- 172.21.15.129:0/2972221217 shutdown_connections 2023-10-14T09:36:59.252 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.248+0000 7fa12dba5640 1 --2- 172.21.15.129:0/2972221217 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa1280b8480 0x7fa1280cd7c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:59.253 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.248+0000 7fa12dba5640 1 -- 172.21.15.129:0/2972221217 >> 172.21.15.129:0/2972221217 conn(0x7fa1280cf570 msgr2=0x7fa1280cf950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:36:59.253 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.248+0000 7fa12dba5640 1 -- 172.21.15.129:0/2972221217 shutdown_connections 2023-10-14T09:36:59.253 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.248+0000 7fa12dba5640 1 -- 172.21.15.129:0/2972221217 wait complete. 2023-10-14T09:36:59.255 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.250+0000 7fa12dba5640 1 Processor -- start 2023-10-14T09:36:59.256 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.250+0000 7fa12dba5640 1 -- start start 2023-10-14T09:36:59.256 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.251+0000 7fa12dba5640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa1280b8480 0x7fa1280c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:36:59.256 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.251+0000 7fa12dba5640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa1280d0be0 0x7fa1281f1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:36:59.256 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.251+0000 7fa12dba5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa12815cd70 0x7fa1280b4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:36:59.256 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.251+0000 7fa12dba5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1280c78d0 con 0x7fa12815cd70 2023-10-14T09:36:59.257 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.251+0000 7fa12dba5640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1280c8080 con 0x7fa1280d0be0 2023-10-14T09:36:59.257 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.251+0000 7fa12dba5640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa12815d900 con 0x7fa1280b8480 2023-10-14T09:36:59.257 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.251+0000 7fa12cba3640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa1280b8480 0x7fa1280c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:59.257 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.251+0000 7fa127fff640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa1280d0be0 0x7fa1281f1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:59.257 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.251+0000 7fa12cba3640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa1280b8480 0x7fa1280c7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.129:50566/0 (socket says 172.21.15.129:50566) 2023-10-14T09:36:59.258 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.251+0000 7fa12cba3640 1 -- 172.21.15.129:0/36424588 learned_addr learned my addr 172.21.15.129:0/36424588 (peer_addr_for_me v2:172.21.15.129:0/0) 2023-10-14T09:36:59.258 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.251+0000 7fa12d3a4640 1 --2- 172.21.15.129:0/36424588 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa12815cd70 0x7fa1280b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:59.258 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.251+0000 7fa127fff640 1 -- 172.21.15.129:0/36424588 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa1280b8480 msgr2=0x7fa1280c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:59.258 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.251+0000 7fa127fff640 1 --2- 172.21.15.129:0/36424588 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa1280b8480 0x7fa1280c7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:59.259 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.251+0000 7fa127fff640 1 -- 172.21.15.129:0/36424588 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa12815cd70 msgr2=0x7fa1280b4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:59.259 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.252+0000 7fa127fff640 1 --2- 172.21.15.129:0/36424588 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa12815cd70 0x7fa1280b4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:59.259 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.252+0000 7fa127fff640 1 -- 172.21.15.129:0/36424588 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa114009400 con 0x7fa1280d0be0 2023-10-14T09:36:59.259 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.252+0000 7fa127fff640 1 --2- 172.21.15.129:0/36424588 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa1280d0be0 0x7fa1281f1d80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa114033000 tx=0x7fa1140046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:36:59.259 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.252+0000 7fa1257fa640 1 -- 172.21.15.129:0/36424588 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11403bce0 con 0x7fa1280d0be0 2023-10-14T09:36:59.259 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.252+0000 7fa1257fa640 1 -- 172.21.15.129:0/36424588 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11403be80 con 0x7fa1280d0be0 2023-10-14T09:36:59.260 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.252+0000 7fa1257fa640 1 -- 172.21.15.129:0/36424588 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa114004260 con 0x7fa1280d0be0 2023-10-14T09:36:59.260 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.252+0000 7fa12dba5640 1 -- 172.21.15.129:0/36424588 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa12815dbe0 con 0x7fa1280d0be0 2023-10-14T09:36:59.260 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.252+0000 7fa12dba5640 1 -- 172.21.15.129:0/36424588 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa12815e1a0 con 0x7fa1280d0be0 2023-10-14T09:36:59.260 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.253+0000 7fa1257fa640 1 -- 172.21.15.129:0/36424588 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa114043070 con 0x7fa1280d0be0 2023-10-14T09:36:59.260 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.253+0000 7fa1257fa640 1 -- 172.21.15.129:0/36424588 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fa114003da0 con 0x7fa1280d0be0 2023-10-14T09:36:59.261 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.253+0000 7fa12dba5640 1 -- 172.21.15.129:0/36424588 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa12804e9b0 con 0x7fa1280d0be0 2023-10-14T09:36:59.261 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.256+0000 7fa1257fa640 1 -- 172.21.15.129:0/36424588 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fa114035020 con 0x7fa1280d0be0 2023-10-14T09:36:59.335 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.333+0000 7fa12dba5640 1 -- 172.21.15.129:0/36424588 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f2110eae-2ff9-4ed9-93d6-bd2361618211", "id": 3} v 0) v1 -- 0x7fa1280d31e0 con 0x7fa1280d0be0 2023-10-14T09:36:59.343 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.341+0000 7fa1257fa640 1 -- 172.21.15.129:0/36424588 <== mon.1 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f2110eae-2ff9-4ed9-93d6-bd2361618211", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa114003910 con 0x7fa1280d0be0 2023-10-14T09:36:59.343 INFO:teuthology.orchestra.run.smithi129.stdout:3 2023-10-14T09:36:59.344 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.342+0000 7fa12dba5640 1 -- 172.21.15.129:0/36424588 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa1280d0be0 msgr2=0x7fa1281f1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:59.345 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.342+0000 7fa12dba5640 1 --2- 172.21.15.129:0/36424588 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa1280d0be0 0x7fa1281f1d80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa114033000 tx=0x7fa1140046c0 comp rx=0 tx=0).stop 2023-10-14T09:36:59.345 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.342+0000 7fa12dba5640 1 -- 172.21.15.129:0/36424588 shutdown_connections 2023-10-14T09:36:59.345 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.342+0000 7fa12dba5640 1 --2- 172.21.15.129:0/36424588 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa12815cd70 0x7fa1280b4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:59.346 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.342+0000 7fa12dba5640 1 --2- 172.21.15.129:0/36424588 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa1280d0be0 0x7fa1281f1d80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:59.346 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.342+0000 7fa12dba5640 1 --2- 172.21.15.129:0/36424588 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa1280b8480 0x7fa1280c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:59.346 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.342+0000 7fa12dba5640 1 -- 172.21.15.129:0/36424588 >> 172.21.15.129:0/36424588 conn(0x7fa1280cf570 msgr2=0x7fa1280b7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:36:59.346 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.342+0000 7fa12dba5640 1 -- 172.21.15.129:0/36424588 shutdown_connections 2023-10-14T09:36:59.346 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.342+0000 7fa12dba5640 1 -- 172.21.15.129:0/36424588 wait complete. 2023-10-14T09:36:59.361 DEBUG:teuthology.orchestra.run.smithi129:> sudo ceph --cluster ceph osd new 33f1ae34-3100-40f7-9cb8-0eca2b358693 4 2023-10-14T09:36:59.377 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-10-14T09:36:59.375+0000 7f0070e12040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-14T09:36:59.490 INFO:tasks.ceph.mgr.x.smithi129.stderr:2023-10-14T09:36:59.488+0000 7f06c3613040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-14T09:36:59.536 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-10-14T09:36:59.534+0000 7f0070e12040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-14T09:36:59.546 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.544+0000 7fa49b555640 1 Processor -- start 2023-10-14T09:36:59.547 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.545+0000 7fa49b555640 1 -- start start 2023-10-14T09:36:59.549 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.546+0000 7fa49b555640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fa49415aee0 0x7fa4940aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:36:59.549 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.546+0000 7fa49b555640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa49406c140 con 0x7fa4940cb810 2023-10-14T09:36:59.549 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.546+0000 7fa49b555640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa49415b2c0 con 0x7fa49415e9b0 2023-10-14T09:36:59.549 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.546+0000 7fa49b555640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa49406b270 con 0x7fa49415aee0 2023-10-14T09:36:59.550 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.546+0000 7fa4992f1640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fa49415aee0 0x7fa4940aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:59.550 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.546+0000 7fa4992f1640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fa49415aee0 0x7fa4940aeef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:56288/0 (socket says 172.21.15.129:56288) 2023-10-14T09:36:59.550 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.546+0000 7fa4992f1640 1 -- 172.21.15.129:0/2434497812 learned_addr learned my addr 172.21.15.129:0/2434497812 (peer_addr_for_me v2:172.21.15.129:0/0) 2023-10-14T09:36:59.550 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.547+0000 7fa4992f1640 1 -- 172.21.15.129:0/2434497812 >> v1:172.21.15.129:6789/0 conn(0x7fa49415e9b0 legacy=0x7fa49415ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:59.550 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.547+0000 7fa4992f1640 1 -- 172.21.15.129:0/2434497812 >> v1:172.21.15.102:6789/0 conn(0x7fa4940cb810 legacy=0x7fa4940cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:59.551 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.547+0000 7fa4992f1640 1 -- 172.21.15.129:0/2434497812 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa49406daf0 con 0x7fa49415aee0 2023-10-14T09:36:59.552 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.548+0000 7fa4992f1640 1 --2- 172.21.15.129:0/2434497812 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa49415aee0 0x7fa4940aeef0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa490009e50 tx=0x7fa49002bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71cb75ab02084166 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:36:59.552 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.548+0000 7fa48bfff640 1 -- 172.21.15.129:0/2434497812 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49002cb20 con 0x7fa49415aee0 2023-10-14T09:36:59.552 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.548+0000 7fa48bfff640 1 -- 172.21.15.129:0/2434497812 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49002cc80 con 0x7fa49415aee0 2023-10-14T09:36:59.552 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.548+0000 7fa48bfff640 1 -- 172.21.15.129:0/2434497812 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4900343f0 con 0x7fa49415aee0 2023-10-14T09:36:59.553 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.549+0000 7fa49b555640 1 -- 172.21.15.129:0/2434497812 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa49415aee0 msgr2=0x7fa4940aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:59.553 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.549+0000 7fa49b555640 1 --2- 172.21.15.129:0/2434497812 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa49415aee0 0x7fa4940aeef0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa490009e50 tx=0x7fa49002bf80 comp rx=0 tx=0).stop 2023-10-14T09:36:59.553 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.549+0000 7fa49b555640 1 -- 172.21.15.129:0/2434497812 shutdown_connections 2023-10-14T09:36:59.553 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.549+0000 7fa49b555640 1 --2- 172.21.15.129:0/2434497812 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa49415aee0 0x7fa4940aeef0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:59.553 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.549+0000 7fa49b555640 1 -- 172.21.15.129:0/2434497812 >> 172.21.15.129:0/2434497812 conn(0x7fa4940cfac0 msgr2=0x7fa4940cfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:36:59.554 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.549+0000 7fa49b555640 1 -- 172.21.15.129:0/2434497812 shutdown_connections 2023-10-14T09:36:59.554 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.549+0000 7fa49b555640 1 -- 172.21.15.129:0/2434497812 wait complete. 2023-10-14T09:36:59.556 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.551+0000 7fa49b555640 1 Processor -- start 2023-10-14T09:36:59.556 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.551+0000 7fa49b555640 1 -- start start 2023-10-14T09:36:59.557 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.552+0000 7fa49b555640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4940cb810 0x7fa4940ace40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:36:59.557 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.552+0000 7fa49b555640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa49415aee0 0x7fa49415d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:36:59.557 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.552+0000 7fa49b555640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa49415e9b0 0x7fa4940b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:36:59.557 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.552+0000 7fa49b555640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4940abda0 con 0x7fa4940cb810 2023-10-14T09:36:59.557 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.552+0000 7fa49b555640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4940ac080 con 0x7fa49415e9b0 2023-10-14T09:36:59.558 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.552+0000 7fa49b555640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4940ac360 con 0x7fa49415aee0 2023-10-14T09:36:59.558 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.552+0000 7fa498af0640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa49415aee0 0x7fa49415d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:59.558 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.553+0000 7fa498af0640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa49415aee0 0x7fa49415d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.129:50572/0 (socket says 172.21.15.129:50572) 2023-10-14T09:36:59.558 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.553+0000 7fa498af0640 1 -- 172.21.15.129:0/3411507739 learned_addr learned my addr 172.21.15.129:0/3411507739 (peer_addr_for_me v2:172.21.15.129:0/0) 2023-10-14T09:36:59.558 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.553+0000 7fa4992f1640 1 --2- 172.21.15.129:0/3411507739 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4940cb810 0x7fa4940ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:59.559 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.553+0000 7fa499af2640 1 --2- 172.21.15.129:0/3411507739 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa49415e9b0 0x7fa4940b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:59.559 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.553+0000 7fa498af0640 1 -- 172.21.15.129:0/3411507739 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa49415e9b0 msgr2=0x7fa4940b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:59.559 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.553+0000 7fa498af0640 1 --2- 172.21.15.129:0/3411507739 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa49415e9b0 0x7fa4940b3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:59.559 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.553+0000 7fa498af0640 1 -- 172.21.15.129:0/3411507739 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4940cb810 msgr2=0x7fa4940ace40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:59.559 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.553+0000 7fa498af0640 1 --2- 172.21.15.129:0/3411507739 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4940cb810 0x7fa4940ace40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:59.560 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.553+0000 7fa498af0640 1 -- 172.21.15.129:0/3411507739 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa490009b30 con 0x7fa49415aee0 2023-10-14T09:36:59.560 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.553+0000 7fa498af0640 1 --2- 172.21.15.129:0/3411507739 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa49415aee0 0x7fa49415d930 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa48400c450 tx=0x7fa48400c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:36:59.560 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.554+0000 7fa489ffb640 1 -- 172.21.15.129:0/3411507739 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4840052d0 con 0x7fa49415aee0 2023-10-14T09:36:59.560 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.554+0000 7fa489ffb640 1 -- 172.21.15.129:0/3411507739 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa484005430 con 0x7fa49415aee0 2023-10-14T09:36:59.560 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.554+0000 7fa489ffb640 1 -- 172.21.15.129:0/3411507739 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa484012870 con 0x7fa49415aee0 2023-10-14T09:36:59.561 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.554+0000 7fa49b555640 1 -- 172.21.15.129:0/3411507739 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4940ac640 con 0x7fa49415aee0 2023-10-14T09:36:59.561 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.554+0000 7fa49b555640 1 -- 172.21.15.129:0/3411507739 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4940ad380 con 0x7fa49415aee0 2023-10-14T09:36:59.561 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.554+0000 7fa489ffb640 1 -- 172.21.15.129:0/3411507739 <== mon.2 v2:172.21.15.129:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa484012cd0 con 0x7fa49415aee0 2023-10-14T09:36:59.561 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.554+0000 7fa489ffb640 1 -- 172.21.15.129:0/3411507739 <== mon.2 v2:172.21.15.129:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fa484003b00 con 0x7fa49415aee0 2023-10-14T09:36:59.562 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.555+0000 7fa49b555640 1 -- 172.21.15.129:0/3411507739 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4940acb60 con 0x7fa49415aee0 2023-10-14T09:36:59.562 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.557+0000 7fa489ffb640 1 -- 172.21.15.129:0/3411507739 <== mon.2 v2:172.21.15.129:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fa4940acb60 con 0x7fa49415aee0 2023-10-14T09:36:59.636 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.634+0000 7fa49b555640 1 -- 172.21.15.129:0/3411507739 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "osd new", "uuid": "33f1ae34-3100-40f7-9cb8-0eca2b358693", "id": 4} v 0) v1 -- 0x7fa49404e160 con 0x7fa49415aee0 2023-10-14T09:36:59.644 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.642+0000 7fa489ffb640 1 -- 172.21.15.129:0/3411507739 <== mon.2 v2:172.21.15.129:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "33f1ae34-3100-40f7-9cb8-0eca2b358693", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa4840035f0 con 0x7fa49415aee0 2023-10-14T09:36:59.644 INFO:teuthology.orchestra.run.smithi129.stdout:4 2023-10-14T09:36:59.646 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.643+0000 7fa49b555640 1 -- 172.21.15.129:0/3411507739 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa49415aee0 msgr2=0x7fa49415d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:59.646 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.643+0000 7fa49b555640 1 --2- 172.21.15.129:0/3411507739 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa49415aee0 0x7fa49415d930 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa48400c450 tx=0x7fa48400c910 comp rx=0 tx=0).stop 2023-10-14T09:36:59.646 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.643+0000 7fa49b555640 1 -- 172.21.15.129:0/3411507739 shutdown_connections 2023-10-14T09:36:59.647 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.643+0000 7fa49b555640 1 --2- 172.21.15.129:0/3411507739 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa49415e9b0 0x7fa4940b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:59.647 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.643+0000 7fa49b555640 1 --2- 172.21.15.129:0/3411507739 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa49415aee0 0x7fa49415d930 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:59.647 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.643+0000 7fa49b555640 1 --2- 172.21.15.129:0/3411507739 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4940cb810 0x7fa4940ace40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:59.647 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.643+0000 7fa49b555640 1 -- 172.21.15.129:0/3411507739 >> 172.21.15.129:0/3411507739 conn(0x7fa4940cfac0 msgr2=0x7fa4940c9160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:36:59.647 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.643+0000 7fa49b555640 1 -- 172.21.15.129:0/3411507739 shutdown_connections 2023-10-14T09:36:59.647 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.644+0000 7fa49b555640 1 -- 172.21.15.129:0/3411507739 wait complete. 2023-10-14T09:36:59.659 INFO:tasks.ceph.mgr.x.smithi129.stderr:2023-10-14T09:36:59.657+0000 7f06c3613040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-14T09:36:59.661 DEBUG:teuthology.orchestra.run.smithi129:> sudo ceph --cluster ceph osd new fab2fc62-3f3e-450d-93e0-770f39e80710 5 2023-10-14T09:36:59.678 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-10-14T09:36:59.676+0000 7f0070e12040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-14T09:36:59.731 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-10-14T09:36:59.729+0000 7f0070e12040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-14T09:36:59.792 INFO:tasks.ceph.mgr.x.smithi129.stderr:2023-10-14T09:36:59.790+0000 7f06c3613040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-14T09:36:59.841 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-10-14T09:36:59.840+0000 7f0070e12040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-14T09:36:59.847 INFO:tasks.ceph.mgr.x.smithi129.stderr:2023-10-14T09:36:59.845+0000 7f06c3613040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-14T09:36:59.850 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.847+0000 7f4ae9413640 1 Processor -- start 2023-10-14T09:36:59.850 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.847+0000 7f4ae9413640 1 -- start start 2023-10-14T09:36:59.851 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.848+0000 7f4ae9413640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f4ae40b2600 0x7f4ae40ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:36:59.851 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.849+0000 7f4ae9413640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ae40b2a60 con 0x7f4ae4070240 2023-10-14T09:36:59.852 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.849+0000 7f4ae9413640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ae40b2d00 con 0x7f4ae415aaa0 2023-10-14T09:36:59.852 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.849+0000 7f4ae9413640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ae40b2fe0 con 0x7f4ae40b2600 2023-10-14T09:36:59.852 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.849+0000 7f4adbfff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f4ae40b2600 0x7f4ae40ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:59.853 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.849+0000 7f4ae3fff640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f4ae415aaa0 0x7f4ae40b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:42870/0 (socket says 172.21.15.129:42870) 2023-10-14T09:36:59.853 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.849+0000 7f4ae3fff640 1 -- 172.21.15.129:0/29642672 learned_addr learned my addr 172.21.15.129:0/29642672 (peer_addr_for_me v1:172.21.15.129:0/0) 2023-10-14T09:36:59.853 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.849+0000 7f4adbfff640 1 -- 172.21.15.129:0/29642672 >> v1:172.21.15.129:6789/0 conn(0x7f4ae415aaa0 legacy=0x7f4ae40b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:59.853 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.849+0000 7f4adbfff640 1 -- 172.21.15.129:0/29642672 >> v1:172.21.15.102:6789/0 conn(0x7f4ae4070240 legacy=0x7f4ae40c67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:59.853 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.849+0000 7f4adbfff640 1 -- 172.21.15.129:0/29642672 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae40b32c0 con 0x7f4ae40b2600 2023-10-14T09:36:59.855 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.851+0000 7f4adbfff640 1 --2- 172.21.15.129:0/29642672 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4ae40b2600 0x7f4ae40ca8a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4acc0097a0 tx=0x7f4acc02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bad423148f486e41 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:36:59.855 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.851+0000 7f4ae37fe640 1 -- 172.21.15.129:0/29642672 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4acc031830 con 0x7f4ae40b2600 2023-10-14T09:36:59.855 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.851+0000 7f4ae37fe640 1 -- 172.21.15.129:0/29642672 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4acc031990 con 0x7f4ae40b2600 2023-10-14T09:36:59.855 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.851+0000 7f4ae37fe640 1 -- 172.21.15.129:0/29642672 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4acc031d20 con 0x7f4ae40b2600 2023-10-14T09:36:59.856 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.852+0000 7f4ae9413640 1 -- 172.21.15.129:0/29642672 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4ae40b2600 msgr2=0x7f4ae40ca8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:59.856 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.852+0000 7f4ae9413640 1 --2- 172.21.15.129:0/29642672 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4ae40b2600 0x7f4ae40ca8a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4acc0097a0 tx=0x7f4acc02b8d0 comp rx=0 tx=0).stop 2023-10-14T09:36:59.856 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.852+0000 7f4ae9413640 1 -- 172.21.15.129:0/29642672 shutdown_connections 2023-10-14T09:36:59.856 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.852+0000 7f4ae9413640 1 --2- 172.21.15.129:0/29642672 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4ae40b2600 0x7f4ae40ca8a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:59.856 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.852+0000 7f4ae9413640 1 -- 172.21.15.129:0/29642672 >> 172.21.15.129:0/29642672 conn(0x7f4ae40cc230 msgr2=0x7f4ae40cc610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:36:59.857 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.852+0000 7f4ae9413640 1 -- 172.21.15.129:0/29642672 shutdown_connections 2023-10-14T09:36:59.857 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.852+0000 7f4ae9413640 1 -- 172.21.15.129:0/29642672 wait complete. 2023-10-14T09:36:59.859 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.854+0000 7f4ae9413640 1 Processor -- start 2023-10-14T09:36:59.860 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.854+0000 7f4ae9413640 1 -- start start 2023-10-14T09:36:59.860 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.855+0000 7f4ae9413640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4ae4070240 0x7f4ae40af210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:36:59.860 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.855+0000 7f4ae9413640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4ae40b2600 0x7f4ae40c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:36:59.860 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.855+0000 7f4ae9413640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ae415aaa0 0x7f4ae41f5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:36:59.861 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.855+0000 7f4ae9413640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae41f6800 con 0x7f4ae415aaa0 2023-10-14T09:36:59.861 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.855+0000 7f4ae9413640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae406cb90 con 0x7f4ae4070240 2023-10-14T09:36:59.861 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.855+0000 7f4ae9413640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae406bf80 con 0x7f4ae40b2600 2023-10-14T09:36:59.861 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.855+0000 7f4ae3fff640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4ae4070240 0x7f4ae40af210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:59.861 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.855+0000 7f4adbfff640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4ae40b2600 0x7f4ae40c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:59.862 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.855+0000 7f4adbfff640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4ae40b2600 0x7f4ae40c8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.129:50574/0 (socket says 172.21.15.129:50574) 2023-10-14T09:36:59.862 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.855+0000 7f4adbfff640 1 -- 172.21.15.129:0/2086659112 learned_addr learned my addr 172.21.15.129:0/2086659112 (peer_addr_for_me v2:172.21.15.129:0/0) 2023-10-14T09:36:59.862 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.855+0000 7f4ae3fff640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4ae4070240 0x7f4ae40af210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:56306/0 (socket says 172.21.15.129:56306) 2023-10-14T09:36:59.862 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.855+0000 7f4ae8c12640 1 --2- 172.21.15.129:0/2086659112 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ae415aaa0 0x7f4ae41f5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:36:59.862 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.856+0000 7f4ae3fff640 1 -- 172.21.15.129:0/2086659112 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4ae40b2600 msgr2=0x7f4ae40c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:59.863 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.856+0000 7f4ae3fff640 1 --2- 172.21.15.129:0/2086659112 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4ae40b2600 0x7f4ae40c8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:59.863 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.856+0000 7f4ae3fff640 1 -- 172.21.15.129:0/2086659112 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ae415aaa0 msgr2=0x7f4ae41f5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:59.863 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.856+0000 7f4ae3fff640 1 --2- 172.21.15.129:0/2086659112 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ae415aaa0 0x7f4ae41f5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:59.863 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.856+0000 7f4ae3fff640 1 -- 172.21.15.129:0/2086659112 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4acc009400 con 0x7f4ae4070240 2023-10-14T09:36:59.863 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.856+0000 7f4ae8c12640 1 --2- 172.21.15.129:0/2086659112 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ae415aaa0 0x7f4ae41f5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:36:59.864 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.856+0000 7f4ae3fff640 1 --2- 172.21.15.129:0/2086659112 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4ae4070240 0x7f4ae40af210 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4ad400c440 tx=0x7f4ad4001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:36:59.864 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.856+0000 7f4ae17fa640 1 -- 172.21.15.129:0/2086659112 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad4005ce0 con 0x7f4ae4070240 2023-10-14T09:36:59.864 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.856+0000 7f4ae17fa640 1 -- 172.21.15.129:0/2086659112 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad4005e40 con 0x7f4ae4070240 2023-10-14T09:36:59.864 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.856+0000 7f4ae17fa640 1 -- 172.21.15.129:0/2086659112 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad40072d0 con 0x7f4ae4070240 2023-10-14T09:36:59.864 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.856+0000 7f4ae9413640 1 -- 172.21.15.129:0/2086659112 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ae406c260 con 0x7f4ae4070240 2023-10-14T09:36:59.865 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.856+0000 7f4ae9413640 1 -- 172.21.15.129:0/2086659112 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae406c820 con 0x7f4ae4070240 2023-10-14T09:36:59.865 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.857+0000 7f4ae17fa640 1 -- 172.21.15.129:0/2086659112 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4ad401c440 con 0x7f4ae4070240 2023-10-14T09:36:59.865 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.857+0000 7f4ae17fa640 1 -- 172.21.15.129:0/2086659112 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f4ad401cc70 con 0x7f4ae4070240 2023-10-14T09:36:59.866 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.857+0000 7f4ae9413640 1 -- 172.21.15.129:0/2086659112 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ae404e9b0 con 0x7f4ae4070240 2023-10-14T09:36:59.866 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.860+0000 7f4ae17fa640 1 -- 172.21.15.129:0/2086659112 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f4ad4021060 con 0x7f4ae4070240 2023-10-14T09:36:59.940 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.937+0000 7f4ae9413640 1 -- 172.21.15.129:0/2086659112 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fab2fc62-3f3e-450d-93e0-770f39e80710", "id": 5} v 0) v1 -- 0x7f4ae40b3850 con 0x7f4ae4070240 2023-10-14T09:36:59.947 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.944+0000 7f4ae17fa640 1 -- 172.21.15.129:0/2086659112 <== mon.1 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fab2fc62-3f3e-450d-93e0-770f39e80710", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4ad4017070 con 0x7f4ae4070240 2023-10-14T09:36:59.947 INFO:teuthology.orchestra.run.smithi129.stdout:5 2023-10-14T09:36:59.948 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.945+0000 7f4ae9413640 1 -- 172.21.15.129:0/2086659112 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4ae4070240 msgr2=0x7f4ae40af210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:36:59.949 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.945+0000 7f4ae9413640 1 --2- 172.21.15.129:0/2086659112 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4ae4070240 0x7f4ae40af210 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4ad400c440 tx=0x7f4ad4001e70 comp rx=0 tx=0).stop 2023-10-14T09:36:59.949 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.946+0000 7f4ae9413640 1 -- 172.21.15.129:0/2086659112 shutdown_connections 2023-10-14T09:36:59.949 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.946+0000 7f4ae9413640 1 --2- 172.21.15.129:0/2086659112 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ae415aaa0 0x7f4ae41f5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:59.949 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.946+0000 7f4ae9413640 1 --2- 172.21.15.129:0/2086659112 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4ae40b2600 0x7f4ae40c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:59.949 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.946+0000 7f4ae9413640 1 --2- 172.21.15.129:0/2086659112 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4ae4070240 0x7f4ae40af210 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:36:59.950 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.946+0000 7f4ae9413640 1 -- 172.21.15.129:0/2086659112 >> 172.21.15.129:0/2086659112 conn(0x7f4ae40cc230 msgr2=0x7f4ae40ad3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:36:59.950 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.946+0000 7f4ae9413640 1 -- 172.21.15.129:0/2086659112 shutdown_connections 2023-10-14T09:36:59.950 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:36:59.946+0000 7f4ae9413640 1 -- 172.21.15.129:0/2086659112 wait complete. 2023-10-14T09:36:59.955 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-10-14T09:36:59.949+0000 7f0070e12040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-14T09:36:59.964 DEBUG:teuthology.orchestra.run.smithi129:> sudo ceph --cluster ceph osd new d7cc1d69-92e7-4253-a127-cfc0444a4809 6 2023-10-14T09:36:59.965 INFO:tasks.ceph.mgr.x.smithi129.stderr:2023-10-14T09:36:59.962+0000 7f06c3613040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-14T09:37:00.085 INFO:tasks.ceph.mgr.x.smithi129.stderr:2023-10-14T09:37:00.079+0000 7f06c3613040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-14T09:37:00.112 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-10-14T09:37:00.107+0000 7f0070e12040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-14T09:37:00.158 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-10-14T09:37:00.156+0000 7f0070e12040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-14T09:37:00.163 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.160+0000 7f947654e640 1 Processor -- start 2023-10-14T09:37:00.163 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.161+0000 7f947654e640 1 -- start start 2023-10-14T09:37:00.166 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.162+0000 7f947654e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f947015cd70 0x7f94700d2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:00.166 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.162+0000 7f947654e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f947015d150 con 0x7f94700b8480 2023-10-14T09:37:00.166 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.162+0000 7f947654e640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94700d1180 con 0x7f94700cded0 2023-10-14T09:37:00.166 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.162+0000 7f947654e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94700d1460 con 0x7f947015cd70 2023-10-14T09:37:00.167 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.162+0000 7f9475d4d640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f94700cded0 0x7f94700b5c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:42876/0 (socket says 172.21.15.129:42876) 2023-10-14T09:37:00.167 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.162+0000 7f9475d4d640 1 -- 172.21.15.129:0/2414044695 learned_addr learned my addr 172.21.15.129:0/2414044695 (peer_addr_for_me v1:172.21.15.129:0/0) 2023-10-14T09:37:00.168 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.163+0000 7f947554c640 1 --2- 172.21.15.129:0/2414044695 >> v2:172.21.15.102:3300/0 conn(0x7f947015cd70 0x7f94700d2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:00.169 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.163+0000 7f946ffff640 1 -- 172.21.15.129:0/2414044695 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2633140492 0 0) 0x7f94700d1180 con 0x7f94700cded0 2023-10-14T09:37:00.170 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.163+0000 7f946ffff640 1 -- 172.21.15.129:0/2414044695 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9460003520 con 0x7f94700cded0 2023-10-14T09:37:00.170 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.163+0000 7f947554c640 1 -- 172.21.15.129:0/2414044695 >> v1:172.21.15.129:6789/0 conn(0x7f94700cded0 legacy=0x7f94700b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:00.170 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.163+0000 7f947554c640 1 -- 172.21.15.129:0/2414044695 >> v1:172.21.15.102:6789/0 conn(0x7f94700b8480 legacy=0x7f94700cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:00.170 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.163+0000 7f947554c640 1 -- 172.21.15.129:0/2414044695 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94700d1740 con 0x7f947015cd70 2023-10-14T09:37:00.171 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.164+0000 7f947554c640 1 --2- 172.21.15.129:0/2414044695 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f947015cd70 0x7f94700d2220 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9464009d90 tx=0x7f946402bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316ef27d902906c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:00.172 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.165+0000 7f946ffff640 1 -- 172.21.15.129:0/2414044695 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946402ccf0 con 0x7f947015cd70 2023-10-14T09:37:00.172 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.165+0000 7f946ffff640 1 -- 172.21.15.129:0/2414044695 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946402ce50 con 0x7f947015cd70 2023-10-14T09:37:00.172 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.165+0000 7f946ffff640 1 -- 172.21.15.129:0/2414044695 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9464034640 con 0x7f947015cd70 2023-10-14T09:37:00.172 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.165+0000 7f947654e640 1 -- 172.21.15.129:0/2414044695 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f947015cd70 msgr2=0x7f94700d2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:00.172 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.165+0000 7f947654e640 1 --2- 172.21.15.129:0/2414044695 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f947015cd70 0x7f94700d2220 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9464009d90 tx=0x7f946402bf40 comp rx=0 tx=0).stop 2023-10-14T09:37:00.173 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.165+0000 7f947654e640 1 -- 172.21.15.129:0/2414044695 shutdown_connections 2023-10-14T09:37:00.173 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.165+0000 7f947654e640 1 --2- 172.21.15.129:0/2414044695 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f947015cd70 0x7f94700d2220 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:00.173 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.165+0000 7f947654e640 1 -- 172.21.15.129:0/2414044695 >> 172.21.15.129:0/2414044695 conn(0x7f94700cf570 msgr2=0x7f94700cf950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:00.173 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.165+0000 7f947654e640 1 -- 172.21.15.129:0/2414044695 shutdown_connections 2023-10-14T09:37:00.174 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.166+0000 7f947654e640 1 -- 172.21.15.129:0/2414044695 wait complete. 2023-10-14T09:37:00.176 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.167+0000 7f947654e640 1 Processor -- start 2023-10-14T09:37:00.176 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.167+0000 7f947654e640 1 -- start start 2023-10-14T09:37:00.176 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.168+0000 7f947654e640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f94700b8480 0x7f94700a9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:00.177 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.168+0000 7f947654e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f94700cded0 0x7f94701f4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:00.177 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.168+0000 7f947654e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f947015cd70 0x7f94700cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:00.177 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.168+0000 7f947654e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94700aaaf0 con 0x7f947015cd70 2023-10-14T09:37:00.177 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.168+0000 7f947654e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9470149b20 con 0x7f94700cded0 2023-10-14T09:37:00.177 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.168+0000 7f947654e640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94700cbf00 con 0x7f94700b8480 2023-10-14T09:37:00.178 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.168+0000 7f9474d4b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f94700cded0 0x7f94701f4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:00.178 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.168+0000 7f947554c640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f94700b8480 0x7f94700a9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:00.178 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.168+0000 7f9474d4b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f94700cded0 0x7f94701f4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:56314/0 (socket says 172.21.15.129:56314) 2023-10-14T09:37:00.178 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.168+0000 7f9474d4b640 1 -- 172.21.15.129:0/2774269170 learned_addr learned my addr 172.21.15.129:0/2774269170 (peer_addr_for_me v2:172.21.15.129:0/0) 2023-10-14T09:37:00.179 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.169+0000 7f9475d4d640 1 --2- 172.21.15.129:0/2774269170 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f947015cd70 0x7f94700cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:00.179 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.169+0000 7f9474d4b640 1 -- 172.21.15.129:0/2774269170 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f94700b8480 msgr2=0x7f94700a9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:00.179 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.169+0000 7f9474d4b640 1 --2- 172.21.15.129:0/2774269170 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f94700b8480 0x7f94700a9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:00.179 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.169+0000 7f9474d4b640 1 -- 172.21.15.129:0/2774269170 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f947015cd70 msgr2=0x7f94700cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:00.179 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.169+0000 7f9474d4b640 1 --2- 172.21.15.129:0/2774269170 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f947015cd70 0x7f94700cb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:00.180 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.169+0000 7f9474d4b640 1 -- 172.21.15.129:0/2774269170 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9464009a70 con 0x7f94700cded0 2023-10-14T09:37:00.180 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.169+0000 7f947554c640 1 --2- 172.21.15.129:0/2774269170 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f94700b8480 0x7f94700a9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:37:00.180 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.169+0000 7f9474d4b640 1 --2- 172.21.15.129:0/2774269170 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f94700cded0 0x7f94701f4f70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f945c00c400 tx=0x7f945c00c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:00.180 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.169+0000 7f946dffb640 1 -- 172.21.15.129:0/2774269170 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945c0052d0 con 0x7f94700cded0 2023-10-14T09:37:00.180 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.169+0000 7f946dffb640 1 -- 172.21.15.129:0/2774269170 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945c005450 con 0x7f94700cded0 2023-10-14T09:37:00.181 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.169+0000 7f946dffb640 1 -- 172.21.15.129:0/2774269170 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945c007260 con 0x7f94700cded0 2023-10-14T09:37:00.181 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.169+0000 7f947654e640 1 -- 172.21.15.129:0/2774269170 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94700cc1e0 con 0x7f94700cded0 2023-10-14T09:37:00.181 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.170+0000 7f947654e640 1 -- 172.21.15.129:0/2774269170 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94700cc4c0 con 0x7f94700cded0 2023-10-14T09:37:00.181 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.170+0000 7f946dffb640 1 -- 172.21.15.129:0/2774269170 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f945c0067d0 con 0x7f94700cded0 2023-10-14T09:37:00.181 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.170+0000 7f946dffb640 1 -- 172.21.15.129:0/2774269170 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f945c006a80 con 0x7f94700cded0 2023-10-14T09:37:00.182 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.171+0000 7f947654e640 1 -- 172.21.15.129:0/2774269170 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94700d1cb0 con 0x7f94700cded0 2023-10-14T09:37:00.182 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.173+0000 7f946dffb640 1 -- 172.21.15.129:0/2774269170 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f945c020060 con 0x7f94700cded0 2023-10-14T09:37:00.249 INFO:tasks.ceph.mgr.x.smithi129.stderr:2023-10-14T09:37:00.246+0000 7f06c3613040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-14T09:37:00.253 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.250+0000 7f947654e640 1 -- 172.21.15.129:0/2774269170 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d7cc1d69-92e7-4253-a127-cfc0444a4809", "id": 6} v 0) v1 -- 0x7f9470149c90 con 0x7f94700cded0 2023-10-14T09:37:00.261 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.259+0000 7f946dffb640 1 -- 172.21.15.129:0/2774269170 <== mon.1 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d7cc1d69-92e7-4253-a127-cfc0444a4809", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f945c006d10 con 0x7f94700cded0 2023-10-14T09:37:00.261 INFO:teuthology.orchestra.run.smithi129.stdout:6 2023-10-14T09:37:00.262 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.260+0000 7f947654e640 1 -- 172.21.15.129:0/2774269170 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f94700cded0 msgr2=0x7f94701f4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:00.262 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.260+0000 7f947654e640 1 --2- 172.21.15.129:0/2774269170 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f94700cded0 0x7f94701f4f70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f945c00c400 tx=0x7f945c00c8c0 comp rx=0 tx=0).stop 2023-10-14T09:37:00.263 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.260+0000 7f947654e640 1 -- 172.21.15.129:0/2774269170 shutdown_connections 2023-10-14T09:37:00.263 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.260+0000 7f947654e640 1 --2- 172.21.15.129:0/2774269170 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f947015cd70 0x7f94700cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:00.263 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.260+0000 7f947654e640 1 --2- 172.21.15.129:0/2774269170 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f94700cded0 0x7f94701f4f70 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:00.264 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.260+0000 7f947654e640 1 --2- 172.21.15.129:0/2774269170 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f94700b8480 0x7f94700a9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:00.264 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.260+0000 7f947654e640 1 -- 172.21.15.129:0/2774269170 >> 172.21.15.129:0/2774269170 conn(0x7f94700cf570 msgr2=0x7f94700b7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:00.264 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.260+0000 7f947654e640 1 -- 172.21.15.129:0/2774269170 shutdown_connections 2023-10-14T09:37:00.264 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.260+0000 7f947654e640 1 -- 172.21.15.129:0/2774269170 wait complete. 2023-10-14T09:37:00.277 DEBUG:teuthology.orchestra.run.smithi129:> sudo ceph --cluster ceph osd new 1e403de1-09e2-4370-b9a7-e790ac44bbee 7 2023-10-14T09:37:00.302 INFO:tasks.ceph.mgr.x.smithi129.stderr:2023-10-14T09:37:00.300+0000 7f06c3613040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-14T09:37:00.317 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-10-14T09:37:00.315+0000 7f0070e12040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-14T09:37:00.455 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.453+0000 7f2bde6d7640 1 Processor -- start 2023-10-14T09:37:00.456 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.453+0000 7f2bde6d7640 1 -- start start 2023-10-14T09:37:00.457 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.455+0000 7f2bde6d7640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2bd80b8480 0x7f2bd80cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:00.457 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.455+0000 7f2bde6d7640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bd815d150 con 0x7f2bd80d0be0 2023-10-14T09:37:00.458 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.455+0000 7f2bde6d7640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bd80d1180 con 0x7f2bd815cd70 2023-10-14T09:37:00.458 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.455+0000 7f2bde6d7640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bd80d1460 con 0x7f2bd80b8480 2023-10-14T09:37:00.458 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.455+0000 7f2bdd6d5640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f2bd815cd70 0x7f2bd80d2220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:42886/0 (socket says 172.21.15.129:42886) 2023-10-14T09:37:00.458 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.455+0000 7f2bdd6d5640 1 -- 172.21.15.129:0/3227378290 learned_addr learned my addr 172.21.15.129:0/3227378290 (peer_addr_for_me v1:172.21.15.129:0/0) 2023-10-14T09:37:00.461 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.455+0000 7f2bdced4640 1 --2- 172.21.15.129:0/3227378290 >> v2:172.21.15.102:3300/0 conn(0x7f2bd80b8480 0x7f2bd80cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:00.461 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.455+0000 7f2bcffff640 1 -- 172.21.15.129:0/3227378290 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 253138578 0 0) 0x7f2bd80d1180 con 0x7f2bd815cd70 2023-10-14T09:37:00.461 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.456+0000 7f2bcffff640 1 -- 172.21.15.129:0/3227378290 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bc4003520 con 0x7f2bd815cd70 2023-10-14T09:37:00.461 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.456+0000 7f2bcffff640 1 -- 172.21.15.129:0/3227378290 <== mon.1 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 995810648 0 0) 0x7f2bc4003520 con 0x7f2bd815cd70 2023-10-14T09:37:00.461 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.456+0000 7f2bcffff640 1 -- 172.21.15.129:0/3227378290 >> v2:172.21.15.102:3300/0 conn(0x7f2bd80b8480 msgr2=0x7f2bd80cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:00.462 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.456+0000 7f2bcffff640 1 --2- 172.21.15.129:0/3227378290 >> v2:172.21.15.102:3300/0 conn(0x7f2bd80b8480 0x7f2bd80cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:00.462 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.456+0000 7f2bcffff640 1 -- 172.21.15.129:0/3227378290 >> v1:172.21.15.102:6789/0 conn(0x7f2bd80d0be0 legacy=0x7f2bd80b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:00.462 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.456+0000 7f2bcffff640 1 -- 172.21.15.129:0/3227378290 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd80d1740 con 0x7f2bd815cd70 2023-10-14T09:37:00.462 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.456+0000 7f2bcffff640 1 -- 172.21.15.129:0/3227378290 <== mon.1 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4030661168 0 0) 0x7f2bd4001670 con 0x7f2bd815cd70 2023-10-14T09:37:00.462 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.456+0000 7f2bdced4640 1 --2- 172.21.15.129:0/3227378290 >> v2:172.21.15.102:3300/0 conn(0x7f2bd80b8480 0x7f2bd80cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:37:00.463 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.456+0000 7f2bcffff640 1 -- 172.21.15.129:0/3227378290 >> v1:172.21.15.129:6789/0 conn(0x7f2bd815cd70 legacy=0x7f2bd80d2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:00.463 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.456+0000 7f2bcffff640 1 --2- 172.21.15.129:0/3227378290 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2bc4003970 0x7f2bc4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:00.463 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.456+0000 7f2bcffff640 1 --2- 172.21.15.129:0/3227378290 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2bc40047c0 0x7f2bc4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:00.463 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.456+0000 7f2bcffff640 1 --2- 172.21.15.129:0/3227378290 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2bc4005180 0x7f2bc400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:00.464 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.456+0000 7f2bcffff640 1 -- 172.21.15.129:0/3227378290 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd80d1460 con 0x7f2bc4005180 2023-10-14T09:37:00.464 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.456+0000 7f2bcffff640 1 -- 172.21.15.129:0/3227378290 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc400c120 con 0x7f2bc40047c0 2023-10-14T09:37:00.464 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.456+0000 7f2bcffff640 1 -- 172.21.15.129:0/3227378290 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc400c2e0 con 0x7f2bc4003970 2023-10-14T09:37:00.464 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.456+0000 7f2bdced4640 1 --2- 172.21.15.129:0/3227378290 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2bc40047c0 0x7f2bc4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:00.464 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.456+0000 7f2bdd6d5640 1 --2- 172.21.15.129:0/3227378290 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2bc4003970 0x7f2bc4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:00.465 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.457+0000 7f2bdded6640 1 --2- 172.21.15.129:0/3227378290 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2bc4005180 0x7f2bc400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:00.465 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.457+0000 7f2bdced4640 1 -- 172.21.15.129:0/3227378290 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2bc4003970 msgr2=0x7f2bc4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:00.465 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.457+0000 7f2bdced4640 1 --2- 172.21.15.129:0/3227378290 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2bc4003970 0x7f2bc4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:00.465 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.457+0000 7f2bdced4640 1 -- 172.21.15.129:0/3227378290 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2bc4005180 msgr2=0x7f2bc400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:00.465 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.457+0000 7f2bdced4640 1 --2- 172.21.15.129:0/3227378290 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2bc4005180 0x7f2bc400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:00.466 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.457+0000 7f2bdced4640 1 -- 172.21.15.129:0/3227378290 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc4003520 con 0x7f2bc40047c0 2023-10-14T09:37:00.466 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.457+0000 7f2bdded6640 1 --2- 172.21.15.129:0/3227378290 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2bc4005180 0x7f2bc400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:37:00.466 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.457+0000 7f2bdded6640 1 -- 172.21.15.129:0/3227378290 reap_dead start 2023-10-14T09:37:00.466 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.458+0000 7f2bdced4640 1 --2- 172.21.15.129:0/3227378290 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2bc40047c0 0x7f2bc4004c40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8009c90 tx=0x7f2bc40057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2e359816c87968f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:00.466 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.458+0000 7f2bcffff640 1 -- 172.21.15.129:0/3227378290 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc802c8f0 con 0x7f2bc40047c0 2023-10-14T09:37:00.467 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.458+0000 7f2bcffff640 1 -- 172.21.15.129:0/3227378290 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc802ca50 con 0x7f2bc40047c0 2023-10-14T09:37:00.467 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.458+0000 7f2bcffff640 1 -- 172.21.15.129:0/3227378290 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc802ce40 con 0x7f2bc40047c0 2023-10-14T09:37:00.470 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.459+0000 7f2bde6d7640 1 -- 172.21.15.129:0/3227378290 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2bc40047c0 msgr2=0x7f2bc4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:00.470 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.459+0000 7f2bde6d7640 1 --2- 172.21.15.129:0/3227378290 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2bc40047c0 0x7f2bc4004c40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8009c90 tx=0x7f2bc40057f0 comp rx=0 tx=0).stop 2023-10-14T09:37:00.470 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.459+0000 7f2bde6d7640 1 -- 172.21.15.129:0/3227378290 shutdown_connections 2023-10-14T09:37:00.470 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.459+0000 7f2bde6d7640 1 --2- 172.21.15.129:0/3227378290 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2bc40047c0 0x7f2bc4004c40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:00.471 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.459+0000 7f2bde6d7640 1 -- 172.21.15.129:0/3227378290 >> 172.21.15.129:0/3227378290 conn(0x7f2bd80cf570 msgr2=0x7f2bd80cf950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:00.471 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.459+0000 7f2bde6d7640 1 -- 172.21.15.129:0/3227378290 shutdown_connections 2023-10-14T09:37:00.471 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.459+0000 7f2bde6d7640 1 -- 172.21.15.129:0/3227378290 wait complete. 2023-10-14T09:37:00.471 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.461+0000 7f2bde6d7640 1 Processor -- start 2023-10-14T09:37:00.471 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.461+0000 7f2bde6d7640 1 -- start start 2023-10-14T09:37:00.472 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.462+0000 7f2bde6d7640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2bc40047c0 0x7f2bd81515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:00.472 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.462+0000 7f2bde6d7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2bd80b7820 0x7f2bd80b7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:00.472 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.462+0000 7f2bde6d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2bd80cb770 0x7f2bd80cbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:00.472 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.462+0000 7f2bde6d7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd815d360 con 0x7f2bd80cb770 2023-10-14T09:37:00.472 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.462+0000 7f2bde6d7640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd80b81e0 con 0x7f2bd80b7820 2023-10-14T09:37:00.472 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.462+0000 7f2bde6d7640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd815e150 con 0x7f2bc40047c0 2023-10-14T09:37:00.473 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.462+0000 7f2bdd6d5640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2bc40047c0 0x7f2bd81515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:00.473 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.462+0000 7f2bdd6d5640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2bc40047c0 0x7f2bd81515c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.129:50606/0 (socket says 172.21.15.129:50606) 2023-10-14T09:37:00.473 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.462+0000 7f2bdd6d5640 1 -- 172.21.15.129:0/1971261283 learned_addr learned my addr 172.21.15.129:0/1971261283 (peer_addr_for_me v2:172.21.15.129:0/0) 2023-10-14T09:37:00.473 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.462+0000 7f2bdced4640 1 --2- 172.21.15.129:0/1971261283 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2bd80b7820 0x7f2bd80b7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:00.473 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.462+0000 7f2bdded6640 1 --2- 172.21.15.129:0/1971261283 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2bd80cb770 0x7f2bd80cbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:00.474 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.462+0000 7f2bdd6d5640 1 -- 172.21.15.129:0/1971261283 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2bd80b7820 msgr2=0x7f2bd80b7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:00.474 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.462+0000 7f2bdd6d5640 1 --2- 172.21.15.129:0/1971261283 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2bd80b7820 0x7f2bd80b7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:00.474 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.462+0000 7f2bdd6d5640 1 -- 172.21.15.129:0/1971261283 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2bd80cb770 msgr2=0x7f2bd80cbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:00.474 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.462+0000 7f2bdd6d5640 1 --2- 172.21.15.129:0/1971261283 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2bd80cb770 0x7f2bd80cbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:00.474 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.462+0000 7f2bdd6d5640 1 -- 172.21.15.129:0/1971261283 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd8151b00 con 0x7f2bc40047c0 2023-10-14T09:37:00.475 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.462+0000 7f2bdced4640 1 --2- 172.21.15.129:0/1971261283 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2bd80b7820 0x7f2bd80b7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:37:00.475 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.463+0000 7f2bdd6d5640 1 --2- 172.21.15.129:0/1971261283 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2bc40047c0 0x7f2bd81515c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40072f0 tx=0x7f2bd40077b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:00.475 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.463+0000 7f2bcdffb640 1 -- 172.21.15.129:0/1971261283 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd400f910 con 0x7f2bc40047c0 2023-10-14T09:37:00.475 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.463+0000 7f2bcdffb640 1 -- 172.21.15.129:0/1971261283 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd400fab0 con 0x7f2bc40047c0 2023-10-14T09:37:00.475 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.463+0000 7f2bde6d7640 1 -- 172.21.15.129:0/1971261283 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bd815d540 con 0x7f2bc40047c0 2023-10-14T09:37:00.476 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.463+0000 7f2bcdffb640 1 -- 172.21.15.129:0/1971261283 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd400fe60 con 0x7f2bc40047c0 2023-10-14T09:37:00.476 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.463+0000 7f2bde6d7640 1 -- 172.21.15.129:0/1971261283 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bd815db00 con 0x7f2bc40047c0 2023-10-14T09:37:00.476 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.463+0000 7f2bcdffb640 1 -- 172.21.15.129:0/1971261283 <== mon.2 v2:172.21.15.129:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2bd401d760 con 0x7f2bc40047c0 2023-10-14T09:37:00.476 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.463+0000 7f2bcdffb640 1 -- 172.21.15.129:0/1971261283 <== mon.2 v2:172.21.15.129:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f2bd4013c80 con 0x7f2bc40047c0 2023-10-14T09:37:00.476 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.464+0000 7f2bde6d7640 1 -- 172.21.15.129:0/1971261283 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bd8153300 con 0x7f2bc40047c0 2023-10-14T09:37:00.477 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.466+0000 7f2bcdffb640 1 -- 172.21.15.129:0/1971261283 <== mon.2 v2:172.21.15.129:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f2bd8153300 con 0x7f2bc40047c0 2023-10-14T09:37:00.477 INFO:tasks.ceph.mgr.x.smithi129.stderr:2023-10-14T09:37:00.467+0000 7f06c3613040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-14T09:37:00.546 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.544+0000 7f2bde6d7640 1 -- 172.21.15.129:0/1971261283 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1e403de1-09e2-4370-b9a7-e790ac44bbee", "id": 7} v 0) v1 -- 0x7f2bd804e9b0 con 0x7f2bc40047c0 2023-10-14T09:37:00.554 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.552+0000 7f2bcdffb640 1 -- 172.21.15.129:0/1971261283 <== mon.2 v2:172.21.15.129:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1e403de1-09e2-4370-b9a7-e790ac44bbee", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2bd401da10 con 0x7f2bc40047c0 2023-10-14T09:37:00.554 INFO:teuthology.orchestra.run.smithi129.stdout:7 2023-10-14T09:37:00.556 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.553+0000 7f2bde6d7640 1 -- 172.21.15.129:0/1971261283 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2bc40047c0 msgr2=0x7f2bd81515c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:00.556 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.553+0000 7f2bde6d7640 1 --2- 172.21.15.129:0/1971261283 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2bc40047c0 0x7f2bd81515c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40072f0 tx=0x7f2bd40077b0 comp rx=0 tx=0).stop 2023-10-14T09:37:00.556 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.554+0000 7f2bde6d7640 1 -- 172.21.15.129:0/1971261283 shutdown_connections 2023-10-14T09:37:00.557 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.554+0000 7f2bde6d7640 1 --2- 172.21.15.129:0/1971261283 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2bd80cb770 0x7f2bd80cbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:00.557 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.554+0000 7f2bde6d7640 1 --2- 172.21.15.129:0/1971261283 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2bd80b7820 0x7f2bd80b7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:00.557 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.554+0000 7f2bde6d7640 1 --2- 172.21.15.129:0/1971261283 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2bc40047c0 0x7f2bd81515c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:00.557 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.554+0000 7f2bde6d7640 1 -- 172.21.15.129:0/1971261283 >> 172.21.15.129:0/1971261283 conn(0x7f2bd80cf570 msgr2=0x7f2bd80b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:00.557 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.554+0000 7f2bde6d7640 1 -- 172.21.15.129:0/1971261283 shutdown_connections 2023-10-14T09:37:00.558 INFO:teuthology.orchestra.run.smithi129.stderr:2023-10-14T09:37:00.554+0000 7f2bde6d7640 1 -- 172.21.15.129:0/1971261283 wait complete. 2023-10-14T09:37:00.572 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-14T09:37:00.573 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-14T09:37:00.584 INFO:tasks.ceph.osd.0:Started 2023-10-14T09:37:00.584 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-14T09:37:00.585 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-14T09:37:00.594 INFO:tasks.ceph.osd.1:Started 2023-10-14T09:37:00.594 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-14T09:37:00.594 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-14T09:37:00.601 INFO:tasks.ceph.osd.2:Started 2023-10-14T09:37:00.602 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-14T09:37:00.602 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-14T09:37:00.608 INFO:tasks.ceph.osd.3:Started 2023-10-14T09:37:00.608 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-14T09:37:00.609 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-14T09:37:00.622 INFO:tasks.ceph.osd.4:Started 2023-10-14T09:37:00.623 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-14T09:37:00.623 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-14T09:37:00.632 INFO:tasks.ceph.osd.5:Started 2023-10-14T09:37:00.633 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-14T09:37:00.633 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-14T09:37:00.640 INFO:tasks.ceph.osd.6:Started 2023-10-14T09:37:00.640 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-14T09:37:00.641 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-14T09:37:00.647 INFO:tasks.ceph.osd.7:Started 2023-10-14T09:37:00.648 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:37:00.867 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.865+0000 7f75a7773640 1 Processor -- start 2023-10-14T09:37:00.868 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.866+0000 7f75a7773640 1 -- start start 2023-10-14T09:37:00.869 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.867+0000 7f75a7773640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f75a015aaa0 0x7f75a015e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:00.869 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.867+0000 7f75a7773640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f75a015ae80 0x7f75a00cc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:00.869 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.867+0000 7f75a7773640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f75a00ccaa0 0x7f75a0070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:00.869 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.867+0000 7f75a7773640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a006b810 con 0x7f75a015aaa0 2023-10-14T09:37:00.870 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.867+0000 7f75a7773640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a015ed60 con 0x7f75a015ae80 2023-10-14T09:37:00.870 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.867+0000 7f75a7773640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a00707e0 con 0x7f75a00ccaa0 2023-10-14T09:37:00.870 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.867+0000 7f75a550f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f75a015aaa0 0x7f75a015e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:00.870 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.867+0000 7f75a4d0e640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f75a015ae80 0x7f75a00cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:00.870 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.867+0000 7f75a550f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f75a015aaa0 0x7f75a015e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60882/0 (socket says 172.21.15.102:60882) 2023-10-14T09:37:00.871 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.867+0000 7f75a550f640 1 -- 172.21.15.102:0/1812003344 learned_addr learned my addr 172.21.15.102:0/1812003344 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:00.871 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.867+0000 7f75a5d10640 1 --2- 172.21.15.102:0/1812003344 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f75a00ccaa0 0x7f75a0070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:00.872 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.867+0000 7f75a4d0e640 1 -- 172.21.15.102:0/1812003344 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f75a00ccaa0 msgr2=0x7f75a0070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:00.873 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.867+0000 7f75a4d0e640 1 --2- 172.21.15.102:0/1812003344 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f75a00ccaa0 0x7f75a0070f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:00.873 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.867+0000 7f75a4d0e640 1 -- 172.21.15.102:0/1812003344 >> v2:172.21.15.102:3300/0 conn(0x7f75a015aaa0 msgr2=0x7f75a015e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:00.873 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.868+0000 7f75a4d0e640 1 --2- 172.21.15.102:0/1812003344 >> v2:172.21.15.102:3300/0 conn(0x7f75a015aaa0 0x7f75a015e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:00.873 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.868+0000 7f75a4d0e640 1 -- 172.21.15.102:0/1812003344 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a015ef90 con 0x7f75a015ae80 2023-10-14T09:37:00.873 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.868+0000 7f75a550f640 1 --2- 172.21.15.102:0/1812003344 >> v2:172.21.15.102:3300/0 conn(0x7f75a015aaa0 0x7f75a015e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:37:00.874 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.869+0000 7f75a4d0e640 1 --2- 172.21.15.102:0/1812003344 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f75a015ae80 0x7f75a00cc560 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f75a00c59c0 tx=0x7f759002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da406ed60f5afc38 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:00.874 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.869+0000 7f7597fff640 1 -- 172.21.15.102:0/1812003344 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759002e070 con 0x7f75a015ae80 2023-10-14T09:37:00.874 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.869+0000 7f7597fff640 1 -- 172.21.15.102:0/1812003344 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75900315a0 con 0x7f75a015ae80 2023-10-14T09:37:00.874 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.869+0000 7f7597fff640 1 -- 172.21.15.102:0/1812003344 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7590031930 con 0x7f75a015ae80 2023-10-14T09:37:00.874 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.869+0000 7f75a7773640 1 -- 172.21.15.102:0/1812003344 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f75a015ae80 msgr2=0x7f75a00cc560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:00.875 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.869+0000 7f75a7773640 1 --2- 172.21.15.102:0/1812003344 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f75a015ae80 0x7f75a00cc560 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f75a00c59c0 tx=0x7f759002b840 comp rx=0 tx=0).stop 2023-10-14T09:37:00.875 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.869+0000 7f75a7773640 1 -- 172.21.15.102:0/1812003344 shutdown_connections 2023-10-14T09:37:00.875 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.869+0000 7f75a7773640 1 --2- 172.21.15.102:0/1812003344 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f75a015ae80 0x7f75a00cc560 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:00.875 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.869+0000 7f75a7773640 1 --2- 172.21.15.102:0/1812003344 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f75a00ccaa0 0x7f75a0070f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:00.875 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.869+0000 7f75a7773640 1 --2- 172.21.15.102:0/1812003344 >> v2:172.21.15.102:3300/0 conn(0x7f75a015aaa0 0x7f75a015e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:00.875 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.869+0000 7f75a7773640 1 -- 172.21.15.102:0/1812003344 >> 172.21.15.102:0/1812003344 conn(0x7f75a00cb410 msgr2=0x7f75a00cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:00.876 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.870+0000 7f75a7773640 1 -- 172.21.15.102:0/1812003344 shutdown_connections 2023-10-14T09:37:00.876 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.870+0000 7f75a7773640 1 -- 172.21.15.102:0/1812003344 wait complete. 2023-10-14T09:37:00.878 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.871+0000 7f75a7773640 1 Processor -- start 2023-10-14T09:37:00.879 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.871+0000 7f75a7773640 1 -- start start 2023-10-14T09:37:00.879 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.872+0000 7f75a7773640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f75a00ccaa0 0x7f75a015de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:00.879 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.872+0000 7f75a7773640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f75a015aaa0 0x7f75a0155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:00.879 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.872+0000 7f75a7773640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f75a015ae80 0x7f75a00b3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:00.879 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.872+0000 7f75a7773640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a0155d70 con 0x7f75a015aaa0 2023-10-14T09:37:00.880 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.872+0000 7f75a7773640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a01576d0 con 0x7f75a015ae80 2023-10-14T09:37:00.880 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.872+0000 7f75a7773640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a015b2b0 con 0x7f75a00ccaa0 2023-10-14T09:37:00.880 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.873+0000 7f75a4d0e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f75a015aaa0 0x7f75a0155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:00.880 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.873+0000 7f75a4d0e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f75a015aaa0 0x7f75a0155830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60888/0 (socket says 172.21.15.102:60888) 2023-10-14T09:37:00.880 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.873+0000 7f75a4d0e640 1 -- 172.21.15.102:0/584889452 learned_addr learned my addr 172.21.15.102:0/584889452 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:00.880 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.873+0000 7f75a5d10640 1 --2- 172.21.15.102:0/584889452 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f75a015ae80 0x7f75a00b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:00.881 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.873+0000 7f75a550f640 1 --2- 172.21.15.102:0/584889452 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f75a00ccaa0 0x7f75a015de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:00.881 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.873+0000 7f75a4d0e640 1 -- 172.21.15.102:0/584889452 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f75a00ccaa0 msgr2=0x7f75a015de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:00.881 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.873+0000 7f75a4d0e640 1 --2- 172.21.15.102:0/584889452 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f75a00ccaa0 0x7f75a015de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:00.881 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.873+0000 7f75a4d0e640 1 -- 172.21.15.102:0/584889452 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f75a015ae80 msgr2=0x7f75a00b3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:00.881 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.873+0000 7f75a4d0e640 1 --2- 172.21.15.102:0/584889452 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f75a015ae80 0x7f75a00b3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:00.882 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.873+0000 7f75a4d0e640 1 -- 172.21.15.102:0/584889452 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759c0094d0 con 0x7f75a015aaa0 2023-10-14T09:37:00.882 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.873+0000 7f75a4d0e640 1 --2- 172.21.15.102:0/584889452 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f75a015aaa0 0x7f75a0155830 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7590009890 tx=0x7f75900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:00.882 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.873+0000 7f7595ffb640 1 -- 172.21.15.102:0/584889452 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7590032630 con 0x7f75a015aaa0 2023-10-14T09:37:00.882 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.874+0000 7f7595ffb640 1 -- 172.21.15.102:0/584889452 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7590032790 con 0x7f75a015aaa0 2023-10-14T09:37:00.882 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.874+0000 7f7595ffb640 1 -- 172.21.15.102:0/584889452 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7590032b40 con 0x7f75a015aaa0 2023-10-14T09:37:00.883 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.874+0000 7f75a7773640 1 -- 172.21.15.102:0/584889452 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7590009400 con 0x7f75a015aaa0 2023-10-14T09:37:00.883 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.874+0000 7f75a7773640 1 -- 172.21.15.102:0/584889452 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a015b870 con 0x7f75a015aaa0 2023-10-14T09:37:00.883 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.874+0000 7f7595ffb640 1 -- 172.21.15.102:0/584889452 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7590005c90 con 0x7f75a015aaa0 2023-10-14T09:37:00.883 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.874+0000 7f7595ffb640 1 -- 172.21.15.102:0/584889452 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f7590006840 con 0x7f75a015aaa0 2023-10-14T09:37:00.883 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.875+0000 7f75a7773640 1 -- 172.21.15.102:0/584889452 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a004e160 con 0x7f75a015aaa0 2023-10-14T09:37:00.884 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.878+0000 7f7595ffb640 1 -- 172.21.15.102:0/584889452 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f7590063b40 con 0x7f75a015aaa0 2023-10-14T09:37:00.944 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.942+0000 7f75a7773640 1 -- 172.21.15.102:0/584889452 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75a00cdc60 con 0x7f75a015aaa0 2023-10-14T09:37:00.945 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.943+0000 7f7595ffb640 1 -- 172.21.15.102:0/584889452 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f7590052020 con 0x7f75a015aaa0 2023-10-14T09:37:00.945 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:37:00.946 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":10,"fsid":"8a6cd69d-7f5b-4f2a-806a-0176c10aed50","created":"2023-10-14T09:36:56.745172+0000","modified":"2023-10-14T09:37:00.547186+0000","last_up_change":"0.000000","last_in_change":"2023-10-14T09:37:00.547186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e5aef8f3-878f-482b-b522-9a5b958b90b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4a8cf50e-387b-4d47-9588-bd22e375a9ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"009ef55f-8a63-4219-bacd-d7c7b4500867","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f2110eae-2ff9-4ed9-93d6-bd2361618211","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"33f1ae34-3100-40f7-9cb8-0eca2b358693","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fab2fc62-3f3e-450d-93e0-770f39e80710","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d7cc1d69-92e7-4253-a127-cfc0444a4809","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1e403de1-09e2-4370-b9a7-e790ac44bbee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:37:00.947 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.945+0000 7f75a7773640 1 -- 172.21.15.102:0/584889452 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f75a015aaa0 msgr2=0x7f75a0155830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:00.947 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.945+0000 7f75a7773640 1 --2- 172.21.15.102:0/584889452 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f75a015aaa0 0x7f75a0155830 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7590009890 tx=0x7f75900046c0 comp rx=0 tx=0).stop 2023-10-14T09:37:00.947 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.945+0000 7f75a7773640 1 -- 172.21.15.102:0/584889452 shutdown_connections 2023-10-14T09:37:00.947 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.945+0000 7f75a7773640 1 --2- 172.21.15.102:0/584889452 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f75a015ae80 0x7f75a00b3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:00.947 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.945+0000 7f75a7773640 1 --2- 172.21.15.102:0/584889452 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f75a015aaa0 0x7f75a0155830 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:00.948 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.945+0000 7f75a7773640 1 --2- 172.21.15.102:0/584889452 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f75a00ccaa0 0x7f75a015de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:00.948 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.945+0000 7f75a7773640 1 -- 172.21.15.102:0/584889452 >> 172.21.15.102:0/584889452 conn(0x7f75a00cb410 msgr2=0x7f75a006cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:00.948 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.945+0000 7f75a7773640 1 -- 172.21.15.102:0/584889452 shutdown_connections 2023-10-14T09:37:00.948 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:00.945+0000 7f75a7773640 1 -- 172.21.15.102:0/584889452 wait complete. 2023-10-14T09:37:00.962 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-14T09:37:00.962 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-14T09:37:01.014 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T09:37:01.022 DEBUG:teuthology.orchestra.run.smithi129:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T09:37:01.315 INFO:tasks.ceph.osd.0.smithi102.stderr:2023-10-14T09:37:01.313+0000 7f932e616500 -1 Falling back to public interface 2023-10-14T09:37:01.318 INFO:tasks.ceph.osd.5.smithi129.stderr:2023-10-14T09:37:01.316+0000 7f8247fad500 -1 Falling back to public interface 2023-10-14T09:37:01.322 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-10-14T09:37:01.320+0000 7f53c218d500 -1 Falling back to public interface 2023-10-14T09:37:01.328 INFO:tasks.ceph.osd.6.smithi129.stderr:2023-10-14T09:37:01.326+0000 7f0d96c25500 -1 Falling back to public interface 2023-10-14T09:37:01.330 INFO:tasks.ceph.osd.2.smithi102.stderr:2023-10-14T09:37:01.329+0000 7f7bfc414500 -1 Falling back to public interface 2023-10-14T09:37:01.331 INFO:tasks.ceph.osd.3.smithi102.stderr:2023-10-14T09:37:01.329+0000 7f36f698d500 -1 Falling back to public interface 2023-10-14T09:37:01.364 INFO:tasks.ceph.osd.4.smithi129.stderr:2023-10-14T09:37:01.362+0000 7f9573e16500 -1 Falling back to public interface 2023-10-14T09:37:01.369 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-10-14T09:37:01.368+0000 7f0070e12040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-14T09:37:01.374 INFO:tasks.ceph.osd.7.smithi129.stderr:2023-10-14T09:37:01.372+0000 7f8551210500 -1 Falling back to public interface 2023-10-14T09:37:01.621 INFO:tasks.ceph.mgr.x.smithi129.stderr:2023-10-14T09:37:01.618+0000 7f06c3613040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-14T09:37:01.675 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-10-14T09:37:01.674+0000 7f0070e12040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-14T09:37:01.735 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-10-14T09:37:01.733+0000 7f0070e12040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-14T09:37:01.768 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-14T09:37:01.852 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-10-14T09:37:01.851+0000 7f0070e12040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-14T09:37:01.938 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.936+0000 7fa216ba0640 1 Processor -- start 2023-10-14T09:37:01.939 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.937+0000 7fa216ba0640 1 -- start start 2023-10-14T09:37:01.940 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.938+0000 7fa216ba0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa21015cd70 0x7fa2100d2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:01.940 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.938+0000 7fa216ba0640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa2100cded0 0x7fa2100b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:01.941 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.938+0000 7fa216ba0640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa21015d150 con 0x7fa2100b8480 2023-10-14T09:37:01.941 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.938+0000 7fa216ba0640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2100d1180 con 0x7fa21015cd70 2023-10-14T09:37:01.941 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.938+0000 7fa216ba0640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2100d1460 con 0x7fa2100cded0 2023-10-14T09:37:01.941 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.938+0000 7fa215b9e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa21015cd70 0x7fa2100d2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:01.941 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.938+0000 7fa215b9e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa21015cd70 0x7fa2100d2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39292/0 (socket says 172.21.15.102:39292) 2023-10-14T09:37:01.942 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.938+0000 7fa215b9e640 1 -- 172.21.15.102:0/3599969285 learned_addr learned my addr 172.21.15.102:0/3599969285 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:01.942 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.938+0000 7fa21639f640 1 --2- 172.21.15.102:0/3599969285 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa2100cded0 0x7fa2100b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:01.942 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.938+0000 7fa215b9e640 1 -- 172.21.15.102:0/3599969285 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa2100cded0 msgr2=0x7fa2100b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:01.943 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.938+0000 7fa215b9e640 1 --2- 172.21.15.102:0/3599969285 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa2100cded0 0x7fa2100b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:01.943 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.938+0000 7fa215b9e640 1 -- 172.21.15.102:0/3599969285 >> v1:172.21.15.102:6789/0 conn(0x7fa2100b8480 legacy=0x7fa2100cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:01.943 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.939+0000 7fa215b9e640 1 -- 172.21.15.102:0/3599969285 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2100d1740 con 0x7fa21015cd70 2023-10-14T09:37:01.944 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.940+0000 7fa215b9e640 1 --2- 172.21.15.102:0/3599969285 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa21015cd70 0x7fa2100d2220 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa20c009870 tx=0x7fa20c02b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=458ac63e9d90977f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:01.945 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.940+0000 7fa214b9c640 1 -- 172.21.15.102:0/3599969285 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20c004230 con 0x7fa21015cd70 2023-10-14T09:37:01.945 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.940+0000 7fa214b9c640 1 -- 172.21.15.102:0/3599969285 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20c02e050 con 0x7fa21015cd70 2023-10-14T09:37:01.945 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.940+0000 7fa214b9c640 1 -- 172.21.15.102:0/3599969285 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20c003610 con 0x7fa21015cd70 2023-10-14T09:37:01.945 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.940+0000 7fa216ba0640 1 -- 172.21.15.102:0/3599969285 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa21015cd70 msgr2=0x7fa2100d2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:01.945 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.940+0000 7fa216ba0640 1 --2- 172.21.15.102:0/3599969285 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa21015cd70 0x7fa2100d2220 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa20c009870 tx=0x7fa20c02b7e0 comp rx=0 tx=0).stop 2023-10-14T09:37:01.946 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.940+0000 7fa216ba0640 1 -- 172.21.15.102:0/3599969285 shutdown_connections 2023-10-14T09:37:01.946 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.940+0000 7fa216ba0640 1 --2- 172.21.15.102:0/3599969285 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa2100cded0 0x7fa2100b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:01.946 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.940+0000 7fa216ba0640 1 --2- 172.21.15.102:0/3599969285 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa21015cd70 0x7fa2100d2220 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:01.946 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.940+0000 7fa216ba0640 1 -- 172.21.15.102:0/3599969285 >> 172.21.15.102:0/3599969285 conn(0x7fa2100cf570 msgr2=0x7fa2100cf950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:01.946 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.941+0000 7fa216ba0640 1 -- 172.21.15.102:0/3599969285 shutdown_connections 2023-10-14T09:37:01.947 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.941+0000 7fa216ba0640 1 -- 172.21.15.102:0/3599969285 wait complete. 2023-10-14T09:37:01.947 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.942+0000 7fa216ba0640 1 Processor -- start 2023-10-14T09:37:01.947 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.942+0000 7fa216ba0640 1 -- start start 2023-10-14T09:37:01.948 INFO:tasks.ceph.mgr.x.smithi129.stderr:2023-10-14T09:37:01.942+0000 7f06c3613040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-14T09:37:01.950 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.943+0000 7fa216ba0640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa2100b8480 0x7fa2101f3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:01.951 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.943+0000 7fa216ba0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2100cded0 0x7fa2100b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:01.951 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.943+0000 7fa216ba0640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa21015cd70 0x7fa2100cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:01.951 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.943+0000 7fa216ba0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2101f4450 con 0x7fa2100cded0 2023-10-14T09:37:01.951 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.943+0000 7fa216ba0640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2101f3570 con 0x7fa2100b8480 2023-10-14T09:37:01.951 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.943+0000 7fa216ba0640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2101f3840 con 0x7fa21015cd70 2023-10-14T09:37:01.952 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.944+0000 7fa21539d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2100cded0 0x7fa2100b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:01.952 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.944+0000 7fa21539d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2100cded0 0x7fa2100b34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39302/0 (socket says 172.21.15.102:39302) 2023-10-14T09:37:01.952 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.944+0000 7fa21539d640 1 -- 172.21.15.102:0/2470827184 learned_addr learned my addr 172.21.15.102:0/2470827184 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:01.952 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.944+0000 7fa215b9e640 1 --2- 172.21.15.102:0/2470827184 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa2100b8480 0x7fa2101f3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:01.953 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.944+0000 7fa21639f640 1 --2- 172.21.15.102:0/2470827184 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa21015cd70 0x7fa2100cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:01.953 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.944+0000 7fa21539d640 1 -- 172.21.15.102:0/2470827184 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa21015cd70 msgr2=0x7fa2100cbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:01.953 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.944+0000 7fa21539d640 1 --2- 172.21.15.102:0/2470827184 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa21015cd70 0x7fa2100cbe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:01.953 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.944+0000 7fa21539d640 1 -- 172.21.15.102:0/2470827184 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa2100b8480 msgr2=0x7fa2101f3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:01.953 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.944+0000 7fa21539d640 1 --2- 172.21.15.102:0/2470827184 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa2100b8480 0x7fa2101f3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:01.954 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.944+0000 7fa21539d640 1 -- 172.21.15.102:0/2470827184 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20c0094d0 con 0x7fa2100cded0 2023-10-14T09:37:01.954 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.944+0000 7fa21639f640 1 --2- 172.21.15.102:0/2470827184 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa21015cd70 0x7fa2100cbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:37:01.954 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.944+0000 7fa21539d640 1 --2- 172.21.15.102:0/2470827184 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2100cded0 0x7fa2100b34f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa20000c780 tx=0x7fa20000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:01.954 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.944+0000 7fa2067fc640 1 -- 172.21.15.102:0/2470827184 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2000052d0 con 0x7fa2100cded0 2023-10-14T09:37:01.955 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.945+0000 7fa2067fc640 1 -- 172.21.15.102:0/2470827184 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa200005430 con 0x7fa2100cded0 2023-10-14T09:37:01.955 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.945+0000 7fa2067fc640 1 -- 172.21.15.102:0/2470827184 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20000a860 con 0x7fa2100cded0 2023-10-14T09:37:01.955 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.945+0000 7fa216ba0640 1 -- 172.21.15.102:0/2470827184 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2101f3b20 con 0x7fa2100cded0 2023-10-14T09:37:01.956 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.945+0000 7fa216ba0640 1 -- 172.21.15.102:0/2470827184 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2101f40e0 con 0x7fa2100cded0 2023-10-14T09:37:01.956 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.946+0000 7fa216ba0640 1 -- 172.21.15.102:0/2470827184 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2101f45c0 con 0x7fa2100cded0 2023-10-14T09:37:01.956 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.946+0000 7fa2067fc640 1 -- 172.21.15.102:0/2470827184 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 2) v1 ==== 44566+0+0 (secure 0 0 0) 0x7fa20000a9c0 con 0x7fa2100cded0 2023-10-14T09:37:01.956 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.947+0000 7fa2067fc640 1 -- 172.21.15.102:0/2470827184 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fa200048cb0 con 0x7fa2100cded0 2023-10-14T09:37:01.957 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:01.949+0000 7fa2067fc640 1 -- 172.21.15.102:0/2470827184 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fa2000196d0 con 0x7fa2100cded0 2023-10-14T09:37:02.005 INFO:tasks.ceph.mgr.x.smithi129.stderr:2023-10-14T09:37:02.003+0000 7f06c3613040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-14T09:37:02.014 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:02.013+0000 7fa216ba0640 1 -- 172.21.15.102:0/2470827184 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa21004e9b0 con 0x7fa2100cded0 2023-10-14T09:37:02.015 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:02.014+0000 7fa2067fc640 1 -- 172.21.15.102:0/2470827184 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fa200017070 con 0x7fa2100cded0 2023-10-14T09:37:02.016 INFO:teuthology.misc.health.smithi102.stdout: 2023-10-14T09:37:02.016 INFO:teuthology.misc.health.smithi102.stdout:{"epoch":10,"fsid":"8a6cd69d-7f5b-4f2a-806a-0176c10aed50","created":"2023-10-14T09:36:56.745172+0000","modified":"2023-10-14T09:37:00.547186+0000","last_up_change":"0.000000","last_in_change":"2023-10-14T09:37:00.547186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e5aef8f3-878f-482b-b522-9a5b958b90b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4a8cf50e-387b-4d47-9588-bd22e375a9ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"009ef55f-8a63-4219-bacd-d7c7b4500867","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f2110eae-2ff9-4ed9-93d6-bd2361618211","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"33f1ae34-3100-40f7-9cb8-0eca2b358693","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fab2fc62-3f3e-450d-93e0-770f39e80710","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d7cc1d69-92e7-4253-a127-cfc0444a4809","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1e403de1-09e2-4370-b9a7-e790ac44bbee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:37:02.017 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:02.014+0000 7fa216ba0640 1 -- 172.21.15.102:0/2470827184 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2100cded0 msgr2=0x7fa2100b34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:02.017 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:02.014+0000 7fa216ba0640 1 --2- 172.21.15.102:0/2470827184 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2100cded0 0x7fa2100b34f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa20000c780 tx=0x7fa20000cc40 comp rx=0 tx=0).stop 2023-10-14T09:37:02.017 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:02.014+0000 7fa216ba0640 1 -- 172.21.15.102:0/2470827184 shutdown_connections 2023-10-14T09:37:02.017 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:02.014+0000 7fa216ba0640 1 --2- 172.21.15.102:0/2470827184 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa21015cd70 0x7fa2100cbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:02.018 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:02.014+0000 7fa216ba0640 1 --2- 172.21.15.102:0/2470827184 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2100cded0 0x7fa2100b34f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:02.018 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:02.015+0000 7fa216ba0640 1 --2- 172.21.15.102:0/2470827184 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa2100b8480 0x7fa2101f3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:02.018 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:02.015+0000 7fa216ba0640 1 -- 172.21.15.102:0/2470827184 >> 172.21.15.102:0/2470827184 conn(0x7fa2100cf570 msgr2=0x7fa2100b7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:02.018 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:02.015+0000 7fa216ba0640 1 -- 172.21.15.102:0/2470827184 shutdown_connections 2023-10-14T09:37:02.019 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:02.015+0000 7fa216ba0640 1 -- 172.21.15.102:0/2470827184 wait complete. 2023-10-14T09:37:02.030 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-14T09:37:02.116 INFO:tasks.ceph.mgr.x.smithi129.stderr:2023-10-14T09:37:02.114+0000 7f06c3613040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-14T09:37:02.895 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-10-14T09:37:02.894+0000 7f0011d36640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-14T09:37:02.896 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-10-14T09:37:02.894+0000 7f0011d36640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-14T09:37:04.851 INFO:tasks.ceph.osd.0.smithi102.stderr:2023-10-14T09:37:04.849+0000 7f932e616500 -1 osd.0 0 log_to_monitors true 2023-10-14T09:37:04.862 INFO:tasks.ceph.osd.5.smithi129.stderr:2023-10-14T09:37:04.860+0000 7f8247fad500 -1 osd.5 0 log_to_monitors true 2023-10-14T09:37:04.890 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-10-14T09:37:04.889+0000 7f53c218d500 -1 osd.1 0 log_to_monitors true 2023-10-14T09:37:04.910 INFO:tasks.ceph.osd.6.smithi129.stderr:2023-10-14T09:37:04.908+0000 7f0d96c25500 -1 osd.6 0 log_to_monitors true 2023-10-14T09:37:04.920 INFO:tasks.ceph.osd.2.smithi102.stderr:2023-10-14T09:37:04.918+0000 7f7bfc414500 -1 osd.2 0 log_to_monitors true 2023-10-14T09:37:04.926 INFO:tasks.ceph.osd.4.smithi129.stderr:2023-10-14T09:37:04.924+0000 7f9573e16500 -1 osd.4 0 log_to_monitors true 2023-10-14T09:37:04.929 INFO:tasks.ceph.osd.3.smithi102.stderr:2023-10-14T09:37:04.928+0000 7f36f698d500 -1 osd.3 0 log_to_monitors true 2023-10-14T09:37:04.956 INFO:tasks.ceph.osd.7.smithi129.stderr:2023-10-14T09:37:04.954+0000 7f8551210500 -1 osd.7 0 log_to_monitors true 2023-10-14T09:37:07.179 INFO:tasks.ceph.osd.0.smithi102.stderr:2023-10-14T09:37:07.177+0000 7f93296c1640 -1 osd.0 0 waiting for initial osdmap 2023-10-14T09:37:07.229 INFO:tasks.ceph.osd.0.smithi102.stderr:2023-10-14T09:37:07.227+0000 7f9321cf3640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T09:37:07.233 INFO:tasks.ceph.osd.5.smithi129.stderr:2023-10-14T09:37:07.231+0000 7f8243716640 -1 osd.5 0 waiting for initial osdmap 2023-10-14T09:37:07.358 INFO:tasks.ceph.osd.5.smithi129.stderr:2023-10-14T09:37:07.356+0000 7f823bd48640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T09:37:08.782 INFO:tasks.ceph.osd.3.smithi102.stderr:2023-10-14T09:37:08.780+0000 7f36f20f8640 -1 osd.3 0 waiting for initial osdmap 2023-10-14T09:37:08.789 INFO:tasks.ceph.osd.6.smithi129.stderr:2023-10-14T09:37:08.786+0000 7f0d92390640 -1 osd.6 0 waiting for initial osdmap 2023-10-14T09:37:08.798 INFO:tasks.ceph.osd.3.smithi102.stderr:2023-10-14T09:37:08.796+0000 7f36ea72a640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T09:37:08.804 INFO:tasks.ceph.osd.6.smithi129.stderr:2023-10-14T09:37:08.802+0000 7f0d8a9c2640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T09:37:08.822 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-10-14T09:37:08.820+0000 7f53bd8f6640 -1 osd.1 0 waiting for initial osdmap 2023-10-14T09:37:08.827 INFO:tasks.ceph.osd.4.smithi129.stderr:2023-10-14T09:37:08.825+0000 7f956f051640 -1 osd.4 0 waiting for initial osdmap 2023-10-14T09:37:08.836 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-14T09:37:08.837 INFO:tasks.ceph.osd.7.smithi129.stderr:2023-10-14T09:37:08.834+0000 7f854c2ba640 -1 osd.7 0 waiting for initial osdmap 2023-10-14T09:37:08.837 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-10-14T09:37:08.835+0000 7f53b5f28640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T09:37:08.842 INFO:tasks.ceph.osd.2.smithi102.stderr:2023-10-14T09:37:08.841+0000 7f7bf75a8640 -1 osd.2 0 waiting for initial osdmap 2023-10-14T09:37:08.845 INFO:tasks.ceph.osd.4.smithi129.stderr:2023-10-14T09:37:08.843+0000 7f9567683640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T09:37:08.855 INFO:tasks.ceph.osd.7.smithi129.stderr:2023-10-14T09:37:08.853+0000 7f85448ec640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T09:37:08.861 INFO:tasks.ceph.osd.2.smithi102.stderr:2023-10-14T09:37:08.860+0000 7f7befbda640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T09:37:08.984 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.982+0000 7fabd2539640 1 Processor -- start 2023-10-14T09:37:08.985 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.982+0000 7fabd2539640 1 -- start start 2023-10-14T09:37:08.986 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.984+0000 7fabd2539640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fabcc159b20 0x7fabcc06bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:08.987 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.984+0000 7fabd2539640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fabcc159f00 0x7fabcc0b0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:08.987 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.984+0000 7fabd2539640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabcc06f7f0 con 0x7fabcc06c120 2023-10-14T09:37:08.987 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.984+0000 7fabd2539640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabcc06c5e0 con 0x7fabcc159f00 2023-10-14T09:37:08.987 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.984+0000 7fabd2539640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabcc06c8c0 con 0x7fabcc159b20 2023-10-14T09:37:08.987 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.984+0000 7fabc3fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fabcc159f00 0x7fabcc0b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:08.988 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.984+0000 7fabc3fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fabcc159f00 0x7fabcc0b0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39356/0 (socket says 172.21.15.102:39356) 2023-10-14T09:37:08.988 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.984+0000 7fabc3fff640 1 -- 172.21.15.102:0/2925201266 learned_addr learned my addr 172.21.15.102:0/2925201266 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:08.988 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.984+0000 7fabcbfff640 1 --2- 172.21.15.102:0/2925201266 >> v2:172.21.15.129:3300/0 conn(0x7fabcc159b20 0x7fabcc06bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:08.988 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.984+0000 7fabc3fff640 1 -- 172.21.15.102:0/2925201266 >> v2:172.21.15.129:3300/0 conn(0x7fabcc159b20 msgr2=0x7fabcc06bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:08.988 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.984+0000 7fabc3fff640 1 --2- 172.21.15.102:0/2925201266 >> v2:172.21.15.129:3300/0 conn(0x7fabcc159b20 0x7fabcc06bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:08.989 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.984+0000 7fabc3fff640 1 -- 172.21.15.102:0/2925201266 >> v1:172.21.15.129:6789/0 conn(0x7fabcc06c120 legacy=0x7fabcc0cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:08.989 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.984+0000 7fabc3fff640 1 -- 172.21.15.102:0/2925201266 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabcc06cba0 con 0x7fabcc159f00 2023-10-14T09:37:08.990 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.985+0000 7fabc3fff640 1 --2- 172.21.15.102:0/2925201266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabcc159f00 0x7fabcc0b0410 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fabcc0c9340 tx=0x7fabb402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a1b79a87b33b6d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:08.990 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.986+0000 7fabcb7fe640 1 -- 172.21.15.102:0/2925201266 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb4031870 con 0x7fabcc159f00 2023-10-14T09:37:08.991 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.986+0000 7fabcb7fe640 1 -- 172.21.15.102:0/2925201266 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb40319d0 con 0x7fabcc159f00 2023-10-14T09:37:08.993 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.986+0000 7fabcb7fe640 1 -- 172.21.15.102:0/2925201266 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb4031d60 con 0x7fabcc159f00 2023-10-14T09:37:08.993 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.986+0000 7fabd2539640 1 -- 172.21.15.102:0/2925201266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabcc159f00 msgr2=0x7fabcc0b0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:08.993 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.986+0000 7fabd2539640 1 --2- 172.21.15.102:0/2925201266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabcc159f00 0x7fabcc0b0410 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fabcc0c9340 tx=0x7fabb402b910 comp rx=0 tx=0).stop 2023-10-14T09:37:08.994 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.986+0000 7fabd2539640 1 -- 172.21.15.102:0/2925201266 shutdown_connections 2023-10-14T09:37:08.994 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.986+0000 7fabd2539640 1 --2- 172.21.15.102:0/2925201266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabcc159f00 0x7fabcc0b0410 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:08.994 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.986+0000 7fabd2539640 1 --2- 172.21.15.102:0/2925201266 >> v2:172.21.15.129:3300/0 conn(0x7fabcc159b20 0x7fabcc06bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:08.994 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.986+0000 7fabd2539640 1 -- 172.21.15.102:0/2925201266 >> 172.21.15.102:0/2925201266 conn(0x7fabcc0cb410 msgr2=0x7fabcc0cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:08.994 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.987+0000 7fabd2539640 1 -- 172.21.15.102:0/2925201266 shutdown_connections 2023-10-14T09:37:08.995 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.987+0000 7fabd2539640 1 -- 172.21.15.102:0/2925201266 wait complete. 2023-10-14T09:37:08.995 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.988+0000 7fabd2539640 1 Processor -- start 2023-10-14T09:37:08.995 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.989+0000 7fabd2539640 1 -- start start 2023-10-14T09:37:08.997 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.990+0000 7fabd2539640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fabcc06c120 0x7fabcc0c7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:08.998 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.990+0000 7fabd2539640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabcc159b20 0x7fabcc0c3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:08.998 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.990+0000 7fabd2539640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fabcc159f00 0x7fabcc14eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:08.998 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.990+0000 7fabd2539640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabcc14f400 con 0x7fabcc159b20 2023-10-14T09:37:08.998 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.990+0000 7fabd2539640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabcc0c8990 con 0x7fabcc06c120 2023-10-14T09:37:08.998 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.990+0000 7fabd2539640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabcc0c2a80 con 0x7fabcc159f00 2023-10-14T09:37:08.999 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.990+0000 7fabc3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabcc159b20 0x7fabcc0c3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:08.999 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.990+0000 7fabc3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabcc159b20 0x7fabcc0c3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39368/0 (socket says 172.21.15.102:39368) 2023-10-14T09:37:08.999 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.990+0000 7fabc3fff640 1 -- 172.21.15.102:0/1700832489 learned_addr learned my addr 172.21.15.102:0/1700832489 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:08.999 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.990+0000 7fabc3fff640 1 -- 172.21.15.102:0/1700832489 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fabcc159f00 msgr2=0x7fabcc14eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:08.999 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.990+0000 7fabc3fff640 1 --2- 172.21.15.102:0/1700832489 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fabcc159f00 0x7fabcc14eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:09.000 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.990+0000 7fabc3fff640 1 -- 172.21.15.102:0/1700832489 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fabcc06c120 msgr2=0x7fabcc0c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:09.000 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.990+0000 7fabc3fff640 1 --2- 172.21.15.102:0/1700832489 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fabcc06c120 0x7fabcc0c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:09.000 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.990+0000 7fabc3fff640 1 -- 172.21.15.102:0/1700832489 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb40094d0 con 0x7fabcc159b20 2023-10-14T09:37:09.000 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.990+0000 7fabc3fff640 1 --2- 172.21.15.102:0/1700832489 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabcc159b20 0x7fabcc0c3b20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fabb4000c00 tx=0x7fabb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:09.000 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.991+0000 7fabc97fa640 1 -- 172.21.15.102:0/1700832489 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb403abe0 con 0x7fabcc159b20 2023-10-14T09:37:09.001 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.991+0000 7fabc97fa640 1 -- 172.21.15.102:0/1700832489 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb403ad40 con 0x7fabcc159b20 2023-10-14T09:37:09.001 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.991+0000 7fabd2539640 1 -- 172.21.15.102:0/1700832489 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabcc0c2d60 con 0x7fabcc159b20 2023-10-14T09:37:09.001 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.991+0000 7fabc97fa640 1 -- 172.21.15.102:0/1700832489 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb4044610 con 0x7fabcc159b20 2023-10-14T09:37:09.001 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.991+0000 7fabd2539640 1 -- 172.21.15.102:0/1700832489 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabcc0c3320 con 0x7fabcc159b20 2023-10-14T09:37:09.002 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.992+0000 7fabd2539640 1 -- 172.21.15.102:0/1700832489 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabcc0c54b0 con 0x7fabcc159b20 2023-10-14T09:37:09.002 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.993+0000 7fabc97fa640 1 -- 172.21.15.102:0/1700832489 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7fabb404d450 con 0x7fabcc159b20 2023-10-14T09:37:09.002 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.994+0000 7fabc97fa640 1 --2- 172.21.15.102:0/1700832489 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fabac06ae30 0x7fabac06d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:09.002 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.994+0000 7fabc97fa640 1 -- 172.21.15.102:0/1700832489 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2791+0+0 (secure 0 0 0) 0x7fabb402d040 con 0x7fabcc159b20 2023-10-14T09:37:09.002 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.994+0000 7fabcbfff640 1 --2- 172.21.15.102:0/1700832489 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fabac06ae30 0x7fabac06d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:09.003 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.994+0000 7fabcbfff640 1 --2- 172.21.15.102:0/1700832489 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fabac06ae30 0x7fabac06d2f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fabbc0098f0 tx=0x7fabbc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:09.003 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:08.999+0000 7fabc97fa640 1 -- 172.21.15.102:0/1700832489 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fabb4076d00 con 0x7fabcc159b20 2023-10-14T09:37:09.177 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:09.175+0000 7fabd2539640 1 -- 172.21.15.102:0/1700832489 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabcc04e160 con 0x7fabcc159b20 2023-10-14T09:37:09.178 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:09.177+0000 7fabc97fa640 1 -- 172.21.15.102:0/1700832489 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+8052 (secure 0 0 0) 0x7fabb4035070 con 0x7fabcc159b20 2023-10-14T09:37:09.179 INFO:teuthology.misc.health.smithi102.stdout: 2023-10-14T09:37:09.179 INFO:teuthology.misc.health.smithi102.stdout:{"epoch":14,"fsid":"8a6cd69d-7f5b-4f2a-806a-0176c10aed50","created":"2023-10-14T09:36:56.745172+0000","modified":"2023-10-14T09:37:08.198770+0000","last_up_change":"2023-10-14T09:37:08.198770+0000","last_in_change":"2023-10-14T09:37:00.547186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e5aef8f3-878f-482b-b522-9a5b958b90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6801","nonce":1727250718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6803","nonce":1727250718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6807","nonce":1727250718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6805","nonce":1727250718}]},"public_addr":"172.21.15.102:6801/1727250718","cluster_addr":"172.21.15.102:6803/1727250718","heartbeat_back_addr":"172.21.15.102:6807/1727250718","heartbeat_front_addr":"172.21.15.102:6805/1727250718","state":["exists","up"]},{"osd":1,"uuid":"4a8cf50e-387b-4d47-9588-bd22e375a9ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"009ef55f-8a63-4219-bacd-d7c7b4500867","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f2110eae-2ff9-4ed9-93d6-bd2361618211","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"33f1ae34-3100-40f7-9cb8-0eca2b358693","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fab2fc62-3f3e-450d-93e0-770f39e80710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6801","nonce":1913451073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6803","nonce":1913451073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6807","nonce":1913451073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6805","nonce":1913451073}]},"public_addr":"172.21.15.129:6801/1913451073","cluster_addr":"172.21.15.129:6803/1913451073","heartbeat_back_addr":"172.21.15.129:6807/1913451073","heartbeat_front_addr":"172.21.15.129:6805/1913451073","state":["exists","up"]},{"osd":6,"uuid":"d7cc1d69-92e7-4253-a127-cfc0444a4809","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1e403de1-09e2-4370-b9a7-e790ac44bbee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:37:09.181 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:09.179+0000 7fabd2539640 1 -- 172.21.15.102:0/1700832489 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fabac06ae30 msgr2=0x7fabac06d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:09.181 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:09.179+0000 7fabd2539640 1 --2- 172.21.15.102:0/1700832489 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fabac06ae30 0x7fabac06d2f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fabbc0098f0 tx=0x7fabbc008040 comp rx=0 tx=0).stop 2023-10-14T09:37:09.181 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:09.179+0000 7fabd2539640 1 -- 172.21.15.102:0/1700832489 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabcc159b20 msgr2=0x7fabcc0c3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:09.182 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:09.179+0000 7fabd2539640 1 --2- 172.21.15.102:0/1700832489 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabcc159b20 0x7fabcc0c3b20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fabb4000c00 tx=0x7fabb40046c0 comp rx=0 tx=0).stop 2023-10-14T09:37:09.182 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:09.179+0000 7fabd2539640 1 -- 172.21.15.102:0/1700832489 shutdown_connections 2023-10-14T09:37:09.182 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:09.179+0000 7fabd2539640 1 --2- 172.21.15.102:0/1700832489 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fabac06ae30 0x7fabac06d2f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:09.182 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:09.179+0000 7fabd2539640 1 --2- 172.21.15.102:0/1700832489 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fabcc159f00 0x7fabcc14eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:09.182 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:09.179+0000 7fabd2539640 1 --2- 172.21.15.102:0/1700832489 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabcc159b20 0x7fabcc0c3b20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:09.183 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:09.179+0000 7fabd2539640 1 --2- 172.21.15.102:0/1700832489 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fabcc06c120 0x7fabcc0c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:09.183 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:09.179+0000 7fabd2539640 1 -- 172.21.15.102:0/1700832489 >> 172.21.15.102:0/1700832489 conn(0x7fabcc0cb410 msgr2=0x7fabcc06d370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:09.183 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:09.179+0000 7fabd2539640 1 -- 172.21.15.102:0/1700832489 shutdown_connections 2023-10-14T09:37:09.183 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:09.179+0000 7fabd2539640 1 -- 172.21.15.102:0/1700832489 wait complete. 2023-10-14T09:37:09.197 DEBUG:teuthology.misc:2 of 8 OSDs are up 2023-10-14T09:37:16.003 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-14T09:37:16.188 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.186+0000 7f2f01a4d640 1 Processor -- start 2023-10-14T09:37:16.188 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.186+0000 7f2f01a4d640 1 -- start start 2023-10-14T09:37:16.190 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.187+0000 7f2f01a4d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2efc070b60 0x7f2efc15a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:16.190 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.187+0000 7f2f01a4d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2efc15aef0 con 0x7f2efc159950 2023-10-14T09:37:16.190 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.187+0000 7f2f01a4d640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2efc15d910 con 0x7f2efc06c100 2023-10-14T09:37:16.190 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.187+0000 7f2f01a4d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2efc15e490 con 0x7f2efc070b60 2023-10-14T09:37:16.191 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.187+0000 7f2f00a4b640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f2efc159950 0x7f2efc070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:57670/0 (socket says 172.21.15.102:57670) 2023-10-14T09:37:16.191 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.187+0000 7f2f00a4b640 1 -- 172.21.15.102:0/1855005947 learned_addr learned my addr 172.21.15.102:0/1855005947 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:16.191 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.188+0000 7f2efbfff640 1 --2- 172.21.15.102:0/1855005947 >> v2:172.21.15.102:3300/0 conn(0x7f2efc070b60 0x7f2efc15a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:16.191 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.188+0000 7f2efbfff640 1 -- 172.21.15.102:0/1855005947 >> v1:172.21.15.129:6789/0 conn(0x7f2efc06c100 legacy=0x7f2efc06c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:16.191 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.188+0000 7f2efb7fe640 1 -- 172.21.15.102:0/1855005947 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 119878903 0 0) 0x7f2eec001490 con 0x7f2efc159950 2023-10-14T09:37:16.192 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.188+0000 7f2efbfff640 1 -- 172.21.15.102:0/1855005947 >> v1:172.21.15.102:6789/0 conn(0x7f2efc159950 legacy=0x7f2efc070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:16.192 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.188+0000 7f2efbfff640 1 -- 172.21.15.102:0/1855005947 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2efc15dbf0 con 0x7f2efc070b60 2023-10-14T09:37:16.193 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.189+0000 7f2efbfff640 1 --2- 172.21.15.102:0/1855005947 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2efc070b60 0x7f2efc15a9b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2ee40097a0 tx=0x7f2ee402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c39e47cb8a813c78 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:16.194 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.189+0000 7f2efb7fe640 1 -- 172.21.15.102:0/1855005947 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee402e070 con 0x7f2efc070b60 2023-10-14T09:37:16.194 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.189+0000 7f2efb7fe640 1 -- 172.21.15.102:0/1855005947 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee40315a0 con 0x7f2efc070b60 2023-10-14T09:37:16.194 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.189+0000 7f2efb7fe640 1 -- 172.21.15.102:0/1855005947 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee4031930 con 0x7f2efc070b60 2023-10-14T09:37:16.195 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.190+0000 7f2f01a4d640 1 -- 172.21.15.102:0/1855005947 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2efc070b60 msgr2=0x7f2efc15a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:16.195 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.190+0000 7f2f01a4d640 1 --2- 172.21.15.102:0/1855005947 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2efc070b60 0x7f2efc15a9b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2ee40097a0 tx=0x7f2ee402b840 comp rx=0 tx=0).stop 2023-10-14T09:37:16.195 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.190+0000 7f2f01a4d640 1 -- 172.21.15.102:0/1855005947 shutdown_connections 2023-10-14T09:37:16.195 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.190+0000 7f2f01a4d640 1 --2- 172.21.15.102:0/1855005947 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2efc070b60 0x7f2efc15a9b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:16.196 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.190+0000 7f2f01a4d640 1 -- 172.21.15.102:0/1855005947 >> 172.21.15.102:0/1855005947 conn(0x7f2efc0ce6a0 msgr2=0x7f2efc0ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:16.196 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.190+0000 7f2f01a4d640 1 -- 172.21.15.102:0/1855005947 shutdown_connections 2023-10-14T09:37:16.196 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.190+0000 7f2f01a4d640 1 -- 172.21.15.102:0/1855005947 wait complete. 2023-10-14T09:37:16.196 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.192+0000 7f2f01a4d640 1 Processor -- start 2023-10-14T09:37:16.196 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.192+0000 7f2f01a4d640 1 -- start start 2023-10-14T09:37:16.198 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.193+0000 7f2f01a4d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2efc06c100 0x7f2efc0c5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:16.199 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.193+0000 7f2f01a4d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2efc070b60 0x7f2efc0c21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:16.199 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.193+0000 7f2f01a4d640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2efc159950 0x7f2efc153fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:16.199 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.193+0000 7f2f01a4d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc0c26f0 con 0x7f2efc06c100 2023-10-14T09:37:16.199 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.193+0000 7f2f01a4d640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc1544f0 con 0x7f2efc070b60 2023-10-14T09:37:16.200 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.193+0000 7f2f01a4d640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc0c4cb0 con 0x7f2efc159950 2023-10-14T09:37:16.200 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.193+0000 7f2f00a4b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2efc06c100 0x7f2efc0c5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:16.200 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.193+0000 7f2f00a4b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2efc06c100 0x7f2efc0c5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49136/0 (socket says 172.21.15.102:49136) 2023-10-14T09:37:16.200 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.193+0000 7f2f00a4b640 1 -- 172.21.15.102:0/2367597732 learned_addr learned my addr 172.21.15.102:0/2367597732 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:16.200 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.193+0000 7f2f00a4b640 1 -- 172.21.15.102:0/2367597732 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2efc159950 msgr2=0x7f2efc153fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:16.200 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.193+0000 7f2f00a4b640 1 --2- 172.21.15.102:0/2367597732 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2efc159950 0x7f2efc153fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:16.201 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.193+0000 7f2f00a4b640 1 -- 172.21.15.102:0/2367597732 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2efc070b60 msgr2=0x7f2efc0c21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:16.201 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.193+0000 7f2f00a4b640 1 --2- 172.21.15.102:0/2367597732 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2efc070b60 0x7f2efc0c21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:16.201 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.193+0000 7f2f00a4b640 1 -- 172.21.15.102:0/2367597732 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee4009400 con 0x7f2efc06c100 2023-10-14T09:37:16.201 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.194+0000 7f2f00a4b640 1 --2- 172.21.15.102:0/2367597732 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2efc06c100 0x7f2efc0c5140 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2eec00c7f0 tx=0x7f2eec00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:16.201 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.194+0000 7f2ef97fa640 1 -- 172.21.15.102:0/2367597732 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec00a5e0 con 0x7f2efc06c100 2023-10-14T09:37:16.202 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.194+0000 7f2ef97fa640 1 -- 172.21.15.102:0/2367597732 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eec00a760 con 0x7f2efc06c100 2023-10-14T09:37:16.202 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.194+0000 7f2f01a4d640 1 -- 172.21.15.102:0/2367597732 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2efc0c8650 con 0x7f2efc06c100 2023-10-14T09:37:16.202 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.194+0000 7f2ef97fa640 1 -- 172.21.15.102:0/2367597732 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec00ab10 con 0x7f2efc06c100 2023-10-14T09:37:16.202 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.194+0000 7f2f01a4d640 1 -- 172.21.15.102:0/2367597732 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2efc0c4660 con 0x7f2efc06c100 2023-10-14T09:37:16.202 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.195+0000 7f2f01a4d640 1 -- 172.21.15.102:0/2367597732 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2efc04e9b0 con 0x7f2efc06c100 2023-10-14T09:37:16.203 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.196+0000 7f2ef97fa640 1 -- 172.21.15.102:0/2367597732 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2eec00ac70 con 0x7f2efc06c100 2023-10-14T09:37:16.203 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.197+0000 7f2ef97fa640 1 --2- 172.21.15.102:0/2367597732 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2edc06ae70 0x7f2edc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:16.203 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.198+0000 7f2ef97fa640 1 -- 172.21.15.102:0/2367597732 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2eec0885d0 con 0x7f2efc06c100 2023-10-14T09:37:16.204 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.198+0000 7f2efbfff640 1 --2- 172.21.15.102:0/2367597732 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2edc06ae70 0x7f2edc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:16.204 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.198+0000 7f2efbfff640 1 --2- 172.21.15.102:0/2367597732 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2edc06ae70 0x7f2edc06d330 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4036000 tx=0x7f2ee4030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:16.205 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.203+0000 7f2ef97fa640 1 -- 172.21.15.102:0/2367597732 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2eec053930 con 0x7f2efc06c100 2023-10-14T09:37:16.395 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.393+0000 7f2f01a4d640 1 -- 172.21.15.102:0/2367597732 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2efc15aef0 con 0x7f2efc06c100 2023-10-14T09:37:16.397 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.396+0000 7f2ef97fa640 1 -- 172.21.15.102:0/2367597732 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12886 (secure 0 0 0) 0x7f2efc15aef0 con 0x7f2efc06c100 2023-10-14T09:37:16.398 INFO:teuthology.misc.health.smithi102.stdout: 2023-10-14T09:37:16.398 INFO:teuthology.misc.health.smithi102.stdout:{"epoch":18,"fsid":"8a6cd69d-7f5b-4f2a-806a-0176c10aed50","created":"2023-10-14T09:36:56.745172+0000","modified":"2023-10-14T09:37:12.810688+0000","last_up_change":"2023-10-14T09:37:09.791473+0000","last_in_change":"2023-10-14T09:37:00.547186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:37:09.952407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e5aef8f3-878f-482b-b522-9a5b958b90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6801","nonce":1727250718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6803","nonce":1727250718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6807","nonce":1727250718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6805","nonce":1727250718}]},"public_addr":"172.21.15.102:6801/1727250718","cluster_addr":"172.21.15.102:6803/1727250718","heartbeat_back_addr":"172.21.15.102:6807/1727250718","heartbeat_front_addr":"172.21.15.102:6805/1727250718","state":["exists","up"]},{"osd":1,"uuid":"4a8cf50e-387b-4d47-9588-bd22e375a9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6809","nonce":1095651107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6811","nonce":1095651107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6815","nonce":1095651107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6813","nonce":1095651107}]},"public_addr":"172.21.15.102:6809/1095651107","cluster_addr":"172.21.15.102:6811/1095651107","heartbeat_back_addr":"172.21.15.102:6815/1095651107","heartbeat_front_addr":"172.21.15.102:6813/1095651107","state":["exists","up"]},{"osd":2,"uuid":"009ef55f-8a63-4219-bacd-d7c7b4500867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6820","nonce":2198222556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6825","nonce":2198222556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6831","nonce":2198222556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6829","nonce":2198222556}]},"public_addr":"172.21.15.102:6820/2198222556","cluster_addr":"172.21.15.102:6825/2198222556","heartbeat_back_addr":"172.21.15.102:6831/2198222556","heartbeat_front_addr":"172.21.15.102:6829/2198222556","state":["exists","up"]},{"osd":3,"uuid":"f2110eae-2ff9-4ed9-93d6-bd2361618211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6818","nonce":654726740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6821","nonce":654726740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6827","nonce":654726740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6823","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6824","nonce":654726740}]},"public_addr":"172.21.15.102:6818/654726740","cluster_addr":"172.21.15.102:6821/654726740","heartbeat_back_addr":"172.21.15.102:6827/654726740","heartbeat_front_addr":"172.21.15.102:6824/654726740","state":["exists","up"]},{"osd":4,"uuid":"33f1ae34-3100-40f7-9cb8-0eca2b358693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6817","nonce":507586170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6819","nonce":507586170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6823","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6825","nonce":507586170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6821","nonce":507586170}]},"public_addr":"172.21.15.129:6817/507586170","cluster_addr":"172.21.15.129:6819/507586170","heartbeat_back_addr":"172.21.15.129:6825/507586170","heartbeat_front_addr":"172.21.15.129:6821/507586170","state":["exists","up"]},{"osd":5,"uuid":"fab2fc62-3f3e-450d-93e0-770f39e80710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6801","nonce":1913451073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6803","nonce":1913451073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6807","nonce":1913451073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6805","nonce":1913451073}]},"public_addr":"172.21.15.129:6801/1913451073","cluster_addr":"172.21.15.129:6803/1913451073","heartbeat_back_addr":"172.21.15.129:6807/1913451073","heartbeat_front_addr":"172.21.15.129:6805/1913451073","state":["exists","up"]},{"osd":6,"uuid":"d7cc1d69-92e7-4253-a127-cfc0444a4809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6809","nonce":2853291511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6811","nonce":2853291511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6815","nonce":2853291511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6813","nonce":2853291511}]},"public_addr":"172.21.15.129:6809/2853291511","cluster_addr":"172.21.15.129:6811/2853291511","heartbeat_back_addr":"172.21.15.129:6815/2853291511","heartbeat_front_addr":"172.21.15.129:6813/2853291511","state":["exists","up"]},{"osd":7,"uuid":"1e403de1-09e2-4370-b9a7-e790ac44bbee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6824","nonce":2933886914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6827","nonce":2933886914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6831","nonce":2933886914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6829","nonce":2933886914}]},"public_addr":"172.21.15.129:6824/2933886914","cluster_addr":"172.21.15.129:6827/2933886914","heartbeat_back_addr":"172.21.15.129:6831/2933886914","heartbeat_front_addr":"172.21.15.129:6829/2933886914","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.849661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.868113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.933488+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.891794+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.901861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.858750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.911712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.996765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:37:16.400 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.398+0000 7f2f01a4d640 1 -- 172.21.15.102:0/2367597732 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2edc06ae70 msgr2=0x7f2edc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:16.400 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.398+0000 7f2f01a4d640 1 --2- 172.21.15.102:0/2367597732 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2edc06ae70 0x7f2edc06d330 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4036000 tx=0x7f2ee4030000 comp rx=0 tx=0).stop 2023-10-14T09:37:16.401 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.398+0000 7f2f01a4d640 1 -- 172.21.15.102:0/2367597732 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2efc06c100 msgr2=0x7f2efc0c5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:16.401 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.398+0000 7f2f01a4d640 1 --2- 172.21.15.102:0/2367597732 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2efc06c100 0x7f2efc0c5140 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2eec00c7f0 tx=0x7f2eec00ccb0 comp rx=0 tx=0).stop 2023-10-14T09:37:16.401 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.398+0000 7f2f01a4d640 1 -- 172.21.15.102:0/2367597732 shutdown_connections 2023-10-14T09:37:16.401 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.398+0000 7f2f01a4d640 1 --2- 172.21.15.102:0/2367597732 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2edc06ae70 0x7f2edc06d330 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:16.401 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.398+0000 7f2f01a4d640 1 --2- 172.21.15.102:0/2367597732 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2efc159950 0x7f2efc153fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:16.402 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.398+0000 7f2f01a4d640 1 --2- 172.21.15.102:0/2367597732 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2efc070b60 0x7f2efc0c21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:16.402 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.398+0000 7f2f01a4d640 1 --2- 172.21.15.102:0/2367597732 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2efc06c100 0x7f2efc0c5140 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:16.402 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.398+0000 7f2f01a4d640 1 -- 172.21.15.102:0/2367597732 >> 172.21.15.102:0/2367597732 conn(0x7f2efc0ce6a0 msgr2=0x7f2efc070450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:16.402 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.399+0000 7f2f01a4d640 1 -- 172.21.15.102:0/2367597732 shutdown_connections 2023-10-14T09:37:16.403 INFO:teuthology.misc.health.smithi102.stderr:2023-10-14T09:37:16.399+0000 7f2f01a4d640 1 -- 172.21.15.102:0/2367597732 wait complete. 2023-10-14T09:37:16.415 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-14T09:37:16.415 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-14T09:37:16.416 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T09:37:16.416 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T09:37:16.423 INFO:tasks.ceph.mds.a:Started 2023-10-14T09:37:16.424 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T09:37:16.424 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T09:37:16.430 INFO:tasks.ceph.mds.c:Started 2023-10-14T09:37:16.431 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T09:37:16.431 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T09:37:16.440 INFO:tasks.ceph.mds.b:Started 2023-10-14T09:37:16.440 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T09:37:16.441 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T09:37:16.451 INFO:tasks.ceph.mds.d:Started 2023-10-14T09:37:16.451 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-14T09:37:16.451 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:37:16.575 INFO:tasks.ceph.mds.a.smithi102.stdout:starting mds.a at 2023-10-14T09:37:16.577 INFO:tasks.ceph.mds.c.smithi102.stdout:starting mds.c at 2023-10-14T09:37:16.610 INFO:tasks.ceph.mds.d.smithi129.stdout:starting mds.d at 2023-10-14T09:37:16.610 INFO:tasks.ceph.mds.b.smithi129.stdout:starting mds.b at 2023-10-14T09:37:16.633 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.631+0000 7f56545e2640 1 Processor -- start 2023-10-14T09:37:16.633 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.631+0000 7f56545e2640 1 -- start start 2023-10-14T09:37:16.634 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.632+0000 7f56545e2640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f564c0cfdd0 0x7f564c0b0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:16.634 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.632+0000 7f56545e2640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f564c0b09c0 0x7f564c15d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:16.635 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.632+0000 7f56545e2640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f564c0cf940 con 0x7f564c06b8c0 2023-10-14T09:37:16.635 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.632+0000 7f56545e2640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f564c0ce990 con 0x7f564c0b09c0 2023-10-14T09:37:16.635 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.632+0000 7f56545e2640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564c15e290 con 0x7f564c0cfdd0 2023-10-14T09:37:16.635 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.632+0000 7f565237e640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f564c06b8c0 0x7f564c06bca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:57692/0 (socket says 172.21.15.102:57692) 2023-10-14T09:37:16.636 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.632+0000 7f565237e640 1 -- 172.21.15.102:0/2496401083 learned_addr learned my addr 172.21.15.102:0/2496401083 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:16.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.633+0000 7f565137c640 1 -- 172.21.15.102:0/2496401083 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2765937454 0 0) 0x7f564c0cf940 con 0x7f564c06b8c0 2023-10-14T09:37:16.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.633+0000 7f565137c640 1 -- 172.21.15.102:0/2496401083 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5638003520 con 0x7f564c06b8c0 2023-10-14T09:37:16.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.633+0000 7f5651b7d640 1 --2- 172.21.15.102:0/2496401083 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f564c0cfdd0 0x7f564c0b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:16.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.633+0000 7f5652b7f640 1 --2- 172.21.15.102:0/2496401083 >> v2:172.21.15.129:3300/0 conn(0x7f564c0b09c0 0x7f564c15d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:16.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.633+0000 7f565137c640 1 -- 172.21.15.102:0/2496401083 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 349362422 0 0) 0x7f5638003520 con 0x7f564c06b8c0 2023-10-14T09:37:16.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.633+0000 7f565137c640 1 -- 172.21.15.102:0/2496401083 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f564c0cfdd0 msgr2=0x7f564c0b0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:16.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.633+0000 7f565137c640 1 --2- 172.21.15.102:0/2496401083 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f564c0cfdd0 0x7f564c0b0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:16.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.633+0000 7f565137c640 1 -- 172.21.15.102:0/2496401083 >> v2:172.21.15.129:3300/0 conn(0x7f564c0b09c0 msgr2=0x7f564c15d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:16.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.633+0000 7f565137c640 1 --2- 172.21.15.102:0/2496401083 >> v2:172.21.15.129:3300/0 conn(0x7f564c0b09c0 0x7f564c15d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:16.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.633+0000 7f565137c640 1 -- 172.21.15.102:0/2496401083 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564c0cf010 con 0x7f564c06b8c0 2023-10-14T09:37:16.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.633+0000 7f565137c640 1 -- 172.21.15.102:0/2496401083 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4030661168 0 0) 0x7f56480017f0 con 0x7f564c06b8c0 2023-10-14T09:37:16.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.633+0000 7f565137c640 1 -- 172.21.15.102:0/2496401083 >> v1:172.21.15.102:6789/0 conn(0x7f564c06b8c0 legacy=0x7f564c06bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:16.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.633+0000 7f565137c640 1 --2- 172.21.15.102:0/2496401083 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5638003970 0x7f5638003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:16.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.633+0000 7f565137c640 1 --2- 172.21.15.102:0/2496401083 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f564c0cfdd0 0x7f56380047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:16.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.633+0000 7f565137c640 1 --2- 172.21.15.102:0/2496401083 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5638004d00 0x7f5638005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:16.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.633+0000 7f565137c640 1 -- 172.21.15.102:0/2496401083 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564c15e290 con 0x7f5638004d00 2023-10-14T09:37:16.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.633+0000 7f565137c640 1 -- 172.21.15.102:0/2496401083 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563800b980 con 0x7f5638003970 2023-10-14T09:37:16.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.633+0000 7f565137c640 1 -- 172.21.15.102:0/2496401083 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f563800bac0 con 0x7f564c0cfdd0 2023-10-14T09:37:16.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.633+0000 7f5652b7f640 1 --2- 172.21.15.102:0/2496401083 >> v2:172.21.15.129:3300/0 conn(0x7f564c0b09c0 0x7f564c15d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:37:16.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.634+0000 7f565237e640 1 --2- 172.21.15.102:0/2496401083 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5638003970 0x7f5638003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:16.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.634+0000 7f5652b7f640 1 --2- 172.21.15.102:0/2496401083 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5638004d00 0x7f5638005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:16.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.634+0000 7f5651b7d640 1 --2- 172.21.15.102:0/2496401083 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f564c0cfdd0 0x7f56380047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:16.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.634+0000 7f565237e640 1 -- 172.21.15.102:0/2496401083 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f564c0cfdd0 msgr2=0x7f56380047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:16.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.634+0000 7f565237e640 1 --2- 172.21.15.102:0/2496401083 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f564c0cfdd0 0x7f56380047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:16.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.634+0000 7f565237e640 1 -- 172.21.15.102:0/2496401083 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5638004d00 msgr2=0x7f5638005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:16.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.634+0000 7f565237e640 1 --2- 172.21.15.102:0/2496401083 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5638004d00 0x7f5638005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:16.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.634+0000 7f565237e640 1 -- 172.21.15.102:0/2496401083 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5638003520 con 0x7f5638003970 2023-10-14T09:37:16.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.634+0000 7f5652b7f640 1 --2- 172.21.15.102:0/2496401083 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5638004d00 0x7f5638005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:37:16.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.635+0000 7f565237e640 1 --2- 172.21.15.102:0/2496401083 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5638003970 0x7f5638003d90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f564800c1c0 tx=0x7f56380057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f71f816b0e58f98d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:16.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.635+0000 7f565137c640 1 -- 172.21.15.102:0/2496401083 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564802cad0 con 0x7f5638003970 2023-10-14T09:37:16.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.635+0000 7f565137c640 1 -- 172.21.15.102:0/2496401083 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564802cc30 con 0x7f5638003970 2023-10-14T09:37:16.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.635+0000 7f565137c640 1 -- 172.21.15.102:0/2496401083 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5648007070 con 0x7f5638003970 2023-10-14T09:37:16.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.636+0000 7f56545e2640 1 -- 172.21.15.102:0/2496401083 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5638003970 msgr2=0x7f5638003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:16.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.636+0000 7f56545e2640 1 --2- 172.21.15.102:0/2496401083 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5638003970 0x7f5638003d90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f564800c1c0 tx=0x7f56380057f0 comp rx=0 tx=0).stop 2023-10-14T09:37:16.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.636+0000 7f5652b7f640 1 -- 172.21.15.102:0/2496401083 reap_dead start 2023-10-14T09:37:16.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.636+0000 7f56545e2640 1 -- 172.21.15.102:0/2496401083 shutdown_connections 2023-10-14T09:37:16.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.636+0000 7f56545e2640 1 -- 172.21.15.102:0/2496401083 >> 172.21.15.102:0/2496401083 conn(0x7f564c099ea0 msgr2=0x7f564c0d0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:16.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.636+0000 7f56545e2640 1 -- 172.21.15.102:0/2496401083 shutdown_connections 2023-10-14T09:37:16.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.636+0000 7f56545e2640 1 -- 172.21.15.102:0/2496401083 wait complete. 2023-10-14T09:37:16.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.637+0000 7f56545e2640 1 Processor -- start 2023-10-14T09:37:16.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.638+0000 7f56545e2640 1 -- start start 2023-10-14T09:37:16.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.638+0000 7f56545e2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5638003970 0x7f564c0c5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:16.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.638+0000 7f56545e2640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f564c1580a0 0x7f564c1f6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:16.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.638+0000 7f56545e2640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f564c0b3690 0x7f564c0b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:16.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.638+0000 7f56545e2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564c0b13b0 con 0x7f5638003970 2023-10-14T09:37:16.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.638+0000 7f56545e2640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564c1f6dc0 con 0x7f564c0b3690 2023-10-14T09:37:16.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.638+0000 7f56545e2640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564c158520 con 0x7f564c1580a0 2023-10-14T09:37:16.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.639+0000 7f565237e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5638003970 0x7f564c0c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:16.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.639+0000 7f565237e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5638003970 0x7f564c0c5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49190/0 (socket says 172.21.15.102:49190) 2023-10-14T09:37:16.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.639+0000 7f565237e640 1 -- 172.21.15.102:0/149830745 learned_addr learned my addr 172.21.15.102:0/149830745 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:16.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.639+0000 7f5651b7d640 1 --2- 172.21.15.102:0/149830745 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f564c1580a0 0x7f564c1f6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:16.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.639+0000 7f5652b7f640 1 --2- 172.21.15.102:0/149830745 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f564c0b3690 0x7f564c0b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:16.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.639+0000 7f565237e640 1 -- 172.21.15.102:0/149830745 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f564c1580a0 msgr2=0x7f564c1f6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:16.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.639+0000 7f565237e640 1 --2- 172.21.15.102:0/149830745 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f564c1580a0 0x7f564c1f6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:16.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.639+0000 7f565237e640 1 -- 172.21.15.102:0/149830745 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f564c0b3690 msgr2=0x7f564c0b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:16.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.639+0000 7f565237e640 1 --2- 172.21.15.102:0/149830745 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f564c0b3690 0x7f564c0b3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:16.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.639+0000 7f565237e640 1 -- 172.21.15.102:0/149830745 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564c0c5b60 con 0x7f5638003970 2023-10-14T09:37:16.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.639+0000 7f565237e640 1 --2- 172.21.15.102:0/149830745 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5638003970 0x7f564c0c5580 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5648000ef0 tx=0x7f5648001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:16.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.639+0000 7f5642ffd640 1 -- 172.21.15.102:0/149830745 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5648039070 con 0x7f5638003970 2023-10-14T09:37:16.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.640+0000 7f5642ffd640 1 -- 172.21.15.102:0/149830745 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5648005cb0 con 0x7f5638003970 2023-10-14T09:37:16.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.640+0000 7f5642ffd640 1 -- 172.21.15.102:0/149830745 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564803c040 con 0x7f5638003970 2023-10-14T09:37:16.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.640+0000 7f56545e2640 1 -- 172.21.15.102:0/149830745 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f564c0c5e40 con 0x7f5638003970 2023-10-14T09:37:16.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.640+0000 7f56545e2640 1 -- 172.21.15.102:0/149830745 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f564c0ae810 con 0x7f5638003970 2023-10-14T09:37:16.653 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.641+0000 7f56545e2640 1 -- 172.21.15.102:0/149830745 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f564c0c6080 con 0x7f5638003970 2023-10-14T09:37:16.653 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.642+0000 7f5642ffd640 1 -- 172.21.15.102:0/149830745 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5648032070 con 0x7f5638003970 2023-10-14T09:37:16.653 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.643+0000 7f5642ffd640 1 --2- 172.21.15.102:0/149830745 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f563006aea0 0x7f563006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:16.653 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.643+0000 7f5642ffd640 1 -- 172.21.15.102:0/149830745 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f56480aa970 con 0x7f5638003970 2023-10-14T09:37:16.653 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.643+0000 7f5651b7d640 1 --2- 172.21.15.102:0/149830745 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f563006aea0 0x7f563006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:16.654 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.644+0000 7f5651b7d640 1 --2- 172.21.15.102:0/149830745 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f563006aea0 0x7f563006d360 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f564c15f0c0 tx=0x7f563c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:16.654 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.648+0000 7f5642ffd640 1 -- 172.21.15.102:0/149830745 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f564c0c6080 con 0x7f5638003970 2023-10-14T09:37:16.839 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.837+0000 7f56545e2640 1 -- 172.21.15.102:0/149830745 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f564c0c6030 con 0x7f5638003970 2023-10-14T09:37:16.841 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.839+0000 7f5642ffd640 1 -- 172.21.15.102:0/149830745 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12886 (secure 0 0 0) 0x7f5648046020 con 0x7f5638003970 2023-10-14T09:37:16.841 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:37:16.842 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":18,"fsid":"8a6cd69d-7f5b-4f2a-806a-0176c10aed50","created":"2023-10-14T09:36:56.745172+0000","modified":"2023-10-14T09:37:12.810688+0000","last_up_change":"2023-10-14T09:37:09.791473+0000","last_in_change":"2023-10-14T09:37:00.547186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:37:09.952407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e5aef8f3-878f-482b-b522-9a5b958b90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6801","nonce":1727250718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6803","nonce":1727250718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6807","nonce":1727250718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6805","nonce":1727250718}]},"public_addr":"172.21.15.102:6801/1727250718","cluster_addr":"172.21.15.102:6803/1727250718","heartbeat_back_addr":"172.21.15.102:6807/1727250718","heartbeat_front_addr":"172.21.15.102:6805/1727250718","state":["exists","up"]},{"osd":1,"uuid":"4a8cf50e-387b-4d47-9588-bd22e375a9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6809","nonce":1095651107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6811","nonce":1095651107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6815","nonce":1095651107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6813","nonce":1095651107}]},"public_addr":"172.21.15.102:6809/1095651107","cluster_addr":"172.21.15.102:6811/1095651107","heartbeat_back_addr":"172.21.15.102:6815/1095651107","heartbeat_front_addr":"172.21.15.102:6813/1095651107","state":["exists","up"]},{"osd":2,"uuid":"009ef55f-8a63-4219-bacd-d7c7b4500867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6820","nonce":2198222556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6825","nonce":2198222556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6831","nonce":2198222556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6829","nonce":2198222556}]},"public_addr":"172.21.15.102:6820/2198222556","cluster_addr":"172.21.15.102:6825/2198222556","heartbeat_back_addr":"172.21.15.102:6831/2198222556","heartbeat_front_addr":"172.21.15.102:6829/2198222556","state":["exists","up"]},{"osd":3,"uuid":"f2110eae-2ff9-4ed9-93d6-bd2361618211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6818","nonce":654726740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6821","nonce":654726740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6827","nonce":654726740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6823","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6824","nonce":654726740}]},"public_addr":"172.21.15.102:6818/654726740","cluster_addr":"172.21.15.102:6821/654726740","heartbeat_back_addr":"172.21.15.102:6827/654726740","heartbeat_front_addr":"172.21.15.102:6824/654726740","state":["exists","up"]},{"osd":4,"uuid":"33f1ae34-3100-40f7-9cb8-0eca2b358693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6817","nonce":507586170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6819","nonce":507586170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6823","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6825","nonce":507586170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6821","nonce":507586170}]},"public_addr":"172.21.15.129:6817/507586170","cluster_addr":"172.21.15.129:6819/507586170","heartbeat_back_addr":"172.21.15.129:6825/507586170","heartbeat_front_addr":"172.21.15.129:6821/507586170","state":["exists","up"]},{"osd":5,"uuid":"fab2fc62-3f3e-450d-93e0-770f39e80710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6801","nonce":1913451073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6803","nonce":1913451073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6807","nonce":1913451073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6805","nonce":1913451073}]},"public_addr":"172.21.15.129:6801/1913451073","cluster_addr":"172.21.15.129:6803/1913451073","heartbeat_back_addr":"172.21.15.129:6807/1913451073","heartbeat_front_addr":"172.21.15.129:6805/1913451073","state":["exists","up"]},{"osd":6,"uuid":"d7cc1d69-92e7-4253-a127-cfc0444a4809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6809","nonce":2853291511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6811","nonce":2853291511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6815","nonce":2853291511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6813","nonce":2853291511}]},"public_addr":"172.21.15.129:6809/2853291511","cluster_addr":"172.21.15.129:6811/2853291511","heartbeat_back_addr":"172.21.15.129:6815/2853291511","heartbeat_front_addr":"172.21.15.129:6813/2853291511","state":["exists","up"]},{"osd":7,"uuid":"1e403de1-09e2-4370-b9a7-e790ac44bbee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6824","nonce":2933886914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6827","nonce":2933886914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6831","nonce":2933886914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6829","nonce":2933886914}]},"public_addr":"172.21.15.129:6824/2933886914","cluster_addr":"172.21.15.129:6827/2933886914","heartbeat_back_addr":"172.21.15.129:6831/2933886914","heartbeat_front_addr":"172.21.15.129:6829/2933886914","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.849661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.868113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.933488+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.891794+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.901861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.858750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.911712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.996765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:37:16.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.842+0000 7f56545e2640 1 -- 172.21.15.102:0/149830745 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f563006aea0 msgr2=0x7f563006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:16.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.842+0000 7f56545e2640 1 --2- 172.21.15.102:0/149830745 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f563006aea0 0x7f563006d360 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f564c15f0c0 tx=0x7f563c009190 comp rx=0 tx=0).stop 2023-10-14T09:37:16.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.842+0000 7f56545e2640 1 -- 172.21.15.102:0/149830745 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5638003970 msgr2=0x7f564c0c5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:16.845 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.842+0000 7f56545e2640 1 --2- 172.21.15.102:0/149830745 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5638003970 0x7f564c0c5580 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5648000ef0 tx=0x7f5648001b80 comp rx=0 tx=0).stop 2023-10-14T09:37:16.845 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.842+0000 7f56545e2640 1 -- 172.21.15.102:0/149830745 shutdown_connections 2023-10-14T09:37:16.845 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.842+0000 7f56545e2640 1 --2- 172.21.15.102:0/149830745 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f563006aea0 0x7f563006d360 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:16.845 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.842+0000 7f56545e2640 1 --2- 172.21.15.102:0/149830745 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f564c0b3690 0x7f564c0b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:16.845 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.842+0000 7f56545e2640 1 --2- 172.21.15.102:0/149830745 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f564c1580a0 0x7f564c1f6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:16.846 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.842+0000 7f56545e2640 1 --2- 172.21.15.102:0/149830745 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5638003970 0x7f564c0c5580 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:16.846 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.842+0000 7f56545e2640 1 -- 172.21.15.102:0/149830745 >> 172.21.15.102:0/149830745 conn(0x7f564c099ea0 msgr2=0x7f564c06d780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:16.846 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.842+0000 7f56545e2640 1 -- 172.21.15.102:0/149830745 shutdown_connections 2023-10-14T09:37:16.846 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:16.842+0000 7f56545e2640 1 -- 172.21.15.102:0/149830745 wait complete. 2023-10-14T09:37:16.862 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T09:37:09.952407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T09:37:16.863 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T09:37:17.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.062+0000 7f3217b24640 1 Processor -- start 2023-10-14T09:37:17.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.062+0000 7f3217b24640 1 -- start start 2023-10-14T09:37:17.066 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.064+0000 7f3217b24640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f3210159e90 0x7f32100ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:17.066 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.064+0000 7f3217b24640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f321006c140 0x7f321006c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:17.066 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.064+0000 7f3217b24640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f321006cad0 con 0x7f3210159ab0 2023-10-14T09:37:17.067 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.064+0000 7f3217b24640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f321015d890 con 0x7f321006c140 2023-10-14T09:37:17.067 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.064+0000 7f3217b24640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3210070360 con 0x7f3210159e90 2023-10-14T09:37:17.067 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.064+0000 7f32160c1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f321006c140 0x7f321006c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:17.067 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.064+0000 7f32160c1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f321006c140 0x7f321006c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49202/0 (socket says 172.21.15.102:49202) 2023-10-14T09:37:17.068 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.064+0000 7f32160c1640 1 -- 172.21.15.102:0/1331428255 learned_addr learned my addr 172.21.15.102:0/1331428255 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:17.069 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.065+0000 7f32150bf640 1 --2- 172.21.15.102:0/1331428255 >> v2:172.21.15.129:3300/0 conn(0x7f3210159e90 0x7f32100ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:17.069 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.065+0000 7f32160c1640 1 -- 172.21.15.102:0/1331428255 >> v2:172.21.15.129:3300/0 conn(0x7f3210159e90 msgr2=0x7f32100ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:17.070 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.065+0000 7f32160c1640 1 --2- 172.21.15.102:0/1331428255 >> v2:172.21.15.129:3300/0 conn(0x7f3210159e90 0x7f32100ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:17.070 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.065+0000 7f32160c1640 1 -- 172.21.15.102:0/1331428255 >> v1:172.21.15.129:6789/0 conn(0x7f3210159ab0 legacy=0x7f321006fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:17.070 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.065+0000 7f32160c1640 1 -- 172.21.15.102:0/1331428255 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32100cd1f0 con 0x7f321006c140 2023-10-14T09:37:17.070 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.066+0000 7f32160c1640 1 --2- 172.21.15.102:0/1331428255 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f321006c140 0x7f321006c590 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f321006d900 tx=0x7f320802bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4708e38e1535fd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:17.071 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.066+0000 7f32148be640 1 -- 172.21.15.102:0/1331428255 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320802c960 con 0x7f321006c140 2023-10-14T09:37:17.071 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.066+0000 7f32148be640 1 -- 172.21.15.102:0/1331428255 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f320802cac0 con 0x7f321006c140 2023-10-14T09:37:17.071 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.066+0000 7f32148be640 1 -- 172.21.15.102:0/1331428255 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320802ce50 con 0x7f321006c140 2023-10-14T09:37:17.072 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.067+0000 7f3217b24640 1 -- 172.21.15.102:0/1331428255 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f321006c140 msgr2=0x7f321006c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:17.072 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.067+0000 7f3217b24640 1 --2- 172.21.15.102:0/1331428255 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f321006c140 0x7f321006c590 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f321006d900 tx=0x7f320802bdc0 comp rx=0 tx=0).stop 2023-10-14T09:37:17.072 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.067+0000 7f3217b24640 1 -- 172.21.15.102:0/1331428255 shutdown_connections 2023-10-14T09:37:17.072 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.067+0000 7f3217b24640 1 --2- 172.21.15.102:0/1331428255 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f321006c140 0x7f321006c590 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:17.072 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.067+0000 7f3217b24640 1 --2- 172.21.15.102:0/1331428255 >> v2:172.21.15.129:3300/0 conn(0x7f3210159e90 0x7f32100ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:17.073 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.067+0000 7f3217b24640 1 -- 172.21.15.102:0/1331428255 >> 172.21.15.102:0/1331428255 conn(0x7f32100ce9b0 msgr2=0x7f32100cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:17.073 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.067+0000 7f3217b24640 1 -- 172.21.15.102:0/1331428255 shutdown_connections 2023-10-14T09:37:17.073 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.067+0000 7f3217b24640 1 -- 172.21.15.102:0/1331428255 wait complete. 2023-10-14T09:37:17.076 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.068+0000 7f3217b24640 1 Processor -- start 2023-10-14T09:37:17.077 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.069+0000 7f3217b24640 1 -- start start 2023-10-14T09:37:17.077 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.069+0000 7f3217b24640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f321006c140 0x7f3210146980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:17.077 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.069+0000 7f3217b24640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3210159ab0 0x7f32100ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:17.078 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.069+0000 7f3217b24640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3210159e90 0x7f32100acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:17.078 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.070+0000 7f3217b24640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32100b2370 con 0x7f321006c140 2023-10-14T09:37:17.078 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.070+0000 7f3217b24640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3210147260 con 0x7f3210159e90 2023-10-14T09:37:17.078 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.070+0000 7f3217b24640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32100c3660 con 0x7f3210159ab0 2023-10-14T09:37:17.079 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.070+0000 7f32158c0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f321006c140 0x7f3210146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:17.079 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.070+0000 7f32158c0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f321006c140 0x7f3210146980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49210/0 (socket says 172.21.15.102:49210) 2023-10-14T09:37:17.079 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.070+0000 7f32158c0640 1 -- 172.21.15.102:0/2239380143 learned_addr learned my addr 172.21.15.102:0/2239380143 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:17.079 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.070+0000 7f32158c0640 1 -- 172.21.15.102:0/2239380143 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3210159ab0 msgr2=0x7f32100ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:17.079 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.070+0000 7f32158c0640 1 --2- 172.21.15.102:0/2239380143 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3210159ab0 0x7f32100ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:17.080 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.070+0000 7f32158c0640 1 -- 172.21.15.102:0/2239380143 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3210159e90 msgr2=0x7f32100acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:17.080 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.070+0000 7f32158c0640 1 --2- 172.21.15.102:0/2239380143 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3210159e90 0x7f32100acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:17.080 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.070+0000 7f32158c0640 1 -- 172.21.15.102:0/2239380143 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3208009b30 con 0x7f321006c140 2023-10-14T09:37:17.080 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.070+0000 7f32158c0640 1 --2- 172.21.15.102:0/2239380143 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f321006c140 0x7f3210146980 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f320c00b3e0 tx=0x7f320c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:17.080 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.071+0000 7f32067fc640 1 -- 172.21.15.102:0/2239380143 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320c011830 con 0x7f321006c140 2023-10-14T09:37:17.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.071+0000 7f32067fc640 1 -- 172.21.15.102:0/2239380143 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f320c0119b0 con 0x7f321006c140 2023-10-14T09:37:17.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.071+0000 7f32067fc640 1 -- 172.21.15.102:0/2239380143 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320c011d60 con 0x7f321006c140 2023-10-14T09:37:17.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.071+0000 7f3217b24640 1 -- 172.21.15.102:0/2239380143 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f321014a0d0 con 0x7f321006c140 2023-10-14T09:37:17.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.071+0000 7f3217b24640 1 -- 172.21.15.102:0/2239380143 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3210147790 con 0x7f321006c140 2023-10-14T09:37:17.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.072+0000 7f3217b24640 1 -- 172.21.15.102:0/2239380143 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f321004e160 con 0x7f321006c140 2023-10-14T09:37:17.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.073+0000 7f32067fc640 1 -- 172.21.15.102:0/2239380143 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f320c01a400 con 0x7f321006c140 2023-10-14T09:37:17.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.073+0000 7f32067fc640 1 --2- 172.21.15.102:0/2239380143 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f31f406aea0 0x7f31f406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:17.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.074+0000 7f32067fc640 1 -- 172.21.15.102:0/2239380143 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f320c0894a0 con 0x7f321006c140 2023-10-14T09:37:17.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.074+0000 7f32150bf640 1 --2- 172.21.15.102:0/2239380143 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f31f406aea0 0x7f31f406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:17.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.074+0000 7f32150bf640 1 --2- 172.21.15.102:0/2239380143 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f31f406aea0 0x7f31f406d360 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3200006fd0 tx=0x7f3200008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:17.083 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.078+0000 7f32067fc640 1 -- 172.21.15.102:0/2239380143 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f320c0548a0 con 0x7f321006c140 2023-10-14T09:37:17.269 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.267+0000 7f3217b24640 1 -- 172.21.15.102:0/2239380143 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f32100ccb60 con 0x7f321006c140 2023-10-14T09:37:17.270 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.268+0000 7f32067fc640 1 -- 172.21.15.102:0/2239380143 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f320c0150a0 con 0x7f321006c140 2023-10-14T09:37:17.270 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2023-10-14T09:37:17.272 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.270+0000 7f3217b24640 1 -- 172.21.15.102:0/2239380143 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f31f406aea0 msgr2=0x7f31f406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:17.273 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.270+0000 7f3217b24640 1 --2- 172.21.15.102:0/2239380143 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f31f406aea0 0x7f31f406d360 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3200006fd0 tx=0x7f3200008040 comp rx=0 tx=0).stop 2023-10-14T09:37:17.273 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.270+0000 7f3217b24640 1 -- 172.21.15.102:0/2239380143 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f321006c140 msgr2=0x7f3210146980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:17.273 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.270+0000 7f3217b24640 1 --2- 172.21.15.102:0/2239380143 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f321006c140 0x7f3210146980 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f320c00b3e0 tx=0x7f320c00b8a0 comp rx=0 tx=0).stop 2023-10-14T09:37:17.273 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.270+0000 7f3217b24640 1 -- 172.21.15.102:0/2239380143 shutdown_connections 2023-10-14T09:37:17.273 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.270+0000 7f3217b24640 1 --2- 172.21.15.102:0/2239380143 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f31f406aea0 0x7f31f406d360 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:17.274 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.270+0000 7f3217b24640 1 --2- 172.21.15.102:0/2239380143 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3210159e90 0x7f32100acdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:17.274 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.270+0000 7f3217b24640 1 --2- 172.21.15.102:0/2239380143 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3210159ab0 0x7f32100ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:17.274 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.270+0000 7f3217b24640 1 --2- 172.21.15.102:0/2239380143 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f321006c140 0x7f3210146980 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:17.274 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.270+0000 7f3217b24640 1 -- 172.21.15.102:0/2239380143 >> 172.21.15.102:0/2239380143 conn(0x7f32100ce9b0 msgr2=0x7f32100aefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:17.274 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.271+0000 7f3217b24640 1 -- 172.21.15.102:0/2239380143 shutdown_connections 2023-10-14T09:37:17.275 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.271+0000 7f3217b24640 1 -- 172.21.15.102:0/2239380143 wait complete. 2023-10-14T09:37:17.291 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:37:17.503 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.501+0000 7feae3ed7640 1 Processor -- start 2023-10-14T09:37:17.503 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.501+0000 7feae3ed7640 1 -- start start 2023-10-14T09:37:17.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.502+0000 7feae3ed7640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7feadc159f00 0x7feadc0b0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:17.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.502+0000 7feae3ed7640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feadc06f7f0 con 0x7feadc159b20 2023-10-14T09:37:17.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.502+0000 7feae3ed7640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feadc06c5e0 con 0x7feadc15d880 2023-10-14T09:37:17.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.502+0000 7feae3ed7640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feadc06c8c0 con 0x7feadc159f00 2023-10-14T09:37:17.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.503+0000 7feae1c73640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7feadc159b20 0x7feadc06bbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:57698/0 (socket says 172.21.15.102:57698) 2023-10-14T09:37:17.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.503+0000 7feae1c73640 1 -- 172.21.15.102:0/2175150389 learned_addr learned my addr 172.21.15.102:0/2175150389 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:17.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.503+0000 7feae1472640 1 --2- 172.21.15.102:0/2175150389 >> v2:172.21.15.102:3300/0 conn(0x7feadc159f00 0x7feadc0b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:17.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.503+0000 7feae0c71640 1 -- 172.21.15.102:0/2175150389 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1594441498 0 0) 0x7feadc06f7f0 con 0x7feadc159b20 2023-10-14T09:37:17.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.503+0000 7feae0c71640 1 -- 172.21.15.102:0/2175150389 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feac8003520 con 0x7feadc159b20 2023-10-14T09:37:17.508 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.503+0000 7feae1472640 1 -- 172.21.15.102:0/2175150389 >> v1:172.21.15.129:6789/0 conn(0x7feadc15d880 legacy=0x7feadc06fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:17.508 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.503+0000 7feae1472640 1 -- 172.21.15.102:0/2175150389 >> v1:172.21.15.102:6789/0 conn(0x7feadc159b20 legacy=0x7feadc06bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:17.508 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.503+0000 7feae1472640 1 -- 172.21.15.102:0/2175150389 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feadc06cba0 con 0x7feadc159f00 2023-10-14T09:37:17.508 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.504+0000 7feae1472640 1 --2- 172.21.15.102:0/2175150389 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feadc159f00 0x7feadc0b0410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feacc0097a0 tx=0x7feacc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5920e647995a8930 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:17.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.505+0000 7feae0c71640 1 -- 172.21.15.102:0/2175150389 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc030610 con 0x7feadc159f00 2023-10-14T09:37:17.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.505+0000 7feae0c71640 1 -- 172.21.15.102:0/2175150389 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feacc030770 con 0x7feadc159f00 2023-10-14T09:37:17.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.505+0000 7feae0c71640 1 -- 172.21.15.102:0/2175150389 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc030b00 con 0x7feadc159f00 2023-10-14T09:37:17.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.505+0000 7feae3ed7640 1 -- 172.21.15.102:0/2175150389 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feadc159f00 msgr2=0x7feadc0b0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:17.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.505+0000 7feae3ed7640 1 --2- 172.21.15.102:0/2175150389 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feadc159f00 0x7feadc0b0410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feacc0097a0 tx=0x7feacc02b960 comp rx=0 tx=0).stop 2023-10-14T09:37:17.510 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.505+0000 7feae3ed7640 1 -- 172.21.15.102:0/2175150389 shutdown_connections 2023-10-14T09:37:17.510 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.505+0000 7feae3ed7640 1 --2- 172.21.15.102:0/2175150389 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feadc159f00 0x7feadc0b0410 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:17.510 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.505+0000 7feae3ed7640 1 -- 172.21.15.102:0/2175150389 >> 172.21.15.102:0/2175150389 conn(0x7feadc0cb410 msgr2=0x7feadc0cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:17.510 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.505+0000 7feae3ed7640 1 -- 172.21.15.102:0/2175150389 shutdown_connections 2023-10-14T09:37:17.510 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.506+0000 7feae3ed7640 1 -- 172.21.15.102:0/2175150389 wait complete. 2023-10-14T09:37:17.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.507+0000 7feae3ed7640 1 Processor -- start 2023-10-14T09:37:17.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.507+0000 7feae3ed7640 1 -- start start 2023-10-14T09:37:17.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.508+0000 7feae3ed7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feadc159b20 0x7feadc0b1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:17.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.508+0000 7feae3ed7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feadc159f00 0x7feadc1450b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:17.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.508+0000 7feae3ed7640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7feadc15d880 0x7feadc0afd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:17.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.508+0000 7feae3ed7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feadc14a950 con 0x7feadc159b20 2023-10-14T09:37:17.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.508+0000 7feae3ed7640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feadc14ac30 con 0x7feadc159f00 2023-10-14T09:37:17.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.508+0000 7feae3ed7640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feadc14af10 con 0x7feadc15d880 2023-10-14T09:37:17.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.508+0000 7feae1c73640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feadc159b20 0x7feadc0b1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:17.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.508+0000 7feae1c73640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feadc159b20 0x7feadc0b1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49238/0 (socket says 172.21.15.102:49238) 2023-10-14T09:37:17.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.508+0000 7feae1c73640 1 -- 172.21.15.102:0/1529065644 learned_addr learned my addr 172.21.15.102:0/1529065644 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:17.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.509+0000 7feae1472640 1 --2- 172.21.15.102:0/1529065644 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feadc159f00 0x7feadc1450b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:17.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.509+0000 7feae1c73640 1 -- 172.21.15.102:0/1529065644 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7feadc15d880 msgr2=0x7feadc0afd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:17.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.509+0000 7feae1c73640 1 --2- 172.21.15.102:0/1529065644 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7feadc15d880 0x7feadc0afd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:17.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.509+0000 7feae1c73640 1 -- 172.21.15.102:0/1529065644 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feadc159f00 msgr2=0x7feadc1450b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:17.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.509+0000 7feae1c73640 1 --2- 172.21.15.102:0/1529065644 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feadc159f00 0x7feadc1450b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:17.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.509+0000 7feae1c73640 1 -- 172.21.15.102:0/1529065644 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feacc009400 con 0x7feadc159b20 2023-10-14T09:37:17.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.509+0000 7feae1c73640 1 --2- 172.21.15.102:0/1529065644 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feadc159b20 0x7feadc0b1c80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fead800c410 tx=0x7fead800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:17.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.509+0000 7fead27fc640 1 -- 172.21.15.102:0/1529065644 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead8005ce0 con 0x7feadc159b20 2023-10-14T09:37:17.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.509+0000 7fead27fc640 1 -- 172.21.15.102:0/1529065644 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead8005e40 con 0x7feadc159b20 2023-10-14T09:37:17.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.509+0000 7fead27fc640 1 -- 172.21.15.102:0/1529065644 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead80072f0 con 0x7feadc159b20 2023-10-14T09:37:17.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.509+0000 7feae3ed7640 1 -- 172.21.15.102:0/1529065644 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feadc14b1f0 con 0x7feadc159b20 2023-10-14T09:37:17.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.509+0000 7feae3ed7640 1 -- 172.21.15.102:0/1529065644 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feadc0b21c0 con 0x7feadc159b20 2023-10-14T09:37:17.517 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.510+0000 7feae3ed7640 1 -- 172.21.15.102:0/1529065644 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feadc04e160 con 0x7feadc159b20 2023-10-14T09:37:17.517 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.511+0000 7fead27fc640 1 -- 172.21.15.102:0/1529065644 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fead8007510 con 0x7feadc159b20 2023-10-14T09:37:17.518 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.512+0000 7fead27fc640 1 --2- 172.21.15.102:0/1529065644 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7feac006ae70 0x7feac006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:17.518 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.512+0000 7fead27fc640 1 -- 172.21.15.102:0/1529065644 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fead8088a10 con 0x7feadc159b20 2023-10-14T09:37:17.518 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.512+0000 7feae1472640 1 --2- 172.21.15.102:0/1529065644 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7feac006ae70 0x7feac006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:17.518 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.513+0000 7feae1472640 1 --2- 172.21.15.102:0/1529065644 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7feac006ae70 0x7feac006d330 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7feacc036000 tx=0x7feacc03b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:17.519 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.518+0000 7fead27fc640 1 -- 172.21.15.102:0/1529065644 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fead8053e30 con 0x7feadc159b20 2023-10-14T09:37:17.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.748+0000 7feae3ed7640 1 -- 172.21.15.102:0/1529065644 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feadc0b10b0 con 0x7feadc159b20 2023-10-14T09:37:17.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.749+0000 7fead27fc640 1 -- 172.21.15.102:0/1529065644 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3703 (secure 0 0 0) 0x7fead8017090 con 0x7feadc159b20 2023-10-14T09:37:17.751 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:37:17.751 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6835/3867702876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6833","nonce":3867702876},{"type":"v1","addr":"172.21.15.129:6835","nonce":3867702876}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6834/1559210030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":1559210030},{"type":"v1","addr":"172.21.15.129:6834","nonce":1559210030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1277026451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1277026451},{"type":"v1","addr":"172.21.15.102:6835","nonce":1277026451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/527707922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":527707922},{"type":"v1","addr":"172.21.15.102:6837","nonce":527707922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-14T09:37:17.751 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 3 2023-10-14T09:37:17.753 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.751+0000 7feae3ed7640 1 -- 172.21.15.102:0/1529065644 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7feac006ae70 msgr2=0x7feac006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:17.754 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.751+0000 7feae3ed7640 1 --2- 172.21.15.102:0/1529065644 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7feac006ae70 0x7feac006d330 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7feacc036000 tx=0x7feacc03b040 comp rx=0 tx=0).stop 2023-10-14T09:37:17.754 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.751+0000 7feae3ed7640 1 -- 172.21.15.102:0/1529065644 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feadc159b20 msgr2=0x7feadc0b1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:17.754 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.751+0000 7feae3ed7640 1 --2- 172.21.15.102:0/1529065644 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feadc159b20 0x7feadc0b1c80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fead800c410 tx=0x7fead800c8d0 comp rx=0 tx=0).stop 2023-10-14T09:37:17.754 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.752+0000 7feae3ed7640 1 -- 172.21.15.102:0/1529065644 shutdown_connections 2023-10-14T09:37:17.754 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.752+0000 7feae3ed7640 1 --2- 172.21.15.102:0/1529065644 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7feac006ae70 0x7feac006d330 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:17.755 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.752+0000 7feae3ed7640 1 --2- 172.21.15.102:0/1529065644 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7feadc15d880 0x7feadc0afd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:17.755 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.752+0000 7feae3ed7640 1 --2- 172.21.15.102:0/1529065644 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feadc159f00 0x7feadc1450b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:17.755 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.752+0000 7feae3ed7640 1 --2- 172.21.15.102:0/1529065644 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feadc159b20 0x7feadc0b1c80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:17.755 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.752+0000 7feae3ed7640 1 -- 172.21.15.102:0/1529065644 >> 172.21.15.102:0/1529065644 conn(0x7feadc0cb410 msgr2=0x7feadc0cca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:17.755 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.752+0000 7feae3ed7640 1 -- 172.21.15.102:0/1529065644 shutdown_connections 2023-10-14T09:37:17.755 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.752+0000 7feae3ed7640 1 -- 172.21.15.102:0/1529065644 wait complete. 2023-10-14T09:37:17.773 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:37:17.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.977+0000 7f7c74efc640 1 Processor -- start 2023-10-14T09:37:17.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.977+0000 7f7c74efc640 1 -- start start 2023-10-14T09:37:17.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.978+0000 7f7c74efc640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7c7015aaa0 0x7f7c7015e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:17.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.978+0000 7f7c74efc640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f7c700ce390 0x7f7c70070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:17.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.978+0000 7f7c74efc640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c7015ed60 con 0x7f7c7015ae80 2023-10-14T09:37:17.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.978+0000 7f7c74efc640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c7006b810 con 0x7f7c700ce390 2023-10-14T09:37:17.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.978+0000 7f7c74efc640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c700707e0 con 0x7f7c7015aaa0 2023-10-14T09:37:17.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.979+0000 7f7c6ed9d640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f7c700ce390 0x7f7c70070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:17.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.979+0000 7f7c6e59c640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7c7015aaa0 0x7f7c7015e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:17.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.979+0000 7f7c67fff640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f7c7015ae80 0x7f7c700cc560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.102:35340/0 (socket says 172.21.15.102:35340) 2023-10-14T09:37:17.983 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.979+0000 7f7c67fff640 1 -- 172.21.15.102:0/770309048 learned_addr learned my addr 172.21.15.102:0/770309048 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:17.983 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.980+0000 7f7c6ed9d640 1 -- 172.21.15.102:0/770309048 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7c7015aaa0 msgr2=0x7f7c7015e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:17.983 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.980+0000 7f7c6ed9d640 1 --2- 172.21.15.102:0/770309048 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7c7015aaa0 0x7f7c7015e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:17.983 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.980+0000 7f7c6ed9d640 1 -- 172.21.15.102:0/770309048 >> v1:172.21.15.129:6789/0 conn(0x7f7c7015ae80 legacy=0x7f7c700cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:17.983 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.980+0000 7f7c6ed9d640 1 -- 172.21.15.102:0/770309048 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7015ef90 con 0x7f7c700ce390 2023-10-14T09:37:17.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.981+0000 7f7c6ed9d640 1 --2- 172.21.15.102:0/770309048 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7c700ce390 0x7f7c70070f50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7c68009d90 tx=0x7f7c6802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69bc856f88c8556f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:17.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.982+0000 7f7c6dd9b640 1 -- 172.21.15.102:0/770309048 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6802cc50 con 0x7f7c700ce390 2023-10-14T09:37:17.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.982+0000 7f7c6dd9b640 1 -- 172.21.15.102:0/770309048 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6802cdb0 con 0x7f7c700ce390 2023-10-14T09:37:17.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.982+0000 7f7c6dd9b640 1 -- 172.21.15.102:0/770309048 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c68034660 con 0x7f7c700ce390 2023-10-14T09:37:17.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.982+0000 7f7c74efc640 1 -- 172.21.15.102:0/770309048 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7c700ce390 msgr2=0x7f7c70070f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:17.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.982+0000 7f7c74efc640 1 --2- 172.21.15.102:0/770309048 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7c700ce390 0x7f7c70070f50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7c68009d90 tx=0x7f7c6802bea0 comp rx=0 tx=0).stop 2023-10-14T09:37:17.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.982+0000 7f7c74efc640 1 -- 172.21.15.102:0/770309048 shutdown_connections 2023-10-14T09:37:17.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.983+0000 7f7c74efc640 1 --2- 172.21.15.102:0/770309048 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7c700ce390 0x7f7c70070f50 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:17.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.983+0000 7f7c74efc640 1 --2- 172.21.15.102:0/770309048 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7c7015aaa0 0x7f7c7015e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:17.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.983+0000 7f7c74efc640 1 -- 172.21.15.102:0/770309048 >> 172.21.15.102:0/770309048 conn(0x7f7c700cb410 msgr2=0x7f7c700cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:17.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.983+0000 7f7c74efc640 1 -- 172.21.15.102:0/770309048 shutdown_connections 2023-10-14T09:37:17.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.983+0000 7f7c74efc640 1 -- 172.21.15.102:0/770309048 wait complete. 2023-10-14T09:37:17.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.984+0000 7f7c74efc640 1 Processor -- start 2023-10-14T09:37:17.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.985+0000 7f7c74efc640 1 -- start start 2023-10-14T09:37:17.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.985+0000 7f7c74efc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c700ce390 0x7f7c700c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:17.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.985+0000 7f7c74efc640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7c7015aaa0 0x7f7c700aee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:17.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.985+0000 7f7c74efc640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7c7015ae80 0x7f7c700c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:17.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.985+0000 7f7c74efc640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c700c5a60 con 0x7f7c700ce390 2023-10-14T09:37:17.990 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.985+0000 7f7c74efc640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c700af340 con 0x7f7c7015ae80 2023-10-14T09:37:17.990 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.985+0000 7f7c74efc640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c700af5e0 con 0x7f7c7015aaa0 2023-10-14T09:37:17.990 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.986+0000 7f7c6e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c700ce390 0x7f7c700c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:17.990 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.986+0000 7f7c6e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c700ce390 0x7f7c700c4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49248/0 (socket says 172.21.15.102:49248) 2023-10-14T09:37:17.990 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.986+0000 7f7c6e59c640 1 -- 172.21.15.102:0/4064281758 learned_addr learned my addr 172.21.15.102:0/4064281758 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:17.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.986+0000 7f7c6e59c640 1 -- 172.21.15.102:0/4064281758 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7c7015aaa0 msgr2=0x7f7c700aee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:17.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.986+0000 7f7c6e59c640 1 --2- 172.21.15.102:0/4064281758 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7c7015aaa0 0x7f7c700aee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:17.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.986+0000 7f7c6e59c640 1 -- 172.21.15.102:0/4064281758 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7c7015ae80 msgr2=0x7f7c700c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:17.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.986+0000 7f7c6ed9d640 1 --2- 172.21.15.102:0/4064281758 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7c7015ae80 0x7f7c700c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:17.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.986+0000 7f7c6e59c640 1 --2- 172.21.15.102:0/4064281758 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7c7015ae80 0x7f7c700c7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:17.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.986+0000 7f7c6e59c640 1 -- 172.21.15.102:0/4064281758 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c68009a70 con 0x7f7c700ce390 2023-10-14T09:37:17.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.986+0000 7f7c6e59c640 1 --2- 172.21.15.102:0/4064281758 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c700ce390 0x7f7c700c4f80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7c6000e9b0 tx=0x7f7c6000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:17.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.987+0000 7f7c66ffd640 1 -- 172.21.15.102:0/4064281758 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c60009670 con 0x7f7c700ce390 2023-10-14T09:37:17.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.987+0000 7f7c66ffd640 1 -- 172.21.15.102:0/4064281758 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6000c9a0 con 0x7f7c700ce390 2023-10-14T09:37:17.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.987+0000 7f7c66ffd640 1 -- 172.21.15.102:0/4064281758 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6000cd50 con 0x7f7c700ce390 2023-10-14T09:37:17.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.987+0000 7f7c74efc640 1 -- 172.21.15.102:0/4064281758 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c700af8c0 con 0x7f7c700ce390 2023-10-14T09:37:17.993 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.987+0000 7f7c74efc640 1 -- 172.21.15.102:0/4064281758 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c700afe80 con 0x7f7c700ce390 2023-10-14T09:37:17.994 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.988+0000 7f7c74efc640 1 -- 172.21.15.102:0/4064281758 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c7004e160 con 0x7f7c700ce390 2023-10-14T09:37:17.994 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.989+0000 7f7c66ffd640 1 -- 172.21.15.102:0/4064281758 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7c60013470 con 0x7f7c700ce390 2023-10-14T09:37:17.994 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.990+0000 7f7c66ffd640 1 --2- 172.21.15.102:0/4064281758 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f7c5006aea0 0x7f7c5006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:17.994 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.990+0000 7f7c66ffd640 1 -- 172.21.15.102:0/4064281758 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7c60089610 con 0x7f7c700ce390 2023-10-14T09:37:17.994 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.990+0000 7f7c67fff640 1 --2- 172.21.15.102:0/4064281758 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f7c5006aea0 0x7f7c5006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:17.995 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.991+0000 7f7c67fff640 1 --2- 172.21.15.102:0/4064281758 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f7c5006aea0 0x7f7c5006d360 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7c700b1900 tx=0x7f7c58007a40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:17.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:17.994+0000 7f7c66ffd640 1 -- 172.21.15.102:0/4064281758 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7c60054970 con 0x7f7c700ce390 2023-10-14T09:37:18.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.185+0000 7f7c74efc640 1 -- 172.21.15.102:0/4064281758 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c7015e350 con 0x7f7c700ce390 2023-10-14T09:37:18.188 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.186+0000 7f7c66ffd640 1 -- 172.21.15.102:0/4064281758 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12886 (secure 0 0 0) 0x7f7c60057f90 con 0x7f7c700ce390 2023-10-14T09:37:18.188 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:37:18.189 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":18,"fsid":"8a6cd69d-7f5b-4f2a-806a-0176c10aed50","created":"2023-10-14T09:36:56.745172+0000","modified":"2023-10-14T09:37:12.810688+0000","last_up_change":"2023-10-14T09:37:09.791473+0000","last_in_change":"2023-10-14T09:37:00.547186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:37:09.952407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e5aef8f3-878f-482b-b522-9a5b958b90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6801","nonce":1727250718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6803","nonce":1727250718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6807","nonce":1727250718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6805","nonce":1727250718}]},"public_addr":"172.21.15.102:6801/1727250718","cluster_addr":"172.21.15.102:6803/1727250718","heartbeat_back_addr":"172.21.15.102:6807/1727250718","heartbeat_front_addr":"172.21.15.102:6805/1727250718","state":["exists","up"]},{"osd":1,"uuid":"4a8cf50e-387b-4d47-9588-bd22e375a9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6809","nonce":1095651107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6811","nonce":1095651107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6815","nonce":1095651107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6813","nonce":1095651107}]},"public_addr":"172.21.15.102:6809/1095651107","cluster_addr":"172.21.15.102:6811/1095651107","heartbeat_back_addr":"172.21.15.102:6815/1095651107","heartbeat_front_addr":"172.21.15.102:6813/1095651107","state":["exists","up"]},{"osd":2,"uuid":"009ef55f-8a63-4219-bacd-d7c7b4500867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6820","nonce":2198222556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6825","nonce":2198222556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6831","nonce":2198222556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6829","nonce":2198222556}]},"public_addr":"172.21.15.102:6820/2198222556","cluster_addr":"172.21.15.102:6825/2198222556","heartbeat_back_addr":"172.21.15.102:6831/2198222556","heartbeat_front_addr":"172.21.15.102:6829/2198222556","state":["exists","up"]},{"osd":3,"uuid":"f2110eae-2ff9-4ed9-93d6-bd2361618211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6818","nonce":654726740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6821","nonce":654726740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6827","nonce":654726740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6823","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6824","nonce":654726740}]},"public_addr":"172.21.15.102:6818/654726740","cluster_addr":"172.21.15.102:6821/654726740","heartbeat_back_addr":"172.21.15.102:6827/654726740","heartbeat_front_addr":"172.21.15.102:6824/654726740","state":["exists","up"]},{"osd":4,"uuid":"33f1ae34-3100-40f7-9cb8-0eca2b358693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6817","nonce":507586170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6819","nonce":507586170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6823","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6825","nonce":507586170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6821","nonce":507586170}]},"public_addr":"172.21.15.129:6817/507586170","cluster_addr":"172.21.15.129:6819/507586170","heartbeat_back_addr":"172.21.15.129:6825/507586170","heartbeat_front_addr":"172.21.15.129:6821/507586170","state":["exists","up"]},{"osd":5,"uuid":"fab2fc62-3f3e-450d-93e0-770f39e80710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6801","nonce":1913451073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6803","nonce":1913451073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6807","nonce":1913451073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6805","nonce":1913451073}]},"public_addr":"172.21.15.129:6801/1913451073","cluster_addr":"172.21.15.129:6803/1913451073","heartbeat_back_addr":"172.21.15.129:6807/1913451073","heartbeat_front_addr":"172.21.15.129:6805/1913451073","state":["exists","up"]},{"osd":6,"uuid":"d7cc1d69-92e7-4253-a127-cfc0444a4809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6809","nonce":2853291511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6811","nonce":2853291511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6815","nonce":2853291511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6813","nonce":2853291511}]},"public_addr":"172.21.15.129:6809/2853291511","cluster_addr":"172.21.15.129:6811/2853291511","heartbeat_back_addr":"172.21.15.129:6815/2853291511","heartbeat_front_addr":"172.21.15.129:6813/2853291511","state":["exists","up"]},{"osd":7,"uuid":"1e403de1-09e2-4370-b9a7-e790ac44bbee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6824","nonce":2933886914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6827","nonce":2933886914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6831","nonce":2933886914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6829","nonce":2933886914}]},"public_addr":"172.21.15.129:6824/2933886914","cluster_addr":"172.21.15.129:6827/2933886914","heartbeat_back_addr":"172.21.15.129:6831/2933886914","heartbeat_front_addr":"172.21.15.129:6829/2933886914","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.849661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.868113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.933488+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.891794+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.901861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.858750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.911712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.996765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:37:18.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.189+0000 7f7c74efc640 1 -- 172.21.15.102:0/4064281758 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f7c5006aea0 msgr2=0x7f7c5006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:18.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.189+0000 7f7c74efc640 1 --2- 172.21.15.102:0/4064281758 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f7c5006aea0 0x7f7c5006d360 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7c700b1900 tx=0x7f7c58007a40 comp rx=0 tx=0).stop 2023-10-14T09:37:18.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.189+0000 7f7c74efc640 1 -- 172.21.15.102:0/4064281758 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c700ce390 msgr2=0x7f7c700c4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:18.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.189+0000 7f7c74efc640 1 --2- 172.21.15.102:0/4064281758 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c700ce390 0x7f7c700c4f80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7c6000e9b0 tx=0x7f7c6000ee70 comp rx=0 tx=0).stop 2023-10-14T09:37:18.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.189+0000 7f7c74efc640 1 -- 172.21.15.102:0/4064281758 shutdown_connections 2023-10-14T09:37:18.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.189+0000 7f7c74efc640 1 --2- 172.21.15.102:0/4064281758 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f7c5006aea0 0x7f7c5006d360 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:18.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.189+0000 7f7c74efc640 1 --2- 172.21.15.102:0/4064281758 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7c7015ae80 0x7f7c700c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:18.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.189+0000 7f7c74efc640 1 --2- 172.21.15.102:0/4064281758 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7c7015aaa0 0x7f7c700aee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:18.193 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.189+0000 7f7c74efc640 1 --2- 172.21.15.102:0/4064281758 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c700ce390 0x7f7c700c4f80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:18.193 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.189+0000 7f7c74efc640 1 -- 172.21.15.102:0/4064281758 >> 172.21.15.102:0/4064281758 conn(0x7f7c700cb410 msgr2=0x7f7c7006d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:18.193 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.190+0000 7f7c74efc640 1 -- 172.21.15.102:0/4064281758 shutdown_connections 2023-10-14T09:37:18.193 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.190+0000 7f7c74efc640 1 -- 172.21.15.102:0/4064281758 wait complete. 2023-10-14T09:37:18.208 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T09:37:09.952407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T09:37:18.209 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T09:37:18.425 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.423+0000 7f9c1759e640 1 Processor -- start 2023-10-14T09:37:18.425 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.424+0000 7f9c1759e640 1 -- start start 2023-10-14T09:37:18.427 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.425+0000 7f9c1759e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9c180b1ca0 0x7f9c180d36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:18.427 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.425+0000 7f9c1759e640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9c180b2080 0x7f9c180ce420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:18.428 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.425+0000 7f9c1759e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c180d0970 con 0x7f9c180ce960 2023-10-14T09:37:18.428 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.425+0000 7f9c1759e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c180d0ea0 con 0x7f9c180b1ca0 2023-10-14T09:37:18.428 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.425+0000 7f9c1759e640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c180d0bc0 con 0x7f9c180b2080 2023-10-14T09:37:18.428 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.426+0000 7f9c1659c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9c180b1ca0 0x7f9c180d36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:18.428 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.426+0000 7f9c1659c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9c180b1ca0 0x7f9c180d36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49254/0 (socket says 172.21.15.102:49254) 2023-10-14T09:37:18.429 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.426+0000 7f9c1659c640 1 -- 172.21.15.102:0/2477623464 learned_addr learned my addr 172.21.15.102:0/2477623464 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:18.429 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.426+0000 7f9c16d9d640 1 --1- 172.21.15.102:0/2477623464 >> v1:172.21.15.102:6789/0 conn(0x7f9c180ce960 0x7f9c180b24c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:57712/0 (socket says 172.21.15.102:57712) 2023-10-14T09:37:18.430 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.426+0000 7f9c1659c640 1 -- 172.21.15.102:0/2477623464 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9c180b2080 msgr2=0x7f9c180ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:18.430 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.426+0000 7f9c1659c640 1 --2- 172.21.15.102:0/2477623464 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9c180b2080 0x7f9c180ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:18.431 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.426+0000 7f9c1659c640 1 -- 172.21.15.102:0/2477623464 >> v1:172.21.15.102:6789/0 conn(0x7f9c180ce960 legacy=0x7f9c180b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:18.431 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.426+0000 7f9c1659c640 1 -- 172.21.15.102:0/2477623464 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c180cd940 con 0x7f9c180b1ca0 2023-10-14T09:37:18.431 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.427+0000 7f9c1659c640 1 --2- 172.21.15.102:0/2477623464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c180b1ca0 0x7f9c180d36b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9c08009870 tx=0x7f9c0802ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f64b09c997cccd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:18.431 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.427+0000 7f9c15d9b640 1 -- 172.21.15.102:0/2477623464 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0802f830 con 0x7f9c180b1ca0 2023-10-14T09:37:18.431 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.427+0000 7f9c15d9b640 1 -- 172.21.15.102:0/2477623464 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0802f990 con 0x7f9c180b1ca0 2023-10-14T09:37:18.432 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.427+0000 7f9c15d9b640 1 -- 172.21.15.102:0/2477623464 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0802fd20 con 0x7f9c180b1ca0 2023-10-14T09:37:18.432 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.428+0000 7f9c1759e640 1 -- 172.21.15.102:0/2477623464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c180b1ca0 msgr2=0x7f9c180d36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:18.432 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.428+0000 7f9c1759e640 1 --2- 172.21.15.102:0/2477623464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c180b1ca0 0x7f9c180d36b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9c08009870 tx=0x7f9c0802ba10 comp rx=0 tx=0).stop 2023-10-14T09:37:18.432 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.428+0000 7f9c1759e640 1 -- 172.21.15.102:0/2477623464 shutdown_connections 2023-10-14T09:37:18.432 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.428+0000 7f9c1759e640 1 --2- 172.21.15.102:0/2477623464 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9c180b2080 0x7f9c180ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:18.432 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.428+0000 7f9c1759e640 1 --2- 172.21.15.102:0/2477623464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c180b1ca0 0x7f9c180d36b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:18.433 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.428+0000 7f9c1759e640 1 -- 172.21.15.102:0/2477623464 >> 172.21.15.102:0/2477623464 conn(0x7f9c180d2b90 msgr2=0x7f9c180d2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:18.433 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.428+0000 7f9c1759e640 1 -- 172.21.15.102:0/2477623464 shutdown_connections 2023-10-14T09:37:18.433 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.428+0000 7f9c1759e640 1 -- 172.21.15.102:0/2477623464 wait complete. 2023-10-14T09:37:18.435 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.430+0000 7f9c1759e640 1 Processor -- start 2023-10-14T09:37:18.435 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.430+0000 7f9c1759e640 1 -- start start 2023-10-14T09:37:18.435 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.431+0000 7f9c1759e640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9c180b1ca0 0x7f9c180c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:18.436 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.431+0000 7f9c1759e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9c180b2080 0x7f9c181f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:18.436 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.431+0000 7f9c1759e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c180ce960 0x7f9c181f1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:18.436 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.431+0000 7f9c1759e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c180c9120 con 0x7f9c180ce960 2023-10-14T09:37:18.436 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.431+0000 7f9c1759e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c181f6a20 con 0x7f9c180b2080 2023-10-14T09:37:18.436 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.431+0000 7f9c1759e640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c180c7b40 con 0x7f9c180b1ca0 2023-10-14T09:37:18.437 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.431+0000 7f9c16d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c180ce960 0x7f9c181f1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:18.437 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.431+0000 7f9c16d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c180ce960 0x7f9c181f1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49270/0 (socket says 172.21.15.102:49270) 2023-10-14T09:37:18.437 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.431+0000 7f9c16d9d640 1 -- 172.21.15.102:0/3134498219 learned_addr learned my addr 172.21.15.102:0/3134498219 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:18.437 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.432+0000 7f9c0ffff640 1 --2- 172.21.15.102:0/3134498219 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9c180b2080 0x7f9c181f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:18.437 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.432+0000 7f9c1659c640 1 --2- 172.21.15.102:0/3134498219 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9c180b1ca0 0x7f9c180c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:18.437 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.432+0000 7f9c16d9d640 1 -- 172.21.15.102:0/3134498219 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9c180b1ca0 msgr2=0x7f9c180c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:18.438 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.432+0000 7f9c16d9d640 1 --2- 172.21.15.102:0/3134498219 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9c180b1ca0 0x7f9c180c8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:18.438 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.432+0000 7f9c16d9d640 1 -- 172.21.15.102:0/3134498219 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9c180b2080 msgr2=0x7f9c181f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:18.438 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.432+0000 7f9c16d9d640 1 --2- 172.21.15.102:0/3134498219 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9c180b2080 0x7f9c181f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:18.438 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.432+0000 7f9c16d9d640 1 -- 172.21.15.102:0/3134498219 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c080094d0 con 0x7f9c180ce960 2023-10-14T09:37:18.438 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.432+0000 7f9c16d9d640 1 --2- 172.21.15.102:0/3134498219 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c180ce960 0x7f9c181f1c10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9c1000c730 tx=0x7f9c1000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:18.439 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.432+0000 7f9c0effd640 1 -- 172.21.15.102:0/3134498219 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1000ce40 con 0x7f9c180ce960 2023-10-14T09:37:18.439 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.432+0000 7f9c0effd640 1 -- 172.21.15.102:0/3134498219 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1000a640 con 0x7f9c180ce960 2023-10-14T09:37:18.439 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.432+0000 7f9c0effd640 1 -- 172.21.15.102:0/3134498219 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1000a9b0 con 0x7f9c180ce960 2023-10-14T09:37:18.439 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.432+0000 7f9c1759e640 1 -- 172.21.15.102:0/3134498219 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c180c7e20 con 0x7f9c180ce960 2023-10-14T09:37:18.439 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.432+0000 7f9c1759e640 1 -- 172.21.15.102:0/3134498219 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c180c83e0 con 0x7f9c180ce960 2023-10-14T09:37:18.440 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.433+0000 7f9c1759e640 1 -- 172.21.15.102:0/3134498219 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c1804e9b0 con 0x7f9c180ce960 2023-10-14T09:37:18.440 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.434+0000 7f9c0effd640 1 -- 172.21.15.102:0/3134498219 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9c1000ab10 con 0x7f9c180ce960 2023-10-14T09:37:18.441 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.435+0000 7f9c0effd640 1 --2- 172.21.15.102:0/3134498219 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f9bf806ae70 0x7f9bf806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:18.441 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.435+0000 7f9c0effd640 1 -- 172.21.15.102:0/3134498219 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9c10088a00 con 0x7f9c180ce960 2023-10-14T09:37:18.441 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.435+0000 7f9c1659c640 1 --2- 172.21.15.102:0/3134498219 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f9bf806ae70 0x7f9bf806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:18.441 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.436+0000 7f9c1659c640 1 --2- 172.21.15.102:0/3134498219 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f9bf806ae70 0x7f9bf806d330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9c08036000 tx=0x7f9c08039040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:18.441 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.440+0000 7f9c0effd640 1 -- 172.21.15.102:0/3134498219 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9c10053e10 con 0x7f9c180ce960 2023-10-14T09:37:18.629 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.627+0000 7f9c1759e640 1 -- 172.21.15.102:0/3134498219 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9c18073a40 con 0x7f9c180ce960 2023-10-14T09:37:18.630 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.628+0000 7f9c0effd640 1 -- 172.21.15.102:0/3134498219 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9c10017020 con 0x7f9c180ce960 2023-10-14T09:37:18.630 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2023-10-14T09:37:18.633 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.631+0000 7f9c1759e640 1 -- 172.21.15.102:0/3134498219 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f9bf806ae70 msgr2=0x7f9bf806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:18.633 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.631+0000 7f9c1759e640 1 --2- 172.21.15.102:0/3134498219 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f9bf806ae70 0x7f9bf806d330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9c08036000 tx=0x7f9c08039040 comp rx=0 tx=0).stop 2023-10-14T09:37:18.633 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.631+0000 7f9c1759e640 1 -- 172.21.15.102:0/3134498219 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c180ce960 msgr2=0x7f9c181f1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:18.634 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.631+0000 7f9c1759e640 1 --2- 172.21.15.102:0/3134498219 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c180ce960 0x7f9c181f1c10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9c1000c730 tx=0x7f9c1000cbf0 comp rx=0 tx=0).stop 2023-10-14T09:37:18.634 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.631+0000 7f9c1759e640 1 -- 172.21.15.102:0/3134498219 shutdown_connections 2023-10-14T09:37:18.634 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.631+0000 7f9c1759e640 1 --2- 172.21.15.102:0/3134498219 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f9bf806ae70 0x7f9bf806d330 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:18.634 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.631+0000 7f9c1759e640 1 --2- 172.21.15.102:0/3134498219 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c180ce960 0x7f9c181f1c10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:18.634 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.631+0000 7f9c1759e640 1 --2- 172.21.15.102:0/3134498219 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9c180b2080 0x7f9c181f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:18.635 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.631+0000 7f9c1759e640 1 --2- 172.21.15.102:0/3134498219 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9c180b1ca0 0x7f9c180c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:18.635 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.631+0000 7f9c1759e640 1 -- 172.21.15.102:0/3134498219 >> 172.21.15.102:0/3134498219 conn(0x7f9c180d2b90 msgr2=0x7f9c1815fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:18.635 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.631+0000 7f9c1759e640 1 -- 172.21.15.102:0/3134498219 shutdown_connections 2023-10-14T09:37:18.635 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.631+0000 7f9c1759e640 1 -- 172.21.15.102:0/3134498219 wait complete. 2023-10-14T09:37:18.650 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T09:37:18.857 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.855+0000 7f64163b6640 1 Processor -- start 2023-10-14T09:37:18.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.855+0000 7f64163b6640 1 -- start start 2023-10-14T09:37:18.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.857+0000 7f64163b6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f64100b3e70 0x7f64100d1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:18.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.857+0000 7f64163b6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64100b3940 con 0x7f64100b3070 2023-10-14T09:37:18.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.857+0000 7f64163b6640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64100b45e0 con 0x7f64100cfc10 2023-10-14T09:37:18.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.857+0000 7f64163b6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64100c7880 con 0x7f64100b3e70 2023-10-14T09:37:18.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.857+0000 7f6414953640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f64100b3e70 0x7f64100d1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:18.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.857+0000 7f6414953640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f64100b3e70 0x7f64100d1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49276/0 (socket says 172.21.15.102:49276) 2023-10-14T09:37:18.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.857+0000 7f6414953640 1 -- 172.21.15.102:0/101722818 learned_addr learned my addr 172.21.15.102:0/101722818 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:18.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.858+0000 7f6414953640 1 -- 172.21.15.102:0/101722818 >> v1:172.21.15.129:6789/0 conn(0x7f64100cfc10 legacy=0x7f64100d0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:18.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.858+0000 7f6414953640 1 -- 172.21.15.102:0/101722818 >> v1:172.21.15.102:6789/0 conn(0x7f64100b3070 legacy=0x7f64100cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:18.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.858+0000 7f6414953640 1 -- 172.21.15.102:0/101722818 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64100b3b90 con 0x7f64100b3e70 2023-10-14T09:37:18.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.859+0000 7f6414953640 1 --2- 172.21.15.102:0/101722818 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64100b3e70 0x7f64100d1210 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6408009e50 tx=0x7f640802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ed15147c5358af server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:18.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.861+0000 7f640f7fe640 1 -- 172.21.15.102:0/101722818 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640802cb20 con 0x7f64100b3e70 2023-10-14T09:37:18.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.861+0000 7f640f7fe640 1 -- 172.21.15.102:0/101722818 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640802cc80 con 0x7f64100b3e70 2023-10-14T09:37:18.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.861+0000 7f640f7fe640 1 -- 172.21.15.102:0/101722818 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64080343f0 con 0x7f64100b3e70 2023-10-14T09:37:18.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.862+0000 7f64163b6640 1 -- 172.21.15.102:0/101722818 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64100b3e70 msgr2=0x7f64100d1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:18.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.862+0000 7f64163b6640 1 --2- 172.21.15.102:0/101722818 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64100b3e70 0x7f64100d1210 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6408009e50 tx=0x7f640802bf80 comp rx=0 tx=0).stop 2023-10-14T09:37:18.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.862+0000 7f64163b6640 1 -- 172.21.15.102:0/101722818 shutdown_connections 2023-10-14T09:37:18.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.862+0000 7f64163b6640 1 --2- 172.21.15.102:0/101722818 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64100b3e70 0x7f64100d1210 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:18.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.862+0000 7f64163b6640 1 -- 172.21.15.102:0/101722818 >> 172.21.15.102:0/101722818 conn(0x7f64100d2d20 msgr2=0x7f64100d3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:18.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.862+0000 7f64163b6640 1 -- 172.21.15.102:0/101722818 shutdown_connections 2023-10-14T09:37:18.866 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.862+0000 7f64163b6640 1 -- 172.21.15.102:0/101722818 wait complete. 2023-10-14T09:37:18.867 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.864+0000 7f64163b6640 1 Processor -- start 2023-10-14T09:37:18.868 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.864+0000 7f64163b6640 1 -- start start 2023-10-14T09:37:18.868 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.865+0000 7f64163b6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f64100b3070 0x7f641009ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:18.868 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.865+0000 7f64163b6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64100b3e70 0x7f641009d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:18.868 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.865+0000 7f64163b6640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f64100cfc10 0x7f64101f5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:18.869 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.865+0000 7f64163b6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6410151f10 con 0x7f64100b3e70 2023-10-14T09:37:18.869 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.865+0000 7f64163b6640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641015fdd0 con 0x7f64100b3070 2023-10-14T09:37:18.869 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.865+0000 7f64163b6640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f641009d100 con 0x7f64100cfc10 2023-10-14T09:37:18.869 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.865+0000 7f6407fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64100b3e70 0x7f641009d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:18.869 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.865+0000 7f6407fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64100b3e70 0x7f641009d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49288/0 (socket says 172.21.15.102:49288) 2023-10-14T09:37:18.869 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.865+0000 7f6407fff640 1 -- 172.21.15.102:0/577457415 learned_addr learned my addr 172.21.15.102:0/577457415 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:18.870 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.865+0000 7f6407fff640 1 -- 172.21.15.102:0/577457415 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f64100cfc10 msgr2=0x7f64101f5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:18.870 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.865+0000 7f6407fff640 1 --2- 172.21.15.102:0/577457415 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f64100cfc10 0x7f64101f5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:18.870 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.865+0000 7f640ffff640 1 --2- 172.21.15.102:0/577457415 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f64100b3070 0x7f641009ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:18.870 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.865+0000 7f6407fff640 1 -- 172.21.15.102:0/577457415 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f64100b3070 msgr2=0x7f641009ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:18.870 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.865+0000 7f6407fff640 1 --2- 172.21.15.102:0/577457415 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f64100b3070 0x7f641009ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:18.871 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.865+0000 7f6407fff640 1 -- 172.21.15.102:0/577457415 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6408009b30 con 0x7f64100b3e70 2023-10-14T09:37:18.871 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.865+0000 7f640ffff640 1 --2- 172.21.15.102:0/577457415 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f64100b3070 0x7f641009ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:18.871 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.866+0000 7f6407fff640 1 --2- 172.21.15.102:0/577457415 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64100b3e70 0x7f641009d930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f63f800b3f0 tx=0x7f63f800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:18.871 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.866+0000 7f640d7fa640 1 -- 172.21.15.102:0/577457415 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f8011830 con 0x7f64100b3e70 2023-10-14T09:37:18.871 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.866+0000 7f640d7fa640 1 -- 172.21.15.102:0/577457415 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f8011990 con 0x7f64100b3e70 2023-10-14T09:37:18.872 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.866+0000 7f640d7fa640 1 -- 172.21.15.102:0/577457415 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f8011d40 con 0x7f64100b3e70 2023-10-14T09:37:18.872 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.866+0000 7f64163b6640 1 -- 172.21.15.102:0/577457415 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6410151570 con 0x7f64100b3e70 2023-10-14T09:37:18.872 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.866+0000 7f64163b6640 1 -- 172.21.15.102:0/577457415 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6410151b30 con 0x7f64100b3e70 2023-10-14T09:37:18.873 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.867+0000 7f64163b6640 1 -- 172.21.15.102:0/577457415 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6410152050 con 0x7f64100b3e70 2023-10-14T09:37:18.873 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.868+0000 7f640d7fa640 1 -- 172.21.15.102:0/577457415 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f63f801a400 con 0x7f64100b3e70 2023-10-14T09:37:18.873 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.869+0000 7f640d7fa640 1 --2- 172.21.15.102:0/577457415 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f63f006ae70 0x7f63f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:18.873 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.869+0000 7f640d7fa640 1 -- 172.21.15.102:0/577457415 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f63f8089130 con 0x7f64100b3e70 2023-10-14T09:37:18.874 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.870+0000 7f640ffff640 1 --2- 172.21.15.102:0/577457415 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f63f006ae70 0x7f63f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:18.874 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.870+0000 7f640ffff640 1 --2- 172.21.15.102:0/577457415 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f63f006ae70 0x7f63f006d330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6400000fd0 tx=0x7f6400009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:18.875 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:18.874+0000 7f640d7fa640 1 -- 172.21.15.102:0/577457415 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6410152050 con 0x7f64100b3e70 2023-10-14T09:37:19.068 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.067+0000 7f64163b6640 1 -- 172.21.15.102:0/577457415 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6410152050 con 0x7f64100b3e70 2023-10-14T09:37:19.069 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.067+0000 7f640d7fa640 1 -- 172.21.15.102:0/577457415 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7f6410152050 con 0x7f64100b3e70 2023-10-14T09:37:19.069 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:37:19.070 INFO:teuthology.orchestra.run.smithi102.stdout:[ 2023-10-14T09:37:19.070 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-10-14T09:37:19.070 INFO:teuthology.orchestra.run.smithi102.stdout: "poolnum": 1, 2023-10-14T09:37:19.070 INFO:teuthology.orchestra.run.smithi102.stdout: "poolname": ".mgr" 2023-10-14T09:37:19.070 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-10-14T09:37:19.071 INFO:teuthology.orchestra.run.smithi102.stdout:] 2023-10-14T09:37:19.072 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.070+0000 7f64163b6640 1 -- 172.21.15.102:0/577457415 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f63f006ae70 msgr2=0x7f63f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:19.072 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.070+0000 7f64163b6640 1 --2- 172.21.15.102:0/577457415 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f63f006ae70 0x7f63f006d330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6400000fd0 tx=0x7f6400009040 comp rx=0 tx=0).stop 2023-10-14T09:37:19.072 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.070+0000 7f64163b6640 1 -- 172.21.15.102:0/577457415 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64100b3e70 msgr2=0x7f641009d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:19.072 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.070+0000 7f64163b6640 1 --2- 172.21.15.102:0/577457415 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64100b3e70 0x7f641009d930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f63f800b3f0 tx=0x7f63f800b8b0 comp rx=0 tx=0).stop 2023-10-14T09:37:19.073 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.070+0000 7f64163b6640 1 -- 172.21.15.102:0/577457415 shutdown_connections 2023-10-14T09:37:19.073 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.070+0000 7f64163b6640 1 --2- 172.21.15.102:0/577457415 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f63f006ae70 0x7f63f006d330 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:19.073 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.070+0000 7f64163b6640 1 --2- 172.21.15.102:0/577457415 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f64100cfc10 0x7f64101f5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:19.073 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.070+0000 7f64163b6640 1 --2- 172.21.15.102:0/577457415 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64100b3e70 0x7f641009d930 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:19.073 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.070+0000 7f64163b6640 1 --2- 172.21.15.102:0/577457415 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f64100b3070 0x7f641009ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:19.073 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.070+0000 7f64163b6640 1 -- 172.21.15.102:0/577457415 >> 172.21.15.102:0/577457415 conn(0x7f64100d2d20 msgr2=0x7f64101600f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:19.074 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.070+0000 7f64163b6640 1 -- 172.21.15.102:0/577457415 shutdown_connections 2023-10-14T09:37:19.074 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.070+0000 7f64163b6640 1 -- 172.21.15.102:0/577457415 wait complete. 2023-10-14T09:37:19.089 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-14T09:37:19.089 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-14T09:37:19.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.304+0000 7fa6d30ca640 1 Processor -- start 2023-10-14T09:37:19.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.304+0000 7fa6d30ca640 1 -- start start 2023-10-14T09:37:19.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.305+0000 7fa6d30ca640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa6cc15ad80 0x7fa6cc06cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:19.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.305+0000 7fa6d30ca640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa6cc0ca310 0x7fa6cc06d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:19.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.305+0000 7fa6d30ca640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6cc0c8e70 con 0x7fa6cc0cae40 2023-10-14T09:37:19.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.305+0000 7fa6d30ca640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6cc0b4170 con 0x7fa6cc15ad80 2023-10-14T09:37:19.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.305+0000 7fa6d30ca640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc0adde0 con 0x7fa6cc0ca310 2023-10-14T09:37:19.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.306+0000 7fa6d20c8640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa6cc15ad80 0x7fa6cc06cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:19.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.306+0000 7fa6d20c8640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa6cc15ad80 0x7fa6cc06cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49304/0 (socket says 172.21.15.102:49304) 2023-10-14T09:37:19.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.306+0000 7fa6d20c8640 1 -- 172.21.15.102:0/864603784 learned_addr learned my addr 172.21.15.102:0/864603784 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:19.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.306+0000 7fa6d28c9640 1 --2- 172.21.15.102:0/864603784 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa6cc0ca310 0x7fa6cc06d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:19.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.306+0000 7fa6d20c8640 1 -- 172.21.15.102:0/864603784 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa6cc0ca310 msgr2=0x7fa6cc06d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:19.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.306+0000 7fa6d20c8640 1 --2- 172.21.15.102:0/864603784 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa6cc0ca310 0x7fa6cc06d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:19.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.306+0000 7fa6d20c8640 1 -- 172.21.15.102:0/864603784 >> v1:172.21.15.102:6789/0 conn(0x7fa6cc0cae40 legacy=0x7fa6cc06b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:19.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.306+0000 7fa6d20c8640 1 -- 172.21.15.102:0/864603784 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6cc0b4410 con 0x7fa6cc15ad80 2023-10-14T09:37:19.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.306+0000 7fa6d10c6640 1 -- 172.21.15.102:0/864603784 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1743153708 0 0) 0x7fa6cc0c8e70 con 0x7fa6cc0cae40 2023-10-14T09:37:19.311 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.306+0000 7fa6d28c9640 1 --2- 172.21.15.102:0/864603784 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa6cc0ca310 0x7fa6cc06d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:19.312 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.307+0000 7fa6d20c8640 1 --2- 172.21.15.102:0/864603784 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6cc15ad80 0x7fa6cc06cb70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8009870 tx=0x7fa6c802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d65b5ceeb70d0d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:19.312 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.307+0000 7fa6d10c6640 1 -- 172.21.15.102:0/864603784 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8030840 con 0x7fa6cc15ad80 2023-10-14T09:37:19.312 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.307+0000 7fa6d10c6640 1 -- 172.21.15.102:0/864603784 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c80309a0 con 0x7fa6cc15ad80 2023-10-14T09:37:19.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.307+0000 7fa6d10c6640 1 -- 172.21.15.102:0/864603784 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8030d30 con 0x7fa6cc15ad80 2023-10-14T09:37:19.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.308+0000 7fa6d30ca640 1 -- 172.21.15.102:0/864603784 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6cc15ad80 msgr2=0x7fa6cc06cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:19.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.308+0000 7fa6d30ca640 1 --2- 172.21.15.102:0/864603784 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6cc15ad80 0x7fa6cc06cb70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8009870 tx=0x7fa6c802b980 comp rx=0 tx=0).stop 2023-10-14T09:37:19.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.308+0000 7fa6d30ca640 1 -- 172.21.15.102:0/864603784 shutdown_connections 2023-10-14T09:37:19.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.308+0000 7fa6d30ca640 1 --2- 172.21.15.102:0/864603784 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa6cc0ca310 0x7fa6cc06d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:19.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.308+0000 7fa6d30ca640 1 --2- 172.21.15.102:0/864603784 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6cc15ad80 0x7fa6cc06cb70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:19.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.308+0000 7fa6d30ca640 1 -- 172.21.15.102:0/864603784 >> 172.21.15.102:0/864603784 conn(0x7fa6cc0ce820 msgr2=0x7fa6cc0cec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:19.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.308+0000 7fa6d30ca640 1 -- 172.21.15.102:0/864603784 shutdown_connections 2023-10-14T09:37:19.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.308+0000 7fa6d30ca640 1 -- 172.21.15.102:0/864603784 wait complete. 2023-10-14T09:37:19.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.310+0000 7fa6d30ca640 1 Processor -- start 2023-10-14T09:37:19.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.310+0000 7fa6d30ca640 1 -- start start 2023-10-14T09:37:19.316 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.311+0000 7fa6d30ca640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6cc0ca310 0x7fa6cc150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:19.317 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.311+0000 7fa6d30ca640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa6cc0cae40 0x7fa6cc1f0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:19.317 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.311+0000 7fa6d30ca640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa6cc15ad80 0x7fa6cc1568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:19.317 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.311+0000 7fa6d30ca640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc156e30 con 0x7fa6cc0ca310 2023-10-14T09:37:19.317 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.311+0000 7fa6d30ca640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc153e60 con 0x7fa6cc15ad80 2023-10-14T09:37:19.317 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.311+0000 7fa6d30ca640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc154140 con 0x7fa6cc0cae40 2023-10-14T09:37:19.318 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.311+0000 7fa6d20c8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6cc0ca310 0x7fa6cc150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:19.318 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.311+0000 7fa6d20c8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6cc0ca310 0x7fa6cc150220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49312/0 (socket says 172.21.15.102:49312) 2023-10-14T09:37:19.318 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.311+0000 7fa6d20c8640 1 -- 172.21.15.102:0/1006539266 learned_addr learned my addr 172.21.15.102:0/1006539266 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:19.318 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.312+0000 7fa6d18c7640 1 --2- 172.21.15.102:0/1006539266 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa6cc0cae40 0x7fa6cc1f0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:19.318 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.312+0000 7fa6d28c9640 1 --2- 172.21.15.102:0/1006539266 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa6cc15ad80 0x7fa6cc1568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:19.318 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.312+0000 7fa6d20c8640 1 -- 172.21.15.102:0/1006539266 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa6cc0cae40 msgr2=0x7fa6cc1f0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:19.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.312+0000 7fa6d20c8640 1 --2- 172.21.15.102:0/1006539266 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa6cc0cae40 0x7fa6cc1f0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:19.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.312+0000 7fa6d20c8640 1 -- 172.21.15.102:0/1006539266 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa6cc15ad80 msgr2=0x7fa6cc1568f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:19.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.312+0000 7fa6d20c8640 1 --2- 172.21.15.102:0/1006539266 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa6cc15ad80 0x7fa6cc1568f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:19.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.312+0000 7fa6d20c8640 1 -- 172.21.15.102:0/1006539266 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c80094d0 con 0x7fa6cc0ca310 2023-10-14T09:37:19.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.312+0000 7fa6d28c9640 1 --2- 172.21.15.102:0/1006539266 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa6cc15ad80 0x7fa6cc1568f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:19.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.312+0000 7fa6d20c8640 1 --2- 172.21.15.102:0/1006539266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6cc0ca310 0x7fa6cc150220 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8000c00 tx=0x7fa6c8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:19.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.312+0000 7fa6c2ffd640 1 -- 172.21.15.102:0/1006539266 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8030810 con 0x7fa6cc0ca310 2023-10-14T09:37:19.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.312+0000 7fa6c2ffd640 1 -- 172.21.15.102:0/1006539266 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c8039d90 con 0x7fa6cc0ca310 2023-10-14T09:37:19.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.312+0000 7fa6c2ffd640 1 -- 172.21.15.102:0/1006539266 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8043670 con 0x7fa6cc0ca310 2023-10-14T09:37:19.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.312+0000 7fa6d30ca640 1 -- 172.21.15.102:0/1006539266 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6cc154420 con 0x7fa6cc0ca310 2023-10-14T09:37:19.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.312+0000 7fa6d30ca640 1 -- 172.21.15.102:0/1006539266 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6cc157040 con 0x7fa6cc0ca310 2023-10-14T09:37:19.321 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.313+0000 7fa6d30ca640 1 -- 172.21.15.102:0/1006539266 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6cc04e9b0 con 0x7fa6cc0ca310 2023-10-14T09:37:19.321 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.314+0000 7fa6c2ffd640 1 -- 172.21.15.102:0/1006539266 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa6c802f390 con 0x7fa6cc0ca310 2023-10-14T09:37:19.322 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.315+0000 7fa6c2ffd640 1 --2- 172.21.15.102:0/1006539266 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa6b006aea0 0x7fa6b006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:19.322 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.315+0000 7fa6c2ffd640 1 -- 172.21.15.102:0/1006539266 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa6c80ab690 con 0x7fa6cc0ca310 2023-10-14T09:37:19.322 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.316+0000 7fa6d18c7640 1 --2- 172.21.15.102:0/1006539266 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa6b006aea0 0x7fa6b006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:19.322 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.316+0000 7fa6d18c7640 1 --2- 172.21.15.102:0/1006539266 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa6b006aea0 0x7fa6b006d360 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc0afa50 tx=0x7fa6bc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:19.322 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.320+0000 7fa6c2ffd640 1 -- 172.21.15.102:0/1006539266 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa6c80769f0 con 0x7fa6cc0ca310 2023-10-14T09:37:19.510 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.508+0000 7fa6d30ca640 1 -- 172.21.15.102:0/1006539266 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa6cc06cf30 con 0x7fa6cc0ca310 2023-10-14T09:37:19.876 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.874+0000 7fa6c2ffd640 1 -- 172.21.15.102:0/1006539266 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa6c807a010 con 0x7fa6cc0ca310 2023-10-14T09:37:19.877 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'cephfs_metadata' created 2023-10-14T09:37:19.880 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.878+0000 7fa6d30ca640 1 -- 172.21.15.102:0/1006539266 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa6b006aea0 msgr2=0x7fa6b006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:19.880 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.878+0000 7fa6d30ca640 1 --2- 172.21.15.102:0/1006539266 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa6b006aea0 0x7fa6b006d360 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc0afa50 tx=0x7fa6bc009040 comp rx=0 tx=0).stop 2023-10-14T09:37:19.881 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.879+0000 7fa6d30ca640 1 -- 172.21.15.102:0/1006539266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6cc0ca310 msgr2=0x7fa6cc150220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:19.881 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.879+0000 7fa6d30ca640 1 --2- 172.21.15.102:0/1006539266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6cc0ca310 0x7fa6cc150220 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8000c00 tx=0x7fa6c8004730 comp rx=0 tx=0).stop 2023-10-14T09:37:19.881 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.879+0000 7fa6d30ca640 1 -- 172.21.15.102:0/1006539266 shutdown_connections 2023-10-14T09:37:19.882 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.879+0000 7fa6d30ca640 1 --2- 172.21.15.102:0/1006539266 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa6b006aea0 0x7fa6b006d360 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:19.882 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.879+0000 7fa6d30ca640 1 --2- 172.21.15.102:0/1006539266 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa6cc15ad80 0x7fa6cc1568f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:19.882 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.879+0000 7fa6d30ca640 1 --2- 172.21.15.102:0/1006539266 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa6cc0cae40 0x7fa6cc1f0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:19.882 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.879+0000 7fa6d30ca640 1 --2- 172.21.15.102:0/1006539266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6cc0ca310 0x7fa6cc150220 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:19.883 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.879+0000 7fa6d30ca640 1 -- 172.21.15.102:0/1006539266 >> 172.21.15.102:0/1006539266 conn(0x7fa6cc0ce820 msgr2=0x7fa6cc158f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:19.883 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.881+0000 7fa6d30ca640 1 -- 172.21.15.102:0/1006539266 shutdown_connections 2023-10-14T09:37:19.883 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:19.881+0000 7fa6d30ca640 1 -- 172.21.15.102:0/1006539266 wait complete. 2023-10-14T09:37:19.906 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T09:37:20.108 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.106+0000 7f221980e640 1 Processor -- start 2023-10-14T09:37:20.108 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.106+0000 7f221980e640 1 -- start start 2023-10-14T09:37:20.110 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.107+0000 7f221980e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f221406ecd0 0x7f2214070e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:20.110 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.107+0000 7f221980e640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f2214071360 0x7f22140cd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:20.110 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.107+0000 7f221980e640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2214070660 con 0x7f221415a970 2023-10-14T09:37:20.110 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.107+0000 7f221980e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f221415dc60 con 0x7f221406ecd0 2023-10-14T09:37:20.111 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.107+0000 7f221980e640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f221415df40 con 0x7f2214071360 2023-10-14T09:37:20.111 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.108+0000 7f22127fc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f221406ecd0 0x7f2214070e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:20.111 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.108+0000 7f22127fc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f221406ecd0 0x7f2214070e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49324/0 (socket says 172.21.15.102:49324) 2023-10-14T09:37:20.111 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.108+0000 7f22127fc640 1 -- 172.21.15.102:0/4269178533 learned_addr learned my addr 172.21.15.102:0/4269178533 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:20.111 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.108+0000 7f22137fe640 1 --2- 172.21.15.102:0/4269178533 >> v2:172.21.15.129:3300/0 conn(0x7f2214071360 0x7f22140cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:20.111 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.108+0000 7f22127fc640 1 -- 172.21.15.102:0/4269178533 >> v2:172.21.15.129:3300/0 conn(0x7f2214071360 msgr2=0x7f22140cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:20.112 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.108+0000 7f22127fc640 1 --2- 172.21.15.102:0/4269178533 >> v2:172.21.15.129:3300/0 conn(0x7f2214071360 0x7f22140cd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:20.112 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.108+0000 7f22127fc640 1 -- 172.21.15.102:0/4269178533 >> v1:172.21.15.129:6789/0 conn(0x7f221415a970 legacy=0x7f221415d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:20.112 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.108+0000 7f22127fc640 1 -- 172.21.15.102:0/4269178533 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f221415e220 con 0x7f221406ecd0 2023-10-14T09:37:20.112 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.108+0000 7f22137fe640 1 --2- 172.21.15.102:0/4269178533 >> v2:172.21.15.129:3300/0 conn(0x7f2214071360 0x7f22140cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:20.114 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.109+0000 7f22127fc640 1 --2- 172.21.15.102:0/4269178533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f221406ecd0 0x7f2214070e20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f221406ada0 tx=0x7f21fc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a3db8142b427ab server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:20.114 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.110+0000 7f2211ffb640 1 -- 172.21.15.102:0/4269178533 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc031870 con 0x7f221406ecd0 2023-10-14T09:37:20.114 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.110+0000 7f2211ffb640 1 -- 172.21.15.102:0/4269178533 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21fc0319d0 con 0x7f221406ecd0 2023-10-14T09:37:20.114 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.110+0000 7f2211ffb640 1 -- 172.21.15.102:0/4269178533 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc031d60 con 0x7f221406ecd0 2023-10-14T09:37:20.114 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.110+0000 7f221980e640 1 -- 172.21.15.102:0/4269178533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f221406ecd0 msgr2=0x7f2214070e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:20.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.110+0000 7f221980e640 1 --2- 172.21.15.102:0/4269178533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f221406ecd0 0x7f2214070e20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f221406ada0 tx=0x7f21fc02b910 comp rx=0 tx=0).stop 2023-10-14T09:37:20.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.110+0000 7f221980e640 1 -- 172.21.15.102:0/4269178533 shutdown_connections 2023-10-14T09:37:20.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.110+0000 7f221980e640 1 --2- 172.21.15.102:0/4269178533 >> v2:172.21.15.129:3300/0 conn(0x7f2214071360 0x7f22140cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:20.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.110+0000 7f221980e640 1 --2- 172.21.15.102:0/4269178533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f221406ecd0 0x7f2214070e20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:20.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.110+0000 7f221980e640 1 -- 172.21.15.102:0/4269178533 >> 172.21.15.102:0/4269178533 conn(0x7f22140cfaa0 msgr2=0x7f22140cfeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:20.116 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.111+0000 7f221980e640 1 -- 172.21.15.102:0/4269178533 shutdown_connections 2023-10-14T09:37:20.116 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.111+0000 7f221980e640 1 -- 172.21.15.102:0/4269178533 wait complete. 2023-10-14T09:37:20.116 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.112+0000 7f221980e640 1 Processor -- start 2023-10-14T09:37:20.116 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.112+0000 7f221980e640 1 -- start start 2023-10-14T09:37:20.118 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.113+0000 7f221980e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f221406ecd0 0x7f22140afa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:20.118 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.113+0000 7f221980e640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f221415a970 0x7f2214159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:20.119 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.113+0000 7f221980e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f221415a150 0x7f221415f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:20.119 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.113+0000 7f221980e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22140b0c70 con 0x7f221415a150 2023-10-14T09:37:20.119 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.113+0000 7f221980e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22140afff0 con 0x7f221406ecd0 2023-10-14T09:37:20.119 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.113+0000 7f221980e640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22140b02d0 con 0x7f221415a970 2023-10-14T09:37:20.119 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.113+0000 7f22137fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f221415a150 0x7f221415f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:20.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.113+0000 7f22137fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f221415a150 0x7f221415f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49336/0 (socket says 172.21.15.102:49336) 2023-10-14T09:37:20.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.113+0000 7f22137fe640 1 -- 172.21.15.102:0/1291721001 learned_addr learned my addr 172.21.15.102:0/1291721001 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:20.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.114+0000 7f22137fe640 1 -- 172.21.15.102:0/1291721001 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f221415a970 msgr2=0x7f2214159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:20.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.114+0000 7f22137fe640 1 --2- 172.21.15.102:0/1291721001 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f221415a970 0x7f2214159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:20.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.114+0000 7f22137fe640 1 -- 172.21.15.102:0/1291721001 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f221406ecd0 msgr2=0x7f22140afa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:20.121 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.114+0000 7f2212ffd640 1 --2- 172.21.15.102:0/1291721001 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f221406ecd0 0x7f22140afa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:20.121 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.114+0000 7f22137fe640 1 --2- 172.21.15.102:0/1291721001 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f221406ecd0 0x7f22140afa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:20.121 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.114+0000 7f22137fe640 1 -- 172.21.15.102:0/1291721001 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21fc0094d0 con 0x7f221415a150 2023-10-14T09:37:20.121 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.114+0000 7f2212ffd640 1 --2- 172.21.15.102:0/1291721001 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f221406ecd0 0x7f22140afa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:20.121 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.114+0000 7f22137fe640 1 --2- 172.21.15.102:0/1291721001 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f221415a150 0x7f221415f720 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f220c00c7f0 tx=0x7f220c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:20.121 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.114+0000 7f220bfff640 1 -- 172.21.15.102:0/1291721001 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220c007820 con 0x7f221415a150 2023-10-14T09:37:20.122 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.114+0000 7f220bfff640 1 -- 172.21.15.102:0/1291721001 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f220c007980 con 0x7f221415a150 2023-10-14T09:37:20.122 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.114+0000 7f220bfff640 1 -- 172.21.15.102:0/1291721001 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220c007d30 con 0x7f221415a150 2023-10-14T09:37:20.122 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.114+0000 7f221980e640 1 -- 172.21.15.102:0/1291721001 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22140b05b0 con 0x7f221415a150 2023-10-14T09:37:20.122 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.115+0000 7f221980e640 1 -- 172.21.15.102:0/1291721001 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2214159eb0 con 0x7f221415a150 2023-10-14T09:37:20.122 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.115+0000 7f221980e640 1 -- 172.21.15.102:0/1291721001 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f221404e160 con 0x7f221415a150 2023-10-14T09:37:20.123 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.117+0000 7f220bfff640 1 -- 172.21.15.102:0/1291721001 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f220c0113f0 con 0x7f221415a150 2023-10-14T09:37:20.123 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.117+0000 7f220bfff640 1 --2- 172.21.15.102:0/1291721001 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f21f406aea0 0x7f21f406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:20.124 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.118+0000 7f220bfff640 1 -- 172.21.15.102:0/1291721001 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f220c089580 con 0x7f221415a150 2023-10-14T09:37:20.124 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.118+0000 7f2212ffd640 1 --2- 172.21.15.102:0/1291721001 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f21f406aea0 0x7f21f406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:20.124 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.118+0000 7f2212ffd640 1 --2- 172.21.15.102:0/1291721001 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f21f406aea0 0x7f21f406d360 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2204007eb0 tx=0x7f22040073c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:20.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.124+0000 7f220bfff640 1 -- 172.21.15.102:0/1291721001 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f220c054800 con 0x7f221415a150 2023-10-14T09:37:20.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.312+0000 7f221980e640 1 -- 172.21.15.102:0/1291721001 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f22140b5a20 con 0x7f221415a150 2023-10-14T09:37:20.890 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.888+0000 7f220bfff640 1 -- 172.21.15.102:0/1291721001 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7f220c057e20 con 0x7f221415a150 2023-10-14T09:37:20.890 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'cephfs_data' created 2023-10-14T09:37:20.893 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.891+0000 7f221980e640 1 -- 172.21.15.102:0/1291721001 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f21f406aea0 msgr2=0x7f21f406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:20.893 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.891+0000 7f221980e640 1 --2- 172.21.15.102:0/1291721001 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f21f406aea0 0x7f21f406d360 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2204007eb0 tx=0x7f22040073c0 comp rx=0 tx=0).stop 2023-10-14T09:37:20.894 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.891+0000 7f221980e640 1 -- 172.21.15.102:0/1291721001 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f221415a150 msgr2=0x7f221415f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:20.895 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.891+0000 7f221980e640 1 --2- 172.21.15.102:0/1291721001 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f221415a150 0x7f221415f720 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f220c00c7f0 tx=0x7f220c00ccb0 comp rx=0 tx=0).stop 2023-10-14T09:37:20.895 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.892+0000 7f221980e640 1 -- 172.21.15.102:0/1291721001 shutdown_connections 2023-10-14T09:37:20.895 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.892+0000 7f221980e640 1 --2- 172.21.15.102:0/1291721001 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f21f406aea0 0x7f21f406d360 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:20.895 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.892+0000 7f221980e640 1 --2- 172.21.15.102:0/1291721001 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f221415a150 0x7f221415f720 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:20.895 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.892+0000 7f221980e640 1 --2- 172.21.15.102:0/1291721001 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f221415a970 0x7f2214159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.892+0000 7f221980e640 1 --2- 172.21.15.102:0/1291721001 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f221406ecd0 0x7f22140afa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.892+0000 7f221980e640 1 -- 172.21.15.102:0/1291721001 >> 172.21.15.102:0/1291721001 conn(0x7f22140cfaa0 msgr2=0x7f22140ae8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.892+0000 7f221980e640 1 -- 172.21.15.102:0/1291721001 shutdown_connections 2023-10-14T09:37:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:20.892+0000 7f221980e640 1 -- 172.21.15.102:0/1291721001 wait complete. 2023-10-14T09:37:20.928 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-14T09:37:21.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.113+0000 7f525359e640 1 Processor -- start 2023-10-14T09:37:21.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.113+0000 7f525359e640 1 -- start start 2023-10-14T09:37:21.117 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.115+0000 7f525359e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f525415dde0 0x7f52540709e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:21.117 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.115+0000 7f525359e640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5254070f20 0x7f52540ac890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:21.117 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.115+0000 7f525359e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5254160a90 con 0x7f525415c9f0 2023-10-14T09:37:21.117 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.115+0000 7f525359e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52540cdec0 con 0x7f525415dde0 2023-10-14T09:37:21.117 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.115+0000 7f525359e640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52540cd900 con 0x7f5254070f20 2023-10-14T09:37:21.119 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.115+0000 7f5249d9b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f525415dde0 0x7f52540709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:21.119 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.115+0000 7f525259c640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f525415c9f0 0x7f52540c8cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:57744/0 (socket says 172.21.15.102:57744) 2023-10-14T09:37:21.119 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.115+0000 7f525259c640 1 -- 172.21.15.102:0/4067276150 learned_addr learned my addr 172.21.15.102:0/4067276150 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:21.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.115+0000 7f5252d9d640 1 --2- 172.21.15.102:0/4067276150 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5254070f20 0x7f52540ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:21.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.116+0000 7f5249d9b640 1 -- 172.21.15.102:0/4067276150 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5254070f20 msgr2=0x7f52540ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:21.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.116+0000 7f5249d9b640 1 --2- 172.21.15.102:0/4067276150 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5254070f20 0x7f52540ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:21.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.116+0000 7f5249d9b640 1 -- 172.21.15.102:0/4067276150 >> v1:172.21.15.102:6789/0 conn(0x7f525415c9f0 legacy=0x7f52540c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:21.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.116+0000 7f5249d9b640 1 -- 172.21.15.102:0/4067276150 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52540cdbe0 con 0x7f525415dde0 2023-10-14T09:37:21.121 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.117+0000 7f5249d9b640 1 --2- 172.21.15.102:0/4067276150 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f525415dde0 0x7f52540709e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f523c0097a0 tx=0x7f523c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf0424f85654b92 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:21.121 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.117+0000 7f5251d9b640 1 -- 172.21.15.102:0/4067276150 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c02d040 con 0x7f525415dde0 2023-10-14T09:37:21.121 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.117+0000 7f5251d9b640 1 -- 172.21.15.102:0/4067276150 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523c031810 con 0x7f525415dde0 2023-10-14T09:37:21.121 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.117+0000 7f5251d9b640 1 -- 172.21.15.102:0/4067276150 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c031ba0 con 0x7f525415dde0 2023-10-14T09:37:21.121 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.118+0000 7f525359e640 1 -- 172.21.15.102:0/4067276150 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f525415dde0 msgr2=0x7f52540709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:21.122 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.118+0000 7f525359e640 1 --2- 172.21.15.102:0/4067276150 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f525415dde0 0x7f52540709e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f523c0097a0 tx=0x7f523c02b8b0 comp rx=0 tx=0).stop 2023-10-14T09:37:21.124 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.118+0000 7f525359e640 1 -- 172.21.15.102:0/4067276150 shutdown_connections 2023-10-14T09:37:21.124 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.118+0000 7f525359e640 1 --2- 172.21.15.102:0/4067276150 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5254070f20 0x7f52540ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:21.124 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.118+0000 7f525359e640 1 --2- 172.21.15.102:0/4067276150 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f525415dde0 0x7f52540709e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:21.124 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.118+0000 7f525359e640 1 -- 172.21.15.102:0/4067276150 >> 172.21.15.102:0/4067276150 conn(0x7f52540ce6a0 msgr2=0x7f52540ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:21.125 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.118+0000 7f525359e640 1 -- 172.21.15.102:0/4067276150 shutdown_connections 2023-10-14T09:37:21.125 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.118+0000 7f525359e640 1 -- 172.21.15.102:0/4067276150 wait complete. 2023-10-14T09:37:21.125 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.119+0000 7f525359e640 1 Processor -- start 2023-10-14T09:37:21.125 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.120+0000 7f525359e640 1 -- start start 2023-10-14T09:37:21.125 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.121+0000 7f525359e640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5254070f20 0x7f525406c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:21.125 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.121+0000 7f525359e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f525415c9f0 0x7f525414ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:21.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.121+0000 7f525359e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f525415dde0 0x7f52540c6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:21.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.121+0000 7f525359e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52540c4a10 con 0x7f525415c9f0 2023-10-14T09:37:21.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.121+0000 7f525359e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52540c7d40 con 0x7f525415dde0 2023-10-14T09:37:21.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.121+0000 7f525359e640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52540c8020 con 0x7f5254070f20 2023-10-14T09:37:21.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.121+0000 7f5249d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f525415c9f0 0x7f525414ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:21.127 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.121+0000 7f5249d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f525415c9f0 0x7f525414ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49356/0 (socket says 172.21.15.102:49356) 2023-10-14T09:37:21.127 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.121+0000 7f5249d9b640 1 -- 172.21.15.102:0/3671467816 learned_addr learned my addr 172.21.15.102:0/3671467816 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:21.127 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.121+0000 7f5249d9b640 1 -- 172.21.15.102:0/3671467816 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5254070f20 msgr2=0x7f525406c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:21.127 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.121+0000 7f5249d9b640 1 --2- 172.21.15.102:0/3671467816 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5254070f20 0x7f525406c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:21.127 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.121+0000 7f5249d9b640 1 -- 172.21.15.102:0/3671467816 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f525415dde0 msgr2=0x7f52540c6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:21.128 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.121+0000 7f5249d9b640 1 --2- 172.21.15.102:0/3671467816 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f525415dde0 0x7f52540c6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:21.128 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.121+0000 7f5249d9b640 1 -- 172.21.15.102:0/3671467816 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523c009400 con 0x7f525415c9f0 2023-10-14T09:37:21.128 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.122+0000 7f5249d9b640 1 --2- 172.21.15.102:0/3671467816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f525415c9f0 0x7f525414ba60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f523c000c00 tx=0x7f523c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:21.128 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.122+0000 7f524b7fe640 1 -- 172.21.15.102:0/3671467816 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c03ad60 con 0x7f525415c9f0 2023-10-14T09:37:21.128 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.122+0000 7f524b7fe640 1 -- 172.21.15.102:0/3671467816 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523c0443f0 con 0x7f525415c9f0 2023-10-14T09:37:21.129 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.122+0000 7f524b7fe640 1 -- 172.21.15.102:0/3671467816 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c0447a0 con 0x7f525415c9f0 2023-10-14T09:37:21.129 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.122+0000 7f525359e640 1 -- 172.21.15.102:0/3671467816 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52540c8300 con 0x7f525415c9f0 2023-10-14T09:37:21.129 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.122+0000 7f525359e640 1 -- 172.21.15.102:0/3671467816 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52540c7400 con 0x7f525415c9f0 2023-10-14T09:37:21.130 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.123+0000 7f525359e640 1 -- 172.21.15.102:0/3671467816 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f525404e9b0 con 0x7f525415c9f0 2023-10-14T09:37:21.130 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.124+0000 7f524b7fe640 1 -- 172.21.15.102:0/3671467816 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f523c04d450 con 0x7f525415c9f0 2023-10-14T09:37:21.130 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.125+0000 7f524b7fe640 1 --2- 172.21.15.102:0/3671467816 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f523406ae70 0x7f523406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:21.131 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.125+0000 7f524b7fe640 1 -- 172.21.15.102:0/3671467816 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f523c0abc70 con 0x7f525415c9f0 2023-10-14T09:37:21.131 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.125+0000 7f525259c640 1 --2- 172.21.15.102:0/3671467816 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f523406ae70 0x7f523406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:21.131 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.126+0000 7f525259c640 1 --2- 172.21.15.102:0/3671467816 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f523406ae70 0x7f523406d330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f52440015f0 tx=0x7f5244007a40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:21.131 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.129+0000 7f524b7fe640 1 -- 172.21.15.102:0/3671467816 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f523c076df0 con 0x7f525415c9f0 2023-10-14T09:37:21.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.359+0000 7f525359e640 1 -- 172.21.15.102:0/3671467816 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f52540c5200 con 0x7f525415c9f0 2023-10-14T09:37:21.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.901+0000 7f524b7fe640 1 -- 172.21.15.102:0/3671467816 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f523c07a410 con 0x7f525415c9f0 2023-10-14T09:37:21.904 INFO:teuthology.orchestra.run.smithi102.stderr:new fs with metadata pool 2 and data pool 3 2023-10-14T09:37:21.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.905+0000 7f525359e640 1 -- 172.21.15.102:0/3671467816 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f523406ae70 msgr2=0x7f523406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:21.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.905+0000 7f525359e640 1 --2- 172.21.15.102:0/3671467816 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f523406ae70 0x7f523406d330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f52440015f0 tx=0x7f5244007a40 comp rx=0 tx=0).stop 2023-10-14T09:37:21.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.905+0000 7f525359e640 1 -- 172.21.15.102:0/3671467816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f525415c9f0 msgr2=0x7f525414ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:21.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.905+0000 7f525359e640 1 --2- 172.21.15.102:0/3671467816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f525415c9f0 0x7f525414ba60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f523c000c00 tx=0x7f523c0046c0 comp rx=0 tx=0).stop 2023-10-14T09:37:21.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.905+0000 7f525359e640 1 -- 172.21.15.102:0/3671467816 shutdown_connections 2023-10-14T09:37:21.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.905+0000 7f525359e640 1 --2- 172.21.15.102:0/3671467816 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f523406ae70 0x7f523406d330 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:21.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.905+0000 7f525359e640 1 --2- 172.21.15.102:0/3671467816 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f525415dde0 0x7f52540c6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:21.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.905+0000 7f525359e640 1 --2- 172.21.15.102:0/3671467816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f525415c9f0 0x7f525414ba60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:21.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.905+0000 7f525359e640 1 --2- 172.21.15.102:0/3671467816 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5254070f20 0x7f525406c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:21.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.905+0000 7f525359e640 1 -- 172.21.15.102:0/3671467816 >> 172.21.15.102:0/3671467816 conn(0x7f52540ce6a0 msgr2=0x7f525415a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:21.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.905+0000 7f525359e640 1 -- 172.21.15.102:0/3671467816 shutdown_connections 2023-10-14T09:37:21.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:21.906+0000 7f525359e640 1 -- 172.21.15.102:0/3671467816 wait complete. 2023-10-14T09:37:21.934 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:37:22.123 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.121+0000 7fa73d790640 1 Processor -- start 2023-10-14T09:37:22.123 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.121+0000 7fa73d790640 1 -- start start 2023-10-14T09:37:22.125 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.123+0000 7fa73d790640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa7380caa10 0x7fa73806fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:22.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.123+0000 7fa73d790640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa7380cc920 0x7fa7380ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:22.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.123+0000 7fa73d790640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa738159790 con 0x7fa7381593b0 2023-10-14T09:37:22.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.123+0000 7fa73d790640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7380c9b20 con 0x7fa7380caa10 2023-10-14T09:37:22.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.123+0000 7fa73d790640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7380c9e00 con 0x7fa7380cc920 2023-10-14T09:37:22.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.123+0000 7fa72e7fc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa7380caa10 0x7fa73806fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:22.127 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.123+0000 7fa736ffd640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fa7381593b0 0x7fa73806f550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:45548/0 (socket says 172.21.15.102:45548) 2023-10-14T09:37:22.127 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.123+0000 7fa736ffd640 1 -- 172.21.15.102:0/1802874930 learned_addr learned my addr 172.21.15.102:0/1802874930 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:22.127 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.124+0000 7fa7377fe640 1 --2- 172.21.15.102:0/1802874930 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa7380cc920 0x7fa7380ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:22.127 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.124+0000 7fa72e7fc640 1 -- 172.21.15.102:0/1802874930 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa7380cc920 msgr2=0x7fa7380ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:22.127 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.124+0000 7fa72e7fc640 1 --2- 172.21.15.102:0/1802874930 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa7380cc920 0x7fa7380ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:22.128 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.124+0000 7fa72e7fc640 1 -- 172.21.15.102:0/1802874930 >> v1:172.21.15.102:6789/0 conn(0x7fa7381593b0 legacy=0x7fa73806f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:22.128 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.124+0000 7fa72e7fc640 1 -- 172.21.15.102:0/1802874930 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7380ca0e0 con 0x7fa7380caa10 2023-10-14T09:37:22.128 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.124+0000 7fa7367fc640 1 -- 172.21.15.102:0/1802874930 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4241787771 0 0) 0x7fa738159790 con 0x7fa7381593b0 2023-10-14T09:37:22.128 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.124+0000 7fa7377fe640 1 --2- 172.21.15.102:0/1802874930 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa7380cc920 0x7fa7380ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:22.130 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.125+0000 7fa72e7fc640 1 --2- 172.21.15.102:0/1802874930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7380caa10 0x7fa73806fc60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa7200097a0 tx=0x7fa72002b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3067bf4914e05b0d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:22.130 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.125+0000 7fa7367fc640 1 -- 172.21.15.102:0/1802874930 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72002f050 con 0x7fa7380caa10 2023-10-14T09:37:22.130 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.125+0000 7fa7367fc640 1 -- 172.21.15.102:0/1802874930 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa720031700 con 0x7fa7380caa10 2023-10-14T09:37:22.131 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.125+0000 7fa7367fc640 1 -- 172.21.15.102:0/1802874930 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa720031a90 con 0x7fa7380caa10 2023-10-14T09:37:22.131 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.126+0000 7fa73d790640 1 -- 172.21.15.102:0/1802874930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7380caa10 msgr2=0x7fa73806fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:22.131 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.126+0000 7fa73d790640 1 --2- 172.21.15.102:0/1802874930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7380caa10 0x7fa73806fc60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa7200097a0 tx=0x7fa72002b7a0 comp rx=0 tx=0).stop 2023-10-14T09:37:22.131 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.126+0000 7fa73d790640 1 -- 172.21.15.102:0/1802874930 shutdown_connections 2023-10-14T09:37:22.131 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.126+0000 7fa73d790640 1 --2- 172.21.15.102:0/1802874930 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa7380cc920 0x7fa7380ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:22.132 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.126+0000 7fa73d790640 1 --2- 172.21.15.102:0/1802874930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7380caa10 0x7fa73806fc60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:22.132 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.126+0000 7fa73d790640 1 -- 172.21.15.102:0/1802874930 >> 172.21.15.102:0/1802874930 conn(0x7fa7380cb410 msgr2=0x7fa7380cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:22.132 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.126+0000 7fa73d790640 1 -- 172.21.15.102:0/1802874930 shutdown_connections 2023-10-14T09:37:22.132 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.126+0000 7fa73d790640 1 -- 172.21.15.102:0/1802874930 wait complete. 2023-10-14T09:37:22.133 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.128+0000 7fa73d790640 1 Processor -- start 2023-10-14T09:37:22.133 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.128+0000 7fa73d790640 1 -- start start 2023-10-14T09:37:22.136 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.129+0000 7fa73d790640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa7380caa10 0x7fa73815c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:22.136 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.129+0000 7fa73d790640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7380cc920 0x7fa738167500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:22.136 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.129+0000 7fa73d790640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa7381593b0 0x7fa738155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:22.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.129+0000 7fa73d790640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73814c970 con 0x7fa7380cc920 2023-10-14T09:37:22.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.129+0000 7fa73d790640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73815a150 con 0x7fa7381593b0 2023-10-14T09:37:22.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.129+0000 7fa73d790640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7380c6000 con 0x7fa7380caa10 2023-10-14T09:37:22.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.129+0000 7fa72e7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7380cc920 0x7fa738167500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:22.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.129+0000 7fa72e7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7380cc920 0x7fa738167500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44524/0 (socket says 172.21.15.102:44524) 2023-10-14T09:37:22.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.129+0000 7fa72e7fc640 1 -- 172.21.15.102:0/2203142441 learned_addr learned my addr 172.21.15.102:0/2203142441 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:22.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.129+0000 7fa736ffd640 1 --2- 172.21.15.102:0/2203142441 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa7380caa10 0x7fa73815c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:22.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.129+0000 7fa72e7fc640 1 -- 172.21.15.102:0/2203142441 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa7380caa10 msgr2=0x7fa73815c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:22.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.129+0000 7fa7377fe640 1 --2- 172.21.15.102:0/2203142441 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa7381593b0 0x7fa738155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:22.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.130+0000 7fa72e7fc640 1 --2- 172.21.15.102:0/2203142441 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa7380caa10 0x7fa73815c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:22.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.130+0000 7fa72e7fc640 1 -- 172.21.15.102:0/2203142441 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa7381593b0 msgr2=0x7fa738155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:22.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.130+0000 7fa72e7fc640 1 --2- 172.21.15.102:0/2203142441 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa7381593b0 0x7fa738155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:22.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.130+0000 7fa72e7fc640 1 -- 172.21.15.102:0/2203142441 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa720009400 con 0x7fa7380cc920 2023-10-14T09:37:22.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.130+0000 7fa736ffd640 1 --2- 172.21.15.102:0/2203142441 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa7380caa10 0x7fa73815c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:22.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.130+0000 7fa72e7fc640 1 --2- 172.21.15.102:0/2203142441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7380cc920 0x7fa738167500 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa7200098c0 tx=0x7fa7200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:22.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.130+0000 7fa72ffff640 1 -- 172.21.15.102:0/2203142441 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa720033a30 con 0x7fa7380cc920 2023-10-14T09:37:22.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.130+0000 7fa72ffff640 1 -- 172.21.15.102:0/2203142441 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa720033bb0 con 0x7fa7380cc920 2023-10-14T09:37:22.141 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.130+0000 7fa72ffff640 1 -- 172.21.15.102:0/2203142441 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72003c400 con 0x7fa7380cc920 2023-10-14T09:37:22.141 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.130+0000 7fa73d790640 1 -- 172.21.15.102:0/2203142441 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7380c62e0 con 0x7fa7380cc920 2023-10-14T09:37:22.141 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.130+0000 7fa73d790640 1 -- 172.21.15.102:0/2203142441 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7380c68a0 con 0x7fa7380cc920 2023-10-14T09:37:22.141 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.131+0000 7fa73d790640 1 -- 172.21.15.102:0/2203142441 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa73815a2e0 con 0x7fa7380cc920 2023-10-14T09:37:22.141 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.132+0000 7fa72ffff640 1 -- 172.21.15.102:0/2203142441 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa72003a040 con 0x7fa7380cc920 2023-10-14T09:37:22.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.133+0000 7fa72ffff640 1 --2- 172.21.15.102:0/2203142441 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa71806ae70 0x7fa71806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:22.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.133+0000 7fa72ffff640 1 -- 172.21.15.102:0/2203142441 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7200aa980 con 0x7fa7380cc920 2023-10-14T09:37:22.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.133+0000 7fa736ffd640 1 --2- 172.21.15.102:0/2203142441 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa71806ae70 0x7fa71806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:22.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.134+0000 7fa736ffd640 1 --2- 172.21.15.102:0/2203142441 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa71806ae70 0x7fa71806d330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa728000f60 tx=0x7fa728009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:22.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.137+0000 7fa72ffff640 1 -- 172.21.15.102:0/2203142441 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa73815a2e0 con 0x7fa7380cc920 2023-10-14T09:37:22.328 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.326+0000 7fa73d790640 1 -- 172.21.15.102:0/2203142441 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa73815a2e0 con 0x7fa7380cc920 2023-10-14T09:37:22.331 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.329+0000 7fa72ffff640 1 -- 172.21.15.102:0/2203142441 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16554 (secure 0 0 0) 0x7fa73815a2e0 con 0x7fa7380cc920 2023-10-14T09:37:22.331 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:37:22.332 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":21,"fsid":"8a6cd69d-7f5b-4f2a-806a-0176c10aed50","created":"2023-10-14T09:36:56.745172+0000","modified":"2023-10-14T09:37:21.361833+0000","last_up_change":"2023-10-14T09:37:09.791473+0000","last_in_change":"2023-10-14T09:37:00.547186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:37:09.952407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:37:19.560925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:37:20.363385+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e5aef8f3-878f-482b-b522-9a5b958b90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6801","nonce":1727250718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6803","nonce":1727250718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6807","nonce":1727250718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6805","nonce":1727250718}]},"public_addr":"172.21.15.102:6801/1727250718","cluster_addr":"172.21.15.102:6803/1727250718","heartbeat_back_addr":"172.21.15.102:6807/1727250718","heartbeat_front_addr":"172.21.15.102:6805/1727250718","state":["exists","up"]},{"osd":1,"uuid":"4a8cf50e-387b-4d47-9588-bd22e375a9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6809","nonce":1095651107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6811","nonce":1095651107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6815","nonce":1095651107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6813","nonce":1095651107}]},"public_addr":"172.21.15.102:6809/1095651107","cluster_addr":"172.21.15.102:6811/1095651107","heartbeat_back_addr":"172.21.15.102:6815/1095651107","heartbeat_front_addr":"172.21.15.102:6813/1095651107","state":["exists","up"]},{"osd":2,"uuid":"009ef55f-8a63-4219-bacd-d7c7b4500867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6820","nonce":2198222556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6825","nonce":2198222556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6831","nonce":2198222556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6829","nonce":2198222556}]},"public_addr":"172.21.15.102:6820/2198222556","cluster_addr":"172.21.15.102:6825/2198222556","heartbeat_back_addr":"172.21.15.102:6831/2198222556","heartbeat_front_addr":"172.21.15.102:6829/2198222556","state":["exists","up"]},{"osd":3,"uuid":"f2110eae-2ff9-4ed9-93d6-bd2361618211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6818","nonce":654726740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6821","nonce":654726740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6827","nonce":654726740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6823","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6824","nonce":654726740}]},"public_addr":"172.21.15.102:6818/654726740","cluster_addr":"172.21.15.102:6821/654726740","heartbeat_back_addr":"172.21.15.102:6827/654726740","heartbeat_front_addr":"172.21.15.102:6824/654726740","state":["exists","up"]},{"osd":4,"uuid":"33f1ae34-3100-40f7-9cb8-0eca2b358693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6817","nonce":507586170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6819","nonce":507586170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6823","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6825","nonce":507586170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6821","nonce":507586170}]},"public_addr":"172.21.15.129:6817/507586170","cluster_addr":"172.21.15.129:6819/507586170","heartbeat_back_addr":"172.21.15.129:6825/507586170","heartbeat_front_addr":"172.21.15.129:6821/507586170","state":["exists","up"]},{"osd":5,"uuid":"fab2fc62-3f3e-450d-93e0-770f39e80710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6801","nonce":1913451073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6803","nonce":1913451073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6807","nonce":1913451073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6805","nonce":1913451073}]},"public_addr":"172.21.15.129:6801/1913451073","cluster_addr":"172.21.15.129:6803/1913451073","heartbeat_back_addr":"172.21.15.129:6807/1913451073","heartbeat_front_addr":"172.21.15.129:6805/1913451073","state":["exists","up"]},{"osd":6,"uuid":"d7cc1d69-92e7-4253-a127-cfc0444a4809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6809","nonce":2853291511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6811","nonce":2853291511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6815","nonce":2853291511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6813","nonce":2853291511}]},"public_addr":"172.21.15.129:6809/2853291511","cluster_addr":"172.21.15.129:6811/2853291511","heartbeat_back_addr":"172.21.15.129:6815/2853291511","heartbeat_front_addr":"172.21.15.129:6813/2853291511","state":["exists","up"]},{"osd":7,"uuid":"1e403de1-09e2-4370-b9a7-e790ac44bbee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6824","nonce":2933886914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6827","nonce":2933886914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6831","nonce":2933886914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6829","nonce":2933886914}]},"public_addr":"172.21.15.129:6824/2933886914","cluster_addr":"172.21.15.129:6827/2933886914","heartbeat_back_addr":"172.21.15.129:6831/2933886914","heartbeat_front_addr":"172.21.15.129:6829/2933886914","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.849661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.868113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.933488+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.891794+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.901861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.858750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.911712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.996765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:37:22.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.332+0000 7fa73d790640 1 -- 172.21.15.102:0/2203142441 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa71806ae70 msgr2=0x7fa71806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:22.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.332+0000 7fa73d790640 1 --2- 172.21.15.102:0/2203142441 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa71806ae70 0x7fa71806d330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa728000f60 tx=0x7fa728009040 comp rx=0 tx=0).stop 2023-10-14T09:37:22.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.332+0000 7fa73d790640 1 -- 172.21.15.102:0/2203142441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7380cc920 msgr2=0x7fa738167500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:22.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.332+0000 7fa73d790640 1 --2- 172.21.15.102:0/2203142441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7380cc920 0x7fa738167500 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa7200098c0 tx=0x7fa7200046c0 comp rx=0 tx=0).stop 2023-10-14T09:37:22.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.332+0000 7fa73d790640 1 -- 172.21.15.102:0/2203142441 shutdown_connections 2023-10-14T09:37:22.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.332+0000 7fa73d790640 1 --2- 172.21.15.102:0/2203142441 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa71806ae70 0x7fa71806d330 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:22.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.332+0000 7fa73d790640 1 --2- 172.21.15.102:0/2203142441 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa7381593b0 0x7fa738155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:22.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.332+0000 7fa73d790640 1 --2- 172.21.15.102:0/2203142441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7380cc920 0x7fa738167500 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:22.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.332+0000 7fa73d790640 1 --2- 172.21.15.102:0/2203142441 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa7380caa10 0x7fa73815c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:22.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.332+0000 7fa73d790640 1 -- 172.21.15.102:0/2203142441 >> 172.21.15.102:0/2203142441 conn(0x7fa7380cb410 msgr2=0x7fa7380cd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:22.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.332+0000 7fa73d790640 1 -- 172.21.15.102:0/2203142441 shutdown_connections 2023-10-14T09:37:22.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.332+0000 7fa73d790640 1 -- 172.21.15.102:0/2203142441 wait complete. 2023-10-14T09:37:22.351 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:37:22.553 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.551+0000 7fd7261f5640 1 Processor -- start 2023-10-14T09:37:22.554 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.551+0000 7fd7261f5640 1 -- start start 2023-10-14T09:37:22.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.553+0000 7fd7261f5640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd720159b20 0x7fd72006bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:22.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.553+0000 7fd7261f5640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd7200b0b20 0x7fd72006fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:22.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.553+0000 7fd7261f5640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd72006f7f0 con 0x7fd720159f00 2023-10-14T09:37:22.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.553+0000 7fd7261f5640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd72006c5e0 con 0x7fd7200b0b20 2023-10-14T09:37:22.556 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.553+0000 7fd7261f5640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd72006c8c0 con 0x7fd720159b20 2023-10-14T09:37:22.556 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.553+0000 7fd716ffd640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fd720159f00 0x7fd7200b0410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:45560/0 (socket says 172.21.15.102:45560) 2023-10-14T09:37:22.556 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.553+0000 7fd716ffd640 1 -- 172.21.15.102:0/3467985264 learned_addr learned my addr 172.21.15.102:0/3467985264 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:22.556 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.553+0000 7fd71ffff640 1 --2- 172.21.15.102:0/3467985264 >> v2:172.21.15.102:3300/0 conn(0x7fd7200b0b20 0x7fd72006fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:22.558 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.553+0000 7fd71f7fe640 1 --2- 172.21.15.102:0/3467985264 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd720159b20 0x7fd72006bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:22.559 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.553+0000 7fd71effd640 1 -- 172.21.15.102:0/3467985264 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2054812575 0 0) 0x7fd72006f7f0 con 0x7fd720159f00 2023-10-14T09:37:22.559 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.553+0000 7fd71effd640 1 -- 172.21.15.102:0/3467985264 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd70c003520 con 0x7fd720159f00 2023-10-14T09:37:22.559 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.554+0000 7fd71ffff640 1 -- 172.21.15.102:0/3467985264 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd720159b20 msgr2=0x7fd72006bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:22.559 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.554+0000 7fd71ffff640 1 --2- 172.21.15.102:0/3467985264 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd720159b20 0x7fd72006bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:22.559 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.554+0000 7fd71ffff640 1 -- 172.21.15.102:0/3467985264 >> v1:172.21.15.102:6789/0 conn(0x7fd720159f00 legacy=0x7fd7200b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:22.560 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.554+0000 7fd71ffff640 1 -- 172.21.15.102:0/3467985264 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72006cba0 con 0x7fd7200b0b20 2023-10-14T09:37:22.560 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.555+0000 7fd71ffff640 1 --2- 172.21.15.102:0/3467985264 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7200b0b20 0x7fd72006fc80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd718009d90 tx=0x7fd71802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=567fef24785cf26 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:22.560 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.555+0000 7fd71effd640 1 -- 172.21.15.102:0/3467985264 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71802cc60 con 0x7fd7200b0b20 2023-10-14T09:37:22.561 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.555+0000 7fd71effd640 1 -- 172.21.15.102:0/3467985264 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71802cdc0 con 0x7fd7200b0b20 2023-10-14T09:37:22.561 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.555+0000 7fd71effd640 1 -- 172.21.15.102:0/3467985264 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd718034660 con 0x7fd7200b0b20 2023-10-14T09:37:22.561 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.555+0000 7fd7261f5640 1 -- 172.21.15.102:0/3467985264 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7200b0b20 msgr2=0x7fd72006fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:22.561 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.555+0000 7fd7261f5640 1 --2- 172.21.15.102:0/3467985264 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7200b0b20 0x7fd72006fc80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd718009d90 tx=0x7fd71802beb0 comp rx=0 tx=0).stop 2023-10-14T09:37:22.562 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.556+0000 7fd7261f5640 1 -- 172.21.15.102:0/3467985264 shutdown_connections 2023-10-14T09:37:22.562 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.556+0000 7fd7261f5640 1 --2- 172.21.15.102:0/3467985264 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7200b0b20 0x7fd72006fc80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:22.562 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.556+0000 7fd7261f5640 1 --2- 172.21.15.102:0/3467985264 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd720159b20 0x7fd72006bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:22.563 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.556+0000 7fd7261f5640 1 -- 172.21.15.102:0/3467985264 >> 172.21.15.102:0/3467985264 conn(0x7fd7200cb410 msgr2=0x7fd7200cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:22.563 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.556+0000 7fd7261f5640 1 -- 172.21.15.102:0/3467985264 shutdown_connections 2023-10-14T09:37:22.563 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.556+0000 7fd7261f5640 1 -- 172.21.15.102:0/3467985264 wait complete. 2023-10-14T09:37:22.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.557+0000 7fd7261f5640 1 Processor -- start 2023-10-14T09:37:22.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.558+0000 7fd7261f5640 1 -- start start 2023-10-14T09:37:22.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.558+0000 7fd7261f5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7200b0b20 0x7fd720150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:22.567 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.559+0000 7fd7261f5640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd720159b20 0x7fd720150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:22.567 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.559+0000 7fd7261f5640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd720159f00 0x7fd72015d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:22.567 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.559+0000 7fd7261f5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7200c1f30 con 0x7fd7200b0b20 2023-10-14T09:37:22.567 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.559+0000 7fd7261f5640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd720150840 con 0x7fd720159b20 2023-10-14T09:37:22.567 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.559+0000 7fd7261f5640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7200c2180 con 0x7fd720159f00 2023-10-14T09:37:22.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.559+0000 7fd71f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7200b0b20 0x7fd720150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:22.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.559+0000 7fd71f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7200b0b20 0x7fd720150a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44542/0 (socket says 172.21.15.102:44542) 2023-10-14T09:37:22.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.559+0000 7fd71f7fe640 1 -- 172.21.15.102:0/3184954716 learned_addr learned my addr 172.21.15.102:0/3184954716 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:22.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.559+0000 7fd71f7fe640 1 -- 172.21.15.102:0/3184954716 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd720159f00 msgr2=0x7fd72015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:22.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.559+0000 7fd71f7fe640 1 --2- 172.21.15.102:0/3184954716 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd720159f00 0x7fd72015d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:22.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.559+0000 7fd71f7fe640 1 -- 172.21.15.102:0/3184954716 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd720159b20 msgr2=0x7fd720150300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:22.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.559+0000 7fd71f7fe640 1 --2- 172.21.15.102:0/3184954716 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd720159b20 0x7fd720150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:22.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.559+0000 7fd71f7fe640 1 -- 172.21.15.102:0/3184954716 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd718009a70 con 0x7fd7200b0b20 2023-10-14T09:37:22.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.559+0000 7fd71f7fe640 1 --2- 172.21.15.102:0/3184954716 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7200b0b20 0x7fd720150a70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd71000d800 tx=0x7fd71000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:22.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.560+0000 7fd71cff9640 1 -- 172.21.15.102:0/3184954716 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71000b6c0 con 0x7fd7200b0b20 2023-10-14T09:37:22.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.560+0000 7fd71cff9640 1 -- 172.21.15.102:0/3184954716 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71000b820 con 0x7fd7200b0b20 2023-10-14T09:37:22.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.560+0000 7fd71cff9640 1 -- 172.21.15.102:0/3184954716 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71000bbb0 con 0x7fd7200b0b20 2023-10-14T09:37:22.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.560+0000 7fd7261f5640 1 -- 172.21.15.102:0/3184954716 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7200c2460 con 0x7fd7200b0b20 2023-10-14T09:37:22.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.560+0000 7fd7261f5640 1 -- 172.21.15.102:0/3184954716 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7200c2a20 con 0x7fd7200b0b20 2023-10-14T09:37:22.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.561+0000 7fd7261f5640 1 -- 172.21.15.102:0/3184954716 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7200c2be0 con 0x7fd7200b0b20 2023-10-14T09:37:22.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.562+0000 7fd71cff9640 1 -- 172.21.15.102:0/3184954716 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd71000bd10 con 0x7fd7200b0b20 2023-10-14T09:37:22.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.563+0000 7fd71cff9640 1 --2- 172.21.15.102:0/3184954716 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd70006aea0 0x7fd70006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:22.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.563+0000 7fd71cff9640 1 -- 172.21.15.102:0/3184954716 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd710089be0 con 0x7fd7200b0b20 2023-10-14T09:37:22.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.563+0000 7fd716ffd640 1 --2- 172.21.15.102:0/3184954716 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd70006aea0 0x7fd70006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:22.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.564+0000 7fd716ffd640 1 --2- 172.21.15.102:0/3184954716 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd70006aea0 0x7fd70006d360 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd7200adce0 tx=0x7fd708007930 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:22.572 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.567+0000 7fd71cff9640 1 -- 172.21.15.102:0/3184954716 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd710054bf0 con 0x7fd7200b0b20 2023-10-14T09:37:22.761 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.760+0000 7fd7261f5640 1 -- 172.21.15.102:0/3184954716 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd72004e160 con 0x7fd7200b0b20 2023-10-14T09:37:22.763 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.761+0000 7fd71cff9640 1 -- 172.21.15.102:0/3184954716 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16541 (secure 0 0 0) 0x7fd710058210 con 0x7fd7200b0b20 2023-10-14T09:37:22.764 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:37:22.764 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":22,"fsid":"8a6cd69d-7f5b-4f2a-806a-0176c10aed50","created":"2023-10-14T09:36:56.745172+0000","modified":"2023-10-14T09:37:22.712469+0000","last_up_change":"2023-10-14T09:37:09.791473+0000","last_in_change":"2023-10-14T09:37:00.547186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:37:09.952407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:37:19.560925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:37:20.363385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e5aef8f3-878f-482b-b522-9a5b958b90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6801","nonce":1727250718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6803","nonce":1727250718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6807","nonce":1727250718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6805","nonce":1727250718}]},"public_addr":"172.21.15.102:6801/1727250718","cluster_addr":"172.21.15.102:6803/1727250718","heartbeat_back_addr":"172.21.15.102:6807/1727250718","heartbeat_front_addr":"172.21.15.102:6805/1727250718","state":["exists","up"]},{"osd":1,"uuid":"4a8cf50e-387b-4d47-9588-bd22e375a9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6809","nonce":1095651107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6811","nonce":1095651107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6815","nonce":1095651107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6813","nonce":1095651107}]},"public_addr":"172.21.15.102:6809/1095651107","cluster_addr":"172.21.15.102:6811/1095651107","heartbeat_back_addr":"172.21.15.102:6815/1095651107","heartbeat_front_addr":"172.21.15.102:6813/1095651107","state":["exists","up"]},{"osd":2,"uuid":"009ef55f-8a63-4219-bacd-d7c7b4500867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6820","nonce":2198222556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6825","nonce":2198222556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6831","nonce":2198222556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6829","nonce":2198222556}]},"public_addr":"172.21.15.102:6820/2198222556","cluster_addr":"172.21.15.102:6825/2198222556","heartbeat_back_addr":"172.21.15.102:6831/2198222556","heartbeat_front_addr":"172.21.15.102:6829/2198222556","state":["exists","up"]},{"osd":3,"uuid":"f2110eae-2ff9-4ed9-93d6-bd2361618211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6818","nonce":654726740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6821","nonce":654726740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6827","nonce":654726740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6823","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6824","nonce":654726740}]},"public_addr":"172.21.15.102:6818/654726740","cluster_addr":"172.21.15.102:6821/654726740","heartbeat_back_addr":"172.21.15.102:6827/654726740","heartbeat_front_addr":"172.21.15.102:6824/654726740","state":["exists","up"]},{"osd":4,"uuid":"33f1ae34-3100-40f7-9cb8-0eca2b358693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6817","nonce":507586170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6819","nonce":507586170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6823","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6825","nonce":507586170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6821","nonce":507586170}]},"public_addr":"172.21.15.129:6817/507586170","cluster_addr":"172.21.15.129:6819/507586170","heartbeat_back_addr":"172.21.15.129:6825/507586170","heartbeat_front_addr":"172.21.15.129:6821/507586170","state":["exists","up"]},{"osd":5,"uuid":"fab2fc62-3f3e-450d-93e0-770f39e80710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6801","nonce":1913451073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6803","nonce":1913451073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6807","nonce":1913451073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6805","nonce":1913451073}]},"public_addr":"172.21.15.129:6801/1913451073","cluster_addr":"172.21.15.129:6803/1913451073","heartbeat_back_addr":"172.21.15.129:6807/1913451073","heartbeat_front_addr":"172.21.15.129:6805/1913451073","state":["exists","up"]},{"osd":6,"uuid":"d7cc1d69-92e7-4253-a127-cfc0444a4809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6809","nonce":2853291511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6811","nonce":2853291511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6815","nonce":2853291511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6813","nonce":2853291511}]},"public_addr":"172.21.15.129:6809/2853291511","cluster_addr":"172.21.15.129:6811/2853291511","heartbeat_back_addr":"172.21.15.129:6815/2853291511","heartbeat_front_addr":"172.21.15.129:6813/2853291511","state":["exists","up"]},{"osd":7,"uuid":"1e403de1-09e2-4370-b9a7-e790ac44bbee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6824","nonce":2933886914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6827","nonce":2933886914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6831","nonce":2933886914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6829","nonce":2933886914}]},"public_addr":"172.21.15.129:6824/2933886914","cluster_addr":"172.21.15.129:6827/2933886914","heartbeat_back_addr":"172.21.15.129:6831/2933886914","heartbeat_front_addr":"172.21.15.129:6829/2933886914","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.849661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.868113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.933488+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.891794+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.901861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.858750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.911712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.996765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:37:22.766 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.764+0000 7fd7261f5640 1 -- 172.21.15.102:0/3184954716 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd70006aea0 msgr2=0x7fd70006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:22.767 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.764+0000 7fd7261f5640 1 --2- 172.21.15.102:0/3184954716 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd70006aea0 0x7fd70006d360 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd7200adce0 tx=0x7fd708007930 comp rx=0 tx=0).stop 2023-10-14T09:37:22.767 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.764+0000 7fd7261f5640 1 -- 172.21.15.102:0/3184954716 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7200b0b20 msgr2=0x7fd720150a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:22.767 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.764+0000 7fd7261f5640 1 --2- 172.21.15.102:0/3184954716 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7200b0b20 0x7fd720150a70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd71000d800 tx=0x7fd71000dcc0 comp rx=0 tx=0).stop 2023-10-14T09:37:22.767 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.764+0000 7fd7261f5640 1 -- 172.21.15.102:0/3184954716 shutdown_connections 2023-10-14T09:37:22.768 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.764+0000 7fd7261f5640 1 --2- 172.21.15.102:0/3184954716 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd70006aea0 0x7fd70006d360 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:22.768 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.764+0000 7fd7261f5640 1 --2- 172.21.15.102:0/3184954716 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd720159f00 0x7fd72015d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:22.768 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.764+0000 7fd7261f5640 1 --2- 172.21.15.102:0/3184954716 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd720159b20 0x7fd720150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:22.768 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.764+0000 7fd7261f5640 1 --2- 172.21.15.102:0/3184954716 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7200b0b20 0x7fd720150a70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:22.769 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.764+0000 7fd7261f5640 1 -- 172.21.15.102:0/3184954716 >> 172.21.15.102:0/3184954716 conn(0x7fd7200cb410 msgr2=0x7fd7200acc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:22.769 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.764+0000 7fd7261f5640 1 -- 172.21.15.102:0/3184954716 shutdown_connections 2023-10-14T09:37:22.769 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.764+0000 7fd7261f5640 1 -- 172.21.15.102:0/3184954716 wait complete. 2023-10-14T09:37:22.784 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-14T09:37:22.995 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.993+0000 7f985cd33640 1 Processor -- start 2023-10-14T09:37:22.995 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.993+0000 7f985cd33640 1 -- start start 2023-10-14T09:37:22.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.994+0000 7f985cd33640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f9858159e90 0x7f98580ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:22.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.994+0000 7f985cd33640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9858070360 con 0x7f985806c140 2023-10-14T09:37:22.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.994+0000 7f985cd33640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98580cd1f0 con 0x7f9858159ab0 2023-10-14T09:37:22.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.994+0000 7f985cd33640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f985815d890 con 0x7f9858159e90 2023-10-14T09:37:22.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.995+0000 7f9856d9d640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f985806c140 0x7f985815dce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:45568/0 (socket says 172.21.15.102:45568) 2023-10-14T09:37:22.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.995+0000 7f9856d9d640 1 -- 172.21.15.102:0/3888567791 learned_addr learned my addr 172.21.15.102:0/3888567791 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:22.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.995+0000 7f984ffff640 1 --2- 172.21.15.102:0/3888567791 >> v2:172.21.15.129:3300/0 conn(0x7f9858159e90 0x7f98580ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:23.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.995+0000 7f9855d9b640 1 -- 172.21.15.102:0/3888567791 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3008663633 0 0) 0x7f9858070360 con 0x7f985806c140 2023-10-14T09:37:23.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.995+0000 7f9855d9b640 1 -- 172.21.15.102:0/3888567791 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9844005730 con 0x7f985806c140 2023-10-14T09:37:23.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.995+0000 7f9855d9b640 1 -- 172.21.15.102:0/3888567791 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4136204976 0 0) 0x7f9844005730 con 0x7f985806c140 2023-10-14T09:37:23.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.995+0000 7f9855d9b640 1 -- 172.21.15.102:0/3888567791 >> v2:172.21.15.129:3300/0 conn(0x7f9858159e90 msgr2=0x7f98580ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:23.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.995+0000 7f9855d9b640 1 --2- 172.21.15.102:0/3888567791 >> v2:172.21.15.129:3300/0 conn(0x7f9858159e90 0x7f98580ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:23.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.995+0000 7f9855d9b640 1 -- 172.21.15.102:0/3888567791 >> v1:172.21.15.129:6789/0 conn(0x7f9858159ab0 legacy=0x7f985806fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:23.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.995+0000 7f9855d9b640 1 -- 172.21.15.102:0/3888567791 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98580cd4d0 con 0x7f985806c140 2023-10-14T09:37:23.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.995+0000 7f9855d9b640 1 -- 172.21.15.102:0/3888567791 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4030661168 0 0) 0x7f98500019f0 con 0x7f985806c140 2023-10-14T09:37:23.002 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.995+0000 7f9855d9b640 1 -- 172.21.15.102:0/3888567791 >> v1:172.21.15.102:6789/0 conn(0x7f985806c140 legacy=0x7f985815dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:23.002 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.995+0000 7f9855d9b640 1 --2- 172.21.15.102:0/3888567791 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9844005b80 0x7f9844005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:23.002 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.996+0000 7f9855d9b640 1 --2- 172.21.15.102:0/3888567791 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98440069d0 0x7f9844006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:23.003 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.996+0000 7f9855d9b640 1 --2- 172.21.15.102:0/3888567791 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f98440074b0 0x7f984400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:23.003 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.996+0000 7f9855d9b640 1 -- 172.21.15.102:0/3888567791 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985815d890 con 0x7f98440069d0 2023-10-14T09:37:23.003 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.996+0000 7f9855d9b640 1 -- 172.21.15.102:0/3888567791 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984400e380 con 0x7f9844005b80 2023-10-14T09:37:23.003 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.996+0000 7f9855d9b640 1 -- 172.21.15.102:0/3888567791 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f984400e540 con 0x7f98440074b0 2023-10-14T09:37:23.003 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.996+0000 7f984ffff640 1 --2- 172.21.15.102:0/3888567791 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98440069d0 0x7f9844006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:23.004 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.996+0000 7f985659c640 1 --2- 172.21.15.102:0/3888567791 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9844005b80 0x7f9844005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:23.005 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.996+0000 7f984ffff640 1 -- 172.21.15.102:0/3888567791 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f98440074b0 msgr2=0x7f984400db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:23.005 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.996+0000 7f984ffff640 1 --2- 172.21.15.102:0/3888567791 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f98440074b0 0x7f984400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:23.006 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.996+0000 7f984ffff640 1 -- 172.21.15.102:0/3888567791 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9844005b80 msgr2=0x7f9844005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:23.006 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.996+0000 7f984ffff640 1 --2- 172.21.15.102:0/3888567791 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9844005b80 0x7f9844005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:23.006 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.996+0000 7f984ffff640 1 -- 172.21.15.102:0/3888567791 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9844005730 con 0x7f98440069d0 2023-10-14T09:37:23.006 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.996+0000 7f9856d9d640 1 -- 172.21.15.102:0/3888567791 reap_dead start 2023-10-14T09:37:23.007 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.998+0000 7f984ffff640 1 --2- 172.21.15.102:0/3888567791 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98440069d0 0x7f9844006e50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9840009a90 tx=0x7f9844007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5864166a44685b8d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:23.011 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.999+0000 7f9855d9b640 1 -- 172.21.15.102:0/3888567791 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984002c690 con 0x7f98440069d0 2023-10-14T09:37:23.011 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.999+0000 7f9855d9b640 1 -- 172.21.15.102:0/3888567791 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f984002c7f0 con 0x7f98440069d0 2023-10-14T09:37:23.011 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:22.999+0000 7f9855d9b640 1 -- 172.21.15.102:0/3888567791 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984002cb80 con 0x7f98440069d0 2023-10-14T09:37:23.011 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.000+0000 7f985cd33640 1 -- 172.21.15.102:0/3888567791 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98440069d0 msgr2=0x7f9844006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:23.011 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.000+0000 7f985cd33640 1 --2- 172.21.15.102:0/3888567791 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98440069d0 0x7f9844006e50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9840009a90 tx=0x7f9844007a00 comp rx=0 tx=0).stop 2023-10-14T09:37:23.012 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.000+0000 7f985cd33640 1 -- 172.21.15.102:0/3888567791 shutdown_connections 2023-10-14T09:37:23.012 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.000+0000 7f985cd33640 1 --2- 172.21.15.102:0/3888567791 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98440069d0 0x7f9844006e50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:23.012 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.000+0000 7f985cd33640 1 -- 172.21.15.102:0/3888567791 >> 172.21.15.102:0/3888567791 conn(0x7f98580ce9b0 msgr2=0x7f98580cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:23.012 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.000+0000 7f985cd33640 1 -- 172.21.15.102:0/3888567791 shutdown_connections 2023-10-14T09:37:23.012 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.000+0000 7f985cd33640 1 -- 172.21.15.102:0/3888567791 wait complete. 2023-10-14T09:37:23.013 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.002+0000 7f985cd33640 1 Processor -- start 2023-10-14T09:37:23.013 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.002+0000 7f985cd33640 1 -- start start 2023-10-14T09:37:23.013 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.003+0000 7f985cd33640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98440069d0 0x7f985815c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:23.013 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.003+0000 7f985cd33640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9858159160 0x7f985815c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:23.013 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.003+0000 7f985cd33640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f98580b3480 0x7f98580c24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:23.014 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.003+0000 7f985cd33640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98580b2750 con 0x7f98440069d0 2023-10-14T09:37:23.014 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.003+0000 7f985cd33640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98580b3dd0 con 0x7f98580b3480 2023-10-14T09:37:23.014 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.003+0000 7f985cd33640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98580b29a0 con 0x7f9858159160 2023-10-14T09:37:23.014 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.003+0000 7f985659c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98440069d0 0x7f985815c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:23.014 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.003+0000 7f985659c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98440069d0 0x7f985815c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44558/0 (socket says 172.21.15.102:44558) 2023-10-14T09:37:23.015 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.003+0000 7f985659c640 1 -- 172.21.15.102:0/2757637621 learned_addr learned my addr 172.21.15.102:0/2757637621 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:23.015 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.004+0000 7f985659c640 1 -- 172.21.15.102:0/2757637621 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9858159160 msgr2=0x7f985815c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:23.015 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.004+0000 7f985659c640 1 --2- 172.21.15.102:0/2757637621 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9858159160 0x7f985815c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:23.015 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.004+0000 7f985659c640 1 -- 172.21.15.102:0/2757637621 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f98580b3480 msgr2=0x7f98580c24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:23.015 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.004+0000 7f985659c640 1 --2- 172.21.15.102:0/2757637621 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f98580b3480 0x7f98580c24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:23.016 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.004+0000 7f985659c640 1 -- 172.21.15.102:0/2757637621 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98580b2c80 con 0x7f98440069d0 2023-10-14T09:37:23.016 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.004+0000 7f985659c640 1 --2- 172.21.15.102:0/2757637621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98440069d0 0x7f985815c340 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f984800e480 tx=0x7f984800e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:23.016 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.004+0000 7f984effd640 1 -- 172.21.15.102:0/2757637621 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98480052e0 con 0x7f98440069d0 2023-10-14T09:37:23.016 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.004+0000 7f984effd640 1 -- 172.21.15.102:0/2757637621 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9848005440 con 0x7f98440069d0 2023-10-14T09:37:23.016 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.004+0000 7f984effd640 1 -- 172.21.15.102:0/2757637621 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9848003810 con 0x7f98440069d0 2023-10-14T09:37:23.016 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.004+0000 7f985cd33640 1 -- 172.21.15.102:0/2757637621 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98580b2f60 con 0x7f98440069d0 2023-10-14T09:37:23.017 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.004+0000 7f985cd33640 1 -- 172.21.15.102:0/2757637621 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98580b3ad0 con 0x7f98440069d0 2023-10-14T09:37:23.017 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.006+0000 7f985cd33640 1 -- 172.21.15.102:0/2757637621 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f985804e160 con 0x7f98440069d0 2023-10-14T09:37:23.017 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.007+0000 7f984effd640 1 -- 172.21.15.102:0/2757637621 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9848003970 con 0x7f98440069d0 2023-10-14T09:37:23.017 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.007+0000 7f984effd640 1 --2- 172.21.15.102:0/2757637621 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f983806ae70 0x7f983806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:23.017 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.008+0000 7f984effd640 1 -- 172.21.15.102:0/2757637621 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9848089330 con 0x7f98440069d0 2023-10-14T09:37:23.018 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.008+0000 7f984ffff640 1 --2- 172.21.15.102:0/2757637621 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f983806ae70 0x7f983806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:23.018 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.008+0000 7f984ffff640 1 --2- 172.21.15.102:0/2757637621 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f983806ae70 0x7f983806d330 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9840036000 tx=0x7f984002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:23.018 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.012+0000 7f984effd640 1 -- 172.21.15.102:0/2757637621 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9848054470 con 0x7f98440069d0 2023-10-14T09:37:23.235 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.233+0000 7f985cd33640 1 -- 172.21.15.102:0/2757637621 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f98580cda90 con 0x7f98440069d0 2023-10-14T09:37:23.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.921+0000 7f984effd640 1 -- 172.21.15.102:0/2757637621 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9848057a90 con 0x7f98440069d0 2023-10-14T09:37:23.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.925+0000 7f985cd33640 1 -- 172.21.15.102:0/2757637621 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f983806ae70 msgr2=0x7f983806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:23.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.925+0000 7f985cd33640 1 --2- 172.21.15.102:0/2757637621 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f983806ae70 0x7f983806d330 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9840036000 tx=0x7f984002e000 comp rx=0 tx=0).stop 2023-10-14T09:37:23.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.925+0000 7f985cd33640 1 -- 172.21.15.102:0/2757637621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98440069d0 msgr2=0x7f985815c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:23.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.925+0000 7f985cd33640 1 --2- 172.21.15.102:0/2757637621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98440069d0 0x7f985815c340 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f984800e480 tx=0x7f984800e940 comp rx=0 tx=0).stop 2023-10-14T09:37:23.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.925+0000 7f985cd33640 1 -- 172.21.15.102:0/2757637621 shutdown_connections 2023-10-14T09:37:23.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.925+0000 7f985cd33640 1 --2- 172.21.15.102:0/2757637621 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f983806ae70 0x7f983806d330 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:23.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.925+0000 7f985cd33640 1 --2- 172.21.15.102:0/2757637621 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f98580b3480 0x7f98580c24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:23.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.925+0000 7f985cd33640 1 --2- 172.21.15.102:0/2757637621 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9858159160 0x7f985815c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:23.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.925+0000 7f985cd33640 1 --2- 172.21.15.102:0/2757637621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98440069d0 0x7f985815c340 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:23.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.925+0000 7f985cd33640 1 -- 172.21.15.102:0/2757637621 >> 172.21.15.102:0/2757637621 conn(0x7f98580ce9b0 msgr2=0x7f985806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:23.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.926+0000 7f985cd33640 1 -- 172.21.15.102:0/2757637621 shutdown_connections 2023-10-14T09:37:23.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:23.926+0000 7f985cd33640 1 -- 172.21.15.102:0/2757637621 wait complete. 2023-10-14T09:37:23.948 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-14T09:37:23.949 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-14T09:37:24.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.161+0000 7f5eb2f73640 1 Processor -- start 2023-10-14T09:37:24.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.161+0000 7f5eb2f73640 1 -- start start 2023-10-14T09:37:24.165 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.163+0000 7f5eb2f73640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5eac15d030 0x7f5eac0d1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:24.166 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.163+0000 7f5eb2f73640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f5eac0cd260 0x7f5eac0cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:24.166 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.163+0000 7f5eb2f73640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eac0b5d90 con 0x7f5eac15d410 2023-10-14T09:37:24.166 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.163+0000 7f5eb2f73640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eac0d2b50 con 0x7f5eac15d030 2023-10-14T09:37:24.166 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.163+0000 7f5eb2f73640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eac0cdbf0 con 0x7f5eac0cd260 2023-10-14T09:37:24.166 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.163+0000 7f5eb0d0f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5eac15d030 0x7f5eac0d1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:24.167 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.163+0000 7f5eabfff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f5eac15d410 0x7f5eac161450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:45570/0 (socket says 172.21.15.102:45570) 2023-10-14T09:37:24.167 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.163+0000 7f5eb0d0f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5eac15d030 0x7f5eac0d1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44562/0 (socket says 172.21.15.102:44562) 2023-10-14T09:37:24.167 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.163+0000 7f5eabfff640 1 -- 172.21.15.102:0/1449362596 learned_addr learned my addr 172.21.15.102:0/1449362596 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:24.167 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.164+0000 7f5eb1510640 1 --2- 172.21.15.102:0/1449362596 >> v2:172.21.15.129:3300/0 conn(0x7f5eac0cd260 0x7f5eac0cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:24.167 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.164+0000 7f5eb0d0f640 1 -- 172.21.15.102:0/1449362596 >> v2:172.21.15.129:3300/0 conn(0x7f5eac0cd260 msgr2=0x7f5eac0cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:24.168 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.164+0000 7f5eb0d0f640 1 --2- 172.21.15.102:0/1449362596 >> v2:172.21.15.129:3300/0 conn(0x7f5eac0cd260 0x7f5eac0cd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:24.168 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.164+0000 7f5eb0d0f640 1 -- 172.21.15.102:0/1449362596 >> v1:172.21.15.102:6789/0 conn(0x7f5eac15d410 legacy=0x7f5eac161450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:24.168 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.164+0000 7f5eb0d0f640 1 -- 172.21.15.102:0/1449362596 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eac160fc0 con 0x7f5eac15d030 2023-10-14T09:37:24.168 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.164+0000 7f5eb1510640 1 --2- 172.21.15.102:0/1449362596 >> v2:172.21.15.129:3300/0 conn(0x7f5eac0cd260 0x7f5eac0cd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:24.169 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.165+0000 7f5eb0d0f640 1 --2- 172.21.15.102:0/1449362596 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5eac15d030 0x7f5eac0d1630 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5eac0d0750 tx=0x7f5e9c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=add44fe46443c50c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:24.169 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.165+0000 7f5eab7fe640 1 -- 172.21.15.102:0/1449362596 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c02cd10 con 0x7f5eac15d030 2023-10-14T09:37:24.169 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.165+0000 7f5eab7fe640 1 -- 172.21.15.102:0/1449362596 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9c02ce70 con 0x7f5eac15d030 2023-10-14T09:37:24.170 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.165+0000 7f5eab7fe640 1 -- 172.21.15.102:0/1449362596 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c034640 con 0x7f5eac15d030 2023-10-14T09:37:24.170 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.165+0000 7f5eb2f73640 1 -- 172.21.15.102:0/1449362596 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5eac15d030 msgr2=0x7f5eac0d1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:24.170 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.165+0000 7f5eb2f73640 1 --2- 172.21.15.102:0/1449362596 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5eac15d030 0x7f5eac0d1630 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5eac0d0750 tx=0x7f5e9c02bf60 comp rx=0 tx=0).stop 2023-10-14T09:37:24.170 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.166+0000 7f5eb2f73640 1 -- 172.21.15.102:0/1449362596 shutdown_connections 2023-10-14T09:37:24.170 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.166+0000 7f5eb2f73640 1 --2- 172.21.15.102:0/1449362596 >> v2:172.21.15.129:3300/0 conn(0x7f5eac0cd260 0x7f5eac0cd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:24.171 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.166+0000 7f5eb2f73640 1 --2- 172.21.15.102:0/1449362596 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5eac15d030 0x7f5eac0d1630 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:24.171 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.166+0000 7f5eb2f73640 1 -- 172.21.15.102:0/1449362596 >> 172.21.15.102:0/1449362596 conn(0x7f5eac0cf720 msgr2=0x7f5eac0cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:24.171 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.166+0000 7f5eb2f73640 1 -- 172.21.15.102:0/1449362596 shutdown_connections 2023-10-14T09:37:24.171 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.166+0000 7f5eb2f73640 1 -- 172.21.15.102:0/1449362596 wait complete. 2023-10-14T09:37:24.171 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.168+0000 7f5eb2f73640 1 Processor -- start 2023-10-14T09:37:24.173 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.168+0000 7f5eb2f73640 1 -- start start 2023-10-14T09:37:24.173 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.169+0000 7f5eb2f73640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5eac0cd260 0x7f5eac15f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:24.174 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.169+0000 7f5eb2f73640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5eac15d030 0x7f5eac159990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:24.174 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.169+0000 7f5eb2f73640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5eac15d410 0x7f5eac0cba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:24.174 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.169+0000 7f5eb2f73640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac15f300 con 0x7f5eac15d030 2023-10-14T09:37:24.174 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.169+0000 7f5eb2f73640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac15aa40 con 0x7f5eac0cd260 2023-10-14T09:37:24.174 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.169+0000 7f5eb2f73640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac15e680 con 0x7f5eac15d410 2023-10-14T09:37:24.175 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.169+0000 7f5eabfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5eac15d030 0x7f5eac159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:24.175 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.169+0000 7f5eabfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5eac15d030 0x7f5eac159990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44578/0 (socket says 172.21.15.102:44578) 2023-10-14T09:37:24.175 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.169+0000 7f5eabfff640 1 -- 172.21.15.102:0/1705913438 learned_addr learned my addr 172.21.15.102:0/1705913438 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:24.175 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.170+0000 7f5eb0d0f640 1 --2- 172.21.15.102:0/1705913438 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5eac0cd260 0x7f5eac15f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:24.175 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.170+0000 7f5eabfff640 1 -- 172.21.15.102:0/1705913438 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5eac15d410 msgr2=0x7f5eac0cba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:24.176 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.170+0000 7f5eabfff640 1 --2- 172.21.15.102:0/1705913438 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5eac15d410 0x7f5eac0cba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:24.176 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.170+0000 7f5eabfff640 1 -- 172.21.15.102:0/1705913438 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5eac0cd260 msgr2=0x7f5eac15f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:24.176 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.170+0000 7f5eabfff640 1 --2- 172.21.15.102:0/1705913438 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5eac0cd260 0x7f5eac15f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:24.176 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.170+0000 7f5eabfff640 1 -- 172.21.15.102:0/1705913438 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e9c009a70 con 0x7f5eac15d030 2023-10-14T09:37:24.176 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.170+0000 7f5eabfff640 1 --2- 172.21.15.102:0/1705913438 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5eac15d030 0x7f5eac159990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5e9400c3c0 tx=0x7f5e9400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:24.177 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.170+0000 7f5ea97fa640 1 -- 172.21.15.102:0/1705913438 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e94005ce0 con 0x7f5eac15d030 2023-10-14T09:37:24.177 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.170+0000 7f5ea97fa640 1 -- 172.21.15.102:0/1705913438 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e94005e40 con 0x7f5eac15d030 2023-10-14T09:37:24.177 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.170+0000 7f5ea97fa640 1 -- 172.21.15.102:0/1705913438 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e940072d0 con 0x7f5eac15d030 2023-10-14T09:37:24.177 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.170+0000 7f5eb2f73640 1 -- 172.21.15.102:0/1705913438 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eac15e960 con 0x7f5eac15d030 2023-10-14T09:37:24.177 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.170+0000 7f5eb2f73640 1 -- 172.21.15.102:0/1705913438 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eac15ef20 con 0x7f5eac15d030 2023-10-14T09:37:24.178 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.171+0000 7f5eb2f73640 1 -- 172.21.15.102:0/1705913438 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eac15f440 con 0x7f5eac15d030 2023-10-14T09:37:24.178 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.172+0000 7f5ea97fa640 1 -- 172.21.15.102:0/1705913438 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5e940074f0 con 0x7f5eac15d030 2023-10-14T09:37:24.179 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.173+0000 7f5ea97fa640 1 --2- 172.21.15.102:0/1705913438 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f5e8c06ae70 0x7f5e8c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:24.179 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.173+0000 7f5ea97fa640 1 -- 172.21.15.102:0/1705913438 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e94088a50 con 0x7f5eac15d030 2023-10-14T09:37:24.179 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.174+0000 7f5eb0d0f640 1 --2- 172.21.15.102:0/1705913438 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f5e8c06ae70 0x7f5e8c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:24.179 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.174+0000 7f5eb0d0f640 1 --2- 172.21.15.102:0/1705913438 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f5e8c06ae70 0x7f5e8c06d330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c036000 tx=0x7f5e9c030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:24.180 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.178+0000 7f5ea97fa640 1 -- 172.21.15.102:0/1705913438 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5eac15f440 con 0x7f5eac15d030 2023-10-14T09:37:24.408 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.406+0000 7f5eb2f73640 1 -- 172.21.15.102:0/1705913438 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5eac15f440 con 0x7f5eac15d030 2023-10-14T09:37:24.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.933+0000 7f5ea97fa640 1 -- 172.21.15.102:0/1705913438 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5eac15f440 con 0x7f5eac15d030 2023-10-14T09:37:24.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.937+0000 7f5eb2f73640 1 -- 172.21.15.102:0/1705913438 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f5e8c06ae70 msgr2=0x7f5e8c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:24.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.937+0000 7f5eb2f73640 1 --2- 172.21.15.102:0/1705913438 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f5e8c06ae70 0x7f5e8c06d330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c036000 tx=0x7f5e9c030000 comp rx=0 tx=0).stop 2023-10-14T09:37:24.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.937+0000 7f5eb2f73640 1 -- 172.21.15.102:0/1705913438 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5eac15d030 msgr2=0x7f5eac159990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:24.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.937+0000 7f5eb2f73640 1 --2- 172.21.15.102:0/1705913438 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5eac15d030 0x7f5eac159990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5e9400c3c0 tx=0x7f5e9400c880 comp rx=0 tx=0).stop 2023-10-14T09:37:24.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.937+0000 7f5eb2f73640 1 -- 172.21.15.102:0/1705913438 shutdown_connections 2023-10-14T09:37:24.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.937+0000 7f5eb2f73640 1 --2- 172.21.15.102:0/1705913438 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f5e8c06ae70 0x7f5e8c06d330 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:24.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.937+0000 7f5eb2f73640 1 --2- 172.21.15.102:0/1705913438 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5eac15d410 0x7f5eac0cba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:24.941 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.937+0000 7f5eb2f73640 1 --2- 172.21.15.102:0/1705913438 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5eac15d030 0x7f5eac159990 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:24.941 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.937+0000 7f5eb2f73640 1 --2- 172.21.15.102:0/1705913438 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5eac0cd260 0x7f5eac15f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:24.941 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.937+0000 7f5eb2f73640 1 -- 172.21.15.102:0/1705913438 >> 172.21.15.102:0/1705913438 conn(0x7f5eac0cf720 msgr2=0x7f5eac0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:24.941 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.937+0000 7f5eb2f73640 1 -- 172.21.15.102:0/1705913438 shutdown_connections 2023-10-14T09:37:24.941 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:24.938+0000 7f5eb2f73640 1 -- 172.21.15.102:0/1705913438 wait complete. 2023-10-14T09:37:24.958 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-14T09:37:24.958 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:37:25.172 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.170+0000 7f3999d0c640 1 Processor -- start 2023-10-14T09:37:25.172 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.170+0000 7f3999d0c640 1 -- start start 2023-10-14T09:37:25.174 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.172+0000 7f3999d0c640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f399415aaa0 0x7f399415e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:25.174 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.172+0000 7f3999d0c640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f399415ae80 0x7f39940cc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:25.174 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.172+0000 7f3999d0c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f399415ed60 con 0x7f39940ccaa0 2023-10-14T09:37:25.174 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.172+0000 7f3999d0c640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f399406b810 con 0x7f399415aaa0 2023-10-14T09:37:25.174 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.172+0000 7f3999d0c640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39940707e0 con 0x7f399415ae80 2023-10-14T09:37:25.175 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.172+0000 7f3993fff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f39940ccaa0 0x7f3994070f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:45580/0 (socket says 172.21.15.102:45580) 2023-10-14T09:37:25.175 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.172+0000 7f3993fff640 1 -- 172.21.15.102:0/3487234407 learned_addr learned my addr 172.21.15.102:0/3487234407 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:25.177 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.173+0000 7f398bfff640 1 --2- 172.21.15.102:0/3487234407 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f399415ae80 0x7f39940cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:25.178 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.173+0000 7f39937fe640 1 --2- 172.21.15.102:0/3487234407 >> v2:172.21.15.129:3300/0 conn(0x7f399415aaa0 0x7f399415e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:25.178 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.173+0000 7f3992ffd640 1 -- 172.21.15.102:0/3487234407 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 297156542 0 0) 0x7f399415ed60 con 0x7f39940ccaa0 2023-10-14T09:37:25.178 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.173+0000 7f3992ffd640 1 -- 172.21.15.102:0/3487234407 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3980003520 con 0x7f39940ccaa0 2023-10-14T09:37:25.178 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.173+0000 7f3992ffd640 1 -- 172.21.15.102:0/3487234407 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2757307170 0 0) 0x7f3980003520 con 0x7f39940ccaa0 2023-10-14T09:37:25.179 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.173+0000 7f3992ffd640 1 -- 172.21.15.102:0/3487234407 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f399415ae80 msgr2=0x7f39940cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:25.179 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.173+0000 7f3992ffd640 1 --2- 172.21.15.102:0/3487234407 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f399415ae80 0x7f39940cc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:25.179 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.173+0000 7f3992ffd640 1 -- 172.21.15.102:0/3487234407 >> v2:172.21.15.129:3300/0 conn(0x7f399415aaa0 msgr2=0x7f399415e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:25.179 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.173+0000 7f3992ffd640 1 --2- 172.21.15.102:0/3487234407 >> v2:172.21.15.129:3300/0 conn(0x7f399415aaa0 0x7f399415e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:25.179 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.173+0000 7f3992ffd640 1 -- 172.21.15.102:0/3487234407 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399415ef90 con 0x7f39940ccaa0 2023-10-14T09:37:25.180 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.173+0000 7f3992ffd640 1 -- 172.21.15.102:0/3487234407 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4030661168 0 0) 0x7f398c0019f0 con 0x7f39940ccaa0 2023-10-14T09:37:25.180 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.173+0000 7f3992ffd640 1 -- 172.21.15.102:0/3487234407 >> v1:172.21.15.102:6789/0 conn(0x7f39940ccaa0 legacy=0x7f3994070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:25.180 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.173+0000 7f3992ffd640 1 --2- 172.21.15.102:0/3487234407 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3980003970 0x7f3980003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:25.180 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.173+0000 7f3992ffd640 1 --2- 172.21.15.102:0/3487234407 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39800047c0 0x7f3980004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:25.180 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.173+0000 7f3992ffd640 1 --2- 172.21.15.102:0/3487234407 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f399415ae80 0x7f3980005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:25.181 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.173+0000 7f3992ffd640 1 -- 172.21.15.102:0/3487234407 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399406b810 con 0x7f39800047c0 2023-10-14T09:37:25.181 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.173+0000 7f3992ffd640 1 -- 172.21.15.102:0/3487234407 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39940707e0 con 0x7f3980003970 2023-10-14T09:37:25.181 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.173+0000 7f3992ffd640 1 -- 172.21.15.102:0/3487234407 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398000b980 con 0x7f399415ae80 2023-10-14T09:37:25.181 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.173+0000 7f398bfff640 1 --2- 172.21.15.102:0/3487234407 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39800047c0 0x7f3980004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:25.181 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.174+0000 7f39937fe640 1 --2- 172.21.15.102:0/3487234407 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3980003970 0x7f3980003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:25.182 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.174+0000 7f3993fff640 1 --2- 172.21.15.102:0/3487234407 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f399415ae80 0x7f3980005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:25.182 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.174+0000 7f398bfff640 1 -- 172.21.15.102:0/3487234407 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f399415ae80 msgr2=0x7f3980005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:25.182 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.174+0000 7f398bfff640 1 --2- 172.21.15.102:0/3487234407 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f399415ae80 0x7f3980005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:25.182 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.174+0000 7f398bfff640 1 -- 172.21.15.102:0/3487234407 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3980003970 msgr2=0x7f3980003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:25.182 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.174+0000 7f398bfff640 1 --2- 172.21.15.102:0/3487234407 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3980003970 0x7f3980003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:25.183 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.174+0000 7f398bfff640 1 -- 172.21.15.102:0/3487234407 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3980003520 con 0x7f39800047c0 2023-10-14T09:37:25.183 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.174+0000 7f3993fff640 1 --2- 172.21.15.102:0/3487234407 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f399415ae80 0x7f3980005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:25.183 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.175+0000 7f398bfff640 1 --2- 172.21.15.102:0/3487234407 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39800047c0 0x7f3980004c40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f397c009ac0 tx=0x7f39800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96bb40e1e456cd7c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:25.183 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.175+0000 7f3992ffd640 1 -- 172.21.15.102:0/3487234407 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c02c6b0 con 0x7f39800047c0 2023-10-14T09:37:25.183 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.175+0000 7f3992ffd640 1 -- 172.21.15.102:0/3487234407 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397c02c810 con 0x7f39800047c0 2023-10-14T09:37:25.183 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.175+0000 7f3992ffd640 1 -- 172.21.15.102:0/3487234407 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c02cba0 con 0x7f39800047c0 2023-10-14T09:37:25.184 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.176+0000 7f3999d0c640 1 -- 172.21.15.102:0/3487234407 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39800047c0 msgr2=0x7f3980004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:25.184 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.176+0000 7f3999d0c640 1 --2- 172.21.15.102:0/3487234407 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39800047c0 0x7f3980004c40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f397c009ac0 tx=0x7f39800057f0 comp rx=0 tx=0).stop 2023-10-14T09:37:25.184 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.176+0000 7f3993fff640 1 -- 172.21.15.102:0/3487234407 reap_dead start 2023-10-14T09:37:25.184 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.176+0000 7f3999d0c640 1 -- 172.21.15.102:0/3487234407 shutdown_connections 2023-10-14T09:37:25.184 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.176+0000 7f3999d0c640 1 -- 172.21.15.102:0/3487234407 >> 172.21.15.102:0/3487234407 conn(0x7f39940cb410 msgr2=0x7f39940cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:25.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.176+0000 7f3999d0c640 1 -- 172.21.15.102:0/3487234407 shutdown_connections 2023-10-14T09:37:25.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.176+0000 7f3999d0c640 1 -- 172.21.15.102:0/3487234407 wait complete. 2023-10-14T09:37:25.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.178+0000 7f3999d0c640 1 Processor -- start 2023-10-14T09:37:25.188 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.178+0000 7f3999d0c640 1 -- start start 2023-10-14T09:37:25.188 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.179+0000 7f3999d0c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39800047c0 0x7f39940c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:25.188 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.179+0000 7f3999d0c640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3994156db0 0x7f39940accb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:25.188 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.179+0000 7f3999d0c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f39940af3b0 0x7f39940af830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:25.188 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.179+0000 7f3999d0c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39940c8fe0 con 0x7f39800047c0 2023-10-14T09:37:25.189 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.179+0000 7f3999d0c640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39940afd70 con 0x7f39940af3b0 2023-10-14T09:37:25.189 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.179+0000 7f3999d0c640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39940c9fb0 con 0x7f3994156db0 2023-10-14T09:37:25.189 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.179+0000 7f39937fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39800047c0 0x7f39940c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:25.189 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.179+0000 7f39937fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39800047c0 0x7f39940c4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44598/0 (socket says 172.21.15.102:44598) 2023-10-14T09:37:25.189 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.179+0000 7f39937fe640 1 -- 172.21.15.102:0/503682815 learned_addr learned my addr 172.21.15.102:0/503682815 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:25.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.179+0000 7f398bfff640 1 --2- 172.21.15.102:0/503682815 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3994156db0 0x7f39940accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:25.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.179+0000 7f3993fff640 1 --2- 172.21.15.102:0/503682815 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f39940af3b0 0x7f39940af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:25.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.180+0000 7f39937fe640 1 -- 172.21.15.102:0/503682815 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3994156db0 msgr2=0x7f39940accb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:25.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.180+0000 7f39937fe640 1 --2- 172.21.15.102:0/503682815 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3994156db0 0x7f39940accb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:25.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.180+0000 7f39937fe640 1 -- 172.21.15.102:0/503682815 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f39940af3b0 msgr2=0x7f39940af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:25.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.180+0000 7f39937fe640 1 --2- 172.21.15.102:0/503682815 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f39940af3b0 0x7f39940af830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:25.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.180+0000 7f39937fe640 1 -- 172.21.15.102:0/503682815 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39940c91f0 con 0x7f39800047c0 2023-10-14T09:37:25.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.180+0000 7f3993fff640 1 --2- 172.21.15.102:0/503682815 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f39940af3b0 0x7f39940af830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:25.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.180+0000 7f39937fe640 1 --2- 172.21.15.102:0/503682815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39800047c0 0x7f39940c4e60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f39840116d0 tx=0x7f3984011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:25.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.180+0000 7f3990ff9640 1 -- 172.21.15.102:0/503682815 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398400f9c0 con 0x7f39800047c0 2023-10-14T09:37:25.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.180+0000 7f3990ff9640 1 -- 172.21.15.102:0/503682815 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398400fb20 con 0x7f39800047c0 2023-10-14T09:37:25.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.180+0000 7f3999d0c640 1 -- 172.21.15.102:0/503682815 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39940c94d0 con 0x7f39800047c0 2023-10-14T09:37:25.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.180+0000 7f3990ff9640 1 -- 172.21.15.102:0/503682815 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398400fe90 con 0x7f39800047c0 2023-10-14T09:37:25.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.180+0000 7f3999d0c640 1 -- 172.21.15.102:0/503682815 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39940c9a90 con 0x7f39800047c0 2023-10-14T09:37:25.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.182+0000 7f3999d0c640 1 -- 172.21.15.102:0/503682815 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39940c9c20 con 0x7f39800047c0 2023-10-14T09:37:25.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.182+0000 7f3990ff9640 1 -- 172.21.15.102:0/503682815 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3984015460 con 0x7f39800047c0 2023-10-14T09:37:25.193 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.183+0000 7f3990ff9640 1 --2- 172.21.15.102:0/503682815 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f397406aea0 0x7f397406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:25.193 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.183+0000 7f3990ff9640 1 -- 172.21.15.102:0/503682815 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3984089fa0 con 0x7f39800047c0 2023-10-14T09:37:25.193 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.184+0000 7f398bfff640 1 --2- 172.21.15.102:0/503682815 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f397406aea0 0x7f397406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:25.193 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.184+0000 7f398bfff640 1 --2- 172.21.15.102:0/503682815 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f397406aea0 0x7f397406d360 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f397c036000 tx=0x7f397c030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:25.194 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.188+0000 7f3990ff9640 1 -- 172.21.15.102:0/503682815 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3984054fb0 con 0x7f39800047c0 2023-10-14T09:37:25.405 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.403+0000 7f3999d0c640 1 -- 172.21.15.102:0/503682815 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f399404e160 con 0x7f39800047c0 2023-10-14T09:37:25.406 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.404+0000 7f3990ff9640 1 -- 172.21.15.102:0/503682815 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4916 (secure 0 0 0) 0x7f39840585d0 con 0x7f39800047c0 2023-10-14T09:37:25.407 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:37:25.407 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6835/3867702876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6833","nonce":3867702876},{"type":"v1","addr":"172.21.15.129:6835","nonce":3867702876}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6834/1559210030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":1559210030},{"type":"v1","addr":"172.21.15.129:6834","nonce":1559210030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1277026451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1277026451},{"type":"v1","addr":"172.21.15.102:6835","nonce":1277026451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T09:37:21.362625+0000","modified":"2023-10-14T09:37:24.408132+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6837/527707922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":527707922},{"type":"v1","addr":"172.21.15.102:6837","nonce":527707922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T09:37:25.407 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 8 2023-10-14T09:37:25.409 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.407+0000 7f3999d0c640 1 -- 172.21.15.102:0/503682815 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f397406aea0 msgr2=0x7f397406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:25.409 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.407+0000 7f3999d0c640 1 --2- 172.21.15.102:0/503682815 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f397406aea0 0x7f397406d360 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f397c036000 tx=0x7f397c030000 comp rx=0 tx=0).stop 2023-10-14T09:37:25.409 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.407+0000 7f3999d0c640 1 -- 172.21.15.102:0/503682815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39800047c0 msgr2=0x7f39940c4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:25.409 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.407+0000 7f3999d0c640 1 --2- 172.21.15.102:0/503682815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39800047c0 0x7f39940c4e60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f39840116d0 tx=0x7f3984011b90 comp rx=0 tx=0).stop 2023-10-14T09:37:25.410 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.407+0000 7f3999d0c640 1 -- 172.21.15.102:0/503682815 shutdown_connections 2023-10-14T09:37:25.410 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.407+0000 7f3999d0c640 1 --2- 172.21.15.102:0/503682815 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f397406aea0 0x7f397406d360 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:25.410 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.407+0000 7f3999d0c640 1 --2- 172.21.15.102:0/503682815 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f39940af3b0 0x7f39940af830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:25.410 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.407+0000 7f3999d0c640 1 --2- 172.21.15.102:0/503682815 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3994156db0 0x7f39940accb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:25.410 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.407+0000 7f3999d0c640 1 --2- 172.21.15.102:0/503682815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39800047c0 0x7f39940c4e60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:25.411 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.407+0000 7f3999d0c640 1 -- 172.21.15.102:0/503682815 >> 172.21.15.102:0/503682815 conn(0x7f39940cb410 msgr2=0x7f39940b33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:25.411 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.407+0000 7f3999d0c640 1 -- 172.21.15.102:0/503682815 shutdown_connections 2023-10-14T09:37:25.411 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.407+0000 7f3999d0c640 1 -- 172.21.15.102:0/503682815 wait complete. 2023-10-14T09:37:25.425 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:37:25.633 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.631+0000 7f119f5d0640 1 Processor -- start 2023-10-14T09:37:25.633 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.631+0000 7f119f5d0640 1 -- start start 2023-10-14T09:37:25.635 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.633+0000 7f119f5d0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1198159b20 0x7f119806bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:25.635 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.633+0000 7f119f5d0640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f119806f7f0 con 0x7f11980b0b20 2023-10-14T09:37:25.635 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.633+0000 7f119f5d0640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f119806c5e0 con 0x7f1198159f00 2023-10-14T09:37:25.636 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.633+0000 7f119f5d0640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f119806c8c0 con 0x7f1198159b20 2023-10-14T09:37:25.636 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.633+0000 7f119d36c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1198159b20 0x7f119806bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:25.636 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.633+0000 7f119db6d640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f11980b0b20 0x7f119806fc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:45594/0 (socket says 172.21.15.102:45594) 2023-10-14T09:37:25.636 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.633+0000 7f119db6d640 1 -- 172.21.15.102:0/3342925114 learned_addr learned my addr 172.21.15.102:0/3342925114 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:25.637 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.633+0000 7f119d36c640 1 -- 172.21.15.102:0/3342925114 >> v1:172.21.15.129:6789/0 conn(0x7f1198159f00 legacy=0x7f11980b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:25.637 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.633+0000 7f119d36c640 1 -- 172.21.15.102:0/3342925114 >> v1:172.21.15.102:6789/0 conn(0x7f11980b0b20 legacy=0x7f119806fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:25.637 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.633+0000 7f119d36c640 1 -- 172.21.15.102:0/3342925114 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119806cba0 con 0x7f1198159b20 2023-10-14T09:37:25.637 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.633+0000 7f118ffff640 1 -- 172.21.15.102:0/3342925114 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1284965747 0 0) 0x7f119806f7f0 con 0x7f11980b0b20 2023-10-14T09:37:25.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.634+0000 7f119d36c640 1 --2- 172.21.15.102:0/3342925114 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1198159b20 0x7f119806bbe0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f11940097a0 tx=0x7f119402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a399ef51126eaa server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:25.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.635+0000 7f118ffff640 1 -- 172.21.15.102:0/3342925114 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1194031830 con 0x7f1198159b20 2023-10-14T09:37:25.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.635+0000 7f118ffff640 1 -- 172.21.15.102:0/3342925114 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1194031990 con 0x7f1198159b20 2023-10-14T09:37:25.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.635+0000 7f118ffff640 1 -- 172.21.15.102:0/3342925114 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1194031d20 con 0x7f1198159b20 2023-10-14T09:37:25.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.635+0000 7f119f5d0640 1 -- 172.21.15.102:0/3342925114 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1198159b20 msgr2=0x7f119806bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:25.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.635+0000 7f119f5d0640 1 --2- 172.21.15.102:0/3342925114 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1198159b20 0x7f119806bbe0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f11940097a0 tx=0x7f119402b8d0 comp rx=0 tx=0).stop 2023-10-14T09:37:25.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.635+0000 7f119f5d0640 1 -- 172.21.15.102:0/3342925114 shutdown_connections 2023-10-14T09:37:25.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.635+0000 7f119f5d0640 1 --2- 172.21.15.102:0/3342925114 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1198159b20 0x7f119806bbe0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:25.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.635+0000 7f119f5d0640 1 -- 172.21.15.102:0/3342925114 >> 172.21.15.102:0/3342925114 conn(0x7f11980cb410 msgr2=0x7f11980cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:25.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.635+0000 7f119f5d0640 1 -- 172.21.15.102:0/3342925114 shutdown_connections 2023-10-14T09:37:25.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.635+0000 7f119f5d0640 1 -- 172.21.15.102:0/3342925114 wait complete. 2023-10-14T09:37:25.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.637+0000 7f119f5d0640 1 Processor -- start 2023-10-14T09:37:25.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.637+0000 7f119f5d0640 1 -- start start 2023-10-14T09:37:25.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.638+0000 7f119f5d0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11980b0b20 0x7f119815a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:25.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.638+0000 7f119f5d0640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1198159b20 0x7f119815c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:25.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.638+0000 7f119f5d0640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1198159f00 0x7f11980acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:25.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.638+0000 7f119f5d0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119815ca60 con 0x7f11980b0b20 2023-10-14T09:37:25.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.638+0000 7f119f5d0640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119815a8f0 con 0x7f1198159b20 2023-10-14T09:37:25.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.638+0000 7f119f5d0640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f119815abd0 con 0x7f1198159f00 2023-10-14T09:37:25.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.638+0000 7f119d36c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11980b0b20 0x7f119815a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:25.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.638+0000 7f119d36c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11980b0b20 0x7f119815a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44624/0 (socket says 172.21.15.102:44624) 2023-10-14T09:37:25.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.638+0000 7f119d36c640 1 -- 172.21.15.102:0/605128598 learned_addr learned my addr 172.21.15.102:0/605128598 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:25.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.639+0000 7f119db6d640 1 --2- 172.21.15.102:0/605128598 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1198159f00 0x7f11980acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:25.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.639+0000 7f119d36c640 1 -- 172.21.15.102:0/605128598 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1198159f00 msgr2=0x7f11980acb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:25.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.639+0000 7f119cb6b640 1 --2- 172.21.15.102:0/605128598 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1198159b20 0x7f119815c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:25.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.639+0000 7f119d36c640 1 --2- 172.21.15.102:0/605128598 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1198159f00 0x7f11980acb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:25.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.639+0000 7f119d36c640 1 -- 172.21.15.102:0/605128598 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1198159b20 msgr2=0x7f119815c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:25.647 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.639+0000 7f119d36c640 1 --2- 172.21.15.102:0/605128598 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1198159b20 0x7f119815c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:25.647 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.639+0000 7f119d36c640 1 -- 172.21.15.102:0/605128598 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1194009400 con 0x7f11980b0b20 2023-10-14T09:37:25.647 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.639+0000 7f119db6d640 1 --2- 172.21.15.102:0/605128598 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1198159f00 0x7f11980acb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:25.647 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.639+0000 7f119cb6b640 1 --2- 172.21.15.102:0/605128598 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1198159b20 0x7f119815c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:25.647 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.639+0000 7f119d36c640 1 --2- 172.21.15.102:0/605128598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11980b0b20 0x7f119815a310 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f11940098c0 tx=0x7f11940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:25.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.639+0000 7f118dffb640 1 -- 172.21.15.102:0/605128598 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119403ba70 con 0x7f11980b0b20 2023-10-14T09:37:25.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.639+0000 7f118dffb640 1 -- 172.21.15.102:0/605128598 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119403bbf0 con 0x7f11980b0b20 2023-10-14T09:37:25.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.639+0000 7f118dffb640 1 -- 172.21.15.102:0/605128598 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11940453f0 con 0x7f11980b0b20 2023-10-14T09:37:25.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.639+0000 7f119f5d0640 1 -- 172.21.15.102:0/605128598 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f119815aeb0 con 0x7f11980b0b20 2023-10-14T09:37:25.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.640+0000 7f119f5d0640 1 -- 172.21.15.102:0/605128598 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11980c3040 con 0x7f11980b0b20 2023-10-14T09:37:25.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.641+0000 7f119f5d0640 1 -- 172.21.15.102:0/605128598 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f119804e160 con 0x7f11980b0b20 2023-10-14T09:37:25.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.642+0000 7f118dffb640 1 -- 172.21.15.102:0/605128598 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f119404e450 con 0x7f11980b0b20 2023-10-14T09:37:25.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.642+0000 7f118dffb640 1 --2- 172.21.15.102:0/605128598 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f117c06aea0 0x7f117c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:25.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.643+0000 7f118dffb640 1 -- 172.21.15.102:0/605128598 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11940ab7f0 con 0x7f11980b0b20 2023-10-14T09:37:25.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.643+0000 7f119cb6b640 1 --2- 172.21.15.102:0/605128598 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f117c06aea0 0x7f117c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:25.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.643+0000 7f119cb6b640 1 --2- 172.21.15.102:0/605128598 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f117c06aea0 0x7f117c06d360 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f11980c57f0 tx=0x7f1188009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:25.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.647+0000 7f118dffb640 1 -- 172.21.15.102:0/605128598 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1194076930 con 0x7f11980b0b20 2023-10-14T09:37:25.838 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.836+0000 7f119f5d0640 1 -- 172.21.15.102:0/605128598 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11980b10b0 con 0x7f11980b0b20 2023-10-14T09:37:25.839 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.837+0000 7f118dffb640 1 -- 172.21.15.102:0/605128598 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f1194079f50 con 0x7f11980b0b20 2023-10-14T09:37:25.840 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:37:25.840 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":22,"fsid":"8a6cd69d-7f5b-4f2a-806a-0176c10aed50","created":"2023-10-14T09:36:56.745172+0000","modified":"2023-10-14T09:37:22.712469+0000","last_up_change":"2023-10-14T09:37:09.791473+0000","last_in_change":"2023-10-14T09:37:00.547186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:37:09.952407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:37:19.560925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:37:20.363385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e5aef8f3-878f-482b-b522-9a5b958b90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6801","nonce":1727250718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6803","nonce":1727250718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6807","nonce":1727250718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6805","nonce":1727250718}]},"public_addr":"172.21.15.102:6801/1727250718","cluster_addr":"172.21.15.102:6803/1727250718","heartbeat_back_addr":"172.21.15.102:6807/1727250718","heartbeat_front_addr":"172.21.15.102:6805/1727250718","state":["exists","up"]},{"osd":1,"uuid":"4a8cf50e-387b-4d47-9588-bd22e375a9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6809","nonce":1095651107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6811","nonce":1095651107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6815","nonce":1095651107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6813","nonce":1095651107}]},"public_addr":"172.21.15.102:6809/1095651107","cluster_addr":"172.21.15.102:6811/1095651107","heartbeat_back_addr":"172.21.15.102:6815/1095651107","heartbeat_front_addr":"172.21.15.102:6813/1095651107","state":["exists","up"]},{"osd":2,"uuid":"009ef55f-8a63-4219-bacd-d7c7b4500867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6820","nonce":2198222556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6825","nonce":2198222556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6831","nonce":2198222556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6829","nonce":2198222556}]},"public_addr":"172.21.15.102:6820/2198222556","cluster_addr":"172.21.15.102:6825/2198222556","heartbeat_back_addr":"172.21.15.102:6831/2198222556","heartbeat_front_addr":"172.21.15.102:6829/2198222556","state":["exists","up"]},{"osd":3,"uuid":"f2110eae-2ff9-4ed9-93d6-bd2361618211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6818","nonce":654726740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6821","nonce":654726740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6827","nonce":654726740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6823","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6824","nonce":654726740}]},"public_addr":"172.21.15.102:6818/654726740","cluster_addr":"172.21.15.102:6821/654726740","heartbeat_back_addr":"172.21.15.102:6827/654726740","heartbeat_front_addr":"172.21.15.102:6824/654726740","state":["exists","up"]},{"osd":4,"uuid":"33f1ae34-3100-40f7-9cb8-0eca2b358693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6817","nonce":507586170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6819","nonce":507586170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6823","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6825","nonce":507586170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6821","nonce":507586170}]},"public_addr":"172.21.15.129:6817/507586170","cluster_addr":"172.21.15.129:6819/507586170","heartbeat_back_addr":"172.21.15.129:6825/507586170","heartbeat_front_addr":"172.21.15.129:6821/507586170","state":["exists","up"]},{"osd":5,"uuid":"fab2fc62-3f3e-450d-93e0-770f39e80710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6801","nonce":1913451073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6803","nonce":1913451073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6807","nonce":1913451073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6805","nonce":1913451073}]},"public_addr":"172.21.15.129:6801/1913451073","cluster_addr":"172.21.15.129:6803/1913451073","heartbeat_back_addr":"172.21.15.129:6807/1913451073","heartbeat_front_addr":"172.21.15.129:6805/1913451073","state":["exists","up"]},{"osd":6,"uuid":"d7cc1d69-92e7-4253-a127-cfc0444a4809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6809","nonce":2853291511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6811","nonce":2853291511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6815","nonce":2853291511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6813","nonce":2853291511}]},"public_addr":"172.21.15.129:6809/2853291511","cluster_addr":"172.21.15.129:6811/2853291511","heartbeat_back_addr":"172.21.15.129:6815/2853291511","heartbeat_front_addr":"172.21.15.129:6813/2853291511","state":["exists","up"]},{"osd":7,"uuid":"1e403de1-09e2-4370-b9a7-e790ac44bbee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6824","nonce":2933886914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6827","nonce":2933886914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6831","nonce":2933886914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6829","nonce":2933886914}]},"public_addr":"172.21.15.129:6824/2933886914","cluster_addr":"172.21.15.129:6827/2933886914","heartbeat_back_addr":"172.21.15.129:6831/2933886914","heartbeat_front_addr":"172.21.15.129:6829/2933886914","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.849661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.868113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.933488+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.891794+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.901861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.858750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.911712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.996765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:37:25.842 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.840+0000 7f119f5d0640 1 -- 172.21.15.102:0/605128598 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f117c06aea0 msgr2=0x7f117c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:25.842 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.840+0000 7f119f5d0640 1 --2- 172.21.15.102:0/605128598 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f117c06aea0 0x7f117c06d360 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f11980c57f0 tx=0x7f1188009040 comp rx=0 tx=0).stop 2023-10-14T09:37:25.842 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.840+0000 7f119f5d0640 1 -- 172.21.15.102:0/605128598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11980b0b20 msgr2=0x7f119815a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:25.843 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.840+0000 7f119f5d0640 1 --2- 172.21.15.102:0/605128598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11980b0b20 0x7f119815a310 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f11940098c0 tx=0x7f11940046c0 comp rx=0 tx=0).stop 2023-10-14T09:37:25.843 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.840+0000 7f119f5d0640 1 -- 172.21.15.102:0/605128598 shutdown_connections 2023-10-14T09:37:25.843 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.840+0000 7f119f5d0640 1 --2- 172.21.15.102:0/605128598 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f117c06aea0 0x7f117c06d360 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:25.843 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.840+0000 7f119f5d0640 1 --2- 172.21.15.102:0/605128598 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1198159f00 0x7f11980acb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:25.843 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.840+0000 7f119f5d0640 1 --2- 172.21.15.102:0/605128598 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1198159b20 0x7f119815c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:25.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.840+0000 7f119f5d0640 1 --2- 172.21.15.102:0/605128598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11980b0b20 0x7f119815a310 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:25.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.840+0000 7f119f5d0640 1 -- 172.21.15.102:0/605128598 >> 172.21.15.102:0/605128598 conn(0x7f11980cb410 msgr2=0x7f119815d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:25.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.840+0000 7f119f5d0640 1 -- 172.21.15.102:0/605128598 shutdown_connections 2023-10-14T09:37:25.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:25.840+0000 7f119f5d0640 1 -- 172.21.15.102:0/605128598 wait complete. 2023-10-14T09:37:25.861 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T09:37:25.861 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:37:26.058 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.056+0000 7f498fc4f640 1 Processor -- start 2023-10-14T09:37:26.058 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.056+0000 7f498fc4f640 1 -- start start 2023-10-14T09:37:26.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.058+0000 7f498fc4f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4988159b20 0x7f498806bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:26.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.058+0000 7f498fc4f640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4988159f00 0x7f49880b0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:26.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.058+0000 7f498fc4f640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f498806f7f0 con 0x7f498806c120 2023-10-14T09:37:26.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.058+0000 7f498fc4f640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f498806c5e0 con 0x7f4988159b20 2023-10-14T09:37:26.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.058+0000 7f498fc4f640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f498806c8c0 con 0x7f4988159f00 2023-10-14T09:37:26.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.058+0000 7f498d9eb640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4988159b20 0x7f498806bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:26.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.058+0000 7f498e1ec640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f498806c120 0x7f49880cd670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:45596/0 (socket says 172.21.15.102:45596) 2023-10-14T09:37:26.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.058+0000 7f498e1ec640 1 -- 172.21.15.102:0/1514206190 learned_addr learned my addr 172.21.15.102:0/1514206190 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:26.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.058+0000 7f498d1ea640 1 --2- 172.21.15.102:0/1514206190 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4988159f00 0x7f49880b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:26.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.058+0000 7f498d9eb640 1 -- 172.21.15.102:0/1514206190 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4988159f00 msgr2=0x7f49880b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:26.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.058+0000 7f498d9eb640 1 --2- 172.21.15.102:0/1514206190 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4988159f00 0x7f49880b0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:26.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.058+0000 7f498d9eb640 1 -- 172.21.15.102:0/1514206190 >> v1:172.21.15.102:6789/0 conn(0x7f498806c120 legacy=0x7f49880cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:26.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.058+0000 7f498d9eb640 1 -- 172.21.15.102:0/1514206190 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498806cba0 con 0x7f4988159b20 2023-10-14T09:37:26.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.059+0000 7f498d9eb640 1 --2- 172.21.15.102:0/1514206190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4988159b20 0x7f498806bbe0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f49840097a0 tx=0x7f498402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80a96243de414187 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:26.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.060+0000 7f498c9e9640 1 -- 172.21.15.102:0/1514206190 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498402d040 con 0x7f4988159b20 2023-10-14T09:37:26.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.060+0000 7f498c9e9640 1 -- 172.21.15.102:0/1514206190 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4984031810 con 0x7f4988159b20 2023-10-14T09:37:26.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.060+0000 7f498c9e9640 1 -- 172.21.15.102:0/1514206190 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4984031ba0 con 0x7f4988159b20 2023-10-14T09:37:26.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.060+0000 7f498fc4f640 1 -- 172.21.15.102:0/1514206190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4988159b20 msgr2=0x7f498806bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:26.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.060+0000 7f498fc4f640 1 --2- 172.21.15.102:0/1514206190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4988159b20 0x7f498806bbe0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f49840097a0 tx=0x7f498402b8b0 comp rx=0 tx=0).stop 2023-10-14T09:37:26.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.060+0000 7f498fc4f640 1 -- 172.21.15.102:0/1514206190 shutdown_connections 2023-10-14T09:37:26.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.060+0000 7f498fc4f640 1 --2- 172.21.15.102:0/1514206190 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4988159f00 0x7f49880b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:26.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.060+0000 7f498fc4f640 1 --2- 172.21.15.102:0/1514206190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4988159b20 0x7f498806bbe0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:26.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.060+0000 7f498fc4f640 1 -- 172.21.15.102:0/1514206190 >> 172.21.15.102:0/1514206190 conn(0x7f49880cb410 msgr2=0x7f49880cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:26.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.061+0000 7f498fc4f640 1 -- 172.21.15.102:0/1514206190 shutdown_connections 2023-10-14T09:37:26.066 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.061+0000 7f498fc4f640 1 -- 172.21.15.102:0/1514206190 wait complete. 2023-10-14T09:37:26.068 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.062+0000 7f498fc4f640 1 Processor -- start 2023-10-14T09:37:26.068 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.062+0000 7f498fc4f640 1 -- start start 2023-10-14T09:37:26.068 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.063+0000 7f498fc4f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f498806c120 0x7f498815cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:26.068 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.063+0000 7f498fc4f640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4988159b20 0x7f49880c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:26.068 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.063+0000 7f498fc4f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4988159f00 0x7f49880ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:26.069 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.063+0000 7f498fc4f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498815c5b0 con 0x7f4988159f00 2023-10-14T09:37:26.069 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.063+0000 7f498fc4f640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498815b9a0 con 0x7f498806c120 2023-10-14T09:37:26.069 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.063+0000 7f498fc4f640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f498815c9d0 con 0x7f4988159b20 2023-10-14T09:37:26.069 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.064+0000 7f498e1ec640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4988159f00 0x7f49880ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:26.069 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.064+0000 7f498e1ec640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4988159f00 0x7f49880ac890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44638/0 (socket says 172.21.15.102:44638) 2023-10-14T09:37:26.070 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.064+0000 7f498e1ec640 1 -- 172.21.15.102:0/258566711 learned_addr learned my addr 172.21.15.102:0/258566711 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:26.070 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.064+0000 7f498d1ea640 1 --2- 172.21.15.102:0/258566711 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4988159b20 0x7f49880c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:26.070 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.064+0000 7f498e1ec640 1 -- 172.21.15.102:0/258566711 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4988159b20 msgr2=0x7f49880c24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:26.070 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.064+0000 7f498e1ec640 1 --2- 172.21.15.102:0/258566711 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4988159b20 0x7f49880c24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:26.070 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.064+0000 7f498e1ec640 1 -- 172.21.15.102:0/258566711 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f498806c120 msgr2=0x7f498815cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:26.070 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.064+0000 7f498e1ec640 1 --2- 172.21.15.102:0/258566711 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f498806c120 0x7f498815cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:26.071 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.064+0000 7f498e1ec640 1 -- 172.21.15.102:0/258566711 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4984009400 con 0x7f4988159f00 2023-10-14T09:37:26.071 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.064+0000 7f498d1ea640 1 --2- 172.21.15.102:0/258566711 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4988159b20 0x7f49880c24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:26.071 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.064+0000 7f498e1ec640 1 --2- 172.21.15.102:0/258566711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4988159f00 0x7f49880ac890 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f498000ca50 tx=0x7f498000cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:26.071 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.065+0000 7f497e7fc640 1 -- 172.21.15.102:0/258566711 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498000abb0 con 0x7f4988159f00 2023-10-14T09:37:26.071 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.065+0000 7f497e7fc640 1 -- 172.21.15.102:0/258566711 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498000ad10 con 0x7f4988159f00 2023-10-14T09:37:26.072 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.065+0000 7f497e7fc640 1 -- 172.21.15.102:0/258566711 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4980012600 con 0x7f4988159f00 2023-10-14T09:37:26.072 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.065+0000 7f498fc4f640 1 -- 172.21.15.102:0/258566711 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f498815bc10 con 0x7f4988159f00 2023-10-14T09:37:26.072 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.065+0000 7f498fc4f640 1 -- 172.21.15.102:0/258566711 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f498815c1d0 con 0x7f4988159f00 2023-10-14T09:37:26.072 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.066+0000 7f498fc4f640 1 -- 172.21.15.102:0/258566711 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f498815c820 con 0x7f4988159f00 2023-10-14T09:37:26.073 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.067+0000 7f497e7fc640 1 -- 172.21.15.102:0/258566711 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4980007070 con 0x7f4988159f00 2023-10-14T09:37:26.073 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.068+0000 7f497e7fc640 1 --2- 172.21.15.102:0/258566711 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f496c06aea0 0x7f496c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:26.073 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.068+0000 7f497e7fc640 1 -- 172.21.15.102:0/258566711 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4980089360 con 0x7f4988159f00 2023-10-14T09:37:26.074 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.068+0000 7f498d9eb640 1 --2- 172.21.15.102:0/258566711 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f496c06aea0 0x7f496c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:26.074 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.069+0000 7f498d9eb640 1 --2- 172.21.15.102:0/258566711 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f496c06aea0 0x7f496c06d360 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4984036000 tx=0x7f4984030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:26.074 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.072+0000 7f497e7fc640 1 -- 172.21.15.102:0/258566711 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f49800544b0 con 0x7f4988159f00 2023-10-14T09:37:26.259 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.257+0000 7f498fc4f640 1 -- 172.21.15.102:0/258566711 --> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f498806ce80 con 0x7f496c06aea0 2023-10-14T09:37:26.269 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.268+0000 7f497e7fc640 1 -- 172.21.15.102:0/258566711 <== mgr.4104 v2:172.21.15.102:6832/1125265706 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264550 (secure 0 0 0) 0x7f498403a420 con 0x7f496c06aea0 2023-10-14T09:37:26.273 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:37:26.275 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2023-10-14T09:37:26.276 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.274+0000 7f498fc4f640 1 -- 172.21.15.102:0/258566711 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f496c06aea0 msgr2=0x7f496c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:26.276 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.274+0000 7f498fc4f640 1 --2- 172.21.15.102:0/258566711 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f496c06aea0 0x7f496c06d360 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4984036000 tx=0x7f4984030000 comp rx=0 tx=0).stop 2023-10-14T09:37:26.277 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.274+0000 7f498fc4f640 1 -- 172.21.15.102:0/258566711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4988159f00 msgr2=0x7f49880ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:26.277 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.274+0000 7f498fc4f640 1 --2- 172.21.15.102:0/258566711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4988159f00 0x7f49880ac890 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f498000ca50 tx=0x7f498000cf10 comp rx=0 tx=0).stop 2023-10-14T09:37:26.277 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.274+0000 7f498fc4f640 1 -- 172.21.15.102:0/258566711 shutdown_connections 2023-10-14T09:37:26.277 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.274+0000 7f498fc4f640 1 --2- 172.21.15.102:0/258566711 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f496c06aea0 0x7f496c06d360 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:26.277 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.274+0000 7f498fc4f640 1 --2- 172.21.15.102:0/258566711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4988159f00 0x7f49880ac890 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:26.278 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.274+0000 7f498fc4f640 1 --2- 172.21.15.102:0/258566711 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4988159b20 0x7f49880c24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:26.278 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.274+0000 7f498fc4f640 1 --2- 172.21.15.102:0/258566711 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f498806c120 0x7f498815cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:26.278 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.274+0000 7f498fc4f640 1 -- 172.21.15.102:0/258566711 >> 172.21.15.102:0/258566711 conn(0x7f49880cb410 msgr2=0x7f49880aef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:26.278 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.274+0000 7f498fc4f640 1 -- 172.21.15.102:0/258566711 shutdown_connections 2023-10-14T09:37:26.278 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.274+0000 7f498fc4f640 1 -- 172.21.15.102:0/258566711 wait complete. 2023-10-14T09:37:26.294 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-14T09:37:25.877904+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":134,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219128,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755592,"statfs":{"total":773094113280,"available":772869726208,"internally_reserved":0,"allocated":3022848,"data_stored":1800068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":58,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.999888"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.007969+0000","last_change":"2023-10-14T09:37:21.757489+0000","last_active":"2023-10-14T09:37:23.007969+0000","last_peered":"2023-10-14T09:37:23.007969+0000","last_clean":"2023-10-14T09:37:23.007969+0000","last_became_active":"2023-10-14T09:37:21.757194+0000","last_became_peered":"2023-10-14T09:37:21.757194+0000","last_unstale":"2023-10-14T09:37:23.007969+0000","last_undegraded":"2023-10-14T09:37:23.007969+0000","last_fullsized":"2023-10-14T09:37:23.007969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:44:42.187325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.725772+0000","last_change":"2023-10-14T09:37:21.747083+0000","last_active":"2023-10-14T09:37:22.725772+0000","last_peered":"2023-10-14T09:37:22.725772+0000","last_clean":"2023-10-14T09:37:22.725772+0000","last_became_active":"2023-10-14T09:37:21.744916+0000","last_became_peered":"2023-10-14T09:37:21.744916+0000","last_unstale":"2023-10-14T09:37:22.725772+0000","last_undegraded":"2023-10-14T09:37:22.725772+0000","last_fullsized":"2023-10-14T09:37:22.725772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:47:20.056113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000967+0000","last_change":"2023-10-14T09:37:21.743145+0000","last_active":"2023-10-14T09:37:23.000967+0000","last_peered":"2023-10-14T09:37:23.000967+0000","last_clean":"2023-10-14T09:37:23.000967+0000","last_became_active":"2023-10-14T09:37:21.740942+0000","last_became_peered":"2023-10-14T09:37:21.740942+0000","last_unstale":"2023-10-14T09:37:23.000967+0000","last_undegraded":"2023-10-14T09:37:23.000967+0000","last_fullsized":"2023-10-14T09:37:23.000967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:13:11.995936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.727695+0000","last_change":"2023-10-14T09:37:21.756893+0000","last_active":"2023-10-14T09:37:22.727695+0000","last_peered":"2023-10-14T09:37:22.727695+0000","last_clean":"2023-10-14T09:37:22.727695+0000","last_became_active":"2023-10-14T09:37:21.752060+0000","last_became_peered":"2023-10-14T09:37:21.752060+0000","last_unstale":"2023-10-14T09:37:22.727695+0000","last_undegraded":"2023-10-14T09:37:22.727695+0000","last_fullsized":"2023-10-14T09:37:22.727695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:40:14.063216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.005308+0000","last_change":"2023-10-14T09:37:21.751922+0000","last_active":"2023-10-14T09:37:23.005308+0000","last_peered":"2023-10-14T09:37:23.005308+0000","last_clean":"2023-10-14T09:37:23.005308+0000","last_became_active":"2023-10-14T09:37:21.751652+0000","last_became_peered":"2023-10-14T09:37:21.751652+0000","last_unstale":"2023-10-14T09:37:23.005308+0000","last_undegraded":"2023-10-14T09:37:23.005308+0000","last_fullsized":"2023-10-14T09:37:23.005308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:18:14.767746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.727589+0000","last_change":"2023-10-14T09:37:21.754232+0000","last_active":"2023-10-14T09:37:22.727589+0000","last_peered":"2023-10-14T09:37:22.727589+0000","last_clean":"2023-10-14T09:37:22.727589+0000","last_became_active":"2023-10-14T09:37:21.751701+0000","last_became_peered":"2023-10-14T09:37:21.751701+0000","last_unstale":"2023-10-14T09:37:22.727589+0000","last_undegraded":"2023-10-14T09:37:22.727589+0000","last_fullsized":"2023-10-14T09:37:22.727589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:00:52.100349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.006549+0000","last_change":"2023-10-14T09:37:21.752184+0000","last_active":"2023-10-14T09:37:23.006549+0000","last_peered":"2023-10-14T09:37:23.006549+0000","last_clean":"2023-10-14T09:37:23.006549+0000","last_became_active":"2023-10-14T09:37:21.751858+0000","last_became_peered":"2023-10-14T09:37:21.751858+0000","last_unstale":"2023-10-14T09:37:23.006549+0000","last_undegraded":"2023-10-14T09:37:23.006549+0000","last_fullsized":"2023-10-14T09:37:23.006549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:46:09.236513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.837906+0000","last_change":"2023-10-14T09:37:21.755347+0000","last_active":"2023-10-14T09:37:22.837906+0000","last_peered":"2023-10-14T09:37:22.837906+0000","last_clean":"2023-10-14T09:37:22.837906+0000","last_became_active":"2023-10-14T09:37:21.755054+0000","last_became_peered":"2023-10-14T09:37:21.755054+0000","last_unstale":"2023-10-14T09:37:22.837906+0000","last_undegraded":"2023-10-14T09:37:22.837906+0000","last_fullsized":"2023-10-14T09:37:22.837906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:34:28.487519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.008184+0000","last_change":"2023-10-14T09:37:21.766430+0000","last_active":"2023-10-14T09:37:23.008184+0000","last_peered":"2023-10-14T09:37:23.008184+0000","last_clean":"2023-10-14T09:37:23.008184+0000","last_became_active":"2023-10-14T09:37:21.766106+0000","last_became_peered":"2023-10-14T09:37:21.766106+0000","last_unstale":"2023-10-14T09:37:23.008184+0000","last_undegraded":"2023-10-14T09:37:23.008184+0000","last_fullsized":"2023-10-14T09:37:23.008184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:49:59.016924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.004124+0000","last_change":"2023-10-14T09:37:21.756666+0000","last_active":"2023-10-14T09:37:23.004124+0000","last_peered":"2023-10-14T09:37:23.004124+0000","last_clean":"2023-10-14T09:37:23.004124+0000","last_became_active":"2023-10-14T09:37:21.756224+0000","last_became_peered":"2023-10-14T09:37:21.756224+0000","last_unstale":"2023-10-14T09:37:23.004124+0000","last_undegraded":"2023-10-14T09:37:23.004124+0000","last_fullsized":"2023-10-14T09:37:23.004124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:34:28.487519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.004690+0000","last_change":"2023-10-14T09:37:21.756982+0000","last_active":"2023-10-14T09:37:23.004690+0000","last_peered":"2023-10-14T09:37:23.004690+0000","last_clean":"2023-10-14T09:37:23.004690+0000","last_became_active":"2023-10-14T09:37:21.756163+0000","last_became_peered":"2023-10-14T09:37:21.756163+0000","last_unstale":"2023-10-14T09:37:23.004690+0000","last_undegraded":"2023-10-14T09:37:23.004690+0000","last_fullsized":"2023-10-14T09:37:23.004690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:31:03.601136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.006237+0000","last_change":"2023-10-14T09:37:21.748380+0000","last_active":"2023-10-14T09:37:23.006237+0000","last_peered":"2023-10-14T09:37:23.006237+0000","last_clean":"2023-10-14T09:37:23.006237+0000","last_became_active":"2023-10-14T09:37:21.747954+0000","last_became_peered":"2023-10-14T09:37:21.747954+0000","last_unstale":"2023-10-14T09:37:23.006237+0000","last_undegraded":"2023-10-14T09:37:23.006237+0000","last_fullsized":"2023-10-14T09:37:23.006237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:43.379673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.838389+0000","last_change":"2023-10-14T09:37:21.748806+0000","last_active":"2023-10-14T09:37:22.838389+0000","last_peered":"2023-10-14T09:37:22.838389+0000","last_clean":"2023-10-14T09:37:22.838389+0000","last_became_active":"2023-10-14T09:37:21.747465+0000","last_became_peered":"2023-10-14T09:37:21.747465+0000","last_unstale":"2023-10-14T09:37:22.838389+0000","last_undegraded":"2023-10-14T09:37:22.838389+0000","last_fullsized":"2023-10-14T09:37:22.838389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:13:19.086221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000271+0000","last_change":"2023-10-14T09:37:21.739392+0000","last_active":"2023-10-14T09:37:23.000271+0000","last_peered":"2023-10-14T09:37:23.000271+0000","last_clean":"2023-10-14T09:37:23.000271+0000","last_became_active":"2023-10-14T09:37:21.738904+0000","last_became_peered":"2023-10-14T09:37:21.738904+0000","last_unstale":"2023-10-14T09:37:23.000271+0000","last_undegraded":"2023-10-14T09:37:23.000271+0000","last_fullsized":"2023-10-14T09:37:23.000271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:25:54.495041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.725892+0000","last_change":"2023-10-14T09:37:21.751374+0000","last_active":"2023-10-14T09:37:22.725892+0000","last_peered":"2023-10-14T09:37:22.725892+0000","last_clean":"2023-10-14T09:37:22.725892+0000","last_became_active":"2023-10-14T09:37:21.750630+0000","last_became_peered":"2023-10-14T09:37:21.750630+0000","last_unstale":"2023-10-14T09:37:22.725892+0000","last_undegraded":"2023-10-14T09:37:22.725892+0000","last_fullsized":"2023-10-14T09:37:22.725892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:58.386910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.727052+0000","last_change":"2023-10-14T09:37:21.746739+0000","last_active":"2023-10-14T09:37:22.727052+0000","last_peered":"2023-10-14T09:37:22.727052+0000","last_clean":"2023-10-14T09:37:22.727052+0000","last_became_active":"2023-10-14T09:37:21.743095+0000","last_became_peered":"2023-10-14T09:37:21.743095+0000","last_unstale":"2023-10-14T09:37:22.727052+0000","last_undegraded":"2023-10-14T09:37:22.727052+0000","last_fullsized":"2023-10-14T09:37:22.727052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:55:22.366551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.728505+0000","last_change":"2023-10-14T09:37:21.758327+0000","last_active":"2023-10-14T09:37:22.728505+0000","last_peered":"2023-10-14T09:37:22.728505+0000","last_clean":"2023-10-14T09:37:22.728505+0000","last_became_active":"2023-10-14T09:37:21.757671+0000","last_became_peered":"2023-10-14T09:37:21.757671+0000","last_unstale":"2023-10-14T09:37:22.728505+0000","last_undegraded":"2023-10-14T09:37:22.728505+0000","last_fullsized":"2023-10-14T09:37:22.728505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:11:25.698621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000594+0000","last_change":"2023-10-14T09:37:21.746441+0000","last_active":"2023-10-14T09:37:23.000594+0000","last_peered":"2023-10-14T09:37:23.000594+0000","last_clean":"2023-10-14T09:37:23.000594+0000","last_became_active":"2023-10-14T09:37:21.746086+0000","last_became_peered":"2023-10-14T09:37:21.746086+0000","last_unstale":"2023-10-14T09:37:23.000594+0000","last_undegraded":"2023-10-14T09:37:23.000594+0000","last_fullsized":"2023-10-14T09:37:23.000594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:47:12.887313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.005539+0000","last_change":"2023-10-14T09:37:21.757982+0000","last_active":"2023-10-14T09:37:23.005539+0000","last_peered":"2023-10-14T09:37:23.005539+0000","last_clean":"2023-10-14T09:37:23.005539+0000","last_became_active":"2023-10-14T09:37:21.757246+0000","last_became_peered":"2023-10-14T09:37:21.757246+0000","last_unstale":"2023-10-14T09:37:23.005539+0000","last_undegraded":"2023-10-14T09:37:23.005539+0000","last_fullsized":"2023-10-14T09:37:23.005539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:57:10.220824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.004161+0000","last_change":"2023-10-14T09:37:21.752806+0000","last_active":"2023-10-14T09:37:23.004161+0000","last_peered":"2023-10-14T09:37:23.004161+0000","last_clean":"2023-10-14T09:37:23.004161+0000","last_became_active":"2023-10-14T09:37:21.752504+0000","last_became_peered":"2023-10-14T09:37:21.752504+0000","last_unstale":"2023-10-14T09:37:23.004161+0000","last_undegraded":"2023-10-14T09:37:23.004161+0000","last_fullsized":"2023-10-14T09:37:23.004161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:47:20.269302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000372+0000","last_change":"2023-10-14T09:37:21.743928+0000","last_active":"2023-10-14T09:37:23.000372+0000","last_peered":"2023-10-14T09:37:23.000372+0000","last_clean":"2023-10-14T09:37:23.000372+0000","last_became_active":"2023-10-14T09:37:21.743649+0000","last_became_peered":"2023-10-14T09:37:21.743649+0000","last_unstale":"2023-10-14T09:37:23.000372+0000","last_undegraded":"2023-10-14T09:37:23.000372+0000","last_fullsized":"2023-10-14T09:37:23.000372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:05:15.351817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.727982+0000","last_change":"2023-10-14T09:37:21.755428+0000","last_active":"2023-10-14T09:37:22.727982+0000","last_peered":"2023-10-14T09:37:22.727982+0000","last_clean":"2023-10-14T09:37:22.727982+0000","last_became_active":"2023-10-14T09:37:21.755003+0000","last_became_peered":"2023-10-14T09:37:21.755003+0000","last_unstale":"2023-10-14T09:37:22.727982+0000","last_undegraded":"2023-10-14T09:37:22.727982+0000","last_fullsized":"2023-10-14T09:37:22.727982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:37:17.999853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.837923+0000","last_change":"2023-10-14T09:37:21.751484+0000","last_active":"2023-10-14T09:37:22.837923+0000","last_peered":"2023-10-14T09:37:22.837923+0000","last_clean":"2023-10-14T09:37:22.837923+0000","last_became_active":"2023-10-14T09:37:21.751206+0000","last_became_peered":"2023-10-14T09:37:21.751206+0000","last_unstale":"2023-10-14T09:37:22.837923+0000","last_undegraded":"2023-10-14T09:37:22.837923+0000","last_fullsized":"2023-10-14T09:37:22.837923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:45.609123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.727258+0000","last_change":"2023-10-14T09:37:21.756153+0000","last_active":"2023-10-14T09:37:22.727258+0000","last_peered":"2023-10-14T09:37:22.727258+0000","last_clean":"2023-10-14T09:37:22.727258+0000","last_became_active":"2023-10-14T09:37:21.755888+0000","last_became_peered":"2023-10-14T09:37:21.755888+0000","last_unstale":"2023-10-14T09:37:22.727258+0000","last_undegraded":"2023-10-14T09:37:22.727258+0000","last_fullsized":"2023-10-14T09:37:22.727258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:33:39.761471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.838544+0000","last_change":"2023-10-14T09:37:21.756618+0000","last_active":"2023-10-14T09:37:22.838544+0000","last_peered":"2023-10-14T09:37:22.838544+0000","last_clean":"2023-10-14T09:37:22.838544+0000","last_became_active":"2023-10-14T09:37:21.756268+0000","last_became_peered":"2023-10-14T09:37:21.756268+0000","last_unstale":"2023-10-14T09:37:22.838544+0000","last_undegraded":"2023-10-14T09:37:22.838544+0000","last_fullsized":"2023-10-14T09:37:22.838544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:20:56.163594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.004153+0000","last_change":"2023-10-14T09:37:21.757751+0000","last_active":"2023-10-14T09:37:23.004153+0000","last_peered":"2023-10-14T09:37:23.004153+0000","last_clean":"2023-10-14T09:37:23.004153+0000","last_became_active":"2023-10-14T09:37:21.757484+0000","last_became_peered":"2023-10-14T09:37:21.757484+0000","last_unstale":"2023-10-14T09:37:23.004153+0000","last_undegraded":"2023-10-14T09:37:23.004153+0000","last_fullsized":"2023-10-14T09:37:23.004153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:45.609123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.726318+0000","last_change":"2023-10-14T09:37:21.748864+0000","last_active":"2023-10-14T09:37:22.726318+0000","last_peered":"2023-10-14T09:37:22.726318+0000","last_clean":"2023-10-14T09:37:22.726318+0000","last_became_active":"2023-10-14T09:37:21.748569+0000","last_became_peered":"2023-10-14T09:37:21.748569+0000","last_unstale":"2023-10-14T09:37:22.726318+0000","last_undegraded":"2023-10-14T09:37:22.726318+0000","last_fullsized":"2023-10-14T09:37:22.726318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:31:03.601136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.838561+0000","last_change":"2023-10-14T09:37:21.752356+0000","last_active":"2023-10-14T09:37:22.838561+0000","last_peered":"2023-10-14T09:37:22.838561+0000","last_clean":"2023-10-14T09:37:22.838561+0000","last_became_active":"2023-10-14T09:37:21.751916+0000","last_became_peered":"2023-10-14T09:37:21.751916+0000","last_unstale":"2023-10-14T09:37:22.838561+0000","last_undegraded":"2023-10-14T09:37:22.838561+0000","last_fullsized":"2023-10-14T09:37:22.838561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:18:14.767746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000415+0000","last_change":"2023-10-14T09:37:21.742511+0000","last_active":"2023-10-14T09:37:23.000415+0000","last_peered":"2023-10-14T09:37:23.000415+0000","last_clean":"2023-10-14T09:37:23.000415+0000","last_became_active":"2023-10-14T09:37:21.742202+0000","last_became_peered":"2023-10-14T09:37:21.742202+0000","last_unstale":"2023-10-14T09:37:23.000415+0000","last_undegraded":"2023-10-14T09:37:23.000415+0000","last_fullsized":"2023-10-14T09:37:23.000415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:24:01.166672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.728259+0000","last_change":"2023-10-14T09:37:21.750041+0000","last_active":"2023-10-14T09:37:22.728259+0000","last_peered":"2023-10-14T09:37:22.728259+0000","last_clean":"2023-10-14T09:37:22.728259+0000","last_became_active":"2023-10-14T09:37:21.749143+0000","last_became_peered":"2023-10-14T09:37:21.749143+0000","last_unstale":"2023-10-14T09:37:22.728259+0000","last_undegraded":"2023-10-14T09:37:22.728259+0000","last_fullsized":"2023-10-14T09:37:22.728259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:06:11.732279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000783+0000","last_change":"2023-10-14T09:37:21.753852+0000","last_active":"2023-10-14T09:37:23.000783+0000","last_peered":"2023-10-14T09:37:23.000783+0000","last_clean":"2023-10-14T09:37:23.000783+0000","last_became_active":"2023-10-14T09:37:21.753535+0000","last_became_peered":"2023-10-14T09:37:21.753535+0000","last_unstale":"2023-10-14T09:37:23.000783+0000","last_undegraded":"2023-10-14T09:37:23.000783+0000","last_fullsized":"2023-10-14T09:37:23.000783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:43.379673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.003190+0000","last_change":"2023-10-14T09:37:21.746670+0000","last_active":"2023-10-14T09:37:23.003190+0000","last_peered":"2023-10-14T09:37:23.003190+0000","last_clean":"2023-10-14T09:37:23.003190+0000","last_became_active":"2023-10-14T09:37:21.746392+0000","last_became_peered":"2023-10-14T09:37:21.746392+0000","last_unstale":"2023-10-14T09:37:23.003190+0000","last_undegraded":"2023-10-14T09:37:23.003190+0000","last_fullsized":"2023-10-14T09:37:23.003190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:59:41.080217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.005826+0000","last_change":"2023-10-14T09:37:21.740283+0000","last_active":"2023-10-14T09:37:23.005826+0000","last_peered":"2023-10-14T09:37:23.005826+0000","last_clean":"2023-10-14T09:37:23.005826+0000","last_became_active":"2023-10-14T09:37:21.740017+0000","last_became_peered":"2023-10-14T09:37:21.740017+0000","last_unstale":"2023-10-14T09:37:23.005826+0000","last_undegraded":"2023-10-14T09:37:23.005826+0000","last_fullsized":"2023-10-14T09:37:23.005826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:47:12.887313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.919472+0000","last_change":"2023-10-14T09:37:20.933870+0000","last_active":"2023-10-14T09:37:21.919472+0000","last_peered":"2023-10-14T09:37:21.919472+0000","last_clean":"2023-10-14T09:37:21.919472+0000","last_became_active":"2023-10-14T09:37:20.933620+0000","last_became_peered":"2023-10-14T09:37:20.933620+0000","last_unstale":"2023-10-14T09:37:21.919472+0000","last_undegraded":"2023-10-14T09:37:21.919472+0000","last_fullsized":"2023-10-14T09:37:21.919472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:25:18.109123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000783+0000","last_change":"2023-10-14T09:37:21.739293+0000","last_active":"2023-10-14T09:37:23.000783+0000","last_peered":"2023-10-14T09:37:23.000783+0000","last_clean":"2023-10-14T09:37:23.000783+0000","last_became_active":"2023-10-14T09:37:21.737376+0000","last_became_peered":"2023-10-14T09:37:21.737376+0000","last_unstale":"2023-10-14T09:37:23.000783+0000","last_undegraded":"2023-10-14T09:37:23.000783+0000","last_fullsized":"2023-10-14T09:37:23.000783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:19:35.129999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.932146+0000","last_change":"2023-10-14T09:37:20.926893+0000","last_active":"2023-10-14T09:37:21.932146+0000","last_peered":"2023-10-14T09:37:21.932146+0000","last_clean":"2023-10-14T09:37:21.932146+0000","last_became_active":"2023-10-14T09:37:20.926029+0000","last_became_peered":"2023-10-14T09:37:20.926029+0000","last_unstale":"2023-10-14T09:37:21.932146+0000","last_undegraded":"2023-10-14T09:37:21.932146+0000","last_fullsized":"2023-10-14T09:37:21.932146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:37:06.069126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.730625+0000","last_change":"2023-10-14T09:37:20.936214+0000","last_active":"2023-10-14T09:37:21.730625+0000","last_peered":"2023-10-14T09:37:21.730625+0000","last_clean":"2023-10-14T09:37:21.730625+0000","last_became_active":"2023-10-14T09:37:20.935904+0000","last_became_peered":"2023-10-14T09:37:20.935904+0000","last_unstale":"2023-10-14T09:37:21.730625+0000","last_undegraded":"2023-10-14T09:37:21.730625+0000","last_fullsized":"2023-10-14T09:37:21.730625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:40:10.259029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.837900+0000","last_change":"2023-10-14T09:37:21.742408+0000","last_active":"2023-10-14T09:37:22.837900+0000","last_peered":"2023-10-14T09:37:22.837900+0000","last_clean":"2023-10-14T09:37:22.837900+0000","last_became_active":"2023-10-14T09:37:21.741339+0000","last_became_peered":"2023-10-14T09:37:21.741339+0000","last_unstale":"2023-10-14T09:37:22.837900+0000","last_undegraded":"2023-10-14T09:37:22.837900+0000","last_fullsized":"2023-10-14T09:37:22.837900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:58.386910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.727298+0000","last_change":"2023-10-14T09:37:20.920967+0000","last_active":"2023-10-14T09:37:22.727298+0000","last_peered":"2023-10-14T09:37:22.727298+0000","last_clean":"2023-10-14T09:37:22.727298+0000","last_became_active":"2023-10-14T09:37:20.919427+0000","last_became_peered":"2023-10-14T09:37:20.919427+0000","last_unstale":"2023-10-14T09:37:22.727298+0000","last_undegraded":"2023-10-14T09:37:22.727298+0000","last_fullsized":"2023-10-14T09:37:22.727298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:36:06.124475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.726089+0000","last_change":"2023-10-14T09:37:21.745880+0000","last_active":"2023-10-14T09:37:22.726089+0000","last_peered":"2023-10-14T09:37:22.726089+0000","last_clean":"2023-10-14T09:37:22.726089+0000","last_became_active":"2023-10-14T09:37:21.745521+0000","last_became_peered":"2023-10-14T09:37:21.745521+0000","last_unstale":"2023-10-14T09:37:22.726089+0000","last_undegraded":"2023-10-14T09:37:22.726089+0000","last_fullsized":"2023-10-14T09:37:22.726089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:45.609123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.733782+0000","last_change":"2023-10-14T09:37:20.934454+0000","last_active":"2023-10-14T09:37:21.733782+0000","last_peered":"2023-10-14T09:37:21.733782+0000","last_clean":"2023-10-14T09:37:21.733782+0000","last_became_active":"2023-10-14T09:37:20.934153+0000","last_became_peered":"2023-10-14T09:37:20.934153+0000","last_unstale":"2023-10-14T09:37:21.733782+0000","last_undegraded":"2023-10-14T09:37:21.733782+0000","last_fullsized":"2023-10-14T09:37:21.733782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:36.063014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.728323+0000","last_change":"2023-10-14T09:37:21.755249+0000","last_active":"2023-10-14T09:37:22.728323+0000","last_peered":"2023-10-14T09:37:22.728323+0000","last_clean":"2023-10-14T09:37:22.728323+0000","last_became_active":"2023-10-14T09:37:21.754740+0000","last_became_peered":"2023-10-14T09:37:21.754740+0000","last_unstale":"2023-10-14T09:37:22.728323+0000","last_undegraded":"2023-10-14T09:37:22.728323+0000","last_fullsized":"2023-10-14T09:37:22.728323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:35:35.551195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.728656+0000","last_change":"2023-10-14T09:37:20.935194+0000","last_active":"2023-10-14T09:37:22.728656+0000","last_peered":"2023-10-14T09:37:22.728656+0000","last_clean":"2023-10-14T09:37:22.728656+0000","last_became_active":"2023-10-14T09:37:20.934945+0000","last_became_peered":"2023-10-14T09:37:20.934945+0000","last_unstale":"2023-10-14T09:37:22.728656+0000","last_undegraded":"2023-10-14T09:37:22.728656+0000","last_fullsized":"2023-10-14T09:37:22.728656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:24:00.151660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.001230+0000","last_change":"2023-10-14T09:37:21.755417+0000","last_active":"2023-10-14T09:37:23.001230+0000","last_peered":"2023-10-14T09:37:23.001230+0000","last_clean":"2023-10-14T09:37:23.001230+0000","last_became_active":"2023-10-14T09:37:21.755076+0000","last_became_peered":"2023-10-14T09:37:21.755076+0000","last_unstale":"2023-10-14T09:37:23.001230+0000","last_undegraded":"2023-10-14T09:37:23.001230+0000","last_fullsized":"2023-10-14T09:37:23.001230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:00:52.100349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.922965+0000","last_change":"2023-10-14T09:37:20.928928+0000","last_active":"2023-10-14T09:37:21.922965+0000","last_peered":"2023-10-14T09:37:21.922965+0000","last_clean":"2023-10-14T09:37:21.922965+0000","last_became_active":"2023-10-14T09:37:20.928584+0000","last_became_peered":"2023-10-14T09:37:20.928584+0000","last_unstale":"2023-10-14T09:37:21.922965+0000","last_undegraded":"2023-10-14T09:37:21.922965+0000","last_fullsized":"2023-10-14T09:37:21.922965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:59:40.065205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.006299+0000","last_change":"2023-10-14T09:37:21.750980+0000","last_active":"2023-10-14T09:37:23.006299+0000","last_peered":"2023-10-14T09:37:23.006299+0000","last_clean":"2023-10-14T09:37:23.006299+0000","last_became_active":"2023-10-14T09:37:21.750695+0000","last_became_peered":"2023-10-14T09:37:21.750695+0000","last_unstale":"2023-10-14T09:37:23.006299+0000","last_undegraded":"2023-10-14T09:37:23.006299+0000","last_fullsized":"2023-10-14T09:37:23.006299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:54:58.954523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.934827+0000","last_change":"2023-10-14T09:37:20.929237+0000","last_active":"2023-10-14T09:37:21.934827+0000","last_peered":"2023-10-14T09:37:21.934827+0000","last_clean":"2023-10-14T09:37:21.934827+0000","last_became_active":"2023-10-14T09:37:20.926149+0000","last_became_peered":"2023-10-14T09:37:20.926149+0000","last_unstale":"2023-10-14T09:37:21.934827+0000","last_undegraded":"2023-10-14T09:37:21.934827+0000","last_fullsized":"2023-10-14T09:37:21.934827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:42.364661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.004759+0000","last_change":"2023-10-14T09:37:21.758759+0000","last_active":"2023-10-14T09:37:23.004759+0000","last_peered":"2023-10-14T09:37:23.004759+0000","last_clean":"2023-10-14T09:37:23.004759+0000","last_became_active":"2023-10-14T09:37:21.757589+0000","last_became_peered":"2023-10-14T09:37:21.757589+0000","last_unstale":"2023-10-14T09:37:23.004759+0000","last_undegraded":"2023-10-14T09:37:23.004759+0000","last_fullsized":"2023-10-14T09:37:23.004759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:20:22.862559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000879+0000","last_change":"2023-10-14T09:37:20.929762+0000","last_active":"2023-10-14T09:37:23.000879+0000","last_peered":"2023-10-14T09:37:23.000879+0000","last_clean":"2023-10-14T09:37:23.000879+0000","last_became_active":"2023-10-14T09:37:20.929207+0000","last_became_peered":"2023-10-14T09:37:20.929207+0000","last_unstale":"2023-10-14T09:37:23.000879+0000","last_undegraded":"2023-10-14T09:37:23.000879+0000","last_fullsized":"2023-10-14T09:37:23.000879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:47:37.290001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000293+0000","last_change":"2023-10-14T09:37:21.749696+0000","last_active":"2023-10-14T09:37:23.000293+0000","last_peered":"2023-10-14T09:37:23.000293+0000","last_clean":"2023-10-14T09:37:23.000293+0000","last_became_active":"2023-10-14T09:37:21.749373+0000","last_became_peered":"2023-10-14T09:37:21.749373+0000","last_unstale":"2023-10-14T09:37:23.000293+0000","last_undegraded":"2023-10-14T09:37:23.000293+0000","last_fullsized":"2023-10-14T09:37:23.000293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:36:07.139487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.728249+0000","last_change":"2023-10-14T09:37:20.925825+0000","last_active":"2023-10-14T09:37:22.728249+0000","last_peered":"2023-10-14T09:37:22.728249+0000","last_clean":"2023-10-14T09:37:22.728249+0000","last_became_active":"2023-10-14T09:37:20.924728+0000","last_became_peered":"2023-10-14T09:37:20.924728+0000","last_unstale":"2023-10-14T09:37:22.728249+0000","last_undegraded":"2023-10-14T09:37:22.728249+0000","last_fullsized":"2023-10-14T09:37:22.728249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:05:14.336805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.005698+0000","last_change":"2023-10-14T09:37:21.754368+0000","last_active":"2023-10-14T09:37:23.005698+0000","last_peered":"2023-10-14T09:37:23.005698+0000","last_clean":"2023-10-14T09:37:23.005698+0000","last_became_active":"2023-10-14T09:37:21.754087+0000","last_became_peered":"2023-10-14T09:37:21.754087+0000","last_unstale":"2023-10-14T09:37:23.005698+0000","last_undegraded":"2023-10-14T09:37:23.005698+0000","last_fullsized":"2023-10-14T09:37:23.005698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:14:34.307289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.743028+0000","last_change":"2023-10-14T09:37:20.927507+0000","last_active":"2023-10-14T09:37:21.743028+0000","last_peered":"2023-10-14T09:37:21.743028+0000","last_clean":"2023-10-14T09:37:21.743028+0000","last_became_active":"2023-10-14T09:37:20.926661+0000","last_became_peered":"2023-10-14T09:37:20.926661+0000","last_unstale":"2023-10-14T09:37:21.743028+0000","last_undegraded":"2023-10-14T09:37:21.743028+0000","last_fullsized":"2023-10-14T09:37:21.743028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:11:56.674281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.003581+0000","last_change":"2023-10-14T09:37:21.746970+0000","last_active":"2023-10-14T09:37:23.003581+0000","last_peered":"2023-10-14T09:37:23.003581+0000","last_clean":"2023-10-14T09:37:23.003581+0000","last_became_active":"2023-10-14T09:37:21.746319+0000","last_became_peered":"2023-10-14T09:37:21.746319+0000","last_unstale":"2023-10-14T09:37:23.003581+0000","last_undegraded":"2023-10-14T09:37:23.003581+0000","last_fullsized":"2023-10-14T09:37:23.003581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:58.386910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.924816+0000","last_change":"2023-10-14T09:37:20.922802+0000","last_active":"2023-10-14T09:37:21.924816+0000","last_peered":"2023-10-14T09:37:21.924816+0000","last_clean":"2023-10-14T09:37:21.924816+0000","last_became_active":"2023-10-14T09:37:20.922500+0000","last_became_peered":"2023-10-14T09:37:20.922500+0000","last_unstale":"2023-10-14T09:37:21.924816+0000","last_undegraded":"2023-10-14T09:37:21.924816+0000","last_fullsized":"2023-10-14T09:37:21.924816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:06:47.039219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.006896+0000","last_change":"2023-10-14T09:37:21.762686+0000","last_active":"2023-10-14T09:37:23.006896+0000","last_peered":"2023-10-14T09:37:23.006896+0000","last_clean":"2023-10-14T09:37:23.006896+0000","last_became_active":"2023-10-14T09:37:21.761363+0000","last_became_peered":"2023-10-14T09:37:21.761363+0000","last_unstale":"2023-10-14T09:37:23.006896+0000","last_undegraded":"2023-10-14T09:37:23.006896+0000","last_fullsized":"2023-10-14T09:37:23.006896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:41:33.345823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.924183+0000","last_change":"2023-10-14T09:37:20.923259+0000","last_active":"2023-10-14T09:37:21.924183+0000","last_peered":"2023-10-14T09:37:21.924183+0000","last_clean":"2023-10-14T09:37:21.924183+0000","last_became_active":"2023-10-14T09:37:20.922949+0000","last_became_peered":"2023-10-14T09:37:20.922949+0000","last_unstale":"2023-10-14T09:37:21.924183+0000","last_undegraded":"2023-10-14T09:37:21.924183+0000","last_fullsized":"2023-10-14T09:37:21.924183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:36.063014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.007898+0000","last_change":"2023-10-14T09:37:21.757197+0000","last_active":"2023-10-14T09:37:23.007898+0000","last_peered":"2023-10-14T09:37:23.007898+0000","last_clean":"2023-10-14T09:37:23.007898+0000","last_became_active":"2023-10-14T09:37:21.756570+0000","last_became_peered":"2023-10-14T09:37:21.756570+0000","last_unstale":"2023-10-14T09:37:23.007898+0000","last_undegraded":"2023-10-14T09:37:23.007898+0000","last_fullsized":"2023-10-14T09:37:23.007898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:26:10.321772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.923988+0000","last_change":"2023-10-14T09:37:20.925144+0000","last_active":"2023-10-14T09:37:21.923988+0000","last_peered":"2023-10-14T09:37:21.923988+0000","last_clean":"2023-10-14T09:37:21.923988+0000","last_became_active":"2023-10-14T09:37:20.924857+0000","last_became_peered":"2023-10-14T09:37:20.924857+0000","last_unstale":"2023-10-14T09:37:21.923988+0000","last_undegraded":"2023-10-14T09:37:21.923988+0000","last_fullsized":"2023-10-14T09:37:21.923988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:40:10.259029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.008287+0000","last_change":"2023-10-14T09:37:21.760917+0000","last_active":"2023-10-14T09:37:23.008287+0000","last_peered":"2023-10-14T09:37:23.008287+0000","last_clean":"2023-10-14T09:37:23.008287+0000","last_became_active":"2023-10-14T09:37:21.760610+0000","last_became_peered":"2023-10-14T09:37:21.760610+0000","last_unstale":"2023-10-14T09:37:23.008287+0000","last_undegraded":"2023-10-14T09:37:23.008287+0000","last_fullsized":"2023-10-14T09:37:23.008287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:55:37.499900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.922672+0000","last_change":"2023-10-14T09:37:20.927543+0000","last_active":"2023-10-14T09:37:21.922672+0000","last_peered":"2023-10-14T09:37:21.922672+0000","last_clean":"2023-10-14T09:37:21.922672+0000","last_became_active":"2023-10-14T09:37:20.926596+0000","last_became_peered":"2023-10-14T09:37:20.926596+0000","last_unstale":"2023-10-14T09:37:21.922672+0000","last_undegraded":"2023-10-14T09:37:21.922672+0000","last_fullsized":"2023-10-14T09:37:21.922672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:41:25.240229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.728342+0000","last_change":"2023-10-14T09:37:21.757458+0000","last_active":"2023-10-14T09:37:22.728342+0000","last_peered":"2023-10-14T09:37:22.728342+0000","last_clean":"2023-10-14T09:37:22.728342+0000","last_became_active":"2023-10-14T09:37:21.755979+0000","last_became_peered":"2023-10-14T09:37:21.755979+0000","last_unstale":"2023-10-14T09:37:22.728342+0000","last_undegraded":"2023-10-14T09:37:22.728342+0000","last_fullsized":"2023-10-14T09:37:22.728342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:01:17.124198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.726389+0000","last_change":"2023-10-14T09:37:20.916979+0000","last_active":"2023-10-14T09:37:21.726389+0000","last_peered":"2023-10-14T09:37:21.726389+0000","last_clean":"2023-10-14T09:37:21.726389+0000","last_became_active":"2023-10-14T09:37:20.916624+0000","last_became_peered":"2023-10-14T09:37:20.916624+0000","last_unstale":"2023-10-14T09:37:21.726389+0000","last_undegraded":"2023-10-14T09:37:21.726389+0000","last_fullsized":"2023-10-14T09:37:21.726389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:25:18.109123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.004982+0000","last_change":"2023-10-14T09:37:21.760133+0000","last_active":"2023-10-14T09:37:23.004982+0000","last_peered":"2023-10-14T09:37:23.004982+0000","last_clean":"2023-10-14T09:37:23.004982+0000","last_became_active":"2023-10-14T09:37:21.756336+0000","last_became_peered":"2023-10-14T09:37:21.756336+0000","last_unstale":"2023-10-14T09:37:23.004982+0000","last_undegraded":"2023-10-14T09:37:23.004982+0000","last_fullsized":"2023-10-14T09:37:23.004982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:20:56.163594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.740212+0000","last_change":"2023-10-14T09:37:12.368000+0000","last_active":"2023-10-14T09:37:21.740212+0000","last_peered":"2023-10-14T09:37:21.740212+0000","last_clean":"2023-10-14T09:37:21.740212+0000","last_became_active":"2023-10-14T09:37:12.364623+0000","last_became_peered":"2023-10-14T09:37:12.364623+0000","last_unstale":"2023-10-14T09:37:21.740212+0000","last_undegraded":"2023-10-14T09:37:21.740212+0000","last_fullsized":"2023-10-14T09:37:21.740212+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:10.796841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:10.796841+0000","last_clean_scrub_stamp":"2023-10-14T09:37:10.796841+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:48.940536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.727610+0000","last_change":"2023-10-14T09:37:20.911869+0000","last_active":"2023-10-14T09:37:22.727610+0000","last_peered":"2023-10-14T09:37:22.727610+0000","last_clean":"2023-10-14T09:37:22.727610+0000","last_became_active":"2023-10-14T09:37:20.911115+0000","last_became_peered":"2023-10-14T09:37:20.911115+0000","last_unstale":"2023-10-14T09:37:22.727610+0000","last_undegraded":"2023-10-14T09:37:22.727610+0000","last_fullsized":"2023-10-14T09:37:22.727610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:19:34.114987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.838142+0000","last_change":"2023-10-14T09:37:21.762010+0000","last_active":"2023-10-14T09:37:22.838142+0000","last_peered":"2023-10-14T09:37:22.838142+0000","last_clean":"2023-10-14T09:37:22.838142+0000","last_became_active":"2023-10-14T09:37:21.761697+0000","last_became_peered":"2023-10-14T09:37:21.761697+0000","last_unstale":"2023-10-14T09:37:22.838142+0000","last_undegraded":"2023-10-14T09:37:22.838142+0000","last_fullsized":"2023-10-14T09:37:22.838142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:31:03.601136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.740046+0000","last_change":"2023-10-14T09:37:20.935352+0000","last_active":"2023-10-14T09:37:21.740046+0000","last_peered":"2023-10-14T09:37:21.740046+0000","last_clean":"2023-10-14T09:37:21.740046+0000","last_became_active":"2023-10-14T09:37:20.935068+0000","last_became_peered":"2023-10-14T09:37:20.935068+0000","last_unstale":"2023-10-14T09:37:21.740046+0000","last_undegraded":"2023-10-14T09:37:21.740046+0000","last_fullsized":"2023-10-14T09:37:21.740046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:11:56.674281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000129+0000","last_change":"2023-10-14T09:37:21.743003+0000","last_active":"2023-10-14T09:37:23.000129+0000","last_peered":"2023-10-14T09:37:23.000129+0000","last_clean":"2023-10-14T09:37:23.000129+0000","last_became_active":"2023-10-14T09:37:21.741330+0000","last_became_peered":"2023-10-14T09:37:21.741330+0000","last_unstale":"2023-10-14T09:37:23.000129+0000","last_undegraded":"2023-10-14T09:37:23.000129+0000","last_fullsized":"2023-10-14T09:37:23.000129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:25:03.218431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.727315+0000","last_change":"2023-10-14T09:37:20.925505+0000","last_active":"2023-10-14T09:37:21.727315+0000","last_peered":"2023-10-14T09:37:21.727315+0000","last_clean":"2023-10-14T09:37:21.727315+0000","last_became_active":"2023-10-14T09:37:20.925234+0000","last_became_peered":"2023-10-14T09:37:20.925234+0000","last_unstale":"2023-10-14T09:37:21.727315+0000","last_undegraded":"2023-10-14T09:37:21.727315+0000","last_fullsized":"2023-10-14T09:37:21.727315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:18:40.682886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.725905+0000","last_change":"2023-10-14T09:37:21.743561+0000","last_active":"2023-10-14T09:37:22.725905+0000","last_peered":"2023-10-14T09:37:22.725905+0000","last_clean":"2023-10-14T09:37:22.725905+0000","last_became_active":"2023-10-14T09:37:21.741553+0000","last_became_peered":"2023-10-14T09:37:21.741553+0000","last_unstale":"2023-10-14T09:37:22.725905+0000","last_undegraded":"2023-10-14T09:37:22.725905+0000","last_fullsized":"2023-10-14T09:37:22.725905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:34:28.487519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.728603+0000","last_change":"2023-10-14T09:37:20.926456+0000","last_active":"2023-10-14T09:37:22.728603+0000","last_peered":"2023-10-14T09:37:22.728603+0000","last_clean":"2023-10-14T09:37:22.728603+0000","last_became_active":"2023-10-14T09:37:20.926173+0000","last_became_peered":"2023-10-14T09:37:20.926173+0000","last_unstale":"2023-10-14T09:37:22.728603+0000","last_undegraded":"2023-10-14T09:37:22.728603+0000","last_fullsized":"2023-10-14T09:37:22.728603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:13:10.980924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.005737+0000","last_change":"2023-10-14T09:37:21.741615+0000","last_active":"2023-10-14T09:37:23.005737+0000","last_peered":"2023-10-14T09:37:23.005737+0000","last_clean":"2023-10-14T09:37:23.005737+0000","last_became_active":"2023-10-14T09:37:21.741104+0000","last_became_peered":"2023-10-14T09:37:21.741104+0000","last_unstale":"2023-10-14T09:37:23.005737+0000","last_undegraded":"2023-10-14T09:37:23.005737+0000","last_fullsized":"2023-10-14T09:37:23.005737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:18:41.697898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.735877+0000","last_change":"2023-10-14T09:37:20.927017+0000","last_active":"2023-10-14T09:37:21.735877+0000","last_peered":"2023-10-14T09:37:21.735877+0000","last_clean":"2023-10-14T09:37:21.735877+0000","last_became_active":"2023-10-14T09:37:20.925357+0000","last_became_peered":"2023-10-14T09:37:20.925357+0000","last_unstale":"2023-10-14T09:37:21.735877+0000","last_undegraded":"2023-10-14T09:37:21.735877+0000","last_fullsized":"2023-10-14T09:37:21.735877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:37:06.069126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.728396+0000","last_change":"2023-10-14T09:37:21.748586+0000","last_active":"2023-10-14T09:37:22.728396+0000","last_peered":"2023-10-14T09:37:22.728396+0000","last_clean":"2023-10-14T09:37:22.728396+0000","last_became_active":"2023-10-14T09:37:21.748040+0000","last_became_peered":"2023-10-14T09:37:21.748040+0000","last_unstale":"2023-10-14T09:37:22.728396+0000","last_undegraded":"2023-10-14T09:37:22.728396+0000","last_fullsized":"2023-10-14T09:37:22.728396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:29:10.224997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.741168+0000","last_change":"2023-10-14T09:37:20.936600+0000","last_active":"2023-10-14T09:37:21.741168+0000","last_peered":"2023-10-14T09:37:21.741168+0000","last_clean":"2023-10-14T09:37:21.741168+0000","last_became_active":"2023-10-14T09:37:20.936310+0000","last_became_peered":"2023-10-14T09:37:20.936310+0000","last_unstale":"2023-10-14T09:37:21.741168+0000","last_undegraded":"2023-10-14T09:37:21.741168+0000","last_fullsized":"2023-10-14T09:37:21.741168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:57.371898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.726291+0000","last_change":"2023-10-14T09:37:21.746713+0000","last_active":"2023-10-14T09:37:22.726291+0000","last_peered":"2023-10-14T09:37:22.726291+0000","last_clean":"2023-10-14T09:37:22.726291+0000","last_became_active":"2023-10-14T09:37:21.742406+0000","last_became_peered":"2023-10-14T09:37:21.742406+0000","last_unstale":"2023-10-14T09:37:22.726291+0000","last_undegraded":"2023-10-14T09:37:22.726291+0000","last_fullsized":"2023-10-14T09:37:22.726291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:47:20.269302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.737418+0000","last_change":"2023-10-14T09:37:20.936548+0000","last_active":"2023-10-14T09:37:21.737418+0000","last_peered":"2023-10-14T09:37:21.737418+0000","last_clean":"2023-10-14T09:37:21.737418+0000","last_became_active":"2023-10-14T09:37:20.936168+0000","last_became_peered":"2023-10-14T09:37:20.936168+0000","last_unstale":"2023-10-14T09:37:21.737418+0000","last_undegraded":"2023-10-14T09:37:21.737418+0000","last_fullsized":"2023-10-14T09:37:21.737418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:11:56.674281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.838498+0000","last_change":"2023-10-14T09:37:21.757494+0000","last_active":"2023-10-14T09:37:22.838498+0000","last_peered":"2023-10-14T09:37:22.838498+0000","last_clean":"2023-10-14T09:37:22.838498+0000","last_became_active":"2023-10-14T09:37:21.757272+0000","last_became_peered":"2023-10-14T09:37:21.757272+0000","last_unstale":"2023-10-14T09:37:22.838498+0000","last_undegraded":"2023-10-14T09:37:22.838498+0000","last_fullsized":"2023-10-14T09:37:22.838498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:20:22.862559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.931957+0000","last_change":"2023-10-14T09:37:20.938169+0000","last_active":"2023-10-14T09:37:21.931957+0000","last_peered":"2023-10-14T09:37:21.931957+0000","last_clean":"2023-10-14T09:37:21.931957+0000","last_became_active":"2023-10-14T09:37:20.937881+0000","last_became_peered":"2023-10-14T09:37:20.937881+0000","last_unstale":"2023-10-14T09:37:21.931957+0000","last_undegraded":"2023-10-14T09:37:21.931957+0000","last_fullsized":"2023-10-14T09:37:21.931957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:40:10.259029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.001082+0000","last_change":"2023-10-14T09:37:21.742197+0000","last_active":"2023-10-14T09:37:23.001082+0000","last_peered":"2023-10-14T09:37:23.001082+0000","last_clean":"2023-10-14T09:37:23.001082+0000","last_became_active":"2023-10-14T09:37:21.741895+0000","last_became_peered":"2023-10-14T09:37:21.741895+0000","last_unstale":"2023-10-14T09:37:23.001082+0000","last_undegraded":"2023-10-14T09:37:23.001082+0000","last_fullsized":"2023-10-14T09:37:23.001082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:55:22.366551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.739759+0000","last_change":"2023-10-14T09:37:20.933959+0000","last_active":"2023-10-14T09:37:21.739759+0000","last_peered":"2023-10-14T09:37:21.739759+0000","last_clean":"2023-10-14T09:37:21.739759+0000","last_became_active":"2023-10-14T09:37:20.933659+0000","last_became_peered":"2023-10-14T09:37:20.933659+0000","last_unstale":"2023-10-14T09:37:21.739759+0000","last_undegraded":"2023-10-14T09:37:21.739759+0000","last_fullsized":"2023-10-14T09:37:21.739759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:41:25.240229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.004951+0000","last_change":"2023-10-14T09:37:21.739948+0000","last_active":"2023-10-14T09:37:23.004951+0000","last_peered":"2023-10-14T09:37:23.004951+0000","last_clean":"2023-10-14T09:37:23.004951+0000","last_became_active":"2023-10-14T09:37:21.739597+0000","last_became_peered":"2023-10-14T09:37:21.739597+0000","last_unstale":"2023-10-14T09:37:23.004951+0000","last_undegraded":"2023-10-14T09:37:23.004951+0000","last_fullsized":"2023-10-14T09:37:23.004951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:25:19.124135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.733841+0000","last_change":"2023-10-14T09:37:20.932183+0000","last_active":"2023-10-14T09:37:21.733841+0000","last_peered":"2023-10-14T09:37:21.733841+0000","last_clean":"2023-10-14T09:37:21.733841+0000","last_became_active":"2023-10-14T09:37:20.931834+0000","last_became_peered":"2023-10-14T09:37:20.931834+0000","last_unstale":"2023-10-14T09:37:21.733841+0000","last_undegraded":"2023-10-14T09:37:21.733841+0000","last_fullsized":"2023-10-14T09:37:21.733841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:54:57.939511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.837982+0000","last_change":"2023-10-14T09:37:21.749015+0000","last_active":"2023-10-14T09:37:22.837982+0000","last_peered":"2023-10-14T09:37:22.837982+0000","last_clean":"2023-10-14T09:37:22.837982+0000","last_became_active":"2023-10-14T09:37:21.748596+0000","last_became_peered":"2023-10-14T09:37:21.748596+0000","last_unstale":"2023-10-14T09:37:22.837982+0000","last_undegraded":"2023-10-14T09:37:22.837982+0000","last_fullsized":"2023-10-14T09:37:22.837982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:47:20.269302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.735064+0000","last_change":"2023-10-14T09:37:20.929243+0000","last_active":"2023-10-14T09:37:21.735064+0000","last_peered":"2023-10-14T09:37:21.735064+0000","last_clean":"2023-10-14T09:37:21.735064+0000","last_became_active":"2023-10-14T09:37:20.928931+0000","last_became_peered":"2023-10-14T09:37:20.928931+0000","last_unstale":"2023-10-14T09:37:21.735064+0000","last_undegraded":"2023-10-14T09:37:21.735064+0000","last_fullsized":"2023-10-14T09:37:21.735064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:37:19.998680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.838457+0000","last_change":"2023-10-14T09:37:21.742020+0000","last_active":"2023-10-14T09:37:22.838457+0000","last_peered":"2023-10-14T09:37:22.838457+0000","last_clean":"2023-10-14T09:37:22.838457+0000","last_became_active":"2023-10-14T09:37:21.741732+0000","last_became_peered":"2023-10-14T09:37:21.741732+0000","last_unstale":"2023-10-14T09:37:22.838457+0000","last_undegraded":"2023-10-14T09:37:22.838457+0000","last_fullsized":"2023-10-14T09:37:22.838457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:14:40.914923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.931371+0000","last_change":"2023-10-14T09:37:20.939984+0000","last_active":"2023-10-14T09:37:21.931371+0000","last_peered":"2023-10-14T09:37:21.931371+0000","last_clean":"2023-10-14T09:37:21.931371+0000","last_became_active":"2023-10-14T09:37:20.937636+0000","last_became_peered":"2023-10-14T09:37:20.937636+0000","last_unstale":"2023-10-14T09:37:21.931371+0000","last_undegraded":"2023-10-14T09:37:21.931371+0000","last_fullsized":"2023-10-14T09:37:21.931371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:54:57.939511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.003333+0000","last_change":"2023-10-14T09:37:21.751303+0000","last_active":"2023-10-14T09:37:23.003333+0000","last_peered":"2023-10-14T09:37:23.003333+0000","last_clean":"2023-10-14T09:37:23.003333+0000","last_became_active":"2023-10-14T09:37:21.751037+0000","last_became_peered":"2023-10-14T09:37:21.751037+0000","last_unstale":"2023-10-14T09:37:23.003333+0000","last_undegraded":"2023-10-14T09:37:23.003333+0000","last_fullsized":"2023-10-14T09:37:23.003333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:47:20.056113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.727977+0000","last_change":"2023-10-14T09:37:21.753475+0000","last_active":"2023-10-14T09:37:22.727977+0000","last_peered":"2023-10-14T09:37:22.727977+0000","last_clean":"2023-10-14T09:37:22.727977+0000","last_became_active":"2023-10-14T09:37:21.751788+0000","last_became_peered":"2023-10-14T09:37:21.751788+0000","last_unstale":"2023-10-14T09:37:22.727977+0000","last_undegraded":"2023-10-14T09:37:22.727977+0000","last_fullsized":"2023-10-14T09:37:22.727977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:13:55.065205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.930531+0000","last_change":"2023-10-14T09:37:20.938049+0000","last_active":"2023-10-14T09:37:21.930531+0000","last_peered":"2023-10-14T09:37:21.930531+0000","last_clean":"2023-10-14T09:37:21.930531+0000","last_became_active":"2023-10-14T09:37:20.937761+0000","last_became_peered":"2023-10-14T09:37:20.937761+0000","last_unstale":"2023-10-14T09:37:21.930531+0000","last_undegraded":"2023-10-14T09:37:21.930531+0000","last_fullsized":"2023-10-14T09:37:21.930531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:25:18.109123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.728499+0000","last_change":"2023-10-14T09:37:21.746300+0000","last_active":"2023-10-14T09:37:22.728499+0000","last_peered":"2023-10-14T09:37:22.728499+0000","last_clean":"2023-10-14T09:37:22.728499+0000","last_became_active":"2023-10-14T09:37:21.743958+0000","last_became_peered":"2023-10-14T09:37:21.743958+0000","last_unstale":"2023-10-14T09:37:22.728499+0000","last_undegraded":"2023-10-14T09:37:22.728499+0000","last_fullsized":"2023-10-14T09:37:22.728499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:59:17.333518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.931999+0000","last_change":"2023-10-14T09:37:20.939300+0000","last_active":"2023-10-14T09:37:21.931999+0000","last_peered":"2023-10-14T09:37:21.931999+0000","last_clean":"2023-10-14T09:37:21.931999+0000","last_became_active":"2023-10-14T09:37:20.938957+0000","last_became_peered":"2023-10-14T09:37:20.938957+0000","last_unstale":"2023-10-14T09:37:21.931999+0000","last_undegraded":"2023-10-14T09:37:21.931999+0000","last_fullsized":"2023-10-14T09:37:21.931999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:59:40.065205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.001168+0000","last_change":"2023-10-14T09:37:21.755441+0000","last_active":"2023-10-14T09:37:23.001168+0000","last_peered":"2023-10-14T09:37:23.001168+0000","last_clean":"2023-10-14T09:37:23.001168+0000","last_became_active":"2023-10-14T09:37:21.755006+0000","last_became_peered":"2023-10-14T09:37:21.755006+0000","last_unstale":"2023-10-14T09:37:23.001168+0000","last_undegraded":"2023-10-14T09:37:23.001168+0000","last_fullsized":"2023-10-14T09:37:23.001168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:33:39.761471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.921465+0000","last_change":"2023-10-14T09:37:20.921785+0000","last_active":"2023-10-14T09:37:21.921465+0000","last_peered":"2023-10-14T09:37:21.921465+0000","last_clean":"2023-10-14T09:37:21.921465+0000","last_became_active":"2023-10-14T09:37:20.921514+0000","last_became_peered":"2023-10-14T09:37:20.921514+0000","last_unstale":"2023-10-14T09:37:21.921465+0000","last_undegraded":"2023-10-14T09:37:21.921465+0000","last_fullsized":"2023-10-14T09:37:21.921465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:37:19.998680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.838600+0000","last_change":"2023-10-14T09:37:21.748918+0000","last_active":"2023-10-14T09:37:22.838600+0000","last_peered":"2023-10-14T09:37:22.838600+0000","last_clean":"2023-10-14T09:37:22.838600+0000","last_became_active":"2023-10-14T09:37:21.746814+0000","last_became_peered":"2023-10-14T09:37:21.746814+0000","last_unstale":"2023-10-14T09:37:22.838600+0000","last_undegraded":"2023-10-14T09:37:22.838600+0000","last_fullsized":"2023-10-14T09:37:22.838600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:57:10.220824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.001310+0000","last_change":"2023-10-14T09:37:20.933646+0000","last_active":"2023-10-14T09:37:23.001310+0000","last_peered":"2023-10-14T09:37:23.001310+0000","last_clean":"2023-10-14T09:37:23.001310+0000","last_became_active":"2023-10-14T09:37:20.933289+0000","last_became_peered":"2023-10-14T09:37:20.933289+0000","last_unstale":"2023-10-14T09:37:23.001310+0000","last_undegraded":"2023-10-14T09:37:23.001310+0000","last_fullsized":"2023-10-14T09:37:23.001310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:56:57.656029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":819200,"data_stored":667764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.514}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.476}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6559999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":78426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2190000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6439999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7889999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5549999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":76940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.404}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.734}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.8520000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.856}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.547000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.481999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.6520000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":78426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4359999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5149999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4850000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":76814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4239999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.23}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4510000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":76974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.246}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1890000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":76904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.327}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.373}]}]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":667820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0310000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8220000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9490000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T09:37:26.300 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:37:26.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.549+0000 7fa89d155640 1 Processor -- start 2023-10-14T09:37:26.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.549+0000 7fa89d155640 1 -- start start 2023-10-14T09:37:26.552 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.550+0000 7fa89d155640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa8980cd0c0 0x7fa8981615f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:26.552 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.550+0000 7fa89d155640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa89815db00 0x7fa8980b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:26.552 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.550+0000 7fa89d155640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa89815e3e0 con 0x7fa8980b0410 2023-10-14T09:37:26.553 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.550+0000 7fa89d155640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8980b0de0 con 0x7fa8980cd0c0 2023-10-14T09:37:26.553 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.550+0000 7fa89d155640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8980cd4a0 con 0x7fa89815db00 2023-10-14T09:37:26.554 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.551+0000 7fa896d9d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa8980cd0c0 0x7fa8981615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:26.554 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.551+0000 7fa896d9d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa8980cd0c0 0x7fa8981615f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44652/0 (socket says 172.21.15.102:44652) 2023-10-14T09:37:26.554 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.551+0000 7fa896d9d640 1 -- 172.21.15.102:0/3947534891 learned_addr learned my addr 172.21.15.102:0/3947534891 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:26.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.551+0000 7fa89759e640 1 --2- 172.21.15.102:0/3947534891 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa89815db00 0x7fa8980b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:26.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.551+0000 7fa896d9d640 1 -- 172.21.15.102:0/3947534891 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa89815db00 msgr2=0x7fa8980b08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:26.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.551+0000 7fa896d9d640 1 --2- 172.21.15.102:0/3947534891 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa89815db00 0x7fa8980b08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:26.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.552+0000 7fa896d9d640 1 -- 172.21.15.102:0/3947534891 >> v1:172.21.15.129:6789/0 conn(0x7fa8980b0410 legacy=0x7fa89815d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:26.556 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.552+0000 7fa896d9d640 1 -- 172.21.15.102:0/3947534891 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89815e100 con 0x7fa8980cd0c0 2023-10-14T09:37:26.557 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.553+0000 7fa896d9d640 1 --2- 172.21.15.102:0/3947534891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8980cd0c0 0x7fa8981615f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa888009870 tx=0x7fa88802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a6b14972e7e3984 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:26.557 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.554+0000 7fa89659c640 1 -- 172.21.15.102:0/3947534891 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa888031640 con 0x7fa8980cd0c0 2023-10-14T09:37:26.557 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.554+0000 7fa89659c640 1 -- 172.21.15.102:0/3947534891 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8880317a0 con 0x7fa8980cd0c0 2023-10-14T09:37:26.558 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.554+0000 7fa89659c640 1 -- 172.21.15.102:0/3947534891 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa888031b30 con 0x7fa8980cd0c0 2023-10-14T09:37:26.558 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.554+0000 7fa89d155640 1 -- 172.21.15.102:0/3947534891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8980cd0c0 msgr2=0x7fa8981615f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:26.558 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.554+0000 7fa89d155640 1 --2- 172.21.15.102:0/3947534891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8980cd0c0 0x7fa8981615f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa888009870 tx=0x7fa88802b8f0 comp rx=0 tx=0).stop 2023-10-14T09:37:26.558 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.554+0000 7fa89d155640 1 -- 172.21.15.102:0/3947534891 shutdown_connections 2023-10-14T09:37:26.558 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.554+0000 7fa89d155640 1 --2- 172.21.15.102:0/3947534891 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa89815db00 0x7fa8980b08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:26.559 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.554+0000 7fa89d155640 1 --2- 172.21.15.102:0/3947534891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8980cd0c0 0x7fa8981615f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:26.559 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.554+0000 7fa89d155640 1 -- 172.21.15.102:0/3947534891 >> 172.21.15.102:0/3947534891 conn(0x7fa8980cb410 msgr2=0x7fa8980cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:26.559 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.554+0000 7fa89d155640 1 -- 172.21.15.102:0/3947534891 shutdown_connections 2023-10-14T09:37:26.559 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.554+0000 7fa89d155640 1 -- 172.21.15.102:0/3947534891 wait complete. 2023-10-14T09:37:26.561 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.556+0000 7fa89d155640 1 Processor -- start 2023-10-14T09:37:26.562 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.556+0000 7fa89d155640 1 -- start start 2023-10-14T09:37:26.562 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.557+0000 7fa89d155640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa8980b0410 0x7fa898154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:26.562 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.557+0000 7fa89d155640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa8980cd0c0 0x7fa8981e8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:26.562 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.557+0000 7fa89d155640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa89815db00 0x7fa8980ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:26.562 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.557+0000 7fa89d155640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8981e7f60 con 0x7fa89815db00 2023-10-14T09:37:26.563 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.557+0000 7fa89d155640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8980ca630 con 0x7fa8980cd0c0 2023-10-14T09:37:26.563 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.557+0000 7fa89d155640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8981e72e0 con 0x7fa8980b0410 2023-10-14T09:37:26.563 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.558+0000 7fa89759e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa89815db00 0x7fa8980ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:26.563 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.558+0000 7fa89759e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa89815db00 0x7fa8980ca0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44664/0 (socket says 172.21.15.102:44664) 2023-10-14T09:37:26.563 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.558+0000 7fa89759e640 1 -- 172.21.15.102:0/3985967039 learned_addr learned my addr 172.21.15.102:0/3985967039 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:26.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.558+0000 7fa896d9d640 1 --2- 172.21.15.102:0/3985967039 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa8980b0410 0x7fa898154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:26.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.558+0000 7fa88ffff640 1 --2- 172.21.15.102:0/3985967039 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa8980cd0c0 0x7fa8981e8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:26.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.558+0000 7fa89759e640 1 -- 172.21.15.102:0/3985967039 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa8980b0410 msgr2=0x7fa898154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:26.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.558+0000 7fa89759e640 1 --2- 172.21.15.102:0/3985967039 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa8980b0410 0x7fa898154ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:26.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.558+0000 7fa89759e640 1 -- 172.21.15.102:0/3985967039 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa8980cd0c0 msgr2=0x7fa8981e8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:26.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.558+0000 7fa89759e640 1 --2- 172.21.15.102:0/3985967039 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa8980cd0c0 0x7fa8981e8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:26.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.558+0000 7fa89759e640 1 -- 172.21.15.102:0/3985967039 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8880094d0 con 0x7fa89815db00 2023-10-14T09:37:26.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.558+0000 7fa88ffff640 1 --2- 172.21.15.102:0/3985967039 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa8980cd0c0 0x7fa8981e8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:26.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.558+0000 7fa89759e640 1 --2- 172.21.15.102:0/3985967039 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa89815db00 0x7fa8980ca0f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa89000efc0 tx=0x7fa89000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:26.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.558+0000 7fa88f7fe640 1 -- 172.21.15.102:0/3985967039 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa890014480 con 0x7fa89815db00 2023-10-14T09:37:26.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.558+0000 7fa88f7fe640 1 -- 172.21.15.102:0/3985967039 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89000f040 con 0x7fa89815db00 2023-10-14T09:37:26.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.558+0000 7fa88f7fe640 1 -- 172.21.15.102:0/3985967039 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa890014820 con 0x7fa89815db00 2023-10-14T09:37:26.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.559+0000 7fa89d155640 1 -- 172.21.15.102:0/3985967039 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8981e75c0 con 0x7fa89815db00 2023-10-14T09:37:26.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.559+0000 7fa89d155640 1 -- 172.21.15.102:0/3985967039 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8981e7b80 con 0x7fa89815db00 2023-10-14T09:37:26.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.560+0000 7fa89d155640 1 -- 172.21.15.102:0/3985967039 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8981e80a0 con 0x7fa89815db00 2023-10-14T09:37:26.567 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.561+0000 7fa88f7fe640 1 -- 172.21.15.102:0/3985967039 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa890014980 con 0x7fa89815db00 2023-10-14T09:37:26.567 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.562+0000 7fa88f7fe640 1 --2- 172.21.15.102:0/3985967039 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa87806ae70 0x7fa87806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:26.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.562+0000 7fa88f7fe640 1 -- 172.21.15.102:0/3985967039 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa89008a4e0 con 0x7fa89815db00 2023-10-14T09:37:26.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.562+0000 7fa896d9d640 1 --2- 172.21.15.102:0/3985967039 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa87806ae70 0x7fa87806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:26.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.563+0000 7fa896d9d640 1 --2- 172.21.15.102:0/3985967039 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa87806ae70 0x7fa87806d330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa888036000 tx=0x7fa88803c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:26.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.566+0000 7fa88f7fe640 1 -- 172.21.15.102:0/3985967039 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa8981e80a0 con 0x7fa89815db00 2023-10-14T09:37:26.759 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.757+0000 7fa89d155640 1 -- 172.21.15.102:0/3985967039 --> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa898160df0 con 0x7fa87806ae70 2023-10-14T09:37:26.770 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.768+0000 7fa88f7fe640 1 -- 172.21.15.102:0/3985967039 <== mgr.4104 v2:172.21.15.102:6832/1125265706 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264550 (secure 0 0 0) 0x7fa888044400 con 0x7fa87806ae70 2023-10-14T09:37:26.773 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:37:26.775 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2023-10-14T09:37:26.776 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.775+0000 7fa89d155640 1 -- 172.21.15.102:0/3985967039 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa87806ae70 msgr2=0x7fa87806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:26.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.775+0000 7fa89d155640 1 --2- 172.21.15.102:0/3985967039 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa87806ae70 0x7fa87806d330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa888036000 tx=0x7fa88803c040 comp rx=0 tx=0).stop 2023-10-14T09:37:26.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.775+0000 7fa89d155640 1 -- 172.21.15.102:0/3985967039 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa89815db00 msgr2=0x7fa8980ca0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:26.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.775+0000 7fa89d155640 1 --2- 172.21.15.102:0/3985967039 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa89815db00 0x7fa8980ca0f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa89000efc0 tx=0x7fa89000c490 comp rx=0 tx=0).stop 2023-10-14T09:37:26.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.775+0000 7fa89d155640 1 -- 172.21.15.102:0/3985967039 shutdown_connections 2023-10-14T09:37:26.778 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.775+0000 7fa89d155640 1 --2- 172.21.15.102:0/3985967039 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa87806ae70 0x7fa87806d330 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:26.778 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.775+0000 7fa89d155640 1 --2- 172.21.15.102:0/3985967039 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa89815db00 0x7fa8980ca0f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:26.778 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.775+0000 7fa89d155640 1 --2- 172.21.15.102:0/3985967039 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa8980cd0c0 0x7fa8981e8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:26.779 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.775+0000 7fa89d155640 1 --2- 172.21.15.102:0/3985967039 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa8980b0410 0x7fa898154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:26.779 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.775+0000 7fa89d155640 1 -- 172.21.15.102:0/3985967039 >> 172.21.15.102:0/3985967039 conn(0x7fa8980cb410 msgr2=0x7fa89815d040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:26.779 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.775+0000 7fa89d155640 1 -- 172.21.15.102:0/3985967039 shutdown_connections 2023-10-14T09:37:26.779 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:26.775+0000 7fa89d155640 1 -- 172.21.15.102:0/3985967039 wait complete. 2023-10-14T09:37:26.795 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-14T09:37:25.877904+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":134,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219128,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755592,"statfs":{"total":773094113280,"available":772869726208,"internally_reserved":0,"allocated":3022848,"data_stored":1800068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":58,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.999888"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.007969+0000","last_change":"2023-10-14T09:37:21.757489+0000","last_active":"2023-10-14T09:37:23.007969+0000","last_peered":"2023-10-14T09:37:23.007969+0000","last_clean":"2023-10-14T09:37:23.007969+0000","last_became_active":"2023-10-14T09:37:21.757194+0000","last_became_peered":"2023-10-14T09:37:21.757194+0000","last_unstale":"2023-10-14T09:37:23.007969+0000","last_undegraded":"2023-10-14T09:37:23.007969+0000","last_fullsized":"2023-10-14T09:37:23.007969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:44:42.187325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.725772+0000","last_change":"2023-10-14T09:37:21.747083+0000","last_active":"2023-10-14T09:37:22.725772+0000","last_peered":"2023-10-14T09:37:22.725772+0000","last_clean":"2023-10-14T09:37:22.725772+0000","last_became_active":"2023-10-14T09:37:21.744916+0000","last_became_peered":"2023-10-14T09:37:21.744916+0000","last_unstale":"2023-10-14T09:37:22.725772+0000","last_undegraded":"2023-10-14T09:37:22.725772+0000","last_fullsized":"2023-10-14T09:37:22.725772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:47:20.056113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000967+0000","last_change":"2023-10-14T09:37:21.743145+0000","last_active":"2023-10-14T09:37:23.000967+0000","last_peered":"2023-10-14T09:37:23.000967+0000","last_clean":"2023-10-14T09:37:23.000967+0000","last_became_active":"2023-10-14T09:37:21.740942+0000","last_became_peered":"2023-10-14T09:37:21.740942+0000","last_unstale":"2023-10-14T09:37:23.000967+0000","last_undegraded":"2023-10-14T09:37:23.000967+0000","last_fullsized":"2023-10-14T09:37:23.000967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:13:11.995936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.727695+0000","last_change":"2023-10-14T09:37:21.756893+0000","last_active":"2023-10-14T09:37:22.727695+0000","last_peered":"2023-10-14T09:37:22.727695+0000","last_clean":"2023-10-14T09:37:22.727695+0000","last_became_active":"2023-10-14T09:37:21.752060+0000","last_became_peered":"2023-10-14T09:37:21.752060+0000","last_unstale":"2023-10-14T09:37:22.727695+0000","last_undegraded":"2023-10-14T09:37:22.727695+0000","last_fullsized":"2023-10-14T09:37:22.727695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:40:14.063216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.005308+0000","last_change":"2023-10-14T09:37:21.751922+0000","last_active":"2023-10-14T09:37:23.005308+0000","last_peered":"2023-10-14T09:37:23.005308+0000","last_clean":"2023-10-14T09:37:23.005308+0000","last_became_active":"2023-10-14T09:37:21.751652+0000","last_became_peered":"2023-10-14T09:37:21.751652+0000","last_unstale":"2023-10-14T09:37:23.005308+0000","last_undegraded":"2023-10-14T09:37:23.005308+0000","last_fullsized":"2023-10-14T09:37:23.005308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:18:14.767746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.727589+0000","last_change":"2023-10-14T09:37:21.754232+0000","last_active":"2023-10-14T09:37:22.727589+0000","last_peered":"2023-10-14T09:37:22.727589+0000","last_clean":"2023-10-14T09:37:22.727589+0000","last_became_active":"2023-10-14T09:37:21.751701+0000","last_became_peered":"2023-10-14T09:37:21.751701+0000","last_unstale":"2023-10-14T09:37:22.727589+0000","last_undegraded":"2023-10-14T09:37:22.727589+0000","last_fullsized":"2023-10-14T09:37:22.727589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:00:52.100349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.006549+0000","last_change":"2023-10-14T09:37:21.752184+0000","last_active":"2023-10-14T09:37:23.006549+0000","last_peered":"2023-10-14T09:37:23.006549+0000","last_clean":"2023-10-14T09:37:23.006549+0000","last_became_active":"2023-10-14T09:37:21.751858+0000","last_became_peered":"2023-10-14T09:37:21.751858+0000","last_unstale":"2023-10-14T09:37:23.006549+0000","last_undegraded":"2023-10-14T09:37:23.006549+0000","last_fullsized":"2023-10-14T09:37:23.006549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:46:09.236513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.837906+0000","last_change":"2023-10-14T09:37:21.755347+0000","last_active":"2023-10-14T09:37:22.837906+0000","last_peered":"2023-10-14T09:37:22.837906+0000","last_clean":"2023-10-14T09:37:22.837906+0000","last_became_active":"2023-10-14T09:37:21.755054+0000","last_became_peered":"2023-10-14T09:37:21.755054+0000","last_unstale":"2023-10-14T09:37:22.837906+0000","last_undegraded":"2023-10-14T09:37:22.837906+0000","last_fullsized":"2023-10-14T09:37:22.837906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:34:28.487519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.008184+0000","last_change":"2023-10-14T09:37:21.766430+0000","last_active":"2023-10-14T09:37:23.008184+0000","last_peered":"2023-10-14T09:37:23.008184+0000","last_clean":"2023-10-14T09:37:23.008184+0000","last_became_active":"2023-10-14T09:37:21.766106+0000","last_became_peered":"2023-10-14T09:37:21.766106+0000","last_unstale":"2023-10-14T09:37:23.008184+0000","last_undegraded":"2023-10-14T09:37:23.008184+0000","last_fullsized":"2023-10-14T09:37:23.008184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:49:59.016924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.004124+0000","last_change":"2023-10-14T09:37:21.756666+0000","last_active":"2023-10-14T09:37:23.004124+0000","last_peered":"2023-10-14T09:37:23.004124+0000","last_clean":"2023-10-14T09:37:23.004124+0000","last_became_active":"2023-10-14T09:37:21.756224+0000","last_became_peered":"2023-10-14T09:37:21.756224+0000","last_unstale":"2023-10-14T09:37:23.004124+0000","last_undegraded":"2023-10-14T09:37:23.004124+0000","last_fullsized":"2023-10-14T09:37:23.004124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:34:28.487519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.004690+0000","last_change":"2023-10-14T09:37:21.756982+0000","last_active":"2023-10-14T09:37:23.004690+0000","last_peered":"2023-10-14T09:37:23.004690+0000","last_clean":"2023-10-14T09:37:23.004690+0000","last_became_active":"2023-10-14T09:37:21.756163+0000","last_became_peered":"2023-10-14T09:37:21.756163+0000","last_unstale":"2023-10-14T09:37:23.004690+0000","last_undegraded":"2023-10-14T09:37:23.004690+0000","last_fullsized":"2023-10-14T09:37:23.004690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:31:03.601136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.006237+0000","last_change":"2023-10-14T09:37:21.748380+0000","last_active":"2023-10-14T09:37:23.006237+0000","last_peered":"2023-10-14T09:37:23.006237+0000","last_clean":"2023-10-14T09:37:23.006237+0000","last_became_active":"2023-10-14T09:37:21.747954+0000","last_became_peered":"2023-10-14T09:37:21.747954+0000","last_unstale":"2023-10-14T09:37:23.006237+0000","last_undegraded":"2023-10-14T09:37:23.006237+0000","last_fullsized":"2023-10-14T09:37:23.006237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:43.379673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.838389+0000","last_change":"2023-10-14T09:37:21.748806+0000","last_active":"2023-10-14T09:37:22.838389+0000","last_peered":"2023-10-14T09:37:22.838389+0000","last_clean":"2023-10-14T09:37:22.838389+0000","last_became_active":"2023-10-14T09:37:21.747465+0000","last_became_peered":"2023-10-14T09:37:21.747465+0000","last_unstale":"2023-10-14T09:37:22.838389+0000","last_undegraded":"2023-10-14T09:37:22.838389+0000","last_fullsized":"2023-10-14T09:37:22.838389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:13:19.086221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000271+0000","last_change":"2023-10-14T09:37:21.739392+0000","last_active":"2023-10-14T09:37:23.000271+0000","last_peered":"2023-10-14T09:37:23.000271+0000","last_clean":"2023-10-14T09:37:23.000271+0000","last_became_active":"2023-10-14T09:37:21.738904+0000","last_became_peered":"2023-10-14T09:37:21.738904+0000","last_unstale":"2023-10-14T09:37:23.000271+0000","last_undegraded":"2023-10-14T09:37:23.000271+0000","last_fullsized":"2023-10-14T09:37:23.000271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:25:54.495041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.725892+0000","last_change":"2023-10-14T09:37:21.751374+0000","last_active":"2023-10-14T09:37:22.725892+0000","last_peered":"2023-10-14T09:37:22.725892+0000","last_clean":"2023-10-14T09:37:22.725892+0000","last_became_active":"2023-10-14T09:37:21.750630+0000","last_became_peered":"2023-10-14T09:37:21.750630+0000","last_unstale":"2023-10-14T09:37:22.725892+0000","last_undegraded":"2023-10-14T09:37:22.725892+0000","last_fullsized":"2023-10-14T09:37:22.725892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:58.386910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.727052+0000","last_change":"2023-10-14T09:37:21.746739+0000","last_active":"2023-10-14T09:37:22.727052+0000","last_peered":"2023-10-14T09:37:22.727052+0000","last_clean":"2023-10-14T09:37:22.727052+0000","last_became_active":"2023-10-14T09:37:21.743095+0000","last_became_peered":"2023-10-14T09:37:21.743095+0000","last_unstale":"2023-10-14T09:37:22.727052+0000","last_undegraded":"2023-10-14T09:37:22.727052+0000","last_fullsized":"2023-10-14T09:37:22.727052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:55:22.366551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.728505+0000","last_change":"2023-10-14T09:37:21.758327+0000","last_active":"2023-10-14T09:37:22.728505+0000","last_peered":"2023-10-14T09:37:22.728505+0000","last_clean":"2023-10-14T09:37:22.728505+0000","last_became_active":"2023-10-14T09:37:21.757671+0000","last_became_peered":"2023-10-14T09:37:21.757671+0000","last_unstale":"2023-10-14T09:37:22.728505+0000","last_undegraded":"2023-10-14T09:37:22.728505+0000","last_fullsized":"2023-10-14T09:37:22.728505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:11:25.698621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000594+0000","last_change":"2023-10-14T09:37:21.746441+0000","last_active":"2023-10-14T09:37:23.000594+0000","last_peered":"2023-10-14T09:37:23.000594+0000","last_clean":"2023-10-14T09:37:23.000594+0000","last_became_active":"2023-10-14T09:37:21.746086+0000","last_became_peered":"2023-10-14T09:37:21.746086+0000","last_unstale":"2023-10-14T09:37:23.000594+0000","last_undegraded":"2023-10-14T09:37:23.000594+0000","last_fullsized":"2023-10-14T09:37:23.000594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:47:12.887313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.005539+0000","last_change":"2023-10-14T09:37:21.757982+0000","last_active":"2023-10-14T09:37:23.005539+0000","last_peered":"2023-10-14T09:37:23.005539+0000","last_clean":"2023-10-14T09:37:23.005539+0000","last_became_active":"2023-10-14T09:37:21.757246+0000","last_became_peered":"2023-10-14T09:37:21.757246+0000","last_unstale":"2023-10-14T09:37:23.005539+0000","last_undegraded":"2023-10-14T09:37:23.005539+0000","last_fullsized":"2023-10-14T09:37:23.005539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:57:10.220824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.004161+0000","last_change":"2023-10-14T09:37:21.752806+0000","last_active":"2023-10-14T09:37:23.004161+0000","last_peered":"2023-10-14T09:37:23.004161+0000","last_clean":"2023-10-14T09:37:23.004161+0000","last_became_active":"2023-10-14T09:37:21.752504+0000","last_became_peered":"2023-10-14T09:37:21.752504+0000","last_unstale":"2023-10-14T09:37:23.004161+0000","last_undegraded":"2023-10-14T09:37:23.004161+0000","last_fullsized":"2023-10-14T09:37:23.004161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:47:20.269302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000372+0000","last_change":"2023-10-14T09:37:21.743928+0000","last_active":"2023-10-14T09:37:23.000372+0000","last_peered":"2023-10-14T09:37:23.000372+0000","last_clean":"2023-10-14T09:37:23.000372+0000","last_became_active":"2023-10-14T09:37:21.743649+0000","last_became_peered":"2023-10-14T09:37:21.743649+0000","last_unstale":"2023-10-14T09:37:23.000372+0000","last_undegraded":"2023-10-14T09:37:23.000372+0000","last_fullsized":"2023-10-14T09:37:23.000372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:05:15.351817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.727982+0000","last_change":"2023-10-14T09:37:21.755428+0000","last_active":"2023-10-14T09:37:22.727982+0000","last_peered":"2023-10-14T09:37:22.727982+0000","last_clean":"2023-10-14T09:37:22.727982+0000","last_became_active":"2023-10-14T09:37:21.755003+0000","last_became_peered":"2023-10-14T09:37:21.755003+0000","last_unstale":"2023-10-14T09:37:22.727982+0000","last_undegraded":"2023-10-14T09:37:22.727982+0000","last_fullsized":"2023-10-14T09:37:22.727982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:37:17.999853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.837923+0000","last_change":"2023-10-14T09:37:21.751484+0000","last_active":"2023-10-14T09:37:22.837923+0000","last_peered":"2023-10-14T09:37:22.837923+0000","last_clean":"2023-10-14T09:37:22.837923+0000","last_became_active":"2023-10-14T09:37:21.751206+0000","last_became_peered":"2023-10-14T09:37:21.751206+0000","last_unstale":"2023-10-14T09:37:22.837923+0000","last_undegraded":"2023-10-14T09:37:22.837923+0000","last_fullsized":"2023-10-14T09:37:22.837923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:45.609123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.727258+0000","last_change":"2023-10-14T09:37:21.756153+0000","last_active":"2023-10-14T09:37:22.727258+0000","last_peered":"2023-10-14T09:37:22.727258+0000","last_clean":"2023-10-14T09:37:22.727258+0000","last_became_active":"2023-10-14T09:37:21.755888+0000","last_became_peered":"2023-10-14T09:37:21.755888+0000","last_unstale":"2023-10-14T09:37:22.727258+0000","last_undegraded":"2023-10-14T09:37:22.727258+0000","last_fullsized":"2023-10-14T09:37:22.727258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:33:39.761471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.838544+0000","last_change":"2023-10-14T09:37:21.756618+0000","last_active":"2023-10-14T09:37:22.838544+0000","last_peered":"2023-10-14T09:37:22.838544+0000","last_clean":"2023-10-14T09:37:22.838544+0000","last_became_active":"2023-10-14T09:37:21.756268+0000","last_became_peered":"2023-10-14T09:37:21.756268+0000","last_unstale":"2023-10-14T09:37:22.838544+0000","last_undegraded":"2023-10-14T09:37:22.838544+0000","last_fullsized":"2023-10-14T09:37:22.838544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:20:56.163594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.004153+0000","last_change":"2023-10-14T09:37:21.757751+0000","last_active":"2023-10-14T09:37:23.004153+0000","last_peered":"2023-10-14T09:37:23.004153+0000","last_clean":"2023-10-14T09:37:23.004153+0000","last_became_active":"2023-10-14T09:37:21.757484+0000","last_became_peered":"2023-10-14T09:37:21.757484+0000","last_unstale":"2023-10-14T09:37:23.004153+0000","last_undegraded":"2023-10-14T09:37:23.004153+0000","last_fullsized":"2023-10-14T09:37:23.004153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:45.609123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.726318+0000","last_change":"2023-10-14T09:37:21.748864+0000","last_active":"2023-10-14T09:37:22.726318+0000","last_peered":"2023-10-14T09:37:22.726318+0000","last_clean":"2023-10-14T09:37:22.726318+0000","last_became_active":"2023-10-14T09:37:21.748569+0000","last_became_peered":"2023-10-14T09:37:21.748569+0000","last_unstale":"2023-10-14T09:37:22.726318+0000","last_undegraded":"2023-10-14T09:37:22.726318+0000","last_fullsized":"2023-10-14T09:37:22.726318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:31:03.601136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.838561+0000","last_change":"2023-10-14T09:37:21.752356+0000","last_active":"2023-10-14T09:37:22.838561+0000","last_peered":"2023-10-14T09:37:22.838561+0000","last_clean":"2023-10-14T09:37:22.838561+0000","last_became_active":"2023-10-14T09:37:21.751916+0000","last_became_peered":"2023-10-14T09:37:21.751916+0000","last_unstale":"2023-10-14T09:37:22.838561+0000","last_undegraded":"2023-10-14T09:37:22.838561+0000","last_fullsized":"2023-10-14T09:37:22.838561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:18:14.767746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000415+0000","last_change":"2023-10-14T09:37:21.742511+0000","last_active":"2023-10-14T09:37:23.000415+0000","last_peered":"2023-10-14T09:37:23.000415+0000","last_clean":"2023-10-14T09:37:23.000415+0000","last_became_active":"2023-10-14T09:37:21.742202+0000","last_became_peered":"2023-10-14T09:37:21.742202+0000","last_unstale":"2023-10-14T09:37:23.000415+0000","last_undegraded":"2023-10-14T09:37:23.000415+0000","last_fullsized":"2023-10-14T09:37:23.000415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:24:01.166672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.728259+0000","last_change":"2023-10-14T09:37:21.750041+0000","last_active":"2023-10-14T09:37:22.728259+0000","last_peered":"2023-10-14T09:37:22.728259+0000","last_clean":"2023-10-14T09:37:22.728259+0000","last_became_active":"2023-10-14T09:37:21.749143+0000","last_became_peered":"2023-10-14T09:37:21.749143+0000","last_unstale":"2023-10-14T09:37:22.728259+0000","last_undegraded":"2023-10-14T09:37:22.728259+0000","last_fullsized":"2023-10-14T09:37:22.728259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:06:11.732279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000783+0000","last_change":"2023-10-14T09:37:21.753852+0000","last_active":"2023-10-14T09:37:23.000783+0000","last_peered":"2023-10-14T09:37:23.000783+0000","last_clean":"2023-10-14T09:37:23.000783+0000","last_became_active":"2023-10-14T09:37:21.753535+0000","last_became_peered":"2023-10-14T09:37:21.753535+0000","last_unstale":"2023-10-14T09:37:23.000783+0000","last_undegraded":"2023-10-14T09:37:23.000783+0000","last_fullsized":"2023-10-14T09:37:23.000783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:43.379673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.003190+0000","last_change":"2023-10-14T09:37:21.746670+0000","last_active":"2023-10-14T09:37:23.003190+0000","last_peered":"2023-10-14T09:37:23.003190+0000","last_clean":"2023-10-14T09:37:23.003190+0000","last_became_active":"2023-10-14T09:37:21.746392+0000","last_became_peered":"2023-10-14T09:37:21.746392+0000","last_unstale":"2023-10-14T09:37:23.003190+0000","last_undegraded":"2023-10-14T09:37:23.003190+0000","last_fullsized":"2023-10-14T09:37:23.003190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:59:41.080217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.005826+0000","last_change":"2023-10-14T09:37:21.740283+0000","last_active":"2023-10-14T09:37:23.005826+0000","last_peered":"2023-10-14T09:37:23.005826+0000","last_clean":"2023-10-14T09:37:23.005826+0000","last_became_active":"2023-10-14T09:37:21.740017+0000","last_became_peered":"2023-10-14T09:37:21.740017+0000","last_unstale":"2023-10-14T09:37:23.005826+0000","last_undegraded":"2023-10-14T09:37:23.005826+0000","last_fullsized":"2023-10-14T09:37:23.005826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:47:12.887313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.919472+0000","last_change":"2023-10-14T09:37:20.933870+0000","last_active":"2023-10-14T09:37:21.919472+0000","last_peered":"2023-10-14T09:37:21.919472+0000","last_clean":"2023-10-14T09:37:21.919472+0000","last_became_active":"2023-10-14T09:37:20.933620+0000","last_became_peered":"2023-10-14T09:37:20.933620+0000","last_unstale":"2023-10-14T09:37:21.919472+0000","last_undegraded":"2023-10-14T09:37:21.919472+0000","last_fullsized":"2023-10-14T09:37:21.919472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:25:18.109123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000783+0000","last_change":"2023-10-14T09:37:21.739293+0000","last_active":"2023-10-14T09:37:23.000783+0000","last_peered":"2023-10-14T09:37:23.000783+0000","last_clean":"2023-10-14T09:37:23.000783+0000","last_became_active":"2023-10-14T09:37:21.737376+0000","last_became_peered":"2023-10-14T09:37:21.737376+0000","last_unstale":"2023-10-14T09:37:23.000783+0000","last_undegraded":"2023-10-14T09:37:23.000783+0000","last_fullsized":"2023-10-14T09:37:23.000783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:19:35.129999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.932146+0000","last_change":"2023-10-14T09:37:20.926893+0000","last_active":"2023-10-14T09:37:21.932146+0000","last_peered":"2023-10-14T09:37:21.932146+0000","last_clean":"2023-10-14T09:37:21.932146+0000","last_became_active":"2023-10-14T09:37:20.926029+0000","last_became_peered":"2023-10-14T09:37:20.926029+0000","last_unstale":"2023-10-14T09:37:21.932146+0000","last_undegraded":"2023-10-14T09:37:21.932146+0000","last_fullsized":"2023-10-14T09:37:21.932146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:37:06.069126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.730625+0000","last_change":"2023-10-14T09:37:20.936214+0000","last_active":"2023-10-14T09:37:21.730625+0000","last_peered":"2023-10-14T09:37:21.730625+0000","last_clean":"2023-10-14T09:37:21.730625+0000","last_became_active":"2023-10-14T09:37:20.935904+0000","last_became_peered":"2023-10-14T09:37:20.935904+0000","last_unstale":"2023-10-14T09:37:21.730625+0000","last_undegraded":"2023-10-14T09:37:21.730625+0000","last_fullsized":"2023-10-14T09:37:21.730625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:40:10.259029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.837900+0000","last_change":"2023-10-14T09:37:21.742408+0000","last_active":"2023-10-14T09:37:22.837900+0000","last_peered":"2023-10-14T09:37:22.837900+0000","last_clean":"2023-10-14T09:37:22.837900+0000","last_became_active":"2023-10-14T09:37:21.741339+0000","last_became_peered":"2023-10-14T09:37:21.741339+0000","last_unstale":"2023-10-14T09:37:22.837900+0000","last_undegraded":"2023-10-14T09:37:22.837900+0000","last_fullsized":"2023-10-14T09:37:22.837900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:58.386910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.727298+0000","last_change":"2023-10-14T09:37:20.920967+0000","last_active":"2023-10-14T09:37:22.727298+0000","last_peered":"2023-10-14T09:37:22.727298+0000","last_clean":"2023-10-14T09:37:22.727298+0000","last_became_active":"2023-10-14T09:37:20.919427+0000","last_became_peered":"2023-10-14T09:37:20.919427+0000","last_unstale":"2023-10-14T09:37:22.727298+0000","last_undegraded":"2023-10-14T09:37:22.727298+0000","last_fullsized":"2023-10-14T09:37:22.727298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:36:06.124475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.726089+0000","last_change":"2023-10-14T09:37:21.745880+0000","last_active":"2023-10-14T09:37:22.726089+0000","last_peered":"2023-10-14T09:37:22.726089+0000","last_clean":"2023-10-14T09:37:22.726089+0000","last_became_active":"2023-10-14T09:37:21.745521+0000","last_became_peered":"2023-10-14T09:37:21.745521+0000","last_unstale":"2023-10-14T09:37:22.726089+0000","last_undegraded":"2023-10-14T09:37:22.726089+0000","last_fullsized":"2023-10-14T09:37:22.726089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:45.609123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.733782+0000","last_change":"2023-10-14T09:37:20.934454+0000","last_active":"2023-10-14T09:37:21.733782+0000","last_peered":"2023-10-14T09:37:21.733782+0000","last_clean":"2023-10-14T09:37:21.733782+0000","last_became_active":"2023-10-14T09:37:20.934153+0000","last_became_peered":"2023-10-14T09:37:20.934153+0000","last_unstale":"2023-10-14T09:37:21.733782+0000","last_undegraded":"2023-10-14T09:37:21.733782+0000","last_fullsized":"2023-10-14T09:37:21.733782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:36.063014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.728323+0000","last_change":"2023-10-14T09:37:21.755249+0000","last_active":"2023-10-14T09:37:22.728323+0000","last_peered":"2023-10-14T09:37:22.728323+0000","last_clean":"2023-10-14T09:37:22.728323+0000","last_became_active":"2023-10-14T09:37:21.754740+0000","last_became_peered":"2023-10-14T09:37:21.754740+0000","last_unstale":"2023-10-14T09:37:22.728323+0000","last_undegraded":"2023-10-14T09:37:22.728323+0000","last_fullsized":"2023-10-14T09:37:22.728323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:35:35.551195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.728656+0000","last_change":"2023-10-14T09:37:20.935194+0000","last_active":"2023-10-14T09:37:22.728656+0000","last_peered":"2023-10-14T09:37:22.728656+0000","last_clean":"2023-10-14T09:37:22.728656+0000","last_became_active":"2023-10-14T09:37:20.934945+0000","last_became_peered":"2023-10-14T09:37:20.934945+0000","last_unstale":"2023-10-14T09:37:22.728656+0000","last_undegraded":"2023-10-14T09:37:22.728656+0000","last_fullsized":"2023-10-14T09:37:22.728656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:24:00.151660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.001230+0000","last_change":"2023-10-14T09:37:21.755417+0000","last_active":"2023-10-14T09:37:23.001230+0000","last_peered":"2023-10-14T09:37:23.001230+0000","last_clean":"2023-10-14T09:37:23.001230+0000","last_became_active":"2023-10-14T09:37:21.755076+0000","last_became_peered":"2023-10-14T09:37:21.755076+0000","last_unstale":"2023-10-14T09:37:23.001230+0000","last_undegraded":"2023-10-14T09:37:23.001230+0000","last_fullsized":"2023-10-14T09:37:23.001230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:00:52.100349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.922965+0000","last_change":"2023-10-14T09:37:20.928928+0000","last_active":"2023-10-14T09:37:21.922965+0000","last_peered":"2023-10-14T09:37:21.922965+0000","last_clean":"2023-10-14T09:37:21.922965+0000","last_became_active":"2023-10-14T09:37:20.928584+0000","last_became_peered":"2023-10-14T09:37:20.928584+0000","last_unstale":"2023-10-14T09:37:21.922965+0000","last_undegraded":"2023-10-14T09:37:21.922965+0000","last_fullsized":"2023-10-14T09:37:21.922965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:59:40.065205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.006299+0000","last_change":"2023-10-14T09:37:21.750980+0000","last_active":"2023-10-14T09:37:23.006299+0000","last_peered":"2023-10-14T09:37:23.006299+0000","last_clean":"2023-10-14T09:37:23.006299+0000","last_became_active":"2023-10-14T09:37:21.750695+0000","last_became_peered":"2023-10-14T09:37:21.750695+0000","last_unstale":"2023-10-14T09:37:23.006299+0000","last_undegraded":"2023-10-14T09:37:23.006299+0000","last_fullsized":"2023-10-14T09:37:23.006299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:54:58.954523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.934827+0000","last_change":"2023-10-14T09:37:20.929237+0000","last_active":"2023-10-14T09:37:21.934827+0000","last_peered":"2023-10-14T09:37:21.934827+0000","last_clean":"2023-10-14T09:37:21.934827+0000","last_became_active":"2023-10-14T09:37:20.926149+0000","last_became_peered":"2023-10-14T09:37:20.926149+0000","last_unstale":"2023-10-14T09:37:21.934827+0000","last_undegraded":"2023-10-14T09:37:21.934827+0000","last_fullsized":"2023-10-14T09:37:21.934827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:42.364661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.004759+0000","last_change":"2023-10-14T09:37:21.758759+0000","last_active":"2023-10-14T09:37:23.004759+0000","last_peered":"2023-10-14T09:37:23.004759+0000","last_clean":"2023-10-14T09:37:23.004759+0000","last_became_active":"2023-10-14T09:37:21.757589+0000","last_became_peered":"2023-10-14T09:37:21.757589+0000","last_unstale":"2023-10-14T09:37:23.004759+0000","last_undegraded":"2023-10-14T09:37:23.004759+0000","last_fullsized":"2023-10-14T09:37:23.004759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:20:22.862559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000879+0000","last_change":"2023-10-14T09:37:20.929762+0000","last_active":"2023-10-14T09:37:23.000879+0000","last_peered":"2023-10-14T09:37:23.000879+0000","last_clean":"2023-10-14T09:37:23.000879+0000","last_became_active":"2023-10-14T09:37:20.929207+0000","last_became_peered":"2023-10-14T09:37:20.929207+0000","last_unstale":"2023-10-14T09:37:23.000879+0000","last_undegraded":"2023-10-14T09:37:23.000879+0000","last_fullsized":"2023-10-14T09:37:23.000879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:47:37.290001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000293+0000","last_change":"2023-10-14T09:37:21.749696+0000","last_active":"2023-10-14T09:37:23.000293+0000","last_peered":"2023-10-14T09:37:23.000293+0000","last_clean":"2023-10-14T09:37:23.000293+0000","last_became_active":"2023-10-14T09:37:21.749373+0000","last_became_peered":"2023-10-14T09:37:21.749373+0000","last_unstale":"2023-10-14T09:37:23.000293+0000","last_undegraded":"2023-10-14T09:37:23.000293+0000","last_fullsized":"2023-10-14T09:37:23.000293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:36:07.139487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.728249+0000","last_change":"2023-10-14T09:37:20.925825+0000","last_active":"2023-10-14T09:37:22.728249+0000","last_peered":"2023-10-14T09:37:22.728249+0000","last_clean":"2023-10-14T09:37:22.728249+0000","last_became_active":"2023-10-14T09:37:20.924728+0000","last_became_peered":"2023-10-14T09:37:20.924728+0000","last_unstale":"2023-10-14T09:37:22.728249+0000","last_undegraded":"2023-10-14T09:37:22.728249+0000","last_fullsized":"2023-10-14T09:37:22.728249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:05:14.336805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.005698+0000","last_change":"2023-10-14T09:37:21.754368+0000","last_active":"2023-10-14T09:37:23.005698+0000","last_peered":"2023-10-14T09:37:23.005698+0000","last_clean":"2023-10-14T09:37:23.005698+0000","last_became_active":"2023-10-14T09:37:21.754087+0000","last_became_peered":"2023-10-14T09:37:21.754087+0000","last_unstale":"2023-10-14T09:37:23.005698+0000","last_undegraded":"2023-10-14T09:37:23.005698+0000","last_fullsized":"2023-10-14T09:37:23.005698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:14:34.307289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.743028+0000","last_change":"2023-10-14T09:37:20.927507+0000","last_active":"2023-10-14T09:37:21.743028+0000","last_peered":"2023-10-14T09:37:21.743028+0000","last_clean":"2023-10-14T09:37:21.743028+0000","last_became_active":"2023-10-14T09:37:20.926661+0000","last_became_peered":"2023-10-14T09:37:20.926661+0000","last_unstale":"2023-10-14T09:37:21.743028+0000","last_undegraded":"2023-10-14T09:37:21.743028+0000","last_fullsized":"2023-10-14T09:37:21.743028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:11:56.674281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.003581+0000","last_change":"2023-10-14T09:37:21.746970+0000","last_active":"2023-10-14T09:37:23.003581+0000","last_peered":"2023-10-14T09:37:23.003581+0000","last_clean":"2023-10-14T09:37:23.003581+0000","last_became_active":"2023-10-14T09:37:21.746319+0000","last_became_peered":"2023-10-14T09:37:21.746319+0000","last_unstale":"2023-10-14T09:37:23.003581+0000","last_undegraded":"2023-10-14T09:37:23.003581+0000","last_fullsized":"2023-10-14T09:37:23.003581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:58.386910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.924816+0000","last_change":"2023-10-14T09:37:20.922802+0000","last_active":"2023-10-14T09:37:21.924816+0000","last_peered":"2023-10-14T09:37:21.924816+0000","last_clean":"2023-10-14T09:37:21.924816+0000","last_became_active":"2023-10-14T09:37:20.922500+0000","last_became_peered":"2023-10-14T09:37:20.922500+0000","last_unstale":"2023-10-14T09:37:21.924816+0000","last_undegraded":"2023-10-14T09:37:21.924816+0000","last_fullsized":"2023-10-14T09:37:21.924816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:06:47.039219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.006896+0000","last_change":"2023-10-14T09:37:21.762686+0000","last_active":"2023-10-14T09:37:23.006896+0000","last_peered":"2023-10-14T09:37:23.006896+0000","last_clean":"2023-10-14T09:37:23.006896+0000","last_became_active":"2023-10-14T09:37:21.761363+0000","last_became_peered":"2023-10-14T09:37:21.761363+0000","last_unstale":"2023-10-14T09:37:23.006896+0000","last_undegraded":"2023-10-14T09:37:23.006896+0000","last_fullsized":"2023-10-14T09:37:23.006896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:41:33.345823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.924183+0000","last_change":"2023-10-14T09:37:20.923259+0000","last_active":"2023-10-14T09:37:21.924183+0000","last_peered":"2023-10-14T09:37:21.924183+0000","last_clean":"2023-10-14T09:37:21.924183+0000","last_became_active":"2023-10-14T09:37:20.922949+0000","last_became_peered":"2023-10-14T09:37:20.922949+0000","last_unstale":"2023-10-14T09:37:21.924183+0000","last_undegraded":"2023-10-14T09:37:21.924183+0000","last_fullsized":"2023-10-14T09:37:21.924183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:36.063014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.007898+0000","last_change":"2023-10-14T09:37:21.757197+0000","last_active":"2023-10-14T09:37:23.007898+0000","last_peered":"2023-10-14T09:37:23.007898+0000","last_clean":"2023-10-14T09:37:23.007898+0000","last_became_active":"2023-10-14T09:37:21.756570+0000","last_became_peered":"2023-10-14T09:37:21.756570+0000","last_unstale":"2023-10-14T09:37:23.007898+0000","last_undegraded":"2023-10-14T09:37:23.007898+0000","last_fullsized":"2023-10-14T09:37:23.007898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:26:10.321772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.923988+0000","last_change":"2023-10-14T09:37:20.925144+0000","last_active":"2023-10-14T09:37:21.923988+0000","last_peered":"2023-10-14T09:37:21.923988+0000","last_clean":"2023-10-14T09:37:21.923988+0000","last_became_active":"2023-10-14T09:37:20.924857+0000","last_became_peered":"2023-10-14T09:37:20.924857+0000","last_unstale":"2023-10-14T09:37:21.923988+0000","last_undegraded":"2023-10-14T09:37:21.923988+0000","last_fullsized":"2023-10-14T09:37:21.923988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:40:10.259029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.008287+0000","last_change":"2023-10-14T09:37:21.760917+0000","last_active":"2023-10-14T09:37:23.008287+0000","last_peered":"2023-10-14T09:37:23.008287+0000","last_clean":"2023-10-14T09:37:23.008287+0000","last_became_active":"2023-10-14T09:37:21.760610+0000","last_became_peered":"2023-10-14T09:37:21.760610+0000","last_unstale":"2023-10-14T09:37:23.008287+0000","last_undegraded":"2023-10-14T09:37:23.008287+0000","last_fullsized":"2023-10-14T09:37:23.008287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:55:37.499900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.922672+0000","last_change":"2023-10-14T09:37:20.927543+0000","last_active":"2023-10-14T09:37:21.922672+0000","last_peered":"2023-10-14T09:37:21.922672+0000","last_clean":"2023-10-14T09:37:21.922672+0000","last_became_active":"2023-10-14T09:37:20.926596+0000","last_became_peered":"2023-10-14T09:37:20.926596+0000","last_unstale":"2023-10-14T09:37:21.922672+0000","last_undegraded":"2023-10-14T09:37:21.922672+0000","last_fullsized":"2023-10-14T09:37:21.922672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:41:25.240229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.728342+0000","last_change":"2023-10-14T09:37:21.757458+0000","last_active":"2023-10-14T09:37:22.728342+0000","last_peered":"2023-10-14T09:37:22.728342+0000","last_clean":"2023-10-14T09:37:22.728342+0000","last_became_active":"2023-10-14T09:37:21.755979+0000","last_became_peered":"2023-10-14T09:37:21.755979+0000","last_unstale":"2023-10-14T09:37:22.728342+0000","last_undegraded":"2023-10-14T09:37:22.728342+0000","last_fullsized":"2023-10-14T09:37:22.728342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:01:17.124198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.726389+0000","last_change":"2023-10-14T09:37:20.916979+0000","last_active":"2023-10-14T09:37:21.726389+0000","last_peered":"2023-10-14T09:37:21.726389+0000","last_clean":"2023-10-14T09:37:21.726389+0000","last_became_active":"2023-10-14T09:37:20.916624+0000","last_became_peered":"2023-10-14T09:37:20.916624+0000","last_unstale":"2023-10-14T09:37:21.726389+0000","last_undegraded":"2023-10-14T09:37:21.726389+0000","last_fullsized":"2023-10-14T09:37:21.726389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:25:18.109123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.004982+0000","last_change":"2023-10-14T09:37:21.760133+0000","last_active":"2023-10-14T09:37:23.004982+0000","last_peered":"2023-10-14T09:37:23.004982+0000","last_clean":"2023-10-14T09:37:23.004982+0000","last_became_active":"2023-10-14T09:37:21.756336+0000","last_became_peered":"2023-10-14T09:37:21.756336+0000","last_unstale":"2023-10-14T09:37:23.004982+0000","last_undegraded":"2023-10-14T09:37:23.004982+0000","last_fullsized":"2023-10-14T09:37:23.004982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:20:56.163594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.740212+0000","last_change":"2023-10-14T09:37:12.368000+0000","last_active":"2023-10-14T09:37:21.740212+0000","last_peered":"2023-10-14T09:37:21.740212+0000","last_clean":"2023-10-14T09:37:21.740212+0000","last_became_active":"2023-10-14T09:37:12.364623+0000","last_became_peered":"2023-10-14T09:37:12.364623+0000","last_unstale":"2023-10-14T09:37:21.740212+0000","last_undegraded":"2023-10-14T09:37:21.740212+0000","last_fullsized":"2023-10-14T09:37:21.740212+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:10.796841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:10.796841+0000","last_clean_scrub_stamp":"2023-10-14T09:37:10.796841+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:48.940536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.727610+0000","last_change":"2023-10-14T09:37:20.911869+0000","last_active":"2023-10-14T09:37:22.727610+0000","last_peered":"2023-10-14T09:37:22.727610+0000","last_clean":"2023-10-14T09:37:22.727610+0000","last_became_active":"2023-10-14T09:37:20.911115+0000","last_became_peered":"2023-10-14T09:37:20.911115+0000","last_unstale":"2023-10-14T09:37:22.727610+0000","last_undegraded":"2023-10-14T09:37:22.727610+0000","last_fullsized":"2023-10-14T09:37:22.727610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:19:34.114987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.838142+0000","last_change":"2023-10-14T09:37:21.762010+0000","last_active":"2023-10-14T09:37:22.838142+0000","last_peered":"2023-10-14T09:37:22.838142+0000","last_clean":"2023-10-14T09:37:22.838142+0000","last_became_active":"2023-10-14T09:37:21.761697+0000","last_became_peered":"2023-10-14T09:37:21.761697+0000","last_unstale":"2023-10-14T09:37:22.838142+0000","last_undegraded":"2023-10-14T09:37:22.838142+0000","last_fullsized":"2023-10-14T09:37:22.838142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:31:03.601136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.740046+0000","last_change":"2023-10-14T09:37:20.935352+0000","last_active":"2023-10-14T09:37:21.740046+0000","last_peered":"2023-10-14T09:37:21.740046+0000","last_clean":"2023-10-14T09:37:21.740046+0000","last_became_active":"2023-10-14T09:37:20.935068+0000","last_became_peered":"2023-10-14T09:37:20.935068+0000","last_unstale":"2023-10-14T09:37:21.740046+0000","last_undegraded":"2023-10-14T09:37:21.740046+0000","last_fullsized":"2023-10-14T09:37:21.740046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:11:56.674281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000129+0000","last_change":"2023-10-14T09:37:21.743003+0000","last_active":"2023-10-14T09:37:23.000129+0000","last_peered":"2023-10-14T09:37:23.000129+0000","last_clean":"2023-10-14T09:37:23.000129+0000","last_became_active":"2023-10-14T09:37:21.741330+0000","last_became_peered":"2023-10-14T09:37:21.741330+0000","last_unstale":"2023-10-14T09:37:23.000129+0000","last_undegraded":"2023-10-14T09:37:23.000129+0000","last_fullsized":"2023-10-14T09:37:23.000129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:25:03.218431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.727315+0000","last_change":"2023-10-14T09:37:20.925505+0000","last_active":"2023-10-14T09:37:21.727315+0000","last_peered":"2023-10-14T09:37:21.727315+0000","last_clean":"2023-10-14T09:37:21.727315+0000","last_became_active":"2023-10-14T09:37:20.925234+0000","last_became_peered":"2023-10-14T09:37:20.925234+0000","last_unstale":"2023-10-14T09:37:21.727315+0000","last_undegraded":"2023-10-14T09:37:21.727315+0000","last_fullsized":"2023-10-14T09:37:21.727315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:18:40.682886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.725905+0000","last_change":"2023-10-14T09:37:21.743561+0000","last_active":"2023-10-14T09:37:22.725905+0000","last_peered":"2023-10-14T09:37:22.725905+0000","last_clean":"2023-10-14T09:37:22.725905+0000","last_became_active":"2023-10-14T09:37:21.741553+0000","last_became_peered":"2023-10-14T09:37:21.741553+0000","last_unstale":"2023-10-14T09:37:22.725905+0000","last_undegraded":"2023-10-14T09:37:22.725905+0000","last_fullsized":"2023-10-14T09:37:22.725905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:34:28.487519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.728603+0000","last_change":"2023-10-14T09:37:20.926456+0000","last_active":"2023-10-14T09:37:22.728603+0000","last_peered":"2023-10-14T09:37:22.728603+0000","last_clean":"2023-10-14T09:37:22.728603+0000","last_became_active":"2023-10-14T09:37:20.926173+0000","last_became_peered":"2023-10-14T09:37:20.926173+0000","last_unstale":"2023-10-14T09:37:22.728603+0000","last_undegraded":"2023-10-14T09:37:22.728603+0000","last_fullsized":"2023-10-14T09:37:22.728603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:13:10.980924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.005737+0000","last_change":"2023-10-14T09:37:21.741615+0000","last_active":"2023-10-14T09:37:23.005737+0000","last_peered":"2023-10-14T09:37:23.005737+0000","last_clean":"2023-10-14T09:37:23.005737+0000","last_became_active":"2023-10-14T09:37:21.741104+0000","last_became_peered":"2023-10-14T09:37:21.741104+0000","last_unstale":"2023-10-14T09:37:23.005737+0000","last_undegraded":"2023-10-14T09:37:23.005737+0000","last_fullsized":"2023-10-14T09:37:23.005737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:18:41.697898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.735877+0000","last_change":"2023-10-14T09:37:20.927017+0000","last_active":"2023-10-14T09:37:21.735877+0000","last_peered":"2023-10-14T09:37:21.735877+0000","last_clean":"2023-10-14T09:37:21.735877+0000","last_became_active":"2023-10-14T09:37:20.925357+0000","last_became_peered":"2023-10-14T09:37:20.925357+0000","last_unstale":"2023-10-14T09:37:21.735877+0000","last_undegraded":"2023-10-14T09:37:21.735877+0000","last_fullsized":"2023-10-14T09:37:21.735877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:37:06.069126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.728396+0000","last_change":"2023-10-14T09:37:21.748586+0000","last_active":"2023-10-14T09:37:22.728396+0000","last_peered":"2023-10-14T09:37:22.728396+0000","last_clean":"2023-10-14T09:37:22.728396+0000","last_became_active":"2023-10-14T09:37:21.748040+0000","last_became_peered":"2023-10-14T09:37:21.748040+0000","last_unstale":"2023-10-14T09:37:22.728396+0000","last_undegraded":"2023-10-14T09:37:22.728396+0000","last_fullsized":"2023-10-14T09:37:22.728396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:29:10.224997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.741168+0000","last_change":"2023-10-14T09:37:20.936600+0000","last_active":"2023-10-14T09:37:21.741168+0000","last_peered":"2023-10-14T09:37:21.741168+0000","last_clean":"2023-10-14T09:37:21.741168+0000","last_became_active":"2023-10-14T09:37:20.936310+0000","last_became_peered":"2023-10-14T09:37:20.936310+0000","last_unstale":"2023-10-14T09:37:21.741168+0000","last_undegraded":"2023-10-14T09:37:21.741168+0000","last_fullsized":"2023-10-14T09:37:21.741168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:57.371898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.726291+0000","last_change":"2023-10-14T09:37:21.746713+0000","last_active":"2023-10-14T09:37:22.726291+0000","last_peered":"2023-10-14T09:37:22.726291+0000","last_clean":"2023-10-14T09:37:22.726291+0000","last_became_active":"2023-10-14T09:37:21.742406+0000","last_became_peered":"2023-10-14T09:37:21.742406+0000","last_unstale":"2023-10-14T09:37:22.726291+0000","last_undegraded":"2023-10-14T09:37:22.726291+0000","last_fullsized":"2023-10-14T09:37:22.726291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:47:20.269302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.737418+0000","last_change":"2023-10-14T09:37:20.936548+0000","last_active":"2023-10-14T09:37:21.737418+0000","last_peered":"2023-10-14T09:37:21.737418+0000","last_clean":"2023-10-14T09:37:21.737418+0000","last_became_active":"2023-10-14T09:37:20.936168+0000","last_became_peered":"2023-10-14T09:37:20.936168+0000","last_unstale":"2023-10-14T09:37:21.737418+0000","last_undegraded":"2023-10-14T09:37:21.737418+0000","last_fullsized":"2023-10-14T09:37:21.737418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:11:56.674281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.838498+0000","last_change":"2023-10-14T09:37:21.757494+0000","last_active":"2023-10-14T09:37:22.838498+0000","last_peered":"2023-10-14T09:37:22.838498+0000","last_clean":"2023-10-14T09:37:22.838498+0000","last_became_active":"2023-10-14T09:37:21.757272+0000","last_became_peered":"2023-10-14T09:37:21.757272+0000","last_unstale":"2023-10-14T09:37:22.838498+0000","last_undegraded":"2023-10-14T09:37:22.838498+0000","last_fullsized":"2023-10-14T09:37:22.838498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:20:22.862559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.931957+0000","last_change":"2023-10-14T09:37:20.938169+0000","last_active":"2023-10-14T09:37:21.931957+0000","last_peered":"2023-10-14T09:37:21.931957+0000","last_clean":"2023-10-14T09:37:21.931957+0000","last_became_active":"2023-10-14T09:37:20.937881+0000","last_became_peered":"2023-10-14T09:37:20.937881+0000","last_unstale":"2023-10-14T09:37:21.931957+0000","last_undegraded":"2023-10-14T09:37:21.931957+0000","last_fullsized":"2023-10-14T09:37:21.931957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:40:10.259029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.001082+0000","last_change":"2023-10-14T09:37:21.742197+0000","last_active":"2023-10-14T09:37:23.001082+0000","last_peered":"2023-10-14T09:37:23.001082+0000","last_clean":"2023-10-14T09:37:23.001082+0000","last_became_active":"2023-10-14T09:37:21.741895+0000","last_became_peered":"2023-10-14T09:37:21.741895+0000","last_unstale":"2023-10-14T09:37:23.001082+0000","last_undegraded":"2023-10-14T09:37:23.001082+0000","last_fullsized":"2023-10-14T09:37:23.001082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:55:22.366551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.739759+0000","last_change":"2023-10-14T09:37:20.933959+0000","last_active":"2023-10-14T09:37:21.739759+0000","last_peered":"2023-10-14T09:37:21.739759+0000","last_clean":"2023-10-14T09:37:21.739759+0000","last_became_active":"2023-10-14T09:37:20.933659+0000","last_became_peered":"2023-10-14T09:37:20.933659+0000","last_unstale":"2023-10-14T09:37:21.739759+0000","last_undegraded":"2023-10-14T09:37:21.739759+0000","last_fullsized":"2023-10-14T09:37:21.739759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:41:25.240229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.004951+0000","last_change":"2023-10-14T09:37:21.739948+0000","last_active":"2023-10-14T09:37:23.004951+0000","last_peered":"2023-10-14T09:37:23.004951+0000","last_clean":"2023-10-14T09:37:23.004951+0000","last_became_active":"2023-10-14T09:37:21.739597+0000","last_became_peered":"2023-10-14T09:37:21.739597+0000","last_unstale":"2023-10-14T09:37:23.004951+0000","last_undegraded":"2023-10-14T09:37:23.004951+0000","last_fullsized":"2023-10-14T09:37:23.004951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:25:19.124135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.733841+0000","last_change":"2023-10-14T09:37:20.932183+0000","last_active":"2023-10-14T09:37:21.733841+0000","last_peered":"2023-10-14T09:37:21.733841+0000","last_clean":"2023-10-14T09:37:21.733841+0000","last_became_active":"2023-10-14T09:37:20.931834+0000","last_became_peered":"2023-10-14T09:37:20.931834+0000","last_unstale":"2023-10-14T09:37:21.733841+0000","last_undegraded":"2023-10-14T09:37:21.733841+0000","last_fullsized":"2023-10-14T09:37:21.733841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:54:57.939511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.837982+0000","last_change":"2023-10-14T09:37:21.749015+0000","last_active":"2023-10-14T09:37:22.837982+0000","last_peered":"2023-10-14T09:37:22.837982+0000","last_clean":"2023-10-14T09:37:22.837982+0000","last_became_active":"2023-10-14T09:37:21.748596+0000","last_became_peered":"2023-10-14T09:37:21.748596+0000","last_unstale":"2023-10-14T09:37:22.837982+0000","last_undegraded":"2023-10-14T09:37:22.837982+0000","last_fullsized":"2023-10-14T09:37:22.837982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:47:20.269302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.735064+0000","last_change":"2023-10-14T09:37:20.929243+0000","last_active":"2023-10-14T09:37:21.735064+0000","last_peered":"2023-10-14T09:37:21.735064+0000","last_clean":"2023-10-14T09:37:21.735064+0000","last_became_active":"2023-10-14T09:37:20.928931+0000","last_became_peered":"2023-10-14T09:37:20.928931+0000","last_unstale":"2023-10-14T09:37:21.735064+0000","last_undegraded":"2023-10-14T09:37:21.735064+0000","last_fullsized":"2023-10-14T09:37:21.735064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:37:19.998680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.838457+0000","last_change":"2023-10-14T09:37:21.742020+0000","last_active":"2023-10-14T09:37:22.838457+0000","last_peered":"2023-10-14T09:37:22.838457+0000","last_clean":"2023-10-14T09:37:22.838457+0000","last_became_active":"2023-10-14T09:37:21.741732+0000","last_became_peered":"2023-10-14T09:37:21.741732+0000","last_unstale":"2023-10-14T09:37:22.838457+0000","last_undegraded":"2023-10-14T09:37:22.838457+0000","last_fullsized":"2023-10-14T09:37:22.838457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:14:40.914923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.931371+0000","last_change":"2023-10-14T09:37:20.939984+0000","last_active":"2023-10-14T09:37:21.931371+0000","last_peered":"2023-10-14T09:37:21.931371+0000","last_clean":"2023-10-14T09:37:21.931371+0000","last_became_active":"2023-10-14T09:37:20.937636+0000","last_became_peered":"2023-10-14T09:37:20.937636+0000","last_unstale":"2023-10-14T09:37:21.931371+0000","last_undegraded":"2023-10-14T09:37:21.931371+0000","last_fullsized":"2023-10-14T09:37:21.931371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:54:57.939511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.003333+0000","last_change":"2023-10-14T09:37:21.751303+0000","last_active":"2023-10-14T09:37:23.003333+0000","last_peered":"2023-10-14T09:37:23.003333+0000","last_clean":"2023-10-14T09:37:23.003333+0000","last_became_active":"2023-10-14T09:37:21.751037+0000","last_became_peered":"2023-10-14T09:37:21.751037+0000","last_unstale":"2023-10-14T09:37:23.003333+0000","last_undegraded":"2023-10-14T09:37:23.003333+0000","last_fullsized":"2023-10-14T09:37:23.003333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:47:20.056113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.727977+0000","last_change":"2023-10-14T09:37:21.753475+0000","last_active":"2023-10-14T09:37:22.727977+0000","last_peered":"2023-10-14T09:37:22.727977+0000","last_clean":"2023-10-14T09:37:22.727977+0000","last_became_active":"2023-10-14T09:37:21.751788+0000","last_became_peered":"2023-10-14T09:37:21.751788+0000","last_unstale":"2023-10-14T09:37:22.727977+0000","last_undegraded":"2023-10-14T09:37:22.727977+0000","last_fullsized":"2023-10-14T09:37:22.727977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:13:55.065205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.930531+0000","last_change":"2023-10-14T09:37:20.938049+0000","last_active":"2023-10-14T09:37:21.930531+0000","last_peered":"2023-10-14T09:37:21.930531+0000","last_clean":"2023-10-14T09:37:21.930531+0000","last_became_active":"2023-10-14T09:37:20.937761+0000","last_became_peered":"2023-10-14T09:37:20.937761+0000","last_unstale":"2023-10-14T09:37:21.930531+0000","last_undegraded":"2023-10-14T09:37:21.930531+0000","last_fullsized":"2023-10-14T09:37:21.930531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:25:18.109123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.728499+0000","last_change":"2023-10-14T09:37:21.746300+0000","last_active":"2023-10-14T09:37:22.728499+0000","last_peered":"2023-10-14T09:37:22.728499+0000","last_clean":"2023-10-14T09:37:22.728499+0000","last_became_active":"2023-10-14T09:37:21.743958+0000","last_became_peered":"2023-10-14T09:37:21.743958+0000","last_unstale":"2023-10-14T09:37:22.728499+0000","last_undegraded":"2023-10-14T09:37:22.728499+0000","last_fullsized":"2023-10-14T09:37:22.728499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:59:17.333518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.931999+0000","last_change":"2023-10-14T09:37:20.939300+0000","last_active":"2023-10-14T09:37:21.931999+0000","last_peered":"2023-10-14T09:37:21.931999+0000","last_clean":"2023-10-14T09:37:21.931999+0000","last_became_active":"2023-10-14T09:37:20.938957+0000","last_became_peered":"2023-10-14T09:37:20.938957+0000","last_unstale":"2023-10-14T09:37:21.931999+0000","last_undegraded":"2023-10-14T09:37:21.931999+0000","last_fullsized":"2023-10-14T09:37:21.931999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:59:40.065205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.001168+0000","last_change":"2023-10-14T09:37:21.755441+0000","last_active":"2023-10-14T09:37:23.001168+0000","last_peered":"2023-10-14T09:37:23.001168+0000","last_clean":"2023-10-14T09:37:23.001168+0000","last_became_active":"2023-10-14T09:37:21.755006+0000","last_became_peered":"2023-10-14T09:37:21.755006+0000","last_unstale":"2023-10-14T09:37:23.001168+0000","last_undegraded":"2023-10-14T09:37:23.001168+0000","last_fullsized":"2023-10-14T09:37:23.001168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:33:39.761471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.921465+0000","last_change":"2023-10-14T09:37:20.921785+0000","last_active":"2023-10-14T09:37:21.921465+0000","last_peered":"2023-10-14T09:37:21.921465+0000","last_clean":"2023-10-14T09:37:21.921465+0000","last_became_active":"2023-10-14T09:37:20.921514+0000","last_became_peered":"2023-10-14T09:37:20.921514+0000","last_unstale":"2023-10-14T09:37:21.921465+0000","last_undegraded":"2023-10-14T09:37:21.921465+0000","last_fullsized":"2023-10-14T09:37:21.921465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:37:19.998680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.838600+0000","last_change":"2023-10-14T09:37:21.748918+0000","last_active":"2023-10-14T09:37:22.838600+0000","last_peered":"2023-10-14T09:37:22.838600+0000","last_clean":"2023-10-14T09:37:22.838600+0000","last_became_active":"2023-10-14T09:37:21.746814+0000","last_became_peered":"2023-10-14T09:37:21.746814+0000","last_unstale":"2023-10-14T09:37:22.838600+0000","last_undegraded":"2023-10-14T09:37:22.838600+0000","last_fullsized":"2023-10-14T09:37:22.838600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:57:10.220824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.001310+0000","last_change":"2023-10-14T09:37:20.933646+0000","last_active":"2023-10-14T09:37:23.001310+0000","last_peered":"2023-10-14T09:37:23.001310+0000","last_clean":"2023-10-14T09:37:23.001310+0000","last_became_active":"2023-10-14T09:37:20.933289+0000","last_became_peered":"2023-10-14T09:37:20.933289+0000","last_unstale":"2023-10-14T09:37:23.001310+0000","last_undegraded":"2023-10-14T09:37:23.001310+0000","last_fullsized":"2023-10-14T09:37:23.001310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:56:57.656029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":819200,"data_stored":667764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.514}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.476}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6559999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":78426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2190000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6439999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7889999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5549999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":76940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.404}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.734}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.8520000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.856}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.547000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.481999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.6520000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":78426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4359999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5149999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4850000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":76814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4239999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.23}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4510000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":76974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.246}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1890000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":76904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.327}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.373}]}]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":667820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0310000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8220000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9490000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T09:37:26.800 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T09:37:26.801 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-14T09:37:26.801 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-14T09:37:26.801 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-14T09:37:26.802 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-14T09:37:27.053 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.052+0000 7f7162c02640 1 Processor -- start 2023-10-14T09:37:27.054 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.052+0000 7f7162c02640 1 -- start start 2023-10-14T09:37:27.055 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.053+0000 7f7162c02640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f715c0cd0c0 0x7f715c1615f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:27.055 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.053+0000 7f7162c02640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f715c15db00 0x7f715c0b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:27.056 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.053+0000 7f7162c02640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f715c15e3e0 con 0x7f715c0b0410 2023-10-14T09:37:27.056 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.053+0000 7f7162c02640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f715c0b0de0 con 0x7f715c0cd0c0 2023-10-14T09:37:27.056 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.053+0000 7f7162c02640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f715c0cd4a0 con 0x7f715c15db00 2023-10-14T09:37:27.056 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.053+0000 7f716099e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f715c0cd0c0 0x7f715c1615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:27.056 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.053+0000 7f716099e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f715c0cd0c0 0x7f715c1615f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44666/0 (socket says 172.21.15.102:44666) 2023-10-14T09:37:27.057 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.053+0000 7f716099e640 1 -- 172.21.15.102:0/3757153368 learned_addr learned my addr 172.21.15.102:0/3757153368 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:27.057 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.053+0000 7f715bfff640 1 --1- 172.21.15.102:0/3757153368 >> v1:172.21.15.102:6789/0 conn(0x7f715c0b0410 0x7f715c15d3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:45610/0 (socket says 172.21.15.102:45610) 2023-10-14T09:37:27.057 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.054+0000 7f716119f640 1 --2- 172.21.15.102:0/3757153368 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f715c15db00 0x7f715c0b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:27.058 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.054+0000 7f716099e640 1 -- 172.21.15.102:0/3757153368 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f715c15db00 msgr2=0x7f715c0b08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:27.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.054+0000 7f716099e640 1 --2- 172.21.15.102:0/3757153368 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f715c15db00 0x7f715c0b08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:27.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.054+0000 7f716099e640 1 -- 172.21.15.102:0/3757153368 >> v1:172.21.15.102:6789/0 conn(0x7f715c0b0410 legacy=0x7f715c15d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:27.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.054+0000 7f716099e640 1 -- 172.21.15.102:0/3757153368 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f715c15e100 con 0x7f715c0cd0c0 2023-10-14T09:37:27.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.054+0000 7f715b7fe640 1 -- 172.21.15.102:0/3757153368 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3028106258 0 0) 0x7f715c15e3e0 con 0x7f715c0b0410 2023-10-14T09:37:27.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.055+0000 7f716099e640 1 --2- 172.21.15.102:0/3757153368 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f715c0cd0c0 0x7f715c1615f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f714c009870 tx=0x7f714c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66d330bbcafdba6a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:27.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.055+0000 7f715b7fe640 1 -- 172.21.15.102:0/3757153368 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c031640 con 0x7f715c0cd0c0 2023-10-14T09:37:27.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.055+0000 7f715b7fe640 1 -- 172.21.15.102:0/3757153368 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714c0317a0 con 0x7f715c0cd0c0 2023-10-14T09:37:27.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.055+0000 7f715b7fe640 1 -- 172.21.15.102:0/3757153368 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c031b30 con 0x7f715c0cd0c0 2023-10-14T09:37:27.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.056+0000 7f7162c02640 1 -- 172.21.15.102:0/3757153368 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f715c0cd0c0 msgr2=0x7f715c1615f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:27.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.056+0000 7f7162c02640 1 --2- 172.21.15.102:0/3757153368 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f715c0cd0c0 0x7f715c1615f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f714c009870 tx=0x7f714c02b8f0 comp rx=0 tx=0).stop 2023-10-14T09:37:27.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.056+0000 7f7162c02640 1 -- 172.21.15.102:0/3757153368 shutdown_connections 2023-10-14T09:37:27.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.056+0000 7f7162c02640 1 --2- 172.21.15.102:0/3757153368 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f715c15db00 0x7f715c0b08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:27.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.056+0000 7f7162c02640 1 --2- 172.21.15.102:0/3757153368 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f715c0cd0c0 0x7f715c1615f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:27.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.056+0000 7f7162c02640 1 -- 172.21.15.102:0/3757153368 >> 172.21.15.102:0/3757153368 conn(0x7f715c0cb410 msgr2=0x7f715c0cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:27.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.056+0000 7f7162c02640 1 -- 172.21.15.102:0/3757153368 shutdown_connections 2023-10-14T09:37:27.062 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.056+0000 7f7162c02640 1 -- 172.21.15.102:0/3757153368 wait complete. 2023-10-14T09:37:27.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.058+0000 7f7162c02640 1 Processor -- start 2023-10-14T09:37:27.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.058+0000 7f7162c02640 1 -- start start 2023-10-14T09:37:27.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.059+0000 7f7162c02640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f715c0b0410 0x7f715c152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:27.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.059+0000 7f7162c02640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f715c0cd0c0 0x7f715c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:27.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.059+0000 7f7162c02640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f715c15db00 0x7f715c155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:27.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.059+0000 7f7162c02640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715c160600 con 0x7f715c0b0410 2023-10-14T09:37:27.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.059+0000 7f7162c02640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715c06b7c0 con 0x7f715c0cd0c0 2023-10-14T09:37:27.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.059+0000 7f7162c02640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f715c1543c0 con 0x7f715c15db00 2023-10-14T09:37:27.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.059+0000 7f716099e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f715c0b0410 0x7f715c152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:27.066 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.059+0000 7f716099e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f715c0b0410 0x7f715c152ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44670/0 (socket says 172.21.15.102:44670) 2023-10-14T09:37:27.066 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.059+0000 7f716099e640 1 -- 172.21.15.102:0/207297410 learned_addr learned my addr 172.21.15.102:0/207297410 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:27.066 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.059+0000 7f716099e640 1 -- 172.21.15.102:0/207297410 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f715c15db00 msgr2=0x7f715c155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:27.066 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.059+0000 7f716099e640 1 --2- 172.21.15.102:0/207297410 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f715c15db00 0x7f715c155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:27.066 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.059+0000 7f716099e640 1 -- 172.21.15.102:0/207297410 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f715c0cd0c0 msgr2=0x7f715c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:27.067 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.059+0000 7f716099e640 1 --2- 172.21.15.102:0/207297410 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f715c0cd0c0 0x7f715c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:27.067 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.059+0000 7f716099e640 1 -- 172.21.15.102:0/207297410 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714c0094d0 con 0x7f715c0b0410 2023-10-14T09:37:27.067 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.060+0000 7f716099e640 1 --2- 172.21.15.102:0/207297410 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f715c0b0410 0x7f715c152ee0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f714c0090b0 tx=0x7f714c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:27.067 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.060+0000 7f71597fa640 1 -- 172.21.15.102:0/207297410 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c004230 con 0x7f715c0b0410 2023-10-14T09:37:27.067 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.060+0000 7f71597fa640 1 -- 172.21.15.102:0/207297410 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714c004390 con 0x7f715c0b0410 2023-10-14T09:37:27.068 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.060+0000 7f7162c02640 1 -- 172.21.15.102:0/207297410 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f715c1546a0 con 0x7f715c0b0410 2023-10-14T09:37:27.068 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.060+0000 7f71597fa640 1 -- 172.21.15.102:0/207297410 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c03aa90 con 0x7f715c0b0410 2023-10-14T09:37:27.068 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.060+0000 7f7162c02640 1 -- 172.21.15.102:0/207297410 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f715c0b2c10 con 0x7f715c0b0410 2023-10-14T09:37:27.068 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.061+0000 7f7162c02640 1 -- 172.21.15.102:0/207297410 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f715c160af0 con 0x7f715c0b0410 2023-10-14T09:37:27.068 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.062+0000 7f71597fa640 1 -- 172.21.15.102:0/207297410 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f714c042070 con 0x7f715c0b0410 2023-10-14T09:37:27.069 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.063+0000 7f71597fa640 1 --2- 172.21.15.102:0/207297410 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f714806aea0 0x7f714806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:27.069 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.063+0000 7f71597fa640 1 -- 172.21.15.102:0/207297410 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f714c0ab2e0 con 0x7f715c0b0410 2023-10-14T09:37:27.070 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.063+0000 7f715bfff640 1 --2- 172.21.15.102:0/207297410 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f714806aea0 0x7f714806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:27.070 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.064+0000 7f715bfff640 1 --2- 172.21.15.102:0/207297410 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f714806aea0 0x7f714806d360 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7150007fd0 tx=0x7f7150007960 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:27.070 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.068+0000 7f71597fa640 1 -- 172.21.15.102:0/207297410 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f715c160af0 con 0x7f715c0b0410 2023-10-14T09:37:27.312 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.310+0000 7f7162c02640 1 -- 172.21.15.102:0/207297410 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f715c160ac0 con 0x7f715c0b0410 2023-10-14T09:37:27.317 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.316+0000 7f71597fa640 1 -- 172.21.15.102:0/207297410 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171035 (secure 0 0 0) 0x7f714c0762f0 con 0x7f715c0b0410 2023-10-14T09:37:27.319 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:37:27.322 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.320+0000 7f7162c02640 1 -- 172.21.15.102:0/207297410 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f714806aea0 msgr2=0x7f714806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:27.323 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.320+0000 7f7162c02640 1 --2- 172.21.15.102:0/207297410 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f714806aea0 0x7f714806d360 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7150007fd0 tx=0x7f7150007960 comp rx=0 tx=0).stop 2023-10-14T09:37:27.323 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.321+0000 7f7162c02640 1 -- 172.21.15.102:0/207297410 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f715c0b0410 msgr2=0x7f715c152ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:27.323 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.321+0000 7f7162c02640 1 --2- 172.21.15.102:0/207297410 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f715c0b0410 0x7f715c152ee0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f714c0090b0 tx=0x7f714c0046c0 comp rx=0 tx=0).stop 2023-10-14T09:37:27.323 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.321+0000 7f7162c02640 1 -- 172.21.15.102:0/207297410 shutdown_connections 2023-10-14T09:37:27.323 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.321+0000 7f7162c02640 1 --2- 172.21.15.102:0/207297410 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f714806aea0 0x7f714806d360 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:27.324 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.321+0000 7f7162c02640 1 --2- 172.21.15.102:0/207297410 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f715c15db00 0x7f715c155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:27.324 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.321+0000 7f7162c02640 1 --2- 172.21.15.102:0/207297410 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f715c0cd0c0 0x7f715c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:27.324 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.321+0000 7f7162c02640 1 --2- 172.21.15.102:0/207297410 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f715c0b0410 0x7f715c152ee0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:27.324 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.321+0000 7f7162c02640 1 -- 172.21.15.102:0/207297410 >> 172.21.15.102:0/207297410 conn(0x7f715c0cb410 msgr2=0x7f715c0ae3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:27.324 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.321+0000 7f7162c02640 1 -- 172.21.15.102:0/207297410 shutdown_connections 2023-10-14T09:37:27.325 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.321+0000 7f7162c02640 1 -- 172.21.15.102:0/207297410 wait complete. 2023-10-14T09:37:27.340 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":5,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1125265706},{"type":"v1","addr":"172.21.15.102:6833","nonce":1125265706}]},"active_addr":"172.21.15.102:6833/1125265706","active_change":"2023-10-14T09:37:01.855079+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4107,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":4293614529}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":694143013}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":754145501}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":3938553042}]}]} 2023-10-14T09:37:27.344 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-14T09:37:27.344 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-14T09:37:27.345 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:37:27.548 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.547+0000 7fbea3ee7640 1 Processor -- start 2023-10-14T09:37:27.549 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.547+0000 7fbea3ee7640 1 -- start start 2023-10-14T09:37:27.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.548+0000 7fbea3ee7640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fbe9c159b20 0x7fbe9c06bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:27.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.548+0000 7fbea3ee7640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbe9c0b0b20 0x7fbe9c06fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:27.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.548+0000 7fbea3ee7640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe9c06f7f0 con 0x7fbe9c159f00 2023-10-14T09:37:27.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.548+0000 7fbea3ee7640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe9c06c5e0 con 0x7fbe9c0b0b20 2023-10-14T09:37:27.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.548+0000 7fbea3ee7640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe9c06c8c0 con 0x7fbe9c159b20 2023-10-14T09:37:27.552 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.549+0000 7fbea2484640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbe9c0b0b20 0x7fbe9c06fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:27.552 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.549+0000 7fbea2484640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbe9c0b0b20 0x7fbe9c06fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44674/0 (socket says 172.21.15.102:44674) 2023-10-14T09:37:27.552 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.549+0000 7fbea2484640 1 -- 172.21.15.102:0/2468289185 learned_addr learned my addr 172.21.15.102:0/2468289185 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:27.552 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.549+0000 7fbea1c83640 1 --2- 172.21.15.102:0/2468289185 >> v2:172.21.15.129:3300/0 conn(0x7fbe9c159b20 0x7fbe9c06bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:27.552 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.549+0000 7fbea2484640 1 -- 172.21.15.102:0/2468289185 >> v2:172.21.15.129:3300/0 conn(0x7fbe9c159b20 msgr2=0x7fbe9c06bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:27.553 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.549+0000 7fbea2484640 1 --2- 172.21.15.102:0/2468289185 >> v2:172.21.15.129:3300/0 conn(0x7fbe9c159b20 0x7fbe9c06bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:27.553 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.549+0000 7fbea2484640 1 -- 172.21.15.102:0/2468289185 >> v1:172.21.15.129:6789/0 conn(0x7fbe9c159f00 legacy=0x7fbe9c0b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:27.553 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.549+0000 7fbea2484640 1 -- 172.21.15.102:0/2468289185 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9c06cba0 con 0x7fbe9c0b0b20 2023-10-14T09:37:27.554 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.550+0000 7fbea2484640 1 --2- 172.21.15.102:0/2468289185 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe9c0b0b20 0x7fbe9c06fc80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c0c9340 tx=0x7fbe9402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f71c1f74d2419f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:27.554 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.550+0000 7fbea0c81640 1 -- 172.21.15.102:0/2468289185 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9402ca80 con 0x7fbe9c0b0b20 2023-10-14T09:37:27.554 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.550+0000 7fbea0c81640 1 -- 172.21.15.102:0/2468289185 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9402cbe0 con 0x7fbe9c0b0b20 2023-10-14T09:37:27.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.550+0000 7fbea0c81640 1 -- 172.21.15.102:0/2468289185 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe940343f0 con 0x7fbe9c0b0b20 2023-10-14T09:37:27.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.551+0000 7fbea3ee7640 1 -- 172.21.15.102:0/2468289185 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe9c0b0b20 msgr2=0x7fbe9c06fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:27.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.551+0000 7fbea3ee7640 1 --2- 172.21.15.102:0/2468289185 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe9c0b0b20 0x7fbe9c06fc80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c0c9340 tx=0x7fbe9402bee0 comp rx=0 tx=0).stop 2023-10-14T09:37:27.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.551+0000 7fbea3ee7640 1 -- 172.21.15.102:0/2468289185 shutdown_connections 2023-10-14T09:37:27.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.551+0000 7fbea3ee7640 1 --2- 172.21.15.102:0/2468289185 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe9c0b0b20 0x7fbe9c06fc80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:27.556 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.551+0000 7fbea3ee7640 1 --2- 172.21.15.102:0/2468289185 >> v2:172.21.15.129:3300/0 conn(0x7fbe9c159b20 0x7fbe9c06bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:27.556 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.551+0000 7fbea3ee7640 1 -- 172.21.15.102:0/2468289185 >> 172.21.15.102:0/2468289185 conn(0x7fbe9c0cb410 msgr2=0x7fbe9c0cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:27.556 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.551+0000 7fbea3ee7640 1 -- 172.21.15.102:0/2468289185 shutdown_connections 2023-10-14T09:37:27.556 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.551+0000 7fbea3ee7640 1 -- 172.21.15.102:0/2468289185 wait complete. 2023-10-14T09:37:27.558 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.553+0000 7fbea3ee7640 1 Processor -- start 2023-10-14T09:37:27.558 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.553+0000 7fbea3ee7640 1 -- start start 2023-10-14T09:37:27.559 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.554+0000 7fbea3ee7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbe9c0b0b20 0x7fbe9c0b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:27.559 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.554+0000 7fbea3ee7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe9c159b20 0x7fbe9c1f31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:27.559 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.554+0000 7fbea3ee7640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbe9c159f00 0x7fbe9c0ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:27.559 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.554+0000 7fbea3ee7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c0c4ba0 con 0x7fbe9c159b20 2023-10-14T09:37:27.559 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.554+0000 7fbea3ee7640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c0c4e80 con 0x7fbe9c0b0b20 2023-10-14T09:37:27.560 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.554+0000 7fbea3ee7640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c0c5160 con 0x7fbe9c159f00 2023-10-14T09:37:27.560 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.554+0000 7fbea1482640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe9c159b20 0x7fbe9c1f31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:27.560 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.554+0000 7fbea1482640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe9c159b20 0x7fbe9c1f31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44680/0 (socket says 172.21.15.102:44680) 2023-10-14T09:37:27.560 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.554+0000 7fbea1482640 1 -- 172.21.15.102:0/3512477962 learned_addr learned my addr 172.21.15.102:0/3512477962 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:27.560 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.555+0000 7fbea1c83640 1 --2- 172.21.15.102:0/3512477962 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbe9c0b0b20 0x7fbe9c0b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:27.561 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.555+0000 7fbea2484640 1 --2- 172.21.15.102:0/3512477962 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbe9c159f00 0x7fbe9c0ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:27.561 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.555+0000 7fbea1482640 1 -- 172.21.15.102:0/3512477962 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbe9c159f00 msgr2=0x7fbe9c0ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:27.561 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.555+0000 7fbea1482640 1 --2- 172.21.15.102:0/3512477962 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbe9c159f00 0x7fbe9c0ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:27.561 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.555+0000 7fbea1482640 1 -- 172.21.15.102:0/3512477962 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbe9c0b0b20 msgr2=0x7fbe9c0b1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:27.561 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.555+0000 7fbea1482640 1 --2- 172.21.15.102:0/3512477962 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbe9c0b0b20 0x7fbe9c0b1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:27.561 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.555+0000 7fbea1482640 1 -- 172.21.15.102:0/3512477962 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe94009b30 con 0x7fbe9c159b20 2023-10-14T09:37:27.562 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.555+0000 7fbea1482640 1 --2- 172.21.15.102:0/3512477962 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe9c159b20 0x7fbe9c1f31f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c00c400 tx=0x7fbe8c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:27.562 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.555+0000 7fbe927fc640 1 -- 172.21.15.102:0/3512477962 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c011790 con 0x7fbe9c159b20 2023-10-14T09:37:27.562 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.555+0000 7fbe927fc640 1 -- 172.21.15.102:0/3512477962 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8c011930 con 0x7fbe9c159b20 2023-10-14T09:37:27.562 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.555+0000 7fbe927fc640 1 -- 172.21.15.102:0/3512477962 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c011ce0 con 0x7fbe9c159b20 2023-10-14T09:37:27.562 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.555+0000 7fbea3ee7640 1 -- 172.21.15.102:0/3512477962 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe9c1f2cd0 con 0x7fbe9c159b20 2023-10-14T09:37:27.563 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.556+0000 7fbea3ee7640 1 -- 172.21.15.102:0/3512477962 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe9c0b0220 con 0x7fbe9c159b20 2023-10-14T09:37:27.563 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.557+0000 7fbea3ee7640 1 -- 172.21.15.102:0/3512477962 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe9c1f2b10 con 0x7fbe9c159b20 2023-10-14T09:37:27.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.557+0000 7fbe927fc640 1 -- 172.21.15.102:0/3512477962 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbe8c01c460 con 0x7fbe9c159b20 2023-10-14T09:37:27.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.558+0000 7fbe927fc640 1 --2- 172.21.15.102:0/3512477962 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fbe8006ae70 0x7fbe8006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:27.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.558+0000 7fbe927fc640 1 -- 172.21.15.102:0/3512477962 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe8c089590 con 0x7fbe9c159b20 2023-10-14T09:37:27.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.559+0000 7fbea1c83640 1 --2- 172.21.15.102:0/3512477962 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fbe8006ae70 0x7fbe8006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:27.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.559+0000 7fbea1c83640 1 --2- 172.21.15.102:0/3512477962 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fbe8006ae70 0x7fbe8006d330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbe98006fd0 tx=0x7fbe98008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:27.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.563+0000 7fbe927fc640 1 -- 172.21.15.102:0/3512477962 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbe8c054640 con 0x7fbe9c159b20 2023-10-14T09:37:27.754 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.752+0000 7fbea3ee7640 1 -- 172.21.15.102:0/3512477962 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe9c04e160 con 0x7fbe9c159b20 2023-10-14T09:37:27.757 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.755+0000 7fbe927fc640 1 -- 172.21.15.102:0/3512477962 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16541 (secure 0 0 0) 0x7fbe8c057c60 con 0x7fbe9c159b20 2023-10-14T09:37:27.757 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:37:27.758 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":22,"fsid":"8a6cd69d-7f5b-4f2a-806a-0176c10aed50","created":"2023-10-14T09:36:56.745172+0000","modified":"2023-10-14T09:37:22.712469+0000","last_up_change":"2023-10-14T09:37:09.791473+0000","last_in_change":"2023-10-14T09:37:00.547186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:37:09.952407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:37:19.560925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:37:20.363385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e5aef8f3-878f-482b-b522-9a5b958b90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6801","nonce":1727250718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6803","nonce":1727250718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6807","nonce":1727250718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6805","nonce":1727250718}]},"public_addr":"172.21.15.102:6801/1727250718","cluster_addr":"172.21.15.102:6803/1727250718","heartbeat_back_addr":"172.21.15.102:6807/1727250718","heartbeat_front_addr":"172.21.15.102:6805/1727250718","state":["exists","up"]},{"osd":1,"uuid":"4a8cf50e-387b-4d47-9588-bd22e375a9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6809","nonce":1095651107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6811","nonce":1095651107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6815","nonce":1095651107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6813","nonce":1095651107}]},"public_addr":"172.21.15.102:6809/1095651107","cluster_addr":"172.21.15.102:6811/1095651107","heartbeat_back_addr":"172.21.15.102:6815/1095651107","heartbeat_front_addr":"172.21.15.102:6813/1095651107","state":["exists","up"]},{"osd":2,"uuid":"009ef55f-8a63-4219-bacd-d7c7b4500867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6820","nonce":2198222556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6825","nonce":2198222556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6831","nonce":2198222556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6829","nonce":2198222556}]},"public_addr":"172.21.15.102:6820/2198222556","cluster_addr":"172.21.15.102:6825/2198222556","heartbeat_back_addr":"172.21.15.102:6831/2198222556","heartbeat_front_addr":"172.21.15.102:6829/2198222556","state":["exists","up"]},{"osd":3,"uuid":"f2110eae-2ff9-4ed9-93d6-bd2361618211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6818","nonce":654726740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6821","nonce":654726740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6827","nonce":654726740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6823","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6824","nonce":654726740}]},"public_addr":"172.21.15.102:6818/654726740","cluster_addr":"172.21.15.102:6821/654726740","heartbeat_back_addr":"172.21.15.102:6827/654726740","heartbeat_front_addr":"172.21.15.102:6824/654726740","state":["exists","up"]},{"osd":4,"uuid":"33f1ae34-3100-40f7-9cb8-0eca2b358693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6817","nonce":507586170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6819","nonce":507586170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6823","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6825","nonce":507586170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6821","nonce":507586170}]},"public_addr":"172.21.15.129:6817/507586170","cluster_addr":"172.21.15.129:6819/507586170","heartbeat_back_addr":"172.21.15.129:6825/507586170","heartbeat_front_addr":"172.21.15.129:6821/507586170","state":["exists","up"]},{"osd":5,"uuid":"fab2fc62-3f3e-450d-93e0-770f39e80710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6801","nonce":1913451073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6803","nonce":1913451073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6807","nonce":1913451073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6805","nonce":1913451073}]},"public_addr":"172.21.15.129:6801/1913451073","cluster_addr":"172.21.15.129:6803/1913451073","heartbeat_back_addr":"172.21.15.129:6807/1913451073","heartbeat_front_addr":"172.21.15.129:6805/1913451073","state":["exists","up"]},{"osd":6,"uuid":"d7cc1d69-92e7-4253-a127-cfc0444a4809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6809","nonce":2853291511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6811","nonce":2853291511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6815","nonce":2853291511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6813","nonce":2853291511}]},"public_addr":"172.21.15.129:6809/2853291511","cluster_addr":"172.21.15.129:6811/2853291511","heartbeat_back_addr":"172.21.15.129:6815/2853291511","heartbeat_front_addr":"172.21.15.129:6813/2853291511","state":["exists","up"]},{"osd":7,"uuid":"1e403de1-09e2-4370-b9a7-e790ac44bbee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6824","nonce":2933886914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6827","nonce":2933886914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6831","nonce":2933886914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6829","nonce":2933886914}]},"public_addr":"172.21.15.129:6824/2933886914","cluster_addr":"172.21.15.129:6827/2933886914","heartbeat_back_addr":"172.21.15.129:6831/2933886914","heartbeat_front_addr":"172.21.15.129:6829/2933886914","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.849661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.868113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.933488+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.891794+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.901861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.858750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.911712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.996765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:37:27.759 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.757+0000 7fbea3ee7640 1 -- 172.21.15.102:0/3512477962 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fbe8006ae70 msgr2=0x7fbe8006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:27.759 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.757+0000 7fbea3ee7640 1 --2- 172.21.15.102:0/3512477962 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fbe8006ae70 0x7fbe8006d330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbe98006fd0 tx=0x7fbe98008040 comp rx=0 tx=0).stop 2023-10-14T09:37:27.759 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.757+0000 7fbea3ee7640 1 -- 172.21.15.102:0/3512477962 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe9c159b20 msgr2=0x7fbe9c1f31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:27.760 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.757+0000 7fbea3ee7640 1 --2- 172.21.15.102:0/3512477962 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe9c159b20 0x7fbe9c1f31f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c00c400 tx=0x7fbe8c00c8c0 comp rx=0 tx=0).stop 2023-10-14T09:37:27.760 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.757+0000 7fbea3ee7640 1 -- 172.21.15.102:0/3512477962 shutdown_connections 2023-10-14T09:37:27.760 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.758+0000 7fbea3ee7640 1 --2- 172.21.15.102:0/3512477962 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fbe8006ae70 0x7fbe8006d330 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:27.761 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.758+0000 7fbea3ee7640 1 --2- 172.21.15.102:0/3512477962 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbe9c159f00 0x7fbe9c0ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:27.761 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.758+0000 7fbea3ee7640 1 --2- 172.21.15.102:0/3512477962 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe9c159b20 0x7fbe9c1f31f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:27.761 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.758+0000 7fbea3ee7640 1 --2- 172.21.15.102:0/3512477962 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbe9c0b0b20 0x7fbe9c0b1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:27.761 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.758+0000 7fbea3ee7640 1 -- 172.21.15.102:0/3512477962 >> 172.21.15.102:0/3512477962 conn(0x7fbe9c0cb410 msgr2=0x7fbe9c06d370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:27.761 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.758+0000 7fbea3ee7640 1 -- 172.21.15.102:0/3512477962 shutdown_connections 2023-10-14T09:37:27.762 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.758+0000 7fbea3ee7640 1 -- 172.21.15.102:0/3512477962 wait complete. 2023-10-14T09:37:27.777 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-14T09:37:27.777 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:37:27.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.989+0000 7fd332d97640 1 Processor -- start 2023-10-14T09:37:27.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.989+0000 7fd332d97640 1 -- start start 2023-10-14T09:37:27.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.990+0000 7fd332d97640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fd32c159f00 0x7fd32c0b0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:27.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.990+0000 7fd332d97640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd32c06f7f0 con 0x7fd32c159b20 2023-10-14T09:37:27.993 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.990+0000 7fd332d97640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd32c06c5e0 con 0x7fd32c15d880 2023-10-14T09:37:27.993 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.990+0000 7fd332d97640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd32c06c8c0 con 0x7fd32c159f00 2023-10-14T09:37:27.993 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.991+0000 7fd330b33640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fd32c159b20 0x7fd32c06bbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:45618/0 (socket says 172.21.15.102:45618) 2023-10-14T09:37:27.993 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.991+0000 7fd330b33640 1 -- 172.21.15.102:0/2835254642 learned_addr learned my addr 172.21.15.102:0/2835254642 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:27.995 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.991+0000 7fd32b7fe640 1 -- 172.21.15.102:0/2835254642 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2668176441 0 0) 0x7fd32c06f7f0 con 0x7fd32c159b20 2023-10-14T09:37:27.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.991+0000 7fd32b7fe640 1 -- 172.21.15.102:0/2835254642 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd31c005730 con 0x7fd32c159b20 2023-10-14T09:37:27.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.991+0000 7fd32bfff640 1 --2- 172.21.15.102:0/2835254642 >> v2:172.21.15.129:3300/0 conn(0x7fd32c159f00 0x7fd32c0b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:27.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.991+0000 7fd32b7fe640 1 -- 172.21.15.102:0/2835254642 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 559971139 0 0) 0x7fd31c005730 con 0x7fd32c159b20 2023-10-14T09:37:27.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.991+0000 7fd32b7fe640 1 -- 172.21.15.102:0/2835254642 >> v2:172.21.15.129:3300/0 conn(0x7fd32c159f00 msgr2=0x7fd32c0b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:27.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.991+0000 7fd32b7fe640 1 --2- 172.21.15.102:0/2835254642 >> v2:172.21.15.129:3300/0 conn(0x7fd32c159f00 0x7fd32c0b0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:27.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.991+0000 7fd32b7fe640 1 -- 172.21.15.102:0/2835254642 >> v1:172.21.15.129:6789/0 conn(0x7fd32c15d880 legacy=0x7fd32c06fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:27.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.991+0000 7fd32b7fe640 1 -- 172.21.15.102:0/2835254642 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32c06cba0 con 0x7fd32c159b20 2023-10-14T09:37:27.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.991+0000 7fd32b7fe640 1 -- 172.21.15.102:0/2835254642 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4030661168 0 0) 0x7fd320001670 con 0x7fd32c159b20 2023-10-14T09:37:27.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.992+0000 7fd32b7fe640 1 -- 172.21.15.102:0/2835254642 >> v1:172.21.15.102:6789/0 conn(0x7fd32c159b20 legacy=0x7fd32c06bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:27.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.992+0000 7fd32b7fe640 1 --2- 172.21.15.102:0/2835254642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd31c005bd0 0x7fd31c005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:27.998 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.992+0000 7fd32b7fe640 1 --2- 172.21.15.102:0/2835254642 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd31c0069d0 0x7fd31c006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:27.998 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.992+0000 7fd32b7fe640 1 --2- 172.21.15.102:0/2835254642 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd31c0073e0 0x7fd31c00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:27.998 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.992+0000 7fd32b7fe640 1 -- 172.21.15.102:0/2835254642 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c06c8c0 con 0x7fd31c005bd0 2023-10-14T09:37:27.998 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.992+0000 7fd32b7fe640 1 -- 172.21.15.102:0/2835254642 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c00e310 con 0x7fd31c0069d0 2023-10-14T09:37:27.999 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.992+0000 7fd32b7fe640 1 -- 172.21.15.102:0/2835254642 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c00e4d0 con 0x7fd31c0073e0 2023-10-14T09:37:27.999 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.992+0000 7fd330b33640 1 --2- 172.21.15.102:0/2835254642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd31c005bd0 0x7fd31c005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:27.999 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.992+0000 7fd330b33640 1 -- 172.21.15.102:0/2835254642 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd31c0073e0 msgr2=0x7fd31c00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:27.999 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.992+0000 7fd330b33640 1 --2- 172.21.15.102:0/2835254642 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd31c0073e0 0x7fd31c00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:27.999 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.992+0000 7fd330b33640 1 -- 172.21.15.102:0/2835254642 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd31c0069d0 msgr2=0x7fd31c006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:27.999 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.992+0000 7fd330b33640 1 --2- 172.21.15.102:0/2835254642 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd31c0069d0 0x7fd31c006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.992+0000 7fd330b33640 1 -- 172.21.15.102:0/2835254642 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd31c005730 con 0x7fd31c005bd0 2023-10-14T09:37:28.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.992+0000 7fd331334640 1 -- 172.21.15.102:0/2835254642 reap_dead start 2023-10-14T09:37:28.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.993+0000 7fd330b33640 1 --2- 172.21.15.102:0/2835254642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd31c005bd0 0x7fd31c005fd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd32000c160 tx=0x7fd31c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6154542449706a7c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:28.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.993+0000 7fd32b7fe640 1 -- 172.21.15.102:0/2835254642 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd320005ad0 con 0x7fd31c005bd0 2023-10-14T09:37:28.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.994+0000 7fd32b7fe640 1 -- 172.21.15.102:0/2835254642 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd320005c30 con 0x7fd31c005bd0 2023-10-14T09:37:28.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.994+0000 7fd32b7fe640 1 -- 172.21.15.102:0/2835254642 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32002c7c0 con 0x7fd31c005bd0 2023-10-14T09:37:28.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.994+0000 7fd332d97640 1 -- 172.21.15.102:0/2835254642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd31c005bd0 msgr2=0x7fd31c005fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.994+0000 7fd332d97640 1 --2- 172.21.15.102:0/2835254642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd31c005bd0 0x7fd31c005fd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd32000c160 tx=0x7fd31c007a00 comp rx=0 tx=0).stop 2023-10-14T09:37:28.003 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.994+0000 7fd332d97640 1 -- 172.21.15.102:0/2835254642 shutdown_connections 2023-10-14T09:37:28.004 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.994+0000 7fd332d97640 1 --2- 172.21.15.102:0/2835254642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd31c005bd0 0x7fd31c005fd0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.004 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.994+0000 7fd332d97640 1 -- 172.21.15.102:0/2835254642 >> 172.21.15.102:0/2835254642 conn(0x7fd32c0cb410 msgr2=0x7fd32c0cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:28.004 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.994+0000 7fd332d97640 1 -- 172.21.15.102:0/2835254642 shutdown_connections 2023-10-14T09:37:28.004 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.994+0000 7fd332d97640 1 -- 172.21.15.102:0/2835254642 wait complete. 2023-10-14T09:37:28.004 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.996+0000 7fd332d97640 1 Processor -- start 2023-10-14T09:37:28.005 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.996+0000 7fd332d97640 1 -- start start 2023-10-14T09:37:28.005 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.997+0000 7fd332d97640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd31c005bd0 0x7fd32c0c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.005 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.997+0000 7fd332d97640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd32c154460 0x7fd32c0ad780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.005 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.997+0000 7fd332d97640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd32c15c4e0 0x7fd32c15c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.006 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.997+0000 7fd332d97640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c15cea0 con 0x7fd32c154460 2023-10-14T09:37:28.006 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.997+0000 7fd332d97640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c0b24f0 con 0x7fd32c15c4e0 2023-10-14T09:37:28.006 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.997+0000 7fd332d97640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c0c8210 con 0x7fd31c005bd0 2023-10-14T09:37:28.006 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.997+0000 7fd32bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd32c154460 0x7fd32c0ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.006 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.998+0000 7fd32bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd32c154460 0x7fd32c0ad780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44696/0 (socket says 172.21.15.102:44696) 2023-10-14T09:37:28.007 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.998+0000 7fd32bfff640 1 -- 172.21.15.102:0/4260900329 learned_addr learned my addr 172.21.15.102:0/4260900329 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:28.007 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.998+0000 7fd330b33640 1 --2- 172.21.15.102:0/4260900329 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd31c005bd0 0x7fd32c0c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.007 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.998+0000 7fd331334640 1 --2- 172.21.15.102:0/4260900329 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd32c15c4e0 0x7fd32c15c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.007 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.998+0000 7fd32bfff640 1 -- 172.21.15.102:0/4260900329 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd31c005bd0 msgr2=0x7fd32c0c7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.007 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.998+0000 7fd32bfff640 1 --2- 172.21.15.102:0/4260900329 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd31c005bd0 0x7fd32c0c7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.008 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.998+0000 7fd32bfff640 1 -- 172.21.15.102:0/4260900329 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd32c15c4e0 msgr2=0x7fd32c15c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.008 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.998+0000 7fd32bfff640 1 --2- 172.21.15.102:0/4260900329 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd32c15c4e0 0x7fd32c15c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.008 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.998+0000 7fd32bfff640 1 -- 172.21.15.102:0/4260900329 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32c0c84f0 con 0x7fd32c154460 2023-10-14T09:37:28.008 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.998+0000 7fd32bfff640 1 --2- 172.21.15.102:0/4260900329 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd32c154460 0x7fd32c0ad780 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd31800d7d0 tx=0x7fd31800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:28.008 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.999+0000 7fd3297fa640 1 -- 172.21.15.102:0/4260900329 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31800b6c0 con 0x7fd32c154460 2023-10-14T09:37:28.008 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.999+0000 7fd3297fa640 1 -- 172.21.15.102:0/4260900329 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31800b860 con 0x7fd32c154460 2023-10-14T09:37:28.009 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.999+0000 7fd332d97640 1 -- 172.21.15.102:0/4260900329 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd32c0c87d0 con 0x7fd32c154460 2023-10-14T09:37:28.009 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.999+0000 7fd3297fa640 1 -- 172.21.15.102:0/4260900329 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31800bc10 con 0x7fd32c154460 2023-10-14T09:37:28.009 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:27.999+0000 7fd332d97640 1 -- 172.21.15.102:0/4260900329 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd32c0adcc0 con 0x7fd32c154460 2023-10-14T09:37:28.009 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.000+0000 7fd332d97640 1 -- 172.21.15.102:0/4260900329 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd32c0c8a10 con 0x7fd32c154460 2023-10-14T09:37:28.009 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.001+0000 7fd3297fa640 1 -- 172.21.15.102:0/4260900329 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd31801e460 con 0x7fd32c154460 2023-10-14T09:37:28.010 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.002+0000 7fd3297fa640 1 --2- 172.21.15.102:0/4260900329 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd31006ae70 0x7fd31006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.011 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.002+0000 7fd3297fa640 1 -- 172.21.15.102:0/4260900329 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3180899e0 con 0x7fd32c154460 2023-10-14T09:37:28.011 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.002+0000 7fd330b33640 1 --2- 172.21.15.102:0/4260900329 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd31006ae70 0x7fd31006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.011 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.003+0000 7fd330b33640 1 --2- 172.21.15.102:0/4260900329 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd31006ae70 0x7fd31006d330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd320034000 tx=0x7fd320009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:28.011 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.007+0000 7fd3297fa640 1 -- 172.21.15.102:0/4260900329 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd318054b20 con 0x7fd32c154460 2023-10-14T09:37:28.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.197+0000 7fd332d97640 1 -- 172.21.15.102:0/4260900329 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd32c04e160 con 0x7fd32c154460 2023-10-14T09:37:28.201 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.200+0000 7fd3297fa640 1 -- 172.21.15.102:0/4260900329 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16541 (secure 0 0 0) 0x7fd3180073e0 con 0x7fd32c154460 2023-10-14T09:37:28.202 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:37:28.202 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":22,"fsid":"8a6cd69d-7f5b-4f2a-806a-0176c10aed50","created":"2023-10-14T09:36:56.745172+0000","modified":"2023-10-14T09:37:22.712469+0000","last_up_change":"2023-10-14T09:37:09.791473+0000","last_in_change":"2023-10-14T09:37:00.547186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:37:09.952407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:37:19.560925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:37:20.363385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e5aef8f3-878f-482b-b522-9a5b958b90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6801","nonce":1727250718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6803","nonce":1727250718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6807","nonce":1727250718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6805","nonce":1727250718}]},"public_addr":"172.21.15.102:6801/1727250718","cluster_addr":"172.21.15.102:6803/1727250718","heartbeat_back_addr":"172.21.15.102:6807/1727250718","heartbeat_front_addr":"172.21.15.102:6805/1727250718","state":["exists","up"]},{"osd":1,"uuid":"4a8cf50e-387b-4d47-9588-bd22e375a9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6809","nonce":1095651107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6811","nonce":1095651107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6815","nonce":1095651107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6813","nonce":1095651107}]},"public_addr":"172.21.15.102:6809/1095651107","cluster_addr":"172.21.15.102:6811/1095651107","heartbeat_back_addr":"172.21.15.102:6815/1095651107","heartbeat_front_addr":"172.21.15.102:6813/1095651107","state":["exists","up"]},{"osd":2,"uuid":"009ef55f-8a63-4219-bacd-d7c7b4500867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6820","nonce":2198222556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6825","nonce":2198222556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6831","nonce":2198222556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6829","nonce":2198222556}]},"public_addr":"172.21.15.102:6820/2198222556","cluster_addr":"172.21.15.102:6825/2198222556","heartbeat_back_addr":"172.21.15.102:6831/2198222556","heartbeat_front_addr":"172.21.15.102:6829/2198222556","state":["exists","up"]},{"osd":3,"uuid":"f2110eae-2ff9-4ed9-93d6-bd2361618211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6818","nonce":654726740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6821","nonce":654726740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6827","nonce":654726740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6823","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6824","nonce":654726740}]},"public_addr":"172.21.15.102:6818/654726740","cluster_addr":"172.21.15.102:6821/654726740","heartbeat_back_addr":"172.21.15.102:6827/654726740","heartbeat_front_addr":"172.21.15.102:6824/654726740","state":["exists","up"]},{"osd":4,"uuid":"33f1ae34-3100-40f7-9cb8-0eca2b358693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6817","nonce":507586170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6819","nonce":507586170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6823","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6825","nonce":507586170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6821","nonce":507586170}]},"public_addr":"172.21.15.129:6817/507586170","cluster_addr":"172.21.15.129:6819/507586170","heartbeat_back_addr":"172.21.15.129:6825/507586170","heartbeat_front_addr":"172.21.15.129:6821/507586170","state":["exists","up"]},{"osd":5,"uuid":"fab2fc62-3f3e-450d-93e0-770f39e80710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6801","nonce":1913451073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6803","nonce":1913451073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6807","nonce":1913451073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6805","nonce":1913451073}]},"public_addr":"172.21.15.129:6801/1913451073","cluster_addr":"172.21.15.129:6803/1913451073","heartbeat_back_addr":"172.21.15.129:6807/1913451073","heartbeat_front_addr":"172.21.15.129:6805/1913451073","state":["exists","up"]},{"osd":6,"uuid":"d7cc1d69-92e7-4253-a127-cfc0444a4809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6809","nonce":2853291511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6811","nonce":2853291511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6815","nonce":2853291511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6813","nonce":2853291511}]},"public_addr":"172.21.15.129:6809/2853291511","cluster_addr":"172.21.15.129:6811/2853291511","heartbeat_back_addr":"172.21.15.129:6815/2853291511","heartbeat_front_addr":"172.21.15.129:6813/2853291511","state":["exists","up"]},{"osd":7,"uuid":"1e403de1-09e2-4370-b9a7-e790ac44bbee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6824","nonce":2933886914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6827","nonce":2933886914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6831","nonce":2933886914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6829","nonce":2933886914}]},"public_addr":"172.21.15.129:6824/2933886914","cluster_addr":"172.21.15.129:6827/2933886914","heartbeat_back_addr":"172.21.15.129:6831/2933886914","heartbeat_front_addr":"172.21.15.129:6829/2933886914","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.849661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.868113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.933488+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.891794+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.901861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.858750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.911712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.996765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:37:28.204 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.202+0000 7fd332d97640 1 -- 172.21.15.102:0/4260900329 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd31006ae70 msgr2=0x7fd31006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.205 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.202+0000 7fd332d97640 1 --2- 172.21.15.102:0/4260900329 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd31006ae70 0x7fd31006d330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd320034000 tx=0x7fd320009030 comp rx=0 tx=0).stop 2023-10-14T09:37:28.205 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.202+0000 7fd332d97640 1 -- 172.21.15.102:0/4260900329 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd32c154460 msgr2=0x7fd32c0ad780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.205 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.202+0000 7fd332d97640 1 --2- 172.21.15.102:0/4260900329 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd32c154460 0x7fd32c0ad780 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd31800d7d0 tx=0x7fd31800dc90 comp rx=0 tx=0).stop 2023-10-14T09:37:28.205 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.202+0000 7fd332d97640 1 -- 172.21.15.102:0/4260900329 shutdown_connections 2023-10-14T09:37:28.206 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.202+0000 7fd332d97640 1 --2- 172.21.15.102:0/4260900329 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd31006ae70 0x7fd31006d330 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.206 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.202+0000 7fd332d97640 1 --2- 172.21.15.102:0/4260900329 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd32c15c4e0 0x7fd32c15c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.206 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.202+0000 7fd332d97640 1 --2- 172.21.15.102:0/4260900329 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd32c154460 0x7fd32c0ad780 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.206 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.202+0000 7fd332d97640 1 --2- 172.21.15.102:0/4260900329 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd31c005bd0 0x7fd32c0c7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.206 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.202+0000 7fd332d97640 1 -- 172.21.15.102:0/4260900329 >> 172.21.15.102:0/4260900329 conn(0x7fd32c0cb410 msgr2=0x7fd32c0cd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:28.207 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.203+0000 7fd332d97640 1 -- 172.21.15.102:0/4260900329 shutdown_connections 2023-10-14T09:37:28.207 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.203+0000 7fd332d97640 1 -- 172.21.15.102:0/4260900329 wait complete. 2023-10-14T09:37:28.225 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-14T09:37:28.226 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-14T09:37:28.227 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-14T09:37:28.228 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-14T09:37:28.228 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-14T09:37:28.229 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-14T09:37:28.229 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-14T09:37:28.230 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-14T09:37:28.532 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.530+0000 7f0f0fc4b640 1 Processor -- start 2023-10-14T09:37:28.534 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.530+0000 7f0f0fc4b640 1 -- start start 2023-10-14T09:37:28.535 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.532+0000 7f0f0fc4b640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0f00006b70 0x7f0f00053c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.535 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.532+0000 7f0f0fc4b640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f0f00054190 0x7f0f00057720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.535 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.532+0000 7f0f0fc4b640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f0003c070 con 0x7f0f000e3070 2023-10-14T09:37:28.535 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.532+0000 7f0f0fc4b640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f00054620 con 0x7f0f00054190 2023-10-14T09:37:28.535 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.532+0000 7f0f0fc4b640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f000070f0 con 0x7f0f00006b70 2023-10-14T09:37:28.536 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.533+0000 7f0f0d9e7640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f0f000e3070 0x7f0f0003ea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:45630/0 (socket says 172.21.15.102:45630) 2023-10-14T09:37:28.536 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.534+0000 7f0f0d9e7640 1 -- 172.21.15.102:0/3250168406 learned_addr learned my addr 172.21.15.102:0/3250168406 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:28.537 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.534+0000 7f0f0d1e6640 1 --2- 172.21.15.102:0/3250168406 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0f00006b70 0x7f0f00053c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.537 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.534+0000 7f0f0e1e8640 1 --2- 172.21.15.102:0/3250168406 >> v2:172.21.15.129:3300/0 conn(0x7f0f00054190 0x7f0f00057720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.537 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.535+0000 7f0f0d1e6640 1 -- 172.21.15.102:0/3250168406 >> v2:172.21.15.129:3300/0 conn(0x7f0f00054190 msgr2=0x7f0f00057720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:28.537 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.535+0000 7f5bfb0d0640 1 Processor -- start 2023-10-14T09:37:28.538 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.535+0000 7f0f0d1e6640 1 --2- 172.21.15.102:0/3250168406 >> v2:172.21.15.129:3300/0 conn(0x7f0f00054190 0x7f0f00057720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.538 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.535+0000 7f0f0d1e6640 1 -- 172.21.15.102:0/3250168406 >> v1:172.21.15.102:6789/0 conn(0x7f0f000e3070 legacy=0x7f0f0003ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.538 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.535+0000 7f0f0d1e6640 1 -- 172.21.15.102:0/3250168406 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f000073b0 con 0x7f0f00006b70 2023-10-14T09:37:28.539 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.535+0000 7f5bfb0d0640 1 -- start start 2023-10-14T09:37:28.539 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.536+0000 7f0f0d1e6640 1 --2- 172.21.15.102:0/3250168406 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0f00006b70 0x7f0f00053c50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0ef80097a0 tx=0x7f0ef802b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8d27eb703b5d27 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:28.540 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.537+0000 7f5bfb0d0640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f5bf415d030 0x7f5bf40d1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.540 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.537+0000 7f5bfb0d0640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5bf40cd260 0x7f5bf40cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.540 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.537+0000 7f5bfb0d0640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf40b5d90 con 0x7f5bf415d410 2023-10-14T09:37:28.540 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.537+0000 7f5bfb0d0640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf40d2b50 con 0x7f5bf415d030 2023-10-14T09:37:28.541 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.537+0000 7f5bfb0d0640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf40cdbf0 con 0x7f5bf40cd260 2023-10-14T09:37:28.541 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.537+0000 7f36bdeda640 1 Processor -- start 2023-10-14T09:37:28.541 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.537+0000 7f36bdeda640 1 -- start start 2023-10-14T09:37:28.542 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.539+0000 7f0f0c9e5640 1 -- 172.21.15.102:0/3250168406 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef8031760 con 0x7f0f00006b70 2023-10-14T09:37:28.542 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.538+0000 7f5bf8e6c640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f5bf415d030 0x7f5bf40d1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.542 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.538+0000 7f5bf966d640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5bf40cd260 0x7f5bf40cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.543 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.538+0000 7f5bf8e6c640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f5bf415d030 0x7f5bf40d1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.102:57570/0 (socket says 172.21.15.102:57570) 2023-10-14T09:37:28.543 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.538+0000 7f5bf8e6c640 1 -- 172.21.15.102:0/556434105 learned_addr learned my addr 172.21.15.102:0/556434105 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:28.543 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.538+0000 7f5bf966d640 1 -- 172.21.15.102:0/556434105 >> v2:172.21.15.129:3300/0 conn(0x7f5bf415d030 msgr2=0x7f5bf40d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:28.543 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.538+0000 7f5bf966d640 1 --2- 172.21.15.102:0/556434105 >> v2:172.21.15.129:3300/0 conn(0x7f5bf415d030 0x7f5bf40d1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.543 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.538+0000 7f5bf966d640 1 -- 172.21.15.102:0/556434105 >> v1:172.21.15.129:6789/0 conn(0x7f5bf415d410 legacy=0x7f5bf4161450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.543 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.538+0000 7f5bf966d640 1 -- 172.21.15.102:0/556434105 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf4160fc0 con 0x7f5bf40cd260 2023-10-14T09:37:28.544 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.538+0000 7f5bf8e6c640 1 --2- 172.21.15.102:0/556434105 >> v2:172.21.15.129:3300/0 conn(0x7f5bf415d030 0x7f5bf40d1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:37:28.544 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.539+0000 7f0f0c9e5640 1 -- 172.21.15.102:0/3250168406 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef80318c0 con 0x7f0f00006b70 2023-10-14T09:37:28.544 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.540+0000 7f0f0c9e5640 1 -- 172.21.15.102:0/3250168406 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef8031c50 con 0x7f0f00006b70 2023-10-14T09:37:28.545 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.539+0000 7f36bdeda640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f36b80ad920 0x7f36b80add00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.545 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.540+0000 7f36bdeda640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f36b80ce2b0 0x7f36b8069da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.545 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.540+0000 7f36bdeda640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f36b806a2e0 0x7f36b81651d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.545 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.540+0000 7f36bdeda640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b806c000 con 0x7f36b80ce2b0 2023-10-14T09:37:28.546 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.540+0000 7f36bdeda640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b806a770 con 0x7f36b806a2e0 2023-10-14T09:37:28.546 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.540+0000 7f36bdeda640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b806ba40 con 0x7f36b80ad920 2023-10-14T09:37:28.546 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.540+0000 7f5bf966d640 1 --2- 172.21.15.102:0/556434105 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5bf40cd260 0x7f5bf40cd6b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc0097a0 tx=0x7f5bdc02b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7f3bb9fc57a9aaa server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:28.547 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.540+0000 7f413359e640 1 Processor -- start 2023-10-14T09:37:28.547 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.541+0000 7f413359e640 1 -- start start 2023-10-14T09:37:28.547 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.540+0000 7f36b6ffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f36b80ce2b0 0x7f36b8069da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.548 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.540+0000 7f36b6ffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f36b80ce2b0 0x7f36b8069da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44700/0 (socket says 172.21.15.102:44700) 2023-10-14T09:37:28.548 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.540+0000 7f36b6ffd640 1 -- 172.21.15.102:0/1143100854 learned_addr learned my addr 172.21.15.102:0/1143100854 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:28.548 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.541+0000 7f36b7fff640 1 --2- 172.21.15.102:0/1143100854 >> v2:172.21.15.129:3300/0 conn(0x7f36b806a2e0 0x7f36b81651d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.548 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.541+0000 7f0f0fc4b640 1 -- 172.21.15.102:0/3250168406 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0f00006b70 msgr2=0x7f0f00053c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.549 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.541+0000 7f0f0fc4b640 1 --2- 172.21.15.102:0/3250168406 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0f00006b70 0x7f0f00053c50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0ef80097a0 tx=0x7f0ef802b800 comp rx=0 tx=0).stop 2023-10-14T09:37:28.549 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.541+0000 7f5bf37fe640 1 -- 172.21.15.102:0/556434105 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc030610 con 0x7f5bf40cd260 2023-10-14T09:37:28.549 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.541+0000 7f5bf37fe640 1 -- 172.21.15.102:0/556434105 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bdc030770 con 0x7f5bf40cd260 2023-10-14T09:37:28.550 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.541+0000 7f5bf37fe640 1 -- 172.21.15.102:0/556434105 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc030b00 con 0x7f5bf40cd260 2023-10-14T09:37:28.550 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.541+0000 7f36b6ffd640 1 -- 172.21.15.102:0/1143100854 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f36b80ad920 msgr2=0x7f36b80add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:28.550 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.541+0000 7f36b6ffd640 1 --2- 172.21.15.102:0/1143100854 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f36b80ad920 0x7f36b80add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.541+0000 7f36b6ffd640 1 -- 172.21.15.102:0/1143100854 >> v2:172.21.15.129:3300/0 conn(0x7f36b806a2e0 msgr2=0x7f36b81651d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:28.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.541+0000 7f36b6ffd640 1 --2- 172.21.15.102:0/1143100854 >> v2:172.21.15.129:3300/0 conn(0x7f36b806a2e0 0x7f36b81651d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.541+0000 7f36b6ffd640 1 -- 172.21.15.102:0/1143100854 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b806bd20 con 0x7f36b80ce2b0 2023-10-14T09:37:28.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.542+0000 7f36b6ffd640 1 --2- 172.21.15.102:0/1143100854 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36b80ce2b0 0x7f36b8069da0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f36b8071780 tx=0x7f36ac02b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ee22869480e5e63 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:28.552 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.543+0000 7f5bfb0d0640 1 -- 172.21.15.102:0/556434105 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5bf40cd260 msgr2=0x7f5bf40cd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.552 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.543+0000 7f5bfb0d0640 1 --2- 172.21.15.102:0/556434105 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5bf40cd260 0x7f5bf40cd6b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc0097a0 tx=0x7f5bdc02b960 comp rx=0 tx=0).stop 2023-10-14T09:37:28.552 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.543+0000 7f36b67fc640 1 -- 172.21.15.102:0/1143100854 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac031880 con 0x7f36b80ce2b0 2023-10-14T09:37:28.553 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.542+0000 7f413359e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f41340ca830 0x7f4134070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.553 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.542+0000 7f413359e640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f4134070780 0x7f413406bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.553 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.543+0000 7f413359e640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41340ca3a0 con 0x7f41341573e0 2023-10-14T09:37:28.553 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.543+0000 7f413359e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4134070c10 con 0x7f41340ca830 2023-10-14T09:37:28.554 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.543+0000 7f413359e640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41340c9d70 con 0x7f4134070780 2023-10-14T09:37:28.554 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.543+0000 7f5bfb0d0640 1 -- 172.21.15.102:0/556434105 shutdown_connections 2023-10-14T09:37:28.554 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.543+0000 7f5bfb0d0640 1 --2- 172.21.15.102:0/556434105 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5bf40cd260 0x7f5bf40cd6b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.554 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.543+0000 7f5bfb0d0640 1 --2- 172.21.15.102:0/556434105 >> v2:172.21.15.129:3300/0 conn(0x7f5bf415d030 0x7f5bf40d1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.543+0000 7f5bfb0d0640 1 -- 172.21.15.102:0/556434105 >> 172.21.15.102:0/556434105 conn(0x7f5bf40cf720 msgr2=0x7f5bf40cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:28.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.543+0000 7fe707c1a640 1 Processor -- start 2023-10-14T09:37:28.556 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.543+0000 7f36b67fc640 1 -- 172.21.15.102:0/1143100854 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ac0319e0 con 0x7f36b80ce2b0 2023-10-14T09:37:28.556 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.543+0000 7f36b67fc640 1 -- 172.21.15.102:0/1143100854 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac031d70 con 0x7f36b80ce2b0 2023-10-14T09:37:28.556 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.543+0000 7fe707c1a640 1 -- start start 2023-10-14T09:37:28.557 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.543+0000 7f5bfb0d0640 1 -- 172.21.15.102:0/556434105 shutdown_connections 2023-10-14T09:37:28.557 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.544+0000 7f0f0fc4b640 1 -- 172.21.15.102:0/3250168406 shutdown_connections 2023-10-14T09:37:28.557 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.544+0000 7f0f0fc4b640 1 --2- 172.21.15.102:0/3250168406 >> v2:172.21.15.129:3300/0 conn(0x7f0f00054190 0x7f0f00057720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.557 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.544+0000 7f0f0fc4b640 1 --2- 172.21.15.102:0/3250168406 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0f00006b70 0x7f0f00053c50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.558 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.544+0000 7f0f0fc4b640 1 -- 172.21.15.102:0/3250168406 >> 172.21.15.102:0/3250168406 conn(0x7f0f00055a90 msgr2=0x7f0f00055e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:28.558 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.544+0000 7f413259c640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f41341573e0 0x7f4134159e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.102:35428/0 (socket says 172.21.15.102:35428) 2023-10-14T09:37:28.559 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.544+0000 7f36bdeda640 1 -- 172.21.15.102:0/1143100854 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36b80ce2b0 msgr2=0x7f36b8069da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.559 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.544+0000 7f36bdeda640 1 --2- 172.21.15.102:0/1143100854 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36b80ce2b0 0x7f36b8069da0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f36b8071780 tx=0x7f36ac02b920 comp rx=0 tx=0).stop 2023-10-14T09:37:28.559 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.544+0000 7f4132d9d640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f4134070780 0x7f413406bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.560 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.544+0000 7f0f0fc4b640 1 -- 172.21.15.102:0/3250168406 shutdown_connections 2023-10-14T09:37:28.560 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.544+0000 7f4132d9d640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f4134070780 0x7f413406bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.102:57584/0 (socket says 172.21.15.102:57584) 2023-10-14T09:37:28.560 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.544+0000 7f413259c640 1 -- 172.21.15.102:0/2851161630 learned_addr learned my addr 172.21.15.102:0/2851161630 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:28.561 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.544+0000 7f4129d9b640 1 --2- 172.21.15.102:0/2851161630 >> v2:172.21.15.102:3300/0 conn(0x7f41340ca830 0x7f4134070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.561 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.544+0000 7f36bdeda640 1 -- 172.21.15.102:0/1143100854 shutdown_connections 2023-10-14T09:37:28.561 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.544+0000 7f36bdeda640 1 --2- 172.21.15.102:0/1143100854 >> v2:172.21.15.129:3300/0 conn(0x7f36b806a2e0 0x7f36b81651d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.561 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.544+0000 7f36bdeda640 1 --2- 172.21.15.102:0/1143100854 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36b80ce2b0 0x7f36b8069da0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.562 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.544+0000 7f36bdeda640 1 --2- 172.21.15.102:0/1143100854 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f36b80ad920 0x7f36b80add00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.562 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.544+0000 7f36bdeda640 1 -- 172.21.15.102:0/1143100854 >> 172.21.15.102:0/1143100854 conn(0x7f36b80ce9b0 msgr2=0x7f36b80cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:28.562 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.543+0000 7f5bfb0d0640 1 -- 172.21.15.102:0/556434105 wait complete. 2023-10-14T09:37:28.563 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.545+0000 7f4131d9b640 1 -- 172.21.15.102:0/2851161630 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 27782452 0 0) 0x7f41340ca3a0 con 0x7f41341573e0 2023-10-14T09:37:28.563 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.545+0000 7f4131d9b640 1 -- 172.21.15.102:0/2851161630 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4120003520 con 0x7f41341573e0 2023-10-14T09:37:28.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.545+0000 7fe707c1a640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe7000addb0 0x7fe7000caa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.545+0000 7fe707c1a640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fe70006a4b0 0x7fe7001650d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.545+0000 7fe707c1a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7000cb140 con 0x7fe7000c9000 2023-10-14T09:37:28.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.545+0000 7fe707c1a640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe700161a50 con 0x7fe70006a4b0 2023-10-14T09:37:28.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.545+0000 7fe707c1a640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70006b030 con 0x7fe7000addb0 2023-10-14T09:37:28.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.546+0000 7fe7059b6640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe7000addb0 0x7fe7000caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.546+0000 7fe7059b6640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe7000addb0 0x7fe7000caa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.102:60456/0 (socket says 172.21.15.102:60456) 2023-10-14T09:37:28.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.546+0000 7fe7059b6640 1 -- 172.21.15.102:0/2438821174 learned_addr learned my addr 172.21.15.102:0/2438821174 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:28.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.546+0000 7f4129d9b640 1 -- 172.21.15.102:0/2851161630 >> v2:172.21.15.129:3300/0 conn(0x7f4134070780 msgr2=0x7f413406bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:28.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.546+0000 7f4129d9b640 1 --2- 172.21.15.102:0/2851161630 >> v2:172.21.15.129:3300/0 conn(0x7f4134070780 0x7f413406bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.546+0000 7f4129d9b640 1 -- 172.21.15.102:0/2851161630 >> v1:172.21.15.129:6789/0 conn(0x7f41341573e0 legacy=0x7f4134159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.546+0000 7f36bdeda640 1 -- 172.21.15.102:0/1143100854 shutdown_connections 2023-10-14T09:37:28.567 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.546+0000 7f36bdeda640 1 -- 172.21.15.102:0/1143100854 wait complete. 2023-10-14T09:37:28.567 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.544+0000 7f0f0fc4b640 1 -- 172.21.15.102:0/3250168406 wait complete. 2023-10-14T09:37:28.567 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.546+0000 7f0f0fc4b640 1 Processor -- start 2023-10-14T09:37:28.567 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.547+0000 7f0f0fc4b640 1 -- start start 2023-10-14T09:37:28.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.547+0000 7fe7059b6640 1 -- 172.21.15.102:0/2438821174 >> v2:172.21.15.129:3300/0 conn(0x7fe70006a4b0 msgr2=0x7fe7001650d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:28.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.547+0000 7fe7059b6640 1 --2- 172.21.15.102:0/2438821174 >> v2:172.21.15.129:3300/0 conn(0x7fe70006a4b0 0x7fe7001650d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.547+0000 7fe7059b6640 1 -- 172.21.15.102:0/2438821174 >> v1:172.21.15.102:6789/0 conn(0x7fe7000c9000 legacy=0x7fe700069da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:28.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.547+0000 7fe7059b6640 1 -- 172.21.15.102:0/2438821174 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70006b310 con 0x7fe7000addb0 2023-10-14T09:37:28.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.547+0000 7f5bfb0d0640 1 Processor -- start 2023-10-14T09:37:28.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.548+0000 7f5bfb0d0640 1 -- start start 2023-10-14T09:37:28.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.546+0000 7f4129d9b640 1 -- 172.21.15.102:0/2851161630 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f413415a9a0 con 0x7f41340ca830 2023-10-14T09:37:28.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.547+0000 7f4132d9d640 1 --2- 172.21.15.102:0/2851161630 >> v2:172.21.15.129:3300/0 conn(0x7f4134070780 0x7f413406bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:37:28.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.548+0000 7f36bdeda640 1 Processor -- start 2023-10-14T09:37:28.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.549+0000 7fe7059b6640 1 --2- 172.21.15.102:0/2438821174 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe7000addb0 0x7fe7000caa80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0009870 tx=0x7fe6f002b9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2dac650c6bbdd21 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:28.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.549+0000 7f0f0fc4b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f00006b70 0x7f0f00182ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.549+0000 7f4129d9b640 1 --2- 172.21.15.102:0/2851161630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41340ca830 0x7f4134070240 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f41340ca310 tx=0x7f411c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c99830d126fc6eb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:28.572 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.549+0000 7f0f0fc4b640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0f00054190 0x7f0f0004b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.572 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.549+0000 7f5bfb0d0640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5bf40cd260 0x7f5bf41597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.572 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.549+0000 7f5bfb0d0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5bf415d030 0x7f5bf40cb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.573 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.549+0000 7f5bfb0d0640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5bf415d410 0x7f5bf40b6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.573 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.549+0000 7f4131d9b640 1 -- 172.21.15.102:0/2851161630 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c031640 con 0x7f41340ca830 2023-10-14T09:37:28.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.549+0000 7f5bfb0d0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf40cc050 con 0x7f5bf415d030 2023-10-14T09:37:28.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.549+0000 7f5bfb0d0640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf40c6740 con 0x7f5bf40cd260 2023-10-14T09:37:28.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.549+0000 7f5bfb0d0640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf40c6a20 con 0x7f5bf415d410 2023-10-14T09:37:28.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.549+0000 7f36bdeda640 1 -- start start 2023-10-14T09:37:28.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.549+0000 7f4131d9b640 1 -- 172.21.15.102:0/2851161630 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411c0317a0 con 0x7f41340ca830 2023-10-14T09:37:28.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.549+0000 7f4131d9b640 1 -- 172.21.15.102:0/2851161630 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c031b70 con 0x7f41340ca830 2023-10-14T09:37:28.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.549+0000 7fb099568640 1 Processor -- start 2023-10-14T09:37:28.576 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.549+0000 7f0f0fc4b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f000e3070 0x7f0f000e1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.576 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.550+0000 7f0f0d9e7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f00006b70 0x7f0f00182ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.576 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.550+0000 7f0f0d9e7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f00006b70 0x7f0f00182ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.102:57608/0 (socket says 172.21.15.102:57608) 2023-10-14T09:37:28.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.550+0000 7f5bf3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5bf415d030 0x7f5bf40cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.550+0000 7fb099568640 1 -- start start 2023-10-14T09:37:28.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.550+0000 7f5bf3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5bf415d030 0x7f5bf40cb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44716/0 (socket says 172.21.15.102:44716) 2023-10-14T09:37:28.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.550+0000 7f5bf966d640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5bf415d410 0x7f5bf40b6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.550+0000 7f5bf3fff640 1 -- 172.21.15.102:0/785894762 learned_addr learned my addr 172.21.15.102:0/785894762 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:28.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.550+0000 7fe7049b4640 1 -- 172.21.15.102:0/2438821174 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f0030860 con 0x7fe7000addb0 2023-10-14T09:37:28.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.550+0000 7f5bf8e6c640 1 --2- 172.21.15.102:0/785894762 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5bf40cd260 0x7f5bf41597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.550+0000 7fe7049b4640 1 -- 172.21.15.102:0/2438821174 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f00309c0 con 0x7fe7000addb0 2023-10-14T09:37:28.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.550+0000 7fe7049b4640 1 -- 172.21.15.102:0/2438821174 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f0030d50 con 0x7fe7000addb0 2023-10-14T09:37:28.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.550+0000 7f26120aa640 1 Processor -- start 2023-10-14T09:37:28.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.550+0000 7f413359e640 1 -- 172.21.15.102:0/2851161630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41340ca830 msgr2=0x7f4134070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.550+0000 7f413359e640 1 --2- 172.21.15.102:0/2851161630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41340ca830 0x7f4134070240 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f41340ca310 tx=0x7f411c02b8f0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.551+0000 7f0f0e1e8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f000e3070 0x7f0f000e1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.551+0000 7f0f0e1e8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f000e3070 0x7f0f000e1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44720/0 (socket says 172.21.15.102:44720) 2023-10-14T09:37:28.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.550+0000 7f5bf3fff640 1 -- 172.21.15.102:0/785894762 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5bf415d410 msgr2=0x7f5bf40b6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.550+0000 7f5bf3fff640 1 --2- 172.21.15.102:0/785894762 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5bf415d410 0x7f5bf40b6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.550+0000 7f5bf3fff640 1 -- 172.21.15.102:0/785894762 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5bf40cd260 msgr2=0x7f5bf41597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.550+0000 7f5bf3fff640 1 --2- 172.21.15.102:0/785894762 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5bf40cd260 0x7f5bf41597d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.550+0000 7f5bf3fff640 1 -- 172.21.15.102:0/785894762 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec0094d0 con 0x7f5bf415d030 2023-10-14T09:37:28.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.551+0000 7f0f0d9e7640 1 -- 172.21.15.102:0/2726590707 learned_addr learned my addr 172.21.15.102:0/2726590707 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:28.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.551+0000 7f0f0d1e6640 1 --2- 172.21.15.102:0/2726590707 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0f00054190 0x7f0f0004b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.551+0000 7f0f0fc4b640 1 -- 172.21.15.102:0/2726590707 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0004e060 con 0x7f0f000e3070 2023-10-14T09:37:28.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.551+0000 7f0f0fc4b640 1 -- 172.21.15.102:0/2726590707 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f00186620 con 0x7f0f00006b70 2023-10-14T09:37:28.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.551+0000 7f0f0fc4b640 1 -- 172.21.15.102:0/2726590707 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f00185aa0 con 0x7f0f00054190 2023-10-14T09:37:28.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.551+0000 7f413359e640 1 -- 172.21.15.102:0/2851161630 shutdown_connections 2023-10-14T09:37:28.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.551+0000 7f413359e640 1 --2- 172.21.15.102:0/2851161630 >> v2:172.21.15.129:3300/0 conn(0x7f4134070780 0x7f413406bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.551+0000 7f413359e640 1 --2- 172.21.15.102:0/2851161630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41340ca830 0x7f4134070240 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.551+0000 7f413359e640 1 -- 172.21.15.102:0/2851161630 >> 172.21.15.102:0/2851161630 conn(0x7f41340cc230 msgr2=0x7f41340cc610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:28.586 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.551+0000 7fe707c1a640 1 -- 172.21.15.102:0/2438821174 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe7000addb0 msgr2=0x7fe7000caa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.586 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.551+0000 7fe707c1a640 1 --2- 172.21.15.102:0/2438821174 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe7000addb0 0x7fe7000caa80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0009870 tx=0x7fe6f002b9a0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.586 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.551+0000 7f413359e640 1 -- 172.21.15.102:0/2851161630 shutdown_connections 2023-10-14T09:37:28.587 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.550+0000 7f26120aa640 1 -- start start 2023-10-14T09:37:28.587 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.551+0000 7f0f0e1e8640 1 -- 172.21.15.102:0/2726590707 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0f00054190 msgr2=0x7f0f0004b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.588 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.551+0000 7fe707c1a640 1 -- 172.21.15.102:0/2438821174 shutdown_connections 2023-10-14T09:37:28.588 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.551+0000 7fe707c1a640 1 --2- 172.21.15.102:0/2438821174 >> v2:172.21.15.129:3300/0 conn(0x7fe70006a4b0 0x7fe7001650d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.588 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.551+0000 7fe707c1a640 1 --2- 172.21.15.102:0/2438821174 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe7000addb0 0x7fe7000caa80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.588 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.551+0000 7fe707c1a640 1 -- 172.21.15.102:0/2438821174 >> 172.21.15.102:0/2438821174 conn(0x7fe7000ce9b0 msgr2=0x7fe7000cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:28.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.552+0000 7fb099568640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb0940cf710 0x7fb0940b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.552+0000 7fb099568640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fb0940b6cd0 0x7fb0940b3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.552+0000 7fb099568640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0940d3980 con 0x7fb0940cfaf0 2023-10-14T09:37:28.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.552+0000 7fb099568640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0940d3c60 con 0x7fb0940cf710 2023-10-14T09:37:28.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.552+0000 7fb099568640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0940ce630 con 0x7fb0940b6cd0 2023-10-14T09:37:28.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.552+0000 7f36bdeda640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f36b806a2e0 0x7f36b815b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.552+0000 7f0f0e1e8640 1 --2- 172.21.15.102:0/2726590707 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0f00054190 0x7f0f0004b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.552+0000 7f0f0e1e8640 1 -- 172.21.15.102:0/2726590707 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f00006b70 msgr2=0x7f0f00182ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.552+0000 7f0f0e1e8640 1 --2- 172.21.15.102:0/2726590707 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f00006b70 0x7f0f00182ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.552+0000 7f0f0e1e8640 1 -- 172.21.15.102:0/2726590707 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef8009400 con 0x7f0f000e3070 2023-10-14T09:37:28.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.551+0000 7f413359e640 1 -- 172.21.15.102:0/2851161630 wait complete. 2023-10-14T09:37:28.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.552+0000 7fe707c1a640 1 -- 172.21.15.102:0/2438821174 shutdown_connections 2023-10-14T09:37:28.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.552+0000 7f36bdeda640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36b80ad920 0x7f36b815e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.593 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.552+0000 7fb092ffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb0940cf710 0x7fb0940b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.593 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.552+0000 7fe707c1a640 1 -- 172.21.15.102:0/2438821174 wait complete. 2023-10-14T09:37:28.594 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.553+0000 7f36bdeda640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f36b80ce2b0 0x7f36b80c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.594 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.552+0000 7fb092ffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb0940cf710 0x7fb0940b2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44726/0 (socket says 172.21.15.102:44726) 2023-10-14T09:37:28.594 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.552+0000 7fb092ffd640 1 -- 172.21.15.102:0/1568199068 learned_addr learned my addr 172.21.15.102:0/1568199068 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:28.595 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.553+0000 7f36bdeda640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b81fb4f0 con 0x7f36b80ad920 2023-10-14T09:37:28.595 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.553+0000 7fb092ffd640 1 -- 172.21.15.102:0/1568199068 >> v2:172.21.15.129:3300/0 conn(0x7fb0940b6cd0 msgr2=0x7fb0940b3250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T09:37:28.596 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.553+0000 7fb092ffd640 1 --2- 172.21.15.102:0/1568199068 >> v2:172.21.15.129:3300/0 conn(0x7fb0940b6cd0 0x7fb0940b3250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.596 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.553+0000 7fb092ffd640 1 -- 172.21.15.102:0/1568199068 >> v1:172.21.15.129:6789/0 conn(0x7fb0940cfaf0 legacy=0x7fb0940d0aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T09:37:28.596 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.553+0000 7fb092ffd640 1 -- 172.21.15.102:0/1568199068 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0940ce910 con 0x7fb0940cf710 2023-10-14T09:37:28.596 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.553+0000 7f36bdeda640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b81fa970 con 0x7f36b80ce2b0 2023-10-14T09:37:28.597 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.553+0000 7f36bdeda640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b81fac50 con 0x7f36b806a2e0 2023-10-14T09:37:28.597 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.553+0000 7f0f0e1e8640 1 --2- 172.21.15.102:0/2726590707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f000e3070 0x7f0f000e1460 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0f0804fa60 tx=0x7f0f080671b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:28.597 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.553+0000 7f0f0d9e7640 1 --2- 172.21.15.102:0/2726590707 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f00006b70 0x7f0f00182ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:37:28.598 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.553+0000 7f0efe7fc640 1 -- 172.21.15.102:0/2726590707 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0808f6a0 con 0x7f0f000e3070 2023-10-14T09:37:28.598 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.553+0000 7f36b77fe640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f36b806a2e0 0x7f36b815b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.598 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.553+0000 7f36b6ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36b80ad920 0x7f36b815e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.598 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.553+0000 7f36b77fe640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f36b806a2e0 0x7f36b815b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.102:60496/0 (socket says 172.21.15.102:60496) 2023-10-14T09:37:28.599 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.553+0000 7f36b77fe640 1 -- 172.21.15.102:0/2765185294 learned_addr learned my addr 172.21.15.102:0/2765185294 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:28.599 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.553+0000 7f0efe7fc640 1 -- 172.21.15.102:0/2726590707 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f0808f800 con 0x7f0f000e3070 2023-10-14T09:37:28.599 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.553+0000 7f36b7fff640 1 --2- 172.21.15.102:0/2765185294 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f36b80ce2b0 0x7f36b80c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.553+0000 7f36b6ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36b80ad920 0x7f36b815e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44742/0 (socket says 172.21.15.102:44742) 2023-10-14T09:37:28.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.553+0000 7f0f0fc4b640 1 -- 172.21.15.102:0/2726590707 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f00185d80 con 0x7f0f000e3070 2023-10-14T09:37:28.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.553+0000 7f0f0d1e6640 1 --2- 172.21.15.102:0/2726590707 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0f00054190 0x7f0f0004b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:28.601 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.554+0000 7f0f0fc4b640 1 -- 172.21.15.102:0/2726590707 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f00186340 con 0x7f0f000e3070 2023-10-14T09:37:28.601 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.552+0000 7f5bf3fff640 1 --2- 172.21.15.102:0/785894762 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5bf415d030 0x7f5bf40cb670 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5be400c780 tx=0x7f5be400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:28.601 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.553+0000 7f5bf17fa640 1 -- 172.21.15.102:0/785894762 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be4003b90 con 0x7f5bf415d030 2023-10-14T09:37:28.601 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.553+0000 7f5bf17fa640 1 -- 172.21.15.102:0/785894762 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be400ce90 con 0x7f5bf415d030 2023-10-14T09:37:28.602 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.553+0000 7f5bf17fa640 1 -- 172.21.15.102:0/785894762 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be400a850 con 0x7f5bf415d030 2023-10-14T09:37:28.602 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.554+0000 7f413359e640 1 Processor -- start 2023-10-14T09:37:28.602 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.554+0000 7f413359e640 1 -- start start 2023-10-14T09:37:28.603 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.554+0000 7f36b7fff640 1 -- 172.21.15.102:0/2765185294 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f36b806a2e0 msgr2=0x7f36b815b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.603 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.554+0000 7f36b7fff640 1 --2- 172.21.15.102:0/2765185294 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f36b806a2e0 0x7f36b815b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.603 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.554+0000 7f36b7fff640 1 -- 172.21.15.102:0/2765185294 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36b80ad920 msgr2=0x7f36b815e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.604 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.554+0000 7f36b7fff640 1 --2- 172.21.15.102:0/2765185294 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36b80ad920 0x7f36b815e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.604 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.554+0000 7f36b7fff640 1 -- 172.21.15.102:0/2765185294 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac0094d0 con 0x7f36b80ce2b0 2023-10-14T09:37:28.604 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.555+0000 7f36b6ffd640 1 --2- 172.21.15.102:0/2765185294 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36b80ad920 0x7f36b815e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:37:28.604 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.555+0000 7f36b7fff640 1 --2- 172.21.15.102:0/2765185294 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f36b80ce2b0 0x7f36b80c7c50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f36b0007cf0 tx=0x7f36b000e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:28.605 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.555+0000 7fb092ffd640 1 --2- 172.21.15.102:0/1568199068 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0940cf710 0x7fb0940b2d10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb0940b5890 tx=0x7fb08402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=273c80654d3177bd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:28.605 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.554+0000 7f0efe7fc640 1 -- 172.21.15.102:0/2726590707 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0808fbb0 con 0x7f0f000e3070 2023-10-14T09:37:28.605 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.555+0000 7f0f0fc4b640 1 -- 172.21.15.102:0/2726590707 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0ef0000fc0 con 0x7f0f000e3070 2023-10-14T09:37:28.606 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.555+0000 7f5bfb0d0640 1 -- 172.21.15.102:0/785894762 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bdc009400 con 0x7f5bf415d030 2023-10-14T09:37:28.606 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.555+0000 7f5bfb0d0640 1 -- 172.21.15.102:0/785894762 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf40c6fe0 con 0x7f5bf415d030 2023-10-14T09:37:28.606 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.556+0000 7f413359e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4134070780 0x7f41340c9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.606 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.556+0000 7f413359e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41340ca830 0x7f41341579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.607 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.556+0000 7f413359e640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f41341573e0 0x7f4134157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.607 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.556+0000 7f413359e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41340c8df0 con 0x7f41340ca830 2023-10-14T09:37:28.607 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.556+0000 7f413359e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4134158450 con 0x7f4134070780 2023-10-14T09:37:28.607 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.556+0000 7f413359e640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f413406db70 con 0x7f41341573e0 2023-10-14T09:37:28.608 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.556+0000 7fb091ffb640 1 -- 172.21.15.102:0/1568199068 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb084004230 con 0x7fb0940cf710 2023-10-14T09:37:28.608 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.556+0000 7fb091ffb640 1 -- 172.21.15.102:0/1568199068 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb084004390 con 0x7fb0940cf710 2023-10-14T09:37:28.608 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.556+0000 7fb091ffb640 1 -- 172.21.15.102:0/1568199068 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb084003810 con 0x7fb0940cf710 2023-10-14T09:37:28.609 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.556+0000 7f36b77fe640 1 --2- 172.21.15.102:0/2765185294 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f36b806a2e0 0x7f36b815b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:28.609 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.556+0000 7f369ffff640 1 -- 172.21.15.102:0/2765185294 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b0018070 con 0x7f36b80ce2b0 2023-10-14T09:37:28.609 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.556+0000 7f369ffff640 1 -- 172.21.15.102:0/2765185294 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b000edd0 con 0x7f36b80ce2b0 2023-10-14T09:37:28.609 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.556+0000 7f369ffff640 1 -- 172.21.15.102:0/2765185294 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b0003bd0 con 0x7f36b80ce2b0 2023-10-14T09:37:28.610 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.556+0000 7f0efe7fc640 1 -- 172.21.15.102:0/2726590707 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0f0808fd10 con 0x7f0f000e3070 2023-10-14T09:37:28.610 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.556+0000 7f36bdeda640 1 -- 172.21.15.102:0/2765185294 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b81faf30 con 0x7f36b80ce2b0 2023-10-14T09:37:28.610 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.557+0000 7f36bdeda640 1 -- 172.21.15.102:0/2765185294 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b81fa590 con 0x7f36b80ce2b0 2023-10-14T09:37:28.611 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.557+0000 7f4132d9d640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f41341573e0 0x7f4134157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.611 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.557+0000 7f26120aa640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2604049ee0 0x7f2604051930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.612 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.557+0000 7f413259c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4134070780 0x7f41340c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.612 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.557+0000 7f413259c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4134070780 0x7f41340c9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.102:57644/0 (socket says 172.21.15.102:57644) 2023-10-14T09:37:28.612 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.557+0000 7f413259c640 1 -- 172.21.15.102:0/3339456199 learned_addr learned my addr 172.21.15.102:0/3339456199 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:28.613 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.557+0000 7f26110a8640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f2604055400 0x7f26040557e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:45650/0 (socket says 172.21.15.102:45650) 2023-10-14T09:37:28.613 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.557+0000 7f26110a8640 1 -- 172.21.15.102:0/458205591 learned_addr learned my addr 172.21.15.102:0/458205591 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:28.613 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.557+0000 7f26108a7640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f26040543c0 0x7f2604039140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.102:35440/0 (socket says 172.21.15.102:35440) 2023-10-14T09:37:28.614 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.558+0000 7fc7a2bd0640 1 Processor -- start 2023-10-14T09:37:28.614 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.558+0000 7f0efe7fc640 1 --2- 172.21.15.102:0/2726590707 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f0eec06ae70 0x7f0eec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.615 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.558+0000 7f36bdeda640 1 -- 172.21.15.102:0/2765185294 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f36b80c9480 con 0x7f36b80ce2b0 2023-10-14T09:37:28.615 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.558+0000 7f5bfb0d0640 1 -- 172.21.15.102:0/785894762 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5bf40d2290 con 0x7f5bf415d030 2023-10-14T09:37:28.615 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.558+0000 7f4129d9b640 1 --2- 172.21.15.102:0/3339456199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41340ca830 0x7f41341579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.616 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.558+0000 7f413259c640 1 -- 172.21.15.102:0/3339456199 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f41341573e0 msgr2=0x7f4134157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.616 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.558+0000 7f413259c640 1 --2- 172.21.15.102:0/3339456199 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f41341573e0 0x7f4134157f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.616 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.558+0000 7f413259c640 1 -- 172.21.15.102:0/3339456199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41340ca830 msgr2=0x7f41341579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.617 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.558+0000 7fe707c1a640 1 Processor -- start 2023-10-14T09:37:28.617 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.558+0000 7f26120aa640 1 -- 172.21.15.102:0/458205591 --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26040532c0 con 0x7f2604055400 2023-10-14T09:37:28.617 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.558+0000 7f26120aa640 1 -- 172.21.15.102:0/458205591 --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26040e8e10 con 0x7f26040543c0 2023-10-14T09:37:28.618 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.558+0000 7fb099568640 1 -- 172.21.15.102:0/1568199068 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0940cf710 msgr2=0x7fb0940b2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.618 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.558+0000 7f413259c640 1 --2- 172.21.15.102:0/3339456199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41340ca830 0x7f41341579d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.618 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.558+0000 7f413259c640 1 -- 172.21.15.102:0/3339456199 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f412c009a70 con 0x7f4134070780 2023-10-14T09:37:28.619 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.558+0000 7fb099568640 1 --2- 172.21.15.102:0/1568199068 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0940cf710 0x7fb0940b2d10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb0940b5890 tx=0x7fb08402b880 comp rx=0 tx=0).stop 2023-10-14T09:37:28.619 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.558+0000 7f26118a9640 1 --2- 172.21.15.102:0/458205591 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2604049ee0 0x7f2604051930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.619 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.558+0000 7f26120aa640 1 -- 172.21.15.102:0/458205591 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2604039850 con 0x7f2604049ee0 2023-10-14T09:37:28.620 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.558+0000 7f0efe7fc640 1 -- 172.21.15.102:0/2726590707 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f08103340 con 0x7f0f000e3070 2023-10-14T09:37:28.620 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.558+0000 7f4129d9b640 1 --2- 172.21.15.102:0/3339456199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41340ca830 0x7f41341579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:28.621 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.558+0000 7fe707c1a640 1 -- start start 2023-10-14T09:37:28.621 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.558+0000 7f2603fff640 1 -- 172.21.15.102:0/458205591 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 401053074 0 0) 0x7f26040532c0 con 0x7f2604055400 2023-10-14T09:37:28.621 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.559+0000 7f2603fff640 1 -- 172.21.15.102:0/458205591 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25f8003520 con 0x7f2604055400 2023-10-14T09:37:28.622 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.559+0000 7f0f0d9e7640 1 --2- 172.21.15.102:0/2726590707 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f0eec06ae70 0x7f0eec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.622 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.559+0000 7f0efe7fc640 1 --2- 172.21.15.102:0/2726590707 >> [v2:172.21.15.102:6800/1727250718,v1:172.21.15.102:6801/1727250718] conn(0x7f0eec073090 0x7f0eec0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.622 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.559+0000 7f0efe7fc640 1 -- 172.21.15.102:0/2726590707 --> [v2:172.21.15.102:6800/1727250718,v1:172.21.15.102:6801/1727250718] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0eec075b60 con 0x7f0eec073090 2023-10-14T09:37:28.622 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.559+0000 7f0efe7fc640 1 -- 172.21.15.102:0/2726590707 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f08105960 con 0x7f0f000e3070 2023-10-14T09:37:28.623 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.559+0000 7f413259c640 1 --2- 172.21.15.102:0/3339456199 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4134070780 0x7f41340c9260 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f412400c500 tx=0x7f412400c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:28.623 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.559+0000 7f26118a9640 1 -- 172.21.15.102:0/458205591 >> v1:172.21.15.129:6789/0 conn(0x7f26040543c0 legacy=0x7f2604039140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.623 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.559+0000 7f2603fff640 1 -- 172.21.15.102:0/458205591 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1505200010 0 0) 0x7f26040e8e10 con 0x7f26040543c0 2023-10-14T09:37:28.623 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.559+0000 7f26118a9640 1 -- 172.21.15.102:0/458205591 >> v1:172.21.15.102:6789/0 conn(0x7f2604055400 legacy=0x7f26040557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.624 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.559+0000 7f26118a9640 1 -- 172.21.15.102:0/458205591 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26040e8b30 con 0x7f2604049ee0 2023-10-14T09:37:28.624 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.559+0000 7fc7a2bd0640 1 -- start start 2023-10-14T09:37:28.624 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.560+0000 7f412b7fe640 1 -- 172.21.15.102:0/3339456199 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4124005ce0 con 0x7f4134070780 2023-10-14T09:37:28.625 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.560+0000 7f413359e640 1 -- 172.21.15.102:0/3339456199 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f411c009400 con 0x7f4134070780 2023-10-14T09:37:28.625 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.560+0000 7fe707c1a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe70006a4b0 0x7fe7000c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.625 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.560+0000 7f5bf17fa640 1 -- 172.21.15.102:0/785894762 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5be400a9b0 con 0x7f5bf415d030 2023-10-14T09:37:28.626 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.560+0000 7fe707c1a640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe7000addb0 0x7fe7000c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.626 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.560+0000 7fe707c1a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7000c9000 0x7fe7000c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.626 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.560+0000 7fe707c1a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7000c2a20 con 0x7fe7000c9000 2023-10-14T09:37:28.627 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.560+0000 7fe707c1a640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7000c6730 con 0x7fe70006a4b0 2023-10-14T09:37:28.627 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.560+0000 7fe707c1a640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7000c6a00 con 0x7fe7000addb0 2023-10-14T09:37:28.627 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.560+0000 7f413359e640 1 -- 172.21.15.102:0/3339456199 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41340c6c50 con 0x7f4134070780 2023-10-14T09:37:28.627 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.560+0000 7fb099568640 1 -- 172.21.15.102:0/1568199068 shutdown_connections 2023-10-14T09:37:28.628 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.560+0000 7fb099568640 1 --2- 172.21.15.102:0/1568199068 >> v2:172.21.15.129:3300/0 conn(0x7fb0940b6cd0 0x7fb0940b3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.628 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.560+0000 7fb099568640 1 --2- 172.21.15.102:0/1568199068 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0940cf710 0x7fb0940b2d10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.628 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.560+0000 7fb099568640 1 -- 172.21.15.102:0/1568199068 >> 172.21.15.102:0/1568199068 conn(0x7fb0940d2cc0 msgr2=0x7fb0940d30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:28.628 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.560+0000 7f0f0d1e6640 1 --2- 172.21.15.102:0/2726590707 >> [v2:172.21.15.102:6800/1727250718,v1:172.21.15.102:6801/1727250718] conn(0x7f0eec073090 0x7f0eec0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.629 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.560+0000 7f412b7fe640 1 -- 172.21.15.102:0/3339456199 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4124005e40 con 0x7f4134070780 2023-10-14T09:37:28.629 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.560+0000 7f0f0d9e7640 1 --2- 172.21.15.102:0/2726590707 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f0eec06ae70 0x7f0eec06d330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0f04005880 tx=0x7f0f04009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:28.630 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.560+0000 7f412b7fe640 1 -- 172.21.15.102:0/3339456199 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41240072b0 con 0x7f4134070780 2023-10-14T09:37:28.630 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.560+0000 7fe7059b6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe70006a4b0 0x7fe7000c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.631 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.561+0000 7fe7059b6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe70006a4b0 0x7fe7000c7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.102:57646/0 (socket says 172.21.15.102:57646) 2023-10-14T09:37:28.631 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.561+0000 7fe7059b6640 1 -- 172.21.15.102:0/1336291804 learned_addr learned my addr 172.21.15.102:0/1336291804 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:28.631 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.561+0000 7fe7061b7640 1 --2- 172.21.15.102:0/1336291804 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7000c9000 0x7fe7000c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.631 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.561+0000 7fe7051b5640 1 --2- 172.21.15.102:0/1336291804 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe7000addb0 0x7fe7000c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.632 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.561+0000 7fc7a2bd0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc79c071b30 0x7fc79c06fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.632 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.561+0000 7fc7a2bd0640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc79c0c9f10 0x7fc79c06b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.632 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.561+0000 7fc7a2bd0640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc79c0cdc30 con 0x7fc79c06ade0 2023-10-14T09:37:28.632 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.561+0000 7fc7a2bd0640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc79c06b780 con 0x7fc79c071b30 2023-10-14T09:37:28.633 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.561+0000 7fc7a2bd0640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c0ccd80 con 0x7fc79c0c9f10 2023-10-14T09:37:28.633 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.561+0000 7f413359e640 1 -- 172.21.15.102:0/3339456199 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4118000fc0 con 0x7f4134070780 2023-10-14T09:37:28.634 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.561+0000 7fe7061b7640 1 -- 172.21.15.102:0/1336291804 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe7000addb0 msgr2=0x7fe7000c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.634 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.561+0000 7fe7061b7640 1 --2- 172.21.15.102:0/1336291804 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe7000addb0 0x7fe7000c5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.634 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.561+0000 7fe7061b7640 1 -- 172.21.15.102:0/1336291804 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe70006a4b0 msgr2=0x7fe7000c7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.634 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.561+0000 7fe7061b7640 1 --2- 172.21.15.102:0/1336291804 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe70006a4b0 0x7fe7000c7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.635 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.561+0000 7fe7061b7640 1 -- 172.21.15.102:0/1336291804 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f00094d0 con 0x7fe7000c9000 2023-10-14T09:37:28.635 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.561+0000 7fe7059b6640 1 --2- 172.21.15.102:0/1336291804 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe70006a4b0 0x7fe7000c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:37:28.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.562+0000 7fc7a116d640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc79c0c9f10 0x7fc79c06b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.562+0000 7fc7a116d640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc79c0c9f10 0x7fc79c06b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.102:60540/0 (socket says 172.21.15.102:60540) 2023-10-14T09:37:28.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.562+0000 7fc7a116d640 1 -- 172.21.15.102:0/688726137 learned_addr learned my addr 172.21.15.102:0/688726137 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:28.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.562+0000 7f26118a9640 1 --2- 172.21.15.102:0/458205591 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2604049ee0 0x7f2604051930 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f260c04fa60 tx=0x7f260c0a5d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f65527fbc81751a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:28.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.562+0000 7f0f0d1e6640 1 --2- 172.21.15.102:0/2726590707 >> [v2:172.21.15.102:6800/1727250718,v1:172.21.15.102:6801/1727250718] conn(0x7f0eec073090 0x7f0eec0754b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:28.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.562+0000 7fb099568640 1 -- 172.21.15.102:0/1568199068 shutdown_connections 2023-10-14T09:37:28.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.562+0000 7f5bf17fa640 1 --2- 172.21.15.102:0/785894762 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f5bd406af40 0x7f5bd406d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.562+0000 7f5bf17fa640 1 -- 172.21.15.102:0/785894762 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5be40892c0 con 0x7f5bf415d030 2023-10-14T09:37:28.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.562+0000 7fb099568640 1 -- 172.21.15.102:0/1568199068 wait complete. 2023-10-14T09:37:28.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.562+0000 7f369ffff640 1 -- 172.21.15.102:0/2765185294 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f36b0003d30 con 0x7f36b80ce2b0 2023-10-14T09:37:28.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.562+0000 7f2603fff640 1 -- 172.21.15.102:0/458205591 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c0a69d0 con 0x7f2604049ee0 2023-10-14T09:37:28.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.562+0000 7f2603fff640 1 -- 172.21.15.102:0/458205591 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260c0a6b30 con 0x7f2604049ee0 2023-10-14T09:37:28.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.562+0000 7f2603fff640 1 -- 172.21.15.102:0/458205591 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c0ae440 con 0x7f2604049ee0 2023-10-14T09:37:28.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.563+0000 7fc7a116d640 1 -- 172.21.15.102:0/688726137 >> v2:172.21.15.102:3300/0 conn(0x7fc79c071b30 msgr2=0x7fc79c06fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:28.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.563+0000 7fc7a116d640 1 --2- 172.21.15.102:0/688726137 >> v2:172.21.15.102:3300/0 conn(0x7fc79c071b30 0x7fc79c06fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.563+0000 7fc7a116d640 1 -- 172.21.15.102:0/688726137 >> v1:172.21.15.102:6789/0 conn(0x7fc79c06ade0 legacy=0x7fc79c0c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.563+0000 7fc7a116d640 1 -- 172.21.15.102:0/688726137 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc79c0cd020 con 0x7fc79c0c9f10 2023-10-14T09:37:28.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.563+0000 7f5bf17fa640 1 --2- 172.21.15.102:0/785894762 >> [v2:172.21.15.102:6808/1095651107,v1:172.21.15.102:6809/1095651107] conn(0x7f5bd4073160 0x7f5bd4075580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.563+0000 7f5bf8e6c640 1 --2- 172.21.15.102:0/785894762 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f5bd406af40 0x7f5bd406d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.564+0000 7f369ffff640 1 --2- 172.21.15.102:0/2765185294 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f36a406ae70 0x7f36a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.564+0000 7f5bf17fa640 1 -- 172.21.15.102:0/785894762 --> [v2:172.21.15.102:6808/1095651107,v1:172.21.15.102:6809/1095651107] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5bd4075c30 con 0x7f5bd4073160 2023-10-14T09:37:28.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.564+0000 7f5bf17fa640 1 -- 172.21.15.102:0/785894762 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5be408b8e0 con 0x7f5bf415d030 2023-10-14T09:37:28.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.564+0000 7f5bf966d640 1 --2- 172.21.15.102:0/785894762 >> [v2:172.21.15.102:6808/1095651107,v1:172.21.15.102:6809/1095651107] conn(0x7f5bd4073160 0x7f5bd4075580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.564+0000 7f369ffff640 1 -- 172.21.15.102:0/2765185294 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36b008a790 con 0x7f36b80ce2b0 2023-10-14T09:37:28.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.564+0000 7f369ffff640 1 --2- 172.21.15.102:0/2765185294 >> [v2:172.21.15.129:6816/507586170,v1:172.21.15.129:6817/507586170] conn(0x7f36a4073010 0x7f36a4075430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.563+0000 7f26120aa640 1 -- 172.21.15.102:0/458205591 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2604049ee0 msgr2=0x7f2604051930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.563+0000 7f26120aa640 1 --2- 172.21.15.102:0/458205591 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2604049ee0 0x7f2604051930 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f260c04fa60 tx=0x7f260c0a5d70 comp rx=0 tx=0).stop 2023-10-14T09:37:28.647 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.564+0000 7f369ffff640 1 -- 172.21.15.102:0/2765185294 --> [v2:172.21.15.129:6816/507586170,v1:172.21.15.129:6817/507586170] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f36a4075ae0 con 0x7f36a4073010 2023-10-14T09:37:28.647 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.564+0000 7f369ffff640 1 -- 172.21.15.102:0/2765185294 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36b008ab00 con 0x7f36b80ce2b0 2023-10-14T09:37:28.647 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.564+0000 7f0efe7fc640 1 -- 172.21.15.102:0/2726590707 <== osd.0 v2:172.21.15.102:6800/1727250718 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f0eec075b60 con 0x7f0eec073090 2023-10-14T09:37:28.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.564+0000 7f5bf8e6c640 1 --2- 172.21.15.102:0/785894762 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f5bd406af40 0x7f5bd406d400 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5bec009cf0 tx=0x7f5bec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:28.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.564+0000 7f36b77fe640 1 --2- 172.21.15.102:0/2765185294 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f36a406ae70 0x7f36a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.564+0000 7f26120aa640 1 -- 172.21.15.102:0/458205591 shutdown_connections 2023-10-14T09:37:28.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.564+0000 7f26120aa640 1 --2- 172.21.15.102:0/458205591 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2604049ee0 0x7f2604051930 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.564+0000 7f26120aa640 1 -- 172.21.15.102:0/458205591 >> 172.21.15.102:0/458205591 conn(0x7f26040538a0 msgr2=0x7f2604053cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:28.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.565+0000 7f36b6ffd640 1 --2- 172.21.15.102:0/2765185294 >> [v2:172.21.15.129:6816/507586170,v1:172.21.15.129:6817/507586170] conn(0x7f36a4073010 0x7f36a4075430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.565+0000 7f26120aa640 1 -- 172.21.15.102:0/458205591 shutdown_connections 2023-10-14T09:37:28.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.565+0000 7fc7a116d640 1 --2- 172.21.15.102:0/688726137 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc79c0c9f10 0x7fc79c06b240 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc79000aa10 tx=0x7fc79002ce90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b71e59d376d5c6d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:28.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.565+0000 7fe7061b7640 1 --2- 172.21.15.102:0/1336291804 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7000c9000 0x7fe7000c61f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe70006d830 tx=0x7fe6f8009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:28.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.565+0000 7f36b77fe640 1 --2- 172.21.15.102:0/2765185294 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f36a406ae70 0x7f36a406d330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f36a8006fd0 tx=0x7f36a8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:28.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.565+0000 7f412b7fe640 1 -- 172.21.15.102:0/3339456199 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f41240074d0 con 0x7f4134070780 2023-10-14T09:37:28.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.565+0000 7fe6f67fc640 1 -- 172.21.15.102:0/1336291804 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f800cdf0 con 0x7fe7000c9000 2023-10-14T09:37:28.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.566+0000 7fe707c1a640 1 -- 172.21.15.102:0/1336291804 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7000c6ce0 con 0x7fe7000c9000 2023-10-14T09:37:28.653 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.565+0000 7fc79b7fe640 1 -- 172.21.15.102:0/688726137 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79002dc40 con 0x7fc79c0c9f10 2023-10-14T09:37:28.653 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.565+0000 7fc79b7fe640 1 -- 172.21.15.102:0/688726137 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc79002dda0 con 0x7fc79c0c9f10 2023-10-14T09:37:28.653 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.565+0000 7fc79b7fe640 1 -- 172.21.15.102:0/688726137 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc790035660 con 0x7fc79c0c9f10 2023-10-14T09:37:28.654 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.566+0000 7fb099568640 1 Processor -- start 2023-10-14T09:37:28.654 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.566+0000 7f36b6ffd640 1 --2- 172.21.15.102:0/2765185294 >> [v2:172.21.15.129:6816/507586170,v1:172.21.15.129:6817/507586170] conn(0x7f36a4073010 0x7f36a4075430 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:28.654 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.566+0000 7f5bf966d640 1 --2- 172.21.15.102:0/785894762 >> [v2:172.21.15.102:6808/1095651107,v1:172.21.15.102:6809/1095651107] conn(0x7f5bd4073160 0x7f5bd4075580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:28.655 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.566+0000 7fe707c1a640 1 -- 172.21.15.102:0/1336291804 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7000c72a0 con 0x7fe7000c9000 2023-10-14T09:37:28.655 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.566+0000 7fe6f67fc640 1 -- 172.21.15.102:0/1336291804 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f80097f0 con 0x7fe7000c9000 2023-10-14T09:37:28.655 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.566+0000 7fe6f67fc640 1 -- 172.21.15.102:0/1336291804 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f801e640 con 0x7fe7000c9000 2023-10-14T09:37:28.656 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.567+0000 7fc7a2bd0640 1 -- 172.21.15.102:0/688726137 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc79c0c9f10 msgr2=0x7fc79c06b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.656 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.567+0000 7fc7a2bd0640 1 --2- 172.21.15.102:0/688726137 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc79c0c9f10 0x7fc79c06b240 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc79000aa10 tx=0x7fc79002ce90 comp rx=0 tx=0).stop 2023-10-14T09:37:28.656 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.568+0000 7f5bf17fa640 1 -- 172.21.15.102:0/785894762 <== osd.1 v2:172.21.15.102:6808/1095651107 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f5bd4075c30 con 0x7f5bd4073160 2023-10-14T09:37:28.657 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.567+0000 7f412b7fe640 1 --2- 172.21.15.102:0/3339456199 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f411406aed0 0x7f411406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.657 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.568+0000 7f412b7fe640 1 -- 172.21.15.102:0/3339456199 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41240891f0 con 0x7f4134070780 2023-10-14T09:37:28.657 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.568+0000 7f412b7fe640 1 --2- 172.21.15.102:0/3339456199 >> [v2:172.21.15.102:6817/2198222556,v1:172.21.15.102:6820/2198222556] conn(0x7f4114073070 0x7f4114075490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.657 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.568+0000 7f412b7fe640 1 -- 172.21.15.102:0/3339456199 --> [v2:172.21.15.102:6817/2198222556,v1:172.21.15.102:6820/2198222556] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4114075b40 con 0x7f4114073070 2023-10-14T09:37:28.657 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.568+0000 7f412b7fe640 1 -- 172.21.15.102:0/3339456199 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f41240072b0 con 0x7f4134070780 2023-10-14T09:37:28.658 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.566+0000 7fb099568640 1 -- start start 2023-10-14T09:37:28.658 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.567+0000 7fb099568640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb0940b6cd0 0x7fb0941563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.658 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.567+0000 7fb099568640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb0940cf710 0x7fb094159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.658 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.567+0000 7fb099568640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0940cfaf0 0x7fb094159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.659 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.567+0000 7fb099568640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0941592f0 con 0x7fb0940cfaf0 2023-10-14T09:37:28.659 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.567+0000 7fb099568640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb094155c80 con 0x7fb0940b6cd0 2023-10-14T09:37:28.659 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.567+0000 7fb099568640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb094158a00 con 0x7fb0940cf710 2023-10-14T09:37:28.659 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.565+0000 7f26120aa640 1 -- 172.21.15.102:0/458205591 wait complete. 2023-10-14T09:37:28.660 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.567+0000 7f26120aa640 1 Processor -- start 2023-10-14T09:37:28.660 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.568+0000 7f4129d9b640 1 --2- 172.21.15.102:0/3339456199 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f411406aed0 0x7f411406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.660 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.568+0000 7fe707c1a640 1 -- 172.21.15.102:0/1336291804 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe6e8000fc0 con 0x7fe7000c9000 2023-10-14T09:37:28.661 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.568+0000 7f369ffff640 1 -- 172.21.15.102:0/2765185294 <== osd.4 v2:172.21.15.129:6816/507586170 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f36a4075ae0 con 0x7f36a4073010 2023-10-14T09:37:28.661 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.568+0000 7fb0937fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0940cfaf0 0x7fb094159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.661 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.568+0000 7fb0937fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0940cfaf0 0x7fb094159cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44788/0 (socket says 172.21.15.102:44788) 2023-10-14T09:37:28.661 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.568+0000 7fb0937fe640 1 -- 172.21.15.102:0/3667925678 learned_addr learned my addr 172.21.15.102:0/3667925678 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:28.662 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.568+0000 7fb092ffd640 1 --2- 172.21.15.102:0/3667925678 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb0940b6cd0 0x7fb0941563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.662 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.568+0000 7fb0927fc640 1 --2- 172.21.15.102:0/3667925678 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb0940cf710 0x7fb094159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.662 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.568+0000 7f26120aa640 1 -- start start 2023-10-14T09:37:28.663 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.567+0000 7fc7a2bd0640 1 -- 172.21.15.102:0/688726137 shutdown_connections 2023-10-14T09:37:28.663 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.568+0000 7fc7a2bd0640 1 --2- 172.21.15.102:0/688726137 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc79c0c9f10 0x7fc79c06b240 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.663 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.568+0000 7fc7a2bd0640 1 --2- 172.21.15.102:0/688726137 >> v2:172.21.15.102:3300/0 conn(0x7fc79c071b30 0x7fc79c06fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.663 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.568+0000 7fc7a2bd0640 1 -- 172.21.15.102:0/688726137 >> 172.21.15.102:0/688726137 conn(0x7fc79c06bc10 msgr2=0x7fc79c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:28.664 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.569+0000 7fb0937fe640 1 -- 172.21.15.102:0/3667925678 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb0940cf710 msgr2=0x7fb094159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.664 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.569+0000 7fb0937fe640 1 --2- 172.21.15.102:0/3667925678 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb0940cf710 0x7fb094159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.664 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.569+0000 7fb0937fe640 1 -- 172.21.15.102:0/3667925678 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb0940b6cd0 msgr2=0x7fb0941563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.664 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.569+0000 7fb0937fe640 1 --2- 172.21.15.102:0/3667925678 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb0940b6cd0 0x7fb0941563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.665 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.569+0000 7fb0937fe640 1 -- 172.21.15.102:0/3667925678 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb084009460 con 0x7fb0940cfaf0 2023-10-14T09:37:28.665 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.569+0000 7f4129d9b640 1 --2- 172.21.15.102:0/3339456199 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f411406aed0 0x7f411406d390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f411c036000 tx=0x7f411c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:28.665 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.569+0000 7f4132d9d640 1 --2- 172.21.15.102:0/3339456199 >> [v2:172.21.15.102:6817/2198222556,v1:172.21.15.102:6820/2198222556] conn(0x7f4114073070 0x7f4114075490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.666 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.569+0000 7fb0937fe640 1 --2- 172.21.15.102:0/3667925678 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0940cfaf0 0x7fb094159cc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb08c00b9c0 tx=0x7fb08c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:28.666 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.570+0000 7fb07b7fe640 1 -- 172.21.15.102:0/3667925678 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c00cba0 con 0x7fb0940cfaf0 2023-10-14T09:37:28.666 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.570+0000 7fb07b7fe640 1 -- 172.21.15.102:0/3667925678 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08c00cd00 con 0x7fb0940cfaf0 2023-10-14T09:37:28.666 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.570+0000 7fb07b7fe640 1 -- 172.21.15.102:0/3667925678 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c014680 con 0x7fb0940cfaf0 2023-10-14T09:37:28.667 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.570+0000 7fb099568640 1 -- 172.21.15.102:0/3667925678 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb094158ca0 con 0x7fb0940cfaf0 2023-10-14T09:37:28.667 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.570+0000 7f4132d9d640 1 --2- 172.21.15.102:0/3339456199 >> [v2:172.21.15.102:6817/2198222556,v1:172.21.15.102:6820/2198222556] conn(0x7f4114073070 0x7f4114075490 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:28.667 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.570+0000 7f26120aa640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2604049ee0 0x7f260417c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.668 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.571+0000 7fc7a2bd0640 1 -- 172.21.15.102:0/688726137 shutdown_connections 2023-10-14T09:37:28.668 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.571+0000 7f26120aa640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26040543c0 0x7f260417a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.669 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.570+0000 7fb099568640 1 -- 172.21.15.102:0/3667925678 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0941572c0 con 0x7fb0940cfaf0 2023-10-14T09:37:28.670 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.571+0000 7f26120aa640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2604055400 0x7f260404b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.670 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.571+0000 7f26120aa640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260417b8e0 con 0x7f2604055400 2023-10-14T09:37:28.670 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.571+0000 7f26120aa640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260417ade0 con 0x7f26040543c0 2023-10-14T09:37:28.670 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.571+0000 7f26120aa640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260417b040 con 0x7f2604049ee0 2023-10-14T09:37:28.670 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.571+0000 7f26108a7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26040543c0 0x7f260417a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.671 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.571+0000 7f26110a8640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2604049ee0 0x7f260417c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.671 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.572+0000 7f26108a7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26040543c0 0x7f260417a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.102:57666/0 (socket says 172.21.15.102:57666) 2023-10-14T09:37:28.671 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.572+0000 7f26110a8640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2604049ee0 0x7f260417c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.102:60566/0 (socket says 172.21.15.102:60566) 2023-10-14T09:37:28.671 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.572+0000 7f26108a7640 1 -- 172.21.15.102:0/2998427125 learned_addr learned my addr 172.21.15.102:0/2998427125 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:28.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.570+0000 7fe6f67fc640 1 -- 172.21.15.102:0/1336291804 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe6f801e7a0 con 0x7fe7000c9000 2023-10-14T09:37:28.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.572+0000 7f412b7fe640 1 -- 172.21.15.102:0/3339456199 <== osd.2 v2:172.21.15.102:6817/2198222556 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f4114075b40 con 0x7f4114073070 2023-10-14T09:37:28.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.574+0000 7fe6f67fc640 1 --2- 172.21.15.102:0/1336291804 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe6e406aea0 0x7fe6e406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.673 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.572+0000 7fb099568640 1 -- 172.21.15.102:0/3667925678 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb0940d1d50 con 0x7fb0940cfaf0 2023-10-14T09:37:28.673 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.574+0000 7fe6f67fc640 1 -- 172.21.15.102:0/1336291804 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe6f8089710 con 0x7fe7000c9000 2023-10-14T09:37:28.674 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.574+0000 7fb07b7fe640 1 -- 172.21.15.102:0/3667925678 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb08c01d3b0 con 0x7fb0940cfaf0 2023-10-14T09:37:28.674 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.574+0000 7fe6f67fc640 1 --2- 172.21.15.102:0/1336291804 >> [v2:172.21.15.102:6816/654726740,v1:172.21.15.102:6818/654726740] conn(0x7fe6e4073040 0x7fe6e4075460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.674 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.574+0000 7fe6f67fc640 1 -- 172.21.15.102:0/1336291804 --> [v2:172.21.15.102:6816/654726740,v1:172.21.15.102:6818/654726740] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe6e4075b10 con 0x7fe6e4073040 2023-10-14T09:37:28.674 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.574+0000 7fe6f67fc640 1 -- 172.21.15.102:0/1336291804 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6f80547d0 con 0x7fe7000c9000 2023-10-14T09:37:28.675 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.572+0000 7fc7a2bd0640 1 -- 172.21.15.102:0/688726137 wait complete. 2023-10-14T09:37:28.675 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.575+0000 7f26110a8640 1 -- 172.21.15.102:0/2998427125 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26040543c0 msgr2=0x7f260417a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.575+0000 7f26110a8640 1 --2- 172.21.15.102:0/2998427125 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26040543c0 0x7f260417a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.575+0000 7f26110a8640 1 -- 172.21.15.102:0/2998427125 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2604055400 msgr2=0x7f260404b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.575+0000 7f26110a8640 1 --2- 172.21.15.102:0/2998427125 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2604055400 0x7f260404b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.575+0000 7f26110a8640 1 -- 172.21.15.102:0/2998427125 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c04f050 con 0x7f2604049ee0 2023-10-14T09:37:28.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.575+0000 7fe7051b5640 1 --2- 172.21.15.102:0/1336291804 >> [v2:172.21.15.102:6816/654726740,v1:172.21.15.102:6818/654726740] conn(0x7fe6e4073040 0x7fe6e4075460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.677 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.576+0000 7fe7051b5640 1 --2- 172.21.15.102:0/1336291804 >> [v2:172.21.15.102:6816/654726740,v1:172.21.15.102:6818/654726740] conn(0x7fe6e4073040 0x7fe6e4075460 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:28.677 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.575+0000 7f26110a8640 1 --2- 172.21.15.102:0/2998427125 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2604049ee0 0x7f260417c360 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f260800c3c0 tx=0x7f2608001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:28.677 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.576+0000 7f26108a7640 1 --2- 172.21.15.102:0/2998427125 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26040543c0 0x7f260417a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:37:28.678 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.576+0000 7f2601ffb640 1 -- 172.21.15.102:0/2998427125 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2608005ce0 con 0x7f2604049ee0 2023-10-14T09:37:28.678 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.576+0000 7f2601ffb640 1 -- 172.21.15.102:0/2998427125 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2608005e40 con 0x7f2604049ee0 2023-10-14T09:37:28.678 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.576+0000 7f2601ffb640 1 -- 172.21.15.102:0/2998427125 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26080072d0 con 0x7f2604049ee0 2023-10-14T09:37:28.678 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.576+0000 7f26120aa640 1 -- 172.21.15.102:0/2998427125 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f260417b320 con 0x7f2604049ee0 2023-10-14T09:37:28.678 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.577+0000 7fe6f67fc640 1 -- 172.21.15.102:0/1336291804 <== osd.3 v2:172.21.15.102:6816/654726740 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fe6e4075b10 con 0x7fe6e4073040 2023-10-14T09:37:28.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.576+0000 7f26120aa640 1 -- 172.21.15.102:0/2998427125 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f260404e090 con 0x7f2604049ee0 2023-10-14T09:37:28.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.577+0000 7fc7a2bd0640 1 Processor -- start 2023-10-14T09:37:28.680 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.577+0000 7fe7059b6640 1 --2- 172.21.15.102:0/1336291804 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe6e406aea0 0x7fe6e406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.680 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.575+0000 7fb07b7fe640 1 --2- 172.21.15.102:0/3667925678 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fb08006af40 0x7fb08006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.681 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.575+0000 7fb07b7fe640 1 -- 172.21.15.102:0/3667925678 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb08c0895c0 con 0x7fb0940cfaf0 2023-10-14T09:37:28.681 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.576+0000 7fb07b7fe640 1 --2- 172.21.15.102:0/3667925678 >> [v2:172.21.15.129:6800/1913451073,v1:172.21.15.129:6801/1913451073] conn(0x7fb080073160 0x7fb080075580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.681 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.576+0000 7fb07b7fe640 1 -- 172.21.15.102:0/3667925678 --> [v2:172.21.15.129:6800/1913451073,v1:172.21.15.129:6801/1913451073] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb080075c30 con 0x7fb080073160 2023-10-14T09:37:28.681 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.576+0000 7fb07b7fe640 1 -- 172.21.15.102:0/3667925678 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb08c08bbe0 con 0x7fb0940cfaf0 2023-10-14T09:37:28.681 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.576+0000 7fb0927fc640 1 --2- 172.21.15.102:0/3667925678 >> [v2:172.21.15.129:6800/1913451073,v1:172.21.15.129:6801/1913451073] conn(0x7fb080073160 0x7fb080075580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.577+0000 7fb092ffd640 1 --2- 172.21.15.102:0/3667925678 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fb08006af40 0x7fb08006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.577+0000 7fb0927fc640 1 --2- 172.21.15.102:0/3667925678 >> [v2:172.21.15.129:6800/1913451073,v1:172.21.15.129:6801/1913451073] conn(0x7fb080073160 0x7fb080075580 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:28.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.578+0000 7fc7a2bd0640 1 -- start start 2023-10-14T09:37:28.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.578+0000 7fb092ffd640 1 --2- 172.21.15.102:0/3667925678 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fb08006af40 0x7fb08006d400 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb084034000 tx=0x7fb084008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:28.683 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.579+0000 7f26120aa640 1 -- 172.21.15.102:0/2998427125 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2604038c20 con 0x7f2604049ee0 2023-10-14T09:37:28.683 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.579+0000 7fc7a2bd0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc79c06ade0 0x7fc79c1f23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.684 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.579+0000 7fc7a2bd0640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc79c071b30 0x7fc79c157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.684 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.579+0000 7fc7a2bd0640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc79c0c9f10 0x7fc79c0c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.684 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.579+0000 7fc7a2bd0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c1f2900 con 0x7fc79c06ade0 2023-10-14T09:37:28.684 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.579+0000 7fc7a2bd0640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c15b7d0 con 0x7fc79c0c9f10 2023-10-14T09:37:28.684 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.579+0000 7fc7a2bd0640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c15bab0 con 0x7fc79c071b30 2023-10-14T09:37:28.685 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.580+0000 7fb07b7fe640 1 -- 172.21.15.102:0/3667925678 <== osd.5 v2:172.21.15.129:6800/1913451073 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fb080075c30 con 0x7fb080073160 2023-10-14T09:37:28.686 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.580+0000 7fc7a096c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc79c06ade0 0x7fc79c1f23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.686 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.580+0000 7fc7a096c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc79c06ade0 0x7fc79c1f23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44802/0 (socket says 172.21.15.102:44802) 2023-10-14T09:37:28.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.581+0000 7fc79bfff640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc79c071b30 0x7fc79c157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.581+0000 7fc79bfff640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc79c071b30 0x7fc79c157d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.102:60574/0 (socket says 172.21.15.102:60574) 2023-10-14T09:37:28.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.581+0000 7fc79bfff640 1 -- 172.21.15.102:0/3242234085 learned_addr learned my addr 172.21.15.102:0/3242234085 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:28.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.582+0000 7fc79bfff640 1 -- 172.21.15.102:0/3242234085 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc79c0c9f10 msgr2=0x7fc79c0c8970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T09:37:28.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.582+0000 7fc79bfff640 1 --2- 172.21.15.102:0/3242234085 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc79c0c9f10 0x7fc79c0c8970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.582+0000 7fc79bfff640 1 -- 172.21.15.102:0/3242234085 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc79c06ade0 msgr2=0x7fc79c1f23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.582+0000 7fc79bfff640 1 --2- 172.21.15.102:0/3242234085 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc79c06ade0 0x7fc79c1f23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.582+0000 7fc79bfff640 1 -- 172.21.15.102:0/3242234085 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc79000a670 con 0x7fc79c071b30 2023-10-14T09:37:28.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.583+0000 7fc7a096c640 1 --2- 172.21.15.102:0/3242234085 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc79c06ade0 0x7fc79c1f23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:37:28.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.583+0000 7fe7059b6640 1 --2- 172.21.15.102:0/1336291804 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe6e406aea0 0x7fe6e406d360 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe6f002b9e0 tx=0x7fe6f0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:28.690 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.583+0000 7fc79bfff640 1 --2- 172.21.15.102:0/3242234085 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc79c071b30 0x7fc79c157d90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc78c00c400 tx=0x7fc78c00c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:28.690 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.584+0000 7fc7997fa640 1 -- 172.21.15.102:0/3242234085 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78c0052d0 con 0x7fc79c071b30 2023-10-14T09:37:28.690 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.584+0000 7fc7a2bd0640 1 -- 172.21.15.102:0/3242234085 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc79c15bd90 con 0x7fc79c071b30 2023-10-14T09:37:28.690 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.584+0000 7fc7997fa640 1 -- 172.21.15.102:0/3242234085 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78c005430 con 0x7fc79c071b30 2023-10-14T09:37:28.690 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.584+0000 7fc7997fa640 1 -- 172.21.15.102:0/3242234085 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78c003830 con 0x7fc79c071b30 2023-10-14T09:37:28.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.584+0000 7fc7a2bd0640 1 -- 172.21.15.102:0/3242234085 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc79c15c350 con 0x7fc79c071b30 2023-10-14T09:37:28.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.586+0000 7fc782ffd640 1 -- 172.21.15.102:0/3242234085 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc774000fc0 con 0x7fc79c071b30 2023-10-14T09:37:28.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.586+0000 7f2601ffb640 1 -- 172.21.15.102:0/2998427125 <== mon.2 v2:172.21.15.129:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2608007430 con 0x7f2604049ee0 2023-10-14T09:37:28.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.587+0000 7f2601ffb640 1 --2- 172.21.15.102:0/2998427125 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f25f006af40 0x7f25f006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.587+0000 7f2601ffb640 1 -- 172.21.15.102:0/2998427125 <== mon.2 v2:172.21.15.129:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2608089590 con 0x7f2604049ee0 2023-10-14T09:37:28.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.588+0000 7f2601ffb640 1 --2- 172.21.15.102:0/2998427125 >> [v2:172.21.15.129:6808/2853291511,v1:172.21.15.129:6809/2853291511] conn(0x7f25f0073160 0x7f25f0075580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.588+0000 7f2601ffb640 1 -- 172.21.15.102:0/2998427125 --> [v2:172.21.15.129:6808/2853291511,v1:172.21.15.129:6809/2853291511] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f25f0075c30 con 0x7f25f0073160 2023-10-14T09:37:28.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.588+0000 7f2601ffb640 1 -- 172.21.15.102:0/2998427125 <== mon.2 v2:172.21.15.129:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2608089940 con 0x7f2604049ee0 2023-10-14T09:37:28.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.588+0000 7f26108a7640 1 --2- 172.21.15.102:0/2998427125 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f25f006af40 0x7f25f006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.589+0000 7f26108a7640 1 --2- 172.21.15.102:0/2998427125 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f25f006af40 0x7f25f006d400 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2604038850 tx=0x7f25fc000f10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:28.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.589+0000 7f26118a9640 1 --2- 172.21.15.102:0/2998427125 >> [v2:172.21.15.129:6808/2853291511,v1:172.21.15.129:6809/2853291511] conn(0x7f25f0073160 0x7f25f0075580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.589+0000 7fc7997fa640 1 -- 172.21.15.102:0/3242234085 <== mon.2 v2:172.21.15.129:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc78c003990 con 0x7fc79c071b30 2023-10-14T09:37:28.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.590+0000 7f26118a9640 1 --2- 172.21.15.102:0/2998427125 >> [v2:172.21.15.129:6808/2853291511,v1:172.21.15.129:6809/2853291511] conn(0x7f25f0073160 0x7f25f0075580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:28.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.591+0000 7fc7997fa640 1 --2- 172.21.15.102:0/3242234085 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc78806af40 0x7fc78806d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.695 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.591+0000 7fc7997fa640 1 -- 172.21.15.102:0/3242234085 <== mon.2 v2:172.21.15.129:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc78c0892d0 con 0x7fc79c071b30 2023-10-14T09:37:28.695 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.591+0000 7fc7997fa640 1 --2- 172.21.15.102:0/3242234085 >> [v2:172.21.15.129:6822/2933886914,v1:172.21.15.129:6824/2933886914] conn(0x7fc788073160 0x7fc788075580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:28.695 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.591+0000 7fc7997fa640 1 -- 172.21.15.102:0/3242234085 --> [v2:172.21.15.129:6822/2933886914,v1:172.21.15.129:6824/2933886914] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc788075c30 con 0x7fc788073160 2023-10-14T09:37:28.695 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.591+0000 7fc7997fa640 1 -- 172.21.15.102:0/3242234085 <== mon.2 v2:172.21.15.129:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc78c089680 con 0x7fc79c071b30 2023-10-14T09:37:28.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.592+0000 7fc7a116d640 1 --2- 172.21.15.102:0/3242234085 >> [v2:172.21.15.129:6822/2933886914,v1:172.21.15.129:6824/2933886914] conn(0x7fc788073160 0x7fc788075580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.593+0000 7fc7a096c640 1 --2- 172.21.15.102:0/3242234085 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc78806af40 0x7fc78806d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:28.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.593+0000 7f2601ffb640 1 -- 172.21.15.102:0/2998427125 <== osd.6 v2:172.21.15.129:6808/2853291511 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f25f0075c30 con 0x7f25f0073160 2023-10-14T09:37:28.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.594+0000 7f36bdeda640 1 -- 172.21.15.102:0/2765185294 --> [v2:172.21.15.129:6816/507586170,v1:172.21.15.129:6817/507586170] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f36b80caaf0 con 0x7f36a4073010 2023-10-14T09:37:28.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.595+0000 7f369ffff640 1 -- 172.21.15.102:0/2765185294 <== osd.4 v2:172.21.15.129:6816/507586170 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f36a4075ae0 con 0x7f36a4073010 2023-10-14T09:37:28.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.596+0000 7f36bdeda640 1 -- 172.21.15.102:0/2765185294 >> [v2:172.21.15.129:6816/507586170,v1:172.21.15.129:6817/507586170] conn(0x7f36a4073010 msgr2=0x7f36a4075430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.596+0000 7f36bdeda640 1 --2- 172.21.15.102:0/2765185294 >> [v2:172.21.15.129:6816/507586170,v1:172.21.15.129:6817/507586170] conn(0x7f36a4073010 0x7f36a4075430 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.596+0000 7f36bdeda640 1 -- 172.21.15.102:0/2765185294 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f36a406ae70 msgr2=0x7f36a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.596+0000 7f36bdeda640 1 --2- 172.21.15.102:0/2765185294 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f36a406ae70 0x7f36a406d330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f36a8006fd0 tx=0x7f36a8008040 comp rx=0 tx=0).stop 2023-10-14T09:37:28.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.596+0000 7f36bdeda640 1 -- 172.21.15.102:0/2765185294 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f36b80ce2b0 msgr2=0x7f36b80c7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.596+0000 7f36bdeda640 1 --2- 172.21.15.102:0/2765185294 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f36b80ce2b0 0x7f36b80c7c50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f36b0007cf0 tx=0x7f36b000e4b0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.596+0000 7f36b7fff640 1 -- 172.21.15.102:0/2765185294 reap_dead start 2023-10-14T09:37:28.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.596+0000 7f0f0fc4b640 1 -- 172.21.15.102:0/2726590707 --> [v2:172.21.15.102:6800/1727250718,v1:172.21.15.102:6801/1727250718] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0ef0002cb0 con 0x7f0eec073090 2023-10-14T09:37:28.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.596+0000 7fc7a096c640 1 --2- 172.21.15.102:0/3242234085 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc78806af40 0x7fc78806d400 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc79400a7b0 tx=0x7fc79400d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:28.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.596+0000 7f36bdeda640 1 -- 172.21.15.102:0/2765185294 shutdown_connections 2023-10-14T09:37:28.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.597+0000 7f36bdeda640 1 -- 172.21.15.102:0/2765185294 >> 172.21.15.102:0/2765185294 conn(0x7f36b80ce9b0 msgr2=0x7f36b80cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:28.701 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.597+0000 7f36bdeda640 1 -- 172.21.15.102:0/2765185294 shutdown_connections 2023-10-14T09:37:28.701 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.597+0000 7fc7a116d640 1 --2- 172.21.15.102:0/3242234085 >> [v2:172.21.15.129:6822/2933886914,v1:172.21.15.129:6824/2933886914] conn(0x7fc788073160 0x7fc788075580 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:28.701 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.597+0000 7f0efe7fc640 1 -- 172.21.15.102:0/2726590707 <== osd.0 v2:172.21.15.102:6800/1727250718 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0ef0002cb0 con 0x7f0eec073090 2023-10-14T09:37:28.702 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.598+0000 7f0f0fc4b640 1 -- 172.21.15.102:0/2726590707 >> [v2:172.21.15.102:6800/1727250718,v1:172.21.15.102:6801/1727250718] conn(0x7f0eec073090 msgr2=0x7f0eec0754b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.702 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.598+0000 7f0f0fc4b640 1 --2- 172.21.15.102:0/2726590707 >> [v2:172.21.15.102:6800/1727250718,v1:172.21.15.102:6801/1727250718] conn(0x7f0eec073090 0x7f0eec0754b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.703 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.597+0000 7f36bdeda640 1 -- 172.21.15.102:0/2765185294 wait complete. 2023-10-14T09:37:28.703 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.598+0000 7f0f0fc4b640 1 -- 172.21.15.102:0/2726590707 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f0eec06ae70 msgr2=0x7f0eec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.598+0000 7f0f0fc4b640 1 --2- 172.21.15.102:0/2726590707 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f0eec06ae70 0x7f0eec06d330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0f04005880 tx=0x7f0f04009040 comp rx=0 tx=0).stop 2023-10-14T09:37:28.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.598+0000 7f0f0fc4b640 1 -- 172.21.15.102:0/2726590707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f000e3070 msgr2=0x7f0f000e1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.598+0000 7f0f0fc4b640 1 --2- 172.21.15.102:0/2726590707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f000e3070 0x7f0f000e1460 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0f0804fa60 tx=0x7f0f080671b0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.598+0000 7f0f0e1e8640 1 -- 172.21.15.102:0/2726590707 reap_dead start 2023-10-14T09:37:28.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.598+0000 7f0f0fc4b640 1 -- 172.21.15.102:0/2726590707 shutdown_connections 2023-10-14T09:37:28.705 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.598+0000 7f0f0fc4b640 1 -- 172.21.15.102:0/2726590707 >> 172.21.15.102:0/2726590707 conn(0x7f0f00055a90 msgr2=0x7f0f0003af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:28.705 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.599+0000 7f0f0fc4b640 1 -- 172.21.15.102:0/2726590707 shutdown_connections 2023-10-14T09:37:28.705 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.599+0000 7f0f0fc4b640 1 -- 172.21.15.102:0/2726590707 wait complete. 2023-10-14T09:37:28.705 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.600+0000 7fc7997fa640 1 -- 172.21.15.102:0/3242234085 <== osd.7 v2:172.21.15.129:6822/2933886914 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fc788075c30 con 0x7fc788073160 2023-10-14T09:37:28.706 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.606+0000 7f413359e640 1 -- 172.21.15.102:0/3339456199 --> [v2:172.21.15.102:6817/2198222556,v1:172.21.15.102:6820/2198222556] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4118002cb0 con 0x7f4114073070 2023-10-14T09:37:28.706 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.608+0000 7f412b7fe640 1 -- 172.21.15.102:0/3339456199 <== osd.2 v2:172.21.15.102:6817/2198222556 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4118002cb0 con 0x7f4114073070 2023-10-14T09:37:28.706 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.608+0000 7f5bfb0d0640 1 -- 172.21.15.102:0/785894762 --> [v2:172.21.15.102:6808/1095651107,v1:172.21.15.102:6809/1095651107] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5bf40d25d0 con 0x7f5bd4073160 2023-10-14T09:37:28.707 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.608+0000 7f4128d99640 1 -- 172.21.15.102:0/3339456199 >> [v2:172.21.15.102:6817/2198222556,v1:172.21.15.102:6820/2198222556] conn(0x7f4114073070 msgr2=0x7f4114075490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.707 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.609+0000 7f4128d99640 1 --2- 172.21.15.102:0/3339456199 >> [v2:172.21.15.102:6817/2198222556,v1:172.21.15.102:6820/2198222556] conn(0x7f4114073070 0x7f4114075490 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.707 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.609+0000 7f4128d99640 1 -- 172.21.15.102:0/3339456199 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f411406aed0 msgr2=0x7f411406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.708 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.609+0000 7f4128d99640 1 --2- 172.21.15.102:0/3339456199 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f411406aed0 0x7f411406d390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f411c036000 tx=0x7f411c008030 comp rx=0 tx=0).stop 2023-10-14T09:37:28.708 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.609+0000 7f4128d99640 1 -- 172.21.15.102:0/3339456199 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4134070780 msgr2=0x7f41340c9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.708 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.609+0000 7f4128d99640 1 --2- 172.21.15.102:0/3339456199 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4134070780 0x7f41340c9260 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f412400c500 tx=0x7f412400c900 comp rx=0 tx=0).stop 2023-10-14T09:37:28.708 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.609+0000 7f4132d9d640 1 -- 172.21.15.102:0/3339456199 reap_dead start 2023-10-14T09:37:28.708 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.609+0000 7f4128d99640 1 -- 172.21.15.102:0/3339456199 shutdown_connections 2023-10-14T09:37:28.709 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.609+0000 7f4128d99640 1 -- 172.21.15.102:0/3339456199 >> 172.21.15.102:0/3339456199 conn(0x7f41340cc230 msgr2=0x7f413415c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:28.709 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.609+0000 7fb099568640 1 -- 172.21.15.102:0/3667925678 --> [v2:172.21.15.129:6800/1913451073,v1:172.21.15.129:6801/1913451073] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb0941594a0 con 0x7fb080073160 2023-10-14T09:37:28.709 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.609+0000 7f5bf17fa640 1 -- 172.21.15.102:0/785894762 <== osd.1 v2:172.21.15.102:6808/1095651107 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5bdc03f040 con 0x7f5bd4073160 2023-10-14T09:37:28.710 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.610+0000 7f4128d99640 1 -- 172.21.15.102:0/3339456199 shutdown_connections 2023-10-14T09:37:28.710 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.610+0000 7fb07b7fe640 1 -- 172.21.15.102:0/3667925678 <== osd.5 v2:172.21.15.129:6800/1913451073 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb0941594a0 con 0x7fb080073160 2023-10-14T09:37:28.711 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.610+0000 7f4128d99640 1 -- 172.21.15.102:0/3339456199 wait complete. 2023-10-14T09:37:28.711 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.611+0000 7fb099568640 1 -- 172.21.15.102:0/3667925678 >> [v2:172.21.15.129:6800/1913451073,v1:172.21.15.129:6801/1913451073] conn(0x7fb080073160 msgr2=0x7fb080075580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.712 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.611+0000 7fb099568640 1 --2- 172.21.15.102:0/3667925678 >> [v2:172.21.15.129:6800/1913451073,v1:172.21.15.129:6801/1913451073] conn(0x7fb080073160 0x7fb080075580 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.712 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.611+0000 7fb099568640 1 -- 172.21.15.102:0/3667925678 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fb08006af40 msgr2=0x7fb08006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.712 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.611+0000 7fb099568640 1 --2- 172.21.15.102:0/3667925678 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fb08006af40 0x7fb08006d400 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb084034000 tx=0x7fb084008030 comp rx=0 tx=0).stop 2023-10-14T09:37:28.712 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.611+0000 7fb099568640 1 -- 172.21.15.102:0/3667925678 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0940cfaf0 msgr2=0x7fb094159cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.712 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.611+0000 7fb099568640 1 --2- 172.21.15.102:0/3667925678 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0940cfaf0 0x7fb094159cc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb08c00b9c0 tx=0x7fb08c00be80 comp rx=0 tx=0).stop 2023-10-14T09:37:28.713 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.611+0000 7fb0937fe640 1 -- 172.21.15.102:0/3667925678 reap_dead start 2023-10-14T09:37:28.713 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.611+0000 7f5bfb0d0640 1 -- 172.21.15.102:0/785894762 >> [v2:172.21.15.102:6808/1095651107,v1:172.21.15.102:6809/1095651107] conn(0x7f5bd4073160 msgr2=0x7f5bd4075580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.714 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.611+0000 7f5bfb0d0640 1 --2- 172.21.15.102:0/785894762 >> [v2:172.21.15.102:6808/1095651107,v1:172.21.15.102:6809/1095651107] conn(0x7f5bd4073160 0x7f5bd4075580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.714 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.611+0000 7f5bfb0d0640 1 -- 172.21.15.102:0/785894762 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f5bd406af40 msgr2=0x7f5bd406d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.714 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.611+0000 7f5bfb0d0640 1 --2- 172.21.15.102:0/785894762 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f5bd406af40 0x7f5bd406d400 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5bec009cf0 tx=0x7f5bec008040 comp rx=0 tx=0).stop 2023-10-14T09:37:28.714 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.612+0000 7fb099568640 1 -- 172.21.15.102:0/3667925678 shutdown_connections 2023-10-14T09:37:28.715 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.611+0000 7f5bfb0d0640 1 -- 172.21.15.102:0/785894762 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5bf415d030 msgr2=0x7f5bf40cb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.715 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.611+0000 7f5bfb0d0640 1 --2- 172.21.15.102:0/785894762 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5bf415d030 0x7f5bf40cb670 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5be400c780 tx=0x7f5be400cc40 comp rx=0 tx=0).stop 2023-10-14T09:37:28.716 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.612+0000 7fb099568640 1 -- 172.21.15.102:0/3667925678 >> 172.21.15.102:0/3667925678 conn(0x7fb0940d2cc0 msgr2=0x7fb0940b7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:28.716 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.613+0000 7fb099568640 1 -- 172.21.15.102:0/3667925678 shutdown_connections 2023-10-14T09:37:28.716 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.613+0000 7fb099568640 1 -- 172.21.15.102:0/3667925678 wait complete. 2023-10-14T09:37:28.717 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.613+0000 7f5bf966d640 1 -- 172.21.15.102:0/785894762 reap_dead start 2023-10-14T09:37:28.717 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.613+0000 7f5bfb0d0640 1 -- 172.21.15.102:0/785894762 shutdown_connections 2023-10-14T09:37:28.717 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.613+0000 7f5bfb0d0640 1 -- 172.21.15.102:0/785894762 >> 172.21.15.102:0/785894762 conn(0x7f5bf40cf720 msgr2=0x7f5bf40b7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:28.717 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.614+0000 7f5bfb0d0640 1 -- 172.21.15.102:0/785894762 shutdown_connections 2023-10-14T09:37:28.718 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.614+0000 7f5bfb0d0640 1 -- 172.21.15.102:0/785894762 wait complete. 2023-10-14T09:37:28.718 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.614+0000 7fe707c1a640 1 -- 172.21.15.102:0/1336291804 --> [v2:172.21.15.102:6816/654726740,v1:172.21.15.102:6818/654726740] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe6e8002cb0 con 0x7fe6e4073040 2023-10-14T09:37:28.718 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.615+0000 7fe6f67fc640 1 -- 172.21.15.102:0/1336291804 <== osd.3 v2:172.21.15.102:6816/654726740 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe6e8002cb0 con 0x7fe6e4073040 2023-10-14T09:37:28.720 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.616+0000 7fe707c1a640 1 -- 172.21.15.102:0/1336291804 >> [v2:172.21.15.102:6816/654726740,v1:172.21.15.102:6818/654726740] conn(0x7fe6e4073040 msgr2=0x7fe6e4075460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.720 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.616+0000 7fe707c1a640 1 --2- 172.21.15.102:0/1336291804 >> [v2:172.21.15.102:6816/654726740,v1:172.21.15.102:6818/654726740] conn(0x7fe6e4073040 0x7fe6e4075460 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.720 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.617+0000 7fe707c1a640 1 -- 172.21.15.102:0/1336291804 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe6e406aea0 msgr2=0x7fe6e406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.720 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.617+0000 7fe707c1a640 1 --2- 172.21.15.102:0/1336291804 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe6e406aea0 0x7fe6e406d360 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe6f002b9e0 tx=0x7fe6f0008030 comp rx=0 tx=0).stop 2023-10-14T09:37:28.721 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.617+0000 7fe707c1a640 1 -- 172.21.15.102:0/1336291804 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7000c9000 msgr2=0x7fe7000c61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.721 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.617+0000 7fe707c1a640 1 --2- 172.21.15.102:0/1336291804 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7000c9000 0x7fe7000c61f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe70006d830 tx=0x7fe6f8009ed0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.721 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.617+0000 7fe7061b7640 1 -- 172.21.15.102:0/1336291804 reap_dead start 2023-10-14T09:37:28.721 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.618+0000 7fe707c1a640 1 -- 172.21.15.102:0/1336291804 shutdown_connections 2023-10-14T09:37:28.721 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.618+0000 7fe707c1a640 1 -- 172.21.15.102:0/1336291804 >> 172.21.15.102:0/1336291804 conn(0x7fe7000ce9b0 msgr2=0x7fe7000ced90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:28.722 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.619+0000 7fe707c1a640 1 -- 172.21.15.102:0/1336291804 shutdown_connections 2023-10-14T09:37:28.722 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.619+0000 7fe707c1a640 1 -- 172.21.15.102:0/1336291804 wait complete. 2023-10-14T09:37:28.723 INFO:teuthology.orchestra.run.smithi102.stdout:60129542150 2023-10-14T09:37:28.723 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-14T09:37:28.724 INFO:teuthology.orchestra.run.smithi102.stdout:64424509447 2023-10-14T09:37:28.724 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-14T09:37:28.725 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.625+0000 7f26120aa640 1 -- 172.21.15.102:0/2998427125 --> [v2:172.21.15.129:6808/2853291511,v1:172.21.15.129:6809/2853291511] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2604038940 con 0x7f25f0073160 2023-10-14T09:37:28.725 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.626+0000 7f2601ffb640 1 -- 172.21.15.102:0/2998427125 <== osd.6 v2:172.21.15.129:6808/2853291511 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f260c0a7dd0 con 0x7f25f0073160 2023-10-14T09:37:28.726 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.627+0000 7f26120aa640 1 -- 172.21.15.102:0/2998427125 >> [v2:172.21.15.129:6808/2853291511,v1:172.21.15.129:6809/2853291511] conn(0x7f25f0073160 msgr2=0x7f25f0075580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.727 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.627+0000 7f26120aa640 1 --2- 172.21.15.102:0/2998427125 >> [v2:172.21.15.129:6808/2853291511,v1:172.21.15.129:6809/2853291511] conn(0x7f25f0073160 0x7f25f0075580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.727 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.627+0000 7f26120aa640 1 -- 172.21.15.102:0/2998427125 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f25f006af40 msgr2=0x7f25f006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.727 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.627+0000 7f26120aa640 1 --2- 172.21.15.102:0/2998427125 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f25f006af40 0x7f25f006d400 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2604038850 tx=0x7f25fc000f10 comp rx=0 tx=0).stop 2023-10-14T09:37:28.727 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.627+0000 7f26120aa640 1 -- 172.21.15.102:0/2998427125 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2604049ee0 msgr2=0x7f260417c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.727 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.627+0000 7f26120aa640 1 --2- 172.21.15.102:0/2998427125 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2604049ee0 0x7f260417c360 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f260800c3c0 tx=0x7f2608001e70 comp rx=0 tx=0).stop 2023-10-14T09:37:28.728 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.627+0000 7f26118a9640 1 -- 172.21.15.102:0/2998427125 reap_dead start 2023-10-14T09:37:28.728 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.627+0000 7f26120aa640 1 -- 172.21.15.102:0/2998427125 shutdown_connections 2023-10-14T09:37:28.728 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.627+0000 7f26120aa640 1 -- 172.21.15.102:0/2998427125 >> 172.21.15.102:0/2998427125 conn(0x7f26040538a0 msgr2=0x7f26040557e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:28.728 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.627+0000 7f26120aa640 1 -- 172.21.15.102:0/2998427125 shutdown_connections 2023-10-14T09:37:28.728 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.627+0000 7f26120aa640 1 -- 172.21.15.102:0/2998427125 wait complete. 2023-10-14T09:37:28.729 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.627+0000 7fc782ffd640 1 -- 172.21.15.102:0/3242234085 --> [v2:172.21.15.129:6822/2933886914,v1:172.21.15.129:6824/2933886914] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc774002cb0 con 0x7fc788073160 2023-10-14T09:37:28.729 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.628+0000 7fc7997fa640 1 -- 172.21.15.102:0/3242234085 <== osd.7 v2:172.21.15.129:6822/2933886914 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc774002cb0 con 0x7fc788073160 2023-10-14T09:37:28.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.629+0000 7fc782ffd640 1 -- 172.21.15.102:0/3242234085 >> [v2:172.21.15.129:6822/2933886914,v1:172.21.15.129:6824/2933886914] conn(0x7fc788073160 msgr2=0x7fc788075580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.629+0000 7fc782ffd640 1 --2- 172.21.15.102:0/3242234085 >> [v2:172.21.15.129:6822/2933886914,v1:172.21.15.129:6824/2933886914] conn(0x7fc788073160 0x7fc788075580 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.629+0000 7fc782ffd640 1 -- 172.21.15.102:0/3242234085 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc78806af40 msgr2=0x7fc78806d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.629+0000 7fc782ffd640 1 --2- 172.21.15.102:0/3242234085 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc78806af40 0x7fc78806d400 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc79400a7b0 tx=0x7fc79400d040 comp rx=0 tx=0).stop 2023-10-14T09:37:28.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.629+0000 7fc782ffd640 1 -- 172.21.15.102:0/3242234085 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc79c071b30 msgr2=0x7fc79c157d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:28.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.629+0000 7fc782ffd640 1 --2- 172.21.15.102:0/3242234085 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc79c071b30 0x7fc79c157d90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc78c00c400 tx=0x7fc78c00c8c0 comp rx=0 tx=0).stop 2023-10-14T09:37:28.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.629+0000 7fc7a116d640 1 -- 172.21.15.102:0/3242234085 reap_dead start 2023-10-14T09:37:28.732 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.631+0000 7fc782ffd640 1 -- 172.21.15.102:0/3242234085 shutdown_connections 2023-10-14T09:37:28.732 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.631+0000 7fc782ffd640 1 -- 172.21.15.102:0/3242234085 >> 172.21.15.102:0/3242234085 conn(0x7fc79c06bc10 msgr2=0x7fc79c06fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:28.732 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.631+0000 7fc782ffd640 1 -- 172.21.15.102:0/3242234085 shutdown_connections 2023-10-14T09:37:28.732 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:28.631+0000 7fc782ffd640 1 -- 172.21.15.102:0/3242234085 wait complete. 2023-10-14T09:37:28.733 INFO:teuthology.orchestra.run.smithi102.stdout:64424509447 2023-10-14T09:37:28.733 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-14T09:37:28.734 INFO:teuthology.orchestra.run.smithi102.stdout:64424509447 2023-10-14T09:37:28.734 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-14T09:37:28.735 INFO:teuthology.orchestra.run.smithi102.stdout:60129542150 2023-10-14T09:37:28.736 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-14T09:37:28.737 INFO:teuthology.orchestra.run.smithi102.stdout:64424509446 2023-10-14T09:37:28.737 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-14T09:37:28.738 INFO:teuthology.orchestra.run.smithi102.stdout:64424509447 2023-10-14T09:37:28.738 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-14T09:37:28.739 INFO:teuthology.orchestra.run.smithi102.stdout:64424509445 2023-10-14T09:37:28.740 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-14T09:37:29.071 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.069+0000 7f862177c640 1 Processor -- start 2023-10-14T09:37:29.072 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.069+0000 7f862177c640 1 -- start start 2023-10-14T09:37:29.073 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.071+0000 7f862177c640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f86140e3070 0x7f861403ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.074 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.072+0000 7f861affd640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f86140e3070 0x7f861403ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.074 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.072+0000 7f861affd640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f86140e3070 0x7f861403ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.102:57668/0 (socket says 172.21.15.102:57668) 2023-10-14T09:37:29.075 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.072+0000 7f861affd640 1 -- 172.21.15.102:0/2309410565 learned_addr learned my addr 172.21.15.102:0/2309410565 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:29.075 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.073+0000 7f862177c640 1 -- 172.21.15.102:0/2309410565 --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f861403c070 con 0x7f8614006b70 2023-10-14T09:37:29.075 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.073+0000 7f16c8a09640 1 Processor -- start 2023-10-14T09:37:29.075 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.073+0000 7f16c8a09640 1 -- start start 2023-10-14T09:37:29.076 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.073+0000 7f862177c640 1 -- 172.21.15.102:0/2309410565 --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86140070f0 con 0x7f8614054360 2023-10-14T09:37:29.076 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.073+0000 7f862177c640 1 -- 172.21.15.102:0/2309410565 --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f861403ef80 con 0x7f86140e3070 2023-10-14T09:37:29.076 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.074+0000 7f5d12f39640 1 Processor -- start 2023-10-14T09:37:29.077 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.074+0000 7f5d12f39640 1 -- start start 2023-10-14T09:37:29.077 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.074+0000 7f8619ffb640 1 -- 172.21.15.102:0/2309410565 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3967831917 0 0) 0x7f86140070f0 con 0x7f8614054360 2023-10-14T09:37:29.078 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.075+0000 7f16c8a09640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f16c40cf710 0x7f16c40b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.078 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.075+0000 7f16c8a09640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f16c40cfaf0 0x7f16c40b3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.078 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.075+0000 7f16c8a09640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f16c40b38e0 0x7f16c40d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.078 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.075+0000 7f16c8a09640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c40d3c60 con 0x7f16c40cfaf0 2023-10-14T09:37:29.078 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.075+0000 7f16c8a09640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c40d3980 con 0x7f16c40b38e0 2023-10-14T09:37:29.079 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.075+0000 7f16c8a09640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c40ce630 con 0x7f16c40cf710 2023-10-14T09:37:29.079 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.075+0000 7f16b9d9b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f16c40cfaf0 0x7f16c40b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.079 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.076+0000 7f16c2d9d640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f16c40b38e0 0x7f16c40d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.079 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.076+0000 7f16b9d9b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f16c40cfaf0 0x7f16c40b3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44818/0 (socket says 172.21.15.102:44818) 2023-10-14T09:37:29.079 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.076+0000 7f16b9d9b640 1 -- 172.21.15.102:0/100850986 learned_addr learned my addr 172.21.15.102:0/100850986 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:29.080 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.076+0000 7f16c259c640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f16c40cf710 0x7f16c40b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.080 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.076+0000 7f8619ffb640 1 -- 172.21.15.102:0/2309410565 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8604003520 con 0x7f8614054360 2023-10-14T09:37:29.080 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.076+0000 7f8619ffb640 1 -- 172.21.15.102:0/2309410565 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1840282115 0 0) 0x7f861403c070 con 0x7f8614006b70 2023-10-14T09:37:29.080 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.076+0000 7f8619ffb640 1 -- 172.21.15.102:0/2309410565 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86140070f0 con 0x7f8614006b70 2023-10-14T09:37:29.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.077+0000 7f861affd640 1 -- 172.21.15.102:0/2309410565 >> v1:172.21.15.129:6789/0 conn(0x7f8614054360 legacy=0x7f8614057720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.077+0000 7f861affd640 1 -- 172.21.15.102:0/2309410565 >> v1:172.21.15.102:6789/0 conn(0x7f8614006b70 legacy=0x7f8614053c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.077+0000 7f861affd640 1 -- 172.21.15.102:0/2309410565 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86140073b0 con 0x7f86140e3070 2023-10-14T09:37:29.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.077+0000 7f5d12f39640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5d0c06a4b0 0x7f5d0c0ade50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.077+0000 7f5d12f39640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f5d0c0ce1c0 0x7f5d0c0cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.078+0000 7f5d12f39640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d0c06cf50 con 0x7f5d0c158f60 2023-10-14T09:37:29.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.078+0000 7f5d12f39640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d0c15d970 con 0x7f5d0c06a4b0 2023-10-14T09:37:29.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.076+0000 7f16b9d9b640 1 -- 172.21.15.102:0/100850986 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f16c40cf710 msgr2=0x7f16c40b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:29.083 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.076+0000 7f16b9d9b640 1 --2- 172.21.15.102:0/100850986 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f16c40cf710 0x7f16c40b2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.083 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.076+0000 7f16b9d9b640 1 -- 172.21.15.102:0/100850986 >> v2:172.21.15.129:3300/0 conn(0x7f16c40b38e0 msgr2=0x7f16c40d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:29.083 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.076+0000 7f58d8896640 1 Processor -- start 2023-10-14T09:37:29.083 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.077+0000 7f58d8896640 1 -- start start 2023-10-14T09:37:29.084 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.078+0000 7f5d12f39640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d0c15ccf0 con 0x7f5d0c0ce1c0 2023-10-14T09:37:29.084 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.077+0000 7f16b9d9b640 1 --2- 172.21.15.102:0/100850986 >> v2:172.21.15.129:3300/0 conn(0x7f16c40b38e0 0x7f16c40d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.084 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.077+0000 7f16b9d9b640 1 -- 172.21.15.102:0/100850986 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c40ce910 con 0x7f16c40cfaf0 2023-10-14T09:37:29.085 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.078+0000 7f16c2d9d640 1 --2- 172.21.15.102:0/100850986 >> v2:172.21.15.129:3300/0 conn(0x7f16c40b38e0 0x7f16c40d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:37:29.085 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.078+0000 7f9acdfc5640 1 Processor -- start 2023-10-14T09:37:29.086 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.078+0000 7f5d114d6640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f5d0c0ce1c0 0x7f5d0c0cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.086 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.078+0000 7f5d114d6640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f5d0c0ce1c0 0x7f5d0c0cc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.102:57692/0 (socket says 172.21.15.102:57692) 2023-10-14T09:37:29.086 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.078+0000 7f5d114d6640 1 -- 172.21.15.102:0/3353918857 learned_addr learned my addr 172.21.15.102:0/3353918857 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:29.086 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.078+0000 7f5d0bfff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5d0c06a4b0 0x7f5d0c0ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.087 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.079+0000 7f9acdfc5640 1 -- start start 2023-10-14T09:37:29.087 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.079+0000 7f16b9d9b640 1 --2- 172.21.15.102:0/100850986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16c40cfaf0 0x7f16c40b3250 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f16c406cd60 tx=0x7f16ac02be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cbdb946a4a7a521 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:29.087 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.079+0000 7f58d8896640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f58d40caa80 0x7f58d4069da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.088 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.078+0000 7f5d10cd5640 1 --1- 172.21.15.102:0/3353918857 >> v1:172.21.15.102:6789/0 conn(0x7f5d0c158f60 0x7f5d0c069da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:45684/0 (socket says 172.21.15.102:45684) 2023-10-14T09:37:29.088 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.079+0000 7f58d8896640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d40caec0 con 0x7f58d406a2e0 2023-10-14T09:37:29.089 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.079+0000 7f58d8896640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d40cb140 con 0x7f58d40addb0 2023-10-14T09:37:29.089 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.079+0000 7f58d8896640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d4161a50 con 0x7f58d40caa80 2023-10-14T09:37:29.089 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.079+0000 7f861affd640 1 --2- 172.21.15.102:0/2309410565 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f86140e3070 0x7f861403ea40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f860c009870 tx=0x7f860c02b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a92cad7fc3b52013 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:29.090 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.079+0000 7f16c1d9b640 1 -- 172.21.15.102:0/100850986 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ac02ca10 con 0x7f16c40cfaf0 2023-10-14T09:37:29.090 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.080+0000 7f16c1d9b640 1 -- 172.21.15.102:0/100850986 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16ac02cb70 con 0x7f16c40cfaf0 2023-10-14T09:37:29.090 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.080+0000 7f16c1d9b640 1 -- 172.21.15.102:0/100850986 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ac0343f0 con 0x7f16c40cfaf0 2023-10-14T09:37:29.091 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.079+0000 7f5d114d6640 1 -- 172.21.15.102:0/3353918857 >> v2:172.21.15.102:3300/0 conn(0x7f5d0c06a4b0 msgr2=0x7f5d0c0ade50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:29.091 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.080+0000 7f5d114d6640 1 --2- 172.21.15.102:0/3353918857 >> v2:172.21.15.102:3300/0 conn(0x7f5d0c06a4b0 0x7f5d0c0ade50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.091 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.080+0000 7f5d114d6640 1 -- 172.21.15.102:0/3353918857 >> v1:172.21.15.102:6789/0 conn(0x7f5d0c158f60 legacy=0x7f5d0c069da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:29.092 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.080+0000 7f8619ffb640 1 -- 172.21.15.102:0/2309410565 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860c030860 con 0x7f86140e3070 2023-10-14T09:37:29.092 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.080+0000 7f8619ffb640 1 -- 172.21.15.102:0/2309410565 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860c0309c0 con 0x7f86140e3070 2023-10-14T09:37:29.092 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.080+0000 7f8619ffb640 1 -- 172.21.15.102:0/2309410565 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860c030d50 con 0x7f86140e3070 2023-10-14T09:37:29.092 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.080+0000 7f58d259c640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f58d40addb0 0x7f58d40c9000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.102:35462/0 (socket says 172.21.15.102:35462) 2023-10-14T09:37:29.093 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.080+0000 7f58d259c640 1 -- 172.21.15.102:0/3802467035 learned_addr learned my addr 172.21.15.102:0/3802467035 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:29.093 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.080+0000 7f5d114d6640 1 -- 172.21.15.102:0/3353918857 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d0c15cfd0 con 0x7f5d0c0ce1c0 2023-10-14T09:37:29.093 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.080+0000 7f9acdfc5640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f9ac80cf710 0x7f9ac80b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.093 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.080+0000 7f9acdfc5640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9ac80cfaf0 0x7f9ac80b3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.094 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.080+0000 7f9acdfc5640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9ac80b38e0 0x7f9ac80d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.094 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.080+0000 7f58d1d9b640 1 --2- 172.21.15.102:0/3802467035 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f58d40caa80 0x7f58d4069da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.094 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.080+0000 7f5d0bfff640 1 --2- 172.21.15.102:0/3353918857 >> v2:172.21.15.102:3300/0 conn(0x7f5d0c06a4b0 0x7f5d0c0ade50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:37:29.095 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.080+0000 7f9acdfc5640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac80d3c60 con 0x7f9ac80b38e0 2023-10-14T09:37:29.095 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.080+0000 7f9acdfc5640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac80d3980 con 0x7f9ac80cf710 2023-10-14T09:37:29.095 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.080+0000 7f9acdfc5640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac80ce630 con 0x7f9ac80cfaf0 2023-10-14T09:37:29.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.081+0000 7f9ac7fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9ac80b38e0 0x7f9ac80d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.081+0000 7f9ac7fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9ac80b38e0 0x7f9ac80d0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44834/0 (socket says 172.21.15.102:44834) 2023-10-14T09:37:29.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.081+0000 7f9ac7fff640 1 -- 172.21.15.102:0/3912175897 learned_addr learned my addr 172.21.15.102:0/3912175897 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:29.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.081+0000 7f16c8a09640 1 -- 172.21.15.102:0/100850986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16c40cfaf0 msgr2=0x7f16c40b3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.097 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.081+0000 7f16c8a09640 1 --2- 172.21.15.102:0/100850986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16c40cfaf0 0x7f16c40b3250 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f16c406cd60 tx=0x7f16ac02be70 comp rx=0 tx=0).stop 2023-10-14T09:37:29.097 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.081+0000 7f9ac6ffd640 1 --2- 172.21.15.102:0/3912175897 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9ac80cfaf0 0x7f9ac80b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.097 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.082+0000 7f9ac77fe640 1 --2- 172.21.15.102:0/3912175897 >> v2:172.21.15.129:3300/0 conn(0x7f9ac80cf710 0x7f9ac80b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.098 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.082+0000 7f58d159a640 1 -- 172.21.15.102:0/3802467035 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1994946224 0 0) 0x7f58d40cb140 con 0x7f58d40addb0 2023-10-14T09:37:29.098 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.082+0000 7f58d159a640 1 -- 172.21.15.102:0/3802467035 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58b4003520 con 0x7f58d40addb0 2023-10-14T09:37:29.099 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.082+0000 7f58d159a640 1 -- 172.21.15.102:0/3802467035 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046672329 0 0) 0x7f58d40caec0 con 0x7f58d406a2e0 2023-10-14T09:37:29.099 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.082+0000 7f58d159a640 1 -- 172.21.15.102:0/3802467035 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58b40048a0 con 0x7f58d406a2e0 2023-10-14T09:37:29.099 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.082+0000 7f58d1d9b640 1 -- 172.21.15.102:0/3802467035 >> v1:172.21.15.129:6789/0 conn(0x7f58d40addb0 legacy=0x7f58d40c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.099 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.082+0000 7f58d1d9b640 1 -- 172.21.15.102:0/3802467035 >> v1:172.21.15.102:6789/0 conn(0x7f58d406a2e0 legacy=0x7f58d41650d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.099 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.082+0000 7f58d1d9b640 1 -- 172.21.15.102:0/3802467035 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d406b030 con 0x7f58d40caa80 2023-10-14T09:37:29.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.082+0000 7f862177c640 1 -- 172.21.15.102:0/2309410565 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f86140e3070 msgr2=0x7f861403ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.082+0000 7f862177c640 1 --2- 172.21.15.102:0/2309410565 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f86140e3070 0x7f861403ea40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f860c009870 tx=0x7f860c02b9a0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.082+0000 7f5d114d6640 1 --2- 172.21.15.102:0/3353918857 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5d0c0ce1c0 0x7f5d0c0cc660 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c0ce950 tx=0x7f5d0402d210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f0ab896f58f0224 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:29.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.082+0000 7f862177c640 1 -- 172.21.15.102:0/2309410565 shutdown_connections 2023-10-14T09:37:29.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.082+0000 7f862177c640 1 --2- 172.21.15.102:0/2309410565 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f86140e3070 0x7f861403ea40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.082+0000 7f862177c640 1 -- 172.21.15.102:0/2309410565 >> 172.21.15.102:0/2309410565 conn(0x7f8614055a90 msgr2=0x7f8614055e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:29.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.082+0000 7f9ac7fff640 1 -- 172.21.15.102:0/3912175897 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9ac80cfaf0 msgr2=0x7f9ac80b3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:29.102 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.082+0000 7f9ac7fff640 1 --2- 172.21.15.102:0/3912175897 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9ac80cfaf0 0x7f9ac80b3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.102 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.082+0000 7f9ac7fff640 1 -- 172.21.15.102:0/3912175897 >> v2:172.21.15.129:3300/0 conn(0x7f9ac80cf710 msgr2=0x7f9ac80b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:29.102 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.082+0000 7f9ac7fff640 1 --2- 172.21.15.102:0/3912175897 >> v2:172.21.15.129:3300/0 conn(0x7f9ac80cf710 0x7f9ac80b2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.102 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.082+0000 7f9ac7fff640 1 -- 172.21.15.102:0/3912175897 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac80ce910 con 0x7f9ac80b38e0 2023-10-14T09:37:29.103 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.083+0000 7f862177c640 1 -- 172.21.15.102:0/2309410565 shutdown_connections 2023-10-14T09:37:29.103 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.083+0000 7f16c8a09640 1 -- 172.21.15.102:0/100850986 shutdown_connections 2023-10-14T09:37:29.103 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.083+0000 7f16c8a09640 1 --2- 172.21.15.102:0/100850986 >> v2:172.21.15.129:3300/0 conn(0x7f16c40b38e0 0x7f16c40d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.104 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.083+0000 7f16c8a09640 1 --2- 172.21.15.102:0/100850986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16c40cfaf0 0x7f16c40b3250 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.104 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.083+0000 7f16c8a09640 1 --2- 172.21.15.102:0/100850986 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f16c40cf710 0x7f16c40b2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.104 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.083+0000 7f16c8a09640 1 -- 172.21.15.102:0/100850986 >> 172.21.15.102:0/100850986 conn(0x7f16c40d2cc0 msgr2=0x7f16c40d30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:29.104 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.083+0000 7f862177c640 1 -- 172.21.15.102:0/2309410565 wait complete. 2023-10-14T09:37:29.105 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.083+0000 7f5d0b7fe640 1 -- 172.21.15.102:0/3353918857 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0400a0d0 con 0x7f5d0c0ce1c0 2023-10-14T09:37:29.105 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.083+0000 7f9ac7fff640 1 --2- 172.21.15.102:0/3912175897 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ac80b38e0 0x7f9ac80d0aa0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80d2c20 tx=0x7f9ac002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81478b6b7b089fba server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:29.106 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.083+0000 7f5d0b7fe640 1 -- 172.21.15.102:0/3353918857 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d0400a230 con 0x7f5d0c0ce1c0 2023-10-14T09:37:29.106 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.083+0000 7f5d0b7fe640 1 -- 172.21.15.102:0/3353918857 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0400a5c0 con 0x7f5d0c0ce1c0 2023-10-14T09:37:29.106 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.084+0000 7f58d1d9b640 1 --2- 172.21.15.102:0/3802467035 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f58d40caa80 0x7f58d4069da0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f58c4009dc0 tx=0x7f58c402bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=425f40496d6f3ac7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:29.107 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.085+0000 7f58d159a640 1 -- 172.21.15.102:0/3802467035 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c402ccc0 con 0x7f58d40caa80 2023-10-14T09:37:29.107 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.084+0000 7f9ac67fc640 1 -- 172.21.15.102:0/3912175897 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac002c9f0 con 0x7f9ac80b38e0 2023-10-14T09:37:29.107 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.084+0000 7f9ac67fc640 1 -- 172.21.15.102:0/3912175897 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac002cb50 con 0x7f9ac80b38e0 2023-10-14T09:37:29.107 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.084+0000 7f9ac67fc640 1 -- 172.21.15.102:0/3912175897 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac00343f0 con 0x7f9ac80b38e0 2023-10-14T09:37:29.108 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.085+0000 7f58d159a640 1 -- 172.21.15.102:0/3802467035 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c402ce20 con 0x7f58d40caa80 2023-10-14T09:37:29.108 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.085+0000 7f5d12f39640 1 -- 172.21.15.102:0/3353918857 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5d0c0ce1c0 msgr2=0x7f5d0c0cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.109 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.085+0000 7f9acdfc5640 1 -- 172.21.15.102:0/3912175897 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ac80b38e0 msgr2=0x7f9ac80d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.109 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.085+0000 7f9acdfc5640 1 --2- 172.21.15.102:0/3912175897 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ac80b38e0 0x7f9ac80d0aa0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80d2c20 tx=0x7f9ac002be50 comp rx=0 tx=0).stop 2023-10-14T09:37:29.109 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.085+0000 7f58d159a640 1 -- 172.21.15.102:0/3802467035 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c4034640 con 0x7f58d40caa80 2023-10-14T09:37:29.110 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.085+0000 7f5d12f39640 1 --2- 172.21.15.102:0/3353918857 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5d0c0ce1c0 0x7f5d0c0cc660 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c0ce950 tx=0x7f5d0402d210 comp rx=0 tx=0).stop 2023-10-14T09:37:29.110 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.085+0000 7f862177c640 1 Processor -- start 2023-10-14T09:37:29.110 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.085+0000 7f16c8a09640 1 -- 172.21.15.102:0/100850986 shutdown_connections 2023-10-14T09:37:29.111 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.086+0000 7f16c8a09640 1 -- 172.21.15.102:0/100850986 wait complete. 2023-10-14T09:37:29.111 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.086+0000 7f9acdfc5640 1 -- 172.21.15.102:0/3912175897 shutdown_connections 2023-10-14T09:37:29.111 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.086+0000 7f9acdfc5640 1 --2- 172.21.15.102:0/3912175897 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ac80b38e0 0x7f9ac80d0aa0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.112 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.086+0000 7f9acdfc5640 1 --2- 172.21.15.102:0/3912175897 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9ac80cfaf0 0x7f9ac80b3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.112 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.086+0000 7f9acdfc5640 1 --2- 172.21.15.102:0/3912175897 >> v2:172.21.15.129:3300/0 conn(0x7f9ac80cf710 0x7f9ac80b2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.112 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.086+0000 7f9acdfc5640 1 -- 172.21.15.102:0/3912175897 >> 172.21.15.102:0/3912175897 conn(0x7f9ac80d2cc0 msgr2=0x7f9ac80d30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:29.112 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.086+0000 7f862177c640 1 -- start start 2023-10-14T09:37:29.113 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.086+0000 7f9acdfc5640 1 -- 172.21.15.102:0/3912175897 shutdown_connections 2023-10-14T09:37:29.113 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.086+0000 7f5d12f39640 1 -- 172.21.15.102:0/3353918857 shutdown_connections 2023-10-14T09:37:29.113 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.086+0000 7f5d12f39640 1 --2- 172.21.15.102:0/3353918857 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5d0c0ce1c0 0x7f5d0c0cc660 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.113 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.086+0000 7f5d12f39640 1 --2- 172.21.15.102:0/3353918857 >> v2:172.21.15.102:3300/0 conn(0x7f5d0c06a4b0 0x7f5d0c0ade50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.114 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.086+0000 7f5d12f39640 1 -- 172.21.15.102:0/3353918857 >> 172.21.15.102:0/3353918857 conn(0x7f5d0c0ce9b0 msgr2=0x7f5d0c0cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:29.114 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.086+0000 7f58d8896640 1 -- 172.21.15.102:0/3802467035 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f58d40caa80 msgr2=0x7f58d4069da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.114 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.086+0000 7f58d8896640 1 --2- 172.21.15.102:0/3802467035 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f58d40caa80 0x7f58d4069da0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f58c4009dc0 tx=0x7f58c402bf10 comp rx=0 tx=0).stop 2023-10-14T09:37:29.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.086+0000 7f5d12f39640 1 -- 172.21.15.102:0/3353918857 shutdown_connections 2023-10-14T09:37:29.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.086+0000 7f5d12f39640 1 -- 172.21.15.102:0/3353918857 wait complete. 2023-10-14T09:37:29.116 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.087+0000 7f862177c640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8614006b70 0x7f86140d3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.116 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.087+0000 7f862177c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8614054360 0x7f861404cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.116 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.087+0000 7f862177c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f86140e3070 0x7f861404d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.116 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.087+0000 7f862177c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861404f9c0 con 0x7f8614054360 2023-10-14T09:37:29.116 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.087+0000 7f862177c640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86140deb30 con 0x7f86140e3070 2023-10-14T09:37:29.116 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.087+0000 7f862177c640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86140d6b50 con 0x7f8614006b70 2023-10-14T09:37:29.117 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.087+0000 7f58d8896640 1 -- 172.21.15.102:0/3802467035 shutdown_connections 2023-10-14T09:37:29.117 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.087+0000 7f58d8896640 1 --2- 172.21.15.102:0/3802467035 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f58d40caa80 0x7f58d4069da0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.117 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.087+0000 7f58d8896640 1 -- 172.21.15.102:0/3802467035 >> 172.21.15.102:0/3802467035 conn(0x7f58d40ce9b0 msgr2=0x7f58d40cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:29.118 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.087+0000 7f58d8896640 1 -- 172.21.15.102:0/3802467035 shutdown_connections 2023-10-14T09:37:29.118 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.088+0000 7f58d8896640 1 -- 172.21.15.102:0/3802467035 wait complete. 2023-10-14T09:37:29.118 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.086+0000 7f9acdfc5640 1 -- 172.21.15.102:0/3912175897 wait complete. 2023-10-14T09:37:29.119 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.088+0000 7f861a7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8614054360 0x7f861404cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.119 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.088+0000 7f861affd640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8614006b70 0x7f86140d3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.119 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.088+0000 7f861b7fe640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f86140e3070 0x7f861404d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.119 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.088+0000 7f861b7fe640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f86140e3070 0x7f861404d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.102:57714/0 (socket says 172.21.15.102:57714) 2023-10-14T09:37:29.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.088+0000 7f861b7fe640 1 -- 172.21.15.102:0/1628225269 learned_addr learned my addr 172.21.15.102:0/1628225269 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:29.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.089+0000 7f16c8a09640 1 Processor -- start 2023-10-14T09:37:29.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.089+0000 7f9acdfc5640 1 Processor -- start 2023-10-14T09:37:29.121 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.089+0000 7f861a7fc640 1 -- 172.21.15.102:0/1628225269 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8614006b70 msgr2=0x7f86140d3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.121 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.089+0000 7f861a7fc640 1 --2- 172.21.15.102:0/1628225269 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8614006b70 0x7f86140d3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.121 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.089+0000 7f861a7fc640 1 -- 172.21.15.102:0/1628225269 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f86140e3070 msgr2=0x7f861404d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.122 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.089+0000 7f861a7fc640 1 --2- 172.21.15.102:0/1628225269 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f86140e3070 0x7f861404d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.122 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.089+0000 7f861a7fc640 1 -- 172.21.15.102:0/1628225269 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860c0094d0 con 0x7f8614054360 2023-10-14T09:37:29.122 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.089+0000 7f16c8a09640 1 -- start start 2023-10-14T09:37:29.123 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.090+0000 7f5d12f39640 1 Processor -- start 2023-10-14T09:37:29.123 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.090+0000 7f5d12f39640 1 -- start start 2023-10-14T09:37:29.123 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.090+0000 7f861a7fc640 1 --2- 172.21.15.102:0/1628225269 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8614054360 0x7f861404cb40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f861000c480 tx=0x7f861000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:29.124 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.090+0000 7f86037fe640 1 -- 172.21.15.102:0/1628225269 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8610005480 con 0x7f8614054360 2023-10-14T09:37:29.124 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.090+0000 7f862177c640 1 -- 172.21.15.102:0/1628225269 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86140d6e30 con 0x7f8614054360 2023-10-14T09:37:29.124 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.089+0000 7f9acdfc5640 1 -- start start 2023-10-14T09:37:29.124 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.091+0000 7f58d8896640 1 Processor -- start 2023-10-14T09:37:29.125 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.091+0000 7f9acdfc5640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9ac80b38e0 0x7f9ac80c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.125 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.091+0000 7f9acdfc5640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ac80cf710 0x7f9ac80c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.125 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.091+0000 7f9acdfc5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ac80cfaf0 0x7f9ac80b6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.091+0000 7f9acdfc5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac80c8f90 con 0x7f9ac80cfaf0 2023-10-14T09:37:29.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.091+0000 7f9acdfc5640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac80c7360 con 0x7f9ac80cf710 2023-10-14T09:37:29.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.091+0000 7f9acdfc5640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac80b82d0 con 0x7f9ac80b38e0 2023-10-14T09:37:29.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.091+0000 7f862177c640 1 -- 172.21.15.102:0/1628225269 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86140d3760 con 0x7f8614054360 2023-10-14T09:37:29.127 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.091+0000 7f86037fe640 1 -- 172.21.15.102:0/1628225269 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86100035f0 con 0x7f8614054360 2023-10-14T09:37:29.127 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.091+0000 7f86037fe640 1 -- 172.21.15.102:0/1628225269 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8610005480 con 0x7f8614054360 2023-10-14T09:37:29.127 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.092+0000 7f9ac77fe640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9ac80b38e0 0x7f9ac80c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.128 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.092+0000 7f58d8896640 1 -- start start 2023-10-14T09:37:29.128 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.092+0000 7f9ac77fe640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9ac80b38e0 0x7f9ac80c6e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.102:60626/0 (socket says 172.21.15.102:60626) 2023-10-14T09:37:29.128 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.092+0000 7f9ac77fe640 1 -- 172.21.15.102:0/2343947378 learned_addr learned my addr 172.21.15.102:0/2343947378 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:29.129 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.092+0000 7f9ac6ffd640 1 --2- 172.21.15.102:0/2343947378 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ac80cf710 0x7f9ac80c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.129 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.093+0000 7f9ac7fff640 1 --2- 172.21.15.102:0/2343947378 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ac80cfaf0 0x7f9ac80b6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.129 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.093+0000 7f9ac77fe640 1 -- 172.21.15.102:0/2343947378 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ac80cf710 msgr2=0x7f9ac80c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.129 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.093+0000 7f9ac77fe640 1 --2- 172.21.15.102:0/2343947378 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ac80cf710 0x7f9ac80c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.129 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.093+0000 7f9ac77fe640 1 -- 172.21.15.102:0/2343947378 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ac80cfaf0 msgr2=0x7f9ac80b6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.130 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.093+0000 7f9ac77fe640 1 --2- 172.21.15.102:0/2343947378 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ac80cfaf0 0x7f9ac80b6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.130 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.093+0000 7f9ac77fe640 1 -- 172.21.15.102:0/2343947378 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac0009b30 con 0x7f9ac80b38e0 2023-10-14T09:37:29.130 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.093+0000 7f16c8a09640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f16c40b38e0 0x7f16c41551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.131 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.093+0000 7f16c8a09640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16c40cf710 0x7f16c40c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.131 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.093+0000 7f16c8a09640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f16c40cfaf0 0x7f16c40b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.131 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.093+0000 7ff741d55640 1 Processor -- start 2023-10-14T09:37:29.131 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.094+0000 7f58d8896640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f58d406a2e0 0x7f58d40c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.132 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.094+0000 7f58d8896640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f58d40addb0 0x7f58d41ff1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.132 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.093+0000 7f16c8a09640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c40ca850 con 0x7f16c40cf710 2023-10-14T09:37:29.132 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.093+0000 7f16c8a09640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c40cab30 con 0x7f16c40b38e0 2023-10-14T09:37:29.133 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.093+0000 7f16c8a09640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c40cae10 con 0x7f16c40cfaf0 2023-10-14T09:37:29.133 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.094+0000 7f16c259c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f16c40b38e0 0x7f16c41551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.133 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.094+0000 7f16c259c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f16c40b38e0 0x7f16c41551f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.102:57738/0 (socket says 172.21.15.102:57738) 2023-10-14T09:37:29.133 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.094+0000 7f16c259c640 1 -- 172.21.15.102:0/2034413486 learned_addr learned my addr 172.21.15.102:0/2034413486 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:29.134 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.094+0000 7ff741d55640 1 -- start start 2023-10-14T09:37:29.134 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.094+0000 7f58d8896640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58d40caa80 0x7f58d40c4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.134 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.094+0000 7f58d8896640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d41ff710 con 0x7f58d40caa80 2023-10-14T09:37:29.134 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.094+0000 7f58d8896640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d40c4770 con 0x7f58d40addb0 2023-10-14T09:37:29.135 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.094+0000 7f58d8896640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d40c4a40 con 0x7f58d406a2e0 2023-10-14T09:37:29.135 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.094+0000 7f86037fe640 1 -- 172.21.15.102:0/1628225269 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8610003760 con 0x7f8614054360 2023-10-14T09:37:29.135 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.094+0000 7f16b9d9b640 1 --2- 172.21.15.102:0/2034413486 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16c40cf710 0x7f16c40c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.136 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.094+0000 7f00a4656640 1 Processor -- start 2023-10-14T09:37:29.136 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.094+0000 7f9ac77fe640 1 --2- 172.21.15.102:0/2343947378 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9ac80b38e0 0x7f9ac80c6e20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9abc00d800 tx=0x7f9abc00dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:29.136 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.095+0000 7f862177c640 1 -- 172.21.15.102:0/1628225269 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85fc005250 con 0x7f8614054360 2023-10-14T09:37:29.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.094+0000 7f58d1d9b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f58d40addb0 0x7f58d41ff1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.095+0000 7f58d2d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58d40caa80 0x7f58d40c4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.095+0000 7f58d2d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58d40caa80 0x7f58d40c4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44880/0 (socket says 172.21.15.102:44880) 2023-10-14T09:37:29.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.095+0000 7f58d2d9d640 1 -- 172.21.15.102:0/3925450721 learned_addr learned my addr 172.21.15.102:0/3925450721 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:29.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.095+0000 7f58d259c640 1 --2- 172.21.15.102:0/3925450721 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f58d406a2e0 0x7f58d40c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.095+0000 7f5d12f39640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d0c06a4b0 0x7f5d0c157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.095+0000 7f5d12f39640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5d0c0ce1c0 0x7f5d0c146d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.095+0000 7f5d12f39640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5d0c158f60 0x7f5d0c0c6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.095+0000 7f5d10cd5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d0c06a4b0 0x7f5d0c157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.095+0000 7f5d10cd5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d0c06a4b0 0x7f5d0c157470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44894/0 (socket says 172.21.15.102:44894) 2023-10-14T09:37:29.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.095+0000 7f9aaffff640 1 -- 172.21.15.102:0/2343947378 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc0096a0 con 0x7f9ac80b38e0 2023-10-14T09:37:29.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.095+0000 7f9aaffff640 1 -- 172.21.15.102:0/2343947378 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9abc009800 con 0x7f9ac80b38e0 2023-10-14T09:37:29.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.095+0000 7f9aaffff640 1 -- 172.21.15.102:0/2343947378 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc009b90 con 0x7f9ac80b38e0 2023-10-14T09:37:29.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.095+0000 7f9acdfc5640 1 -- 172.21.15.102:0/2343947378 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac81f33b0 con 0x7f9ac80b38e0 2023-10-14T09:37:29.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.095+0000 7f9acdfc5640 1 -- 172.21.15.102:0/2343947378 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac80c8940 con 0x7f9ac80b38e0 2023-10-14T09:37:29.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.095+0000 7f00a4656640 1 -- start start 2023-10-14T09:37:29.141 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.096+0000 7ff741d55640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7ff73c0cf710 0x7ff73c0b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.141 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.096+0000 7ff741d55640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff73c0b6cd0 0x7ff73c0b3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.141 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.096+0000 7ff741d55640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff73c0d3980 con 0x7ff73c0cfaf0 2023-10-14T09:37:29.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.096+0000 7ff741d55640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff73c0d3c60 con 0x7ff73c0cf710 2023-10-14T09:37:29.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.096+0000 7ff741d55640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c0ce630 con 0x7ff73c0b6cd0 2023-10-14T09:37:29.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.096+0000 7f5d12f39640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c157050 con 0x7f5d0c06a4b0 2023-10-14T09:37:29.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.096+0000 7f5d12f39640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c1566d0 con 0x7f5d0c158f60 2023-10-14T09:37:29.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.096+0000 7f5d12f39640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c1f46c0 con 0x7f5d0c0ce1c0 2023-10-14T09:37:29.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.096+0000 7f5d10cd5640 1 -- 172.21.15.102:0/3204515272 learned_addr learned my addr 172.21.15.102:0/3204515272 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:29.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.096+0000 7f5d114d6640 1 --2- 172.21.15.102:0/3204515272 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5d0c158f60 0x7f5d0c0c6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.096+0000 7f86037fe640 1 --2- 172.21.15.102:0/1628225269 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f860806aed0 0x7f860806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.144 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.096+0000 7f5d0bfff640 1 --2- 172.21.15.102:0/3204515272 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5d0c0ce1c0 0x7f5d0c146d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.144 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.096+0000 7f58d1d9b640 1 -- 172.21.15.102:0/3925450721 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f58d406a2e0 msgr2=0x7f58d40c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.144 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.097+0000 7f58d1d9b640 1 --2- 172.21.15.102:0/3925450721 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f58d406a2e0 0x7f58d40c81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.144 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.097+0000 7f58d1d9b640 1 -- 172.21.15.102:0/3925450721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58d40caa80 msgr2=0x7f58d40c4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.097+0000 7f58d1d9b640 1 --2- 172.21.15.102:0/3925450721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58d40caa80 0x7f58d40c4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.097+0000 7f58d1d9b640 1 -- 172.21.15.102:0/3925450721 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c4009a70 con 0x7f58d40addb0 2023-10-14T09:37:29.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.096+0000 7ff73bfff640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff73c0b6cd0 0x7ff73c0b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.097+0000 7ff73bfff640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff73c0b6cd0 0x7ff73c0b3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.102:60652/0 (socket says 172.21.15.102:60652) 2023-10-14T09:37:29.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.097+0000 7ff73bfff640 1 -- 172.21.15.102:0/3175869566 learned_addr learned my addr 172.21.15.102:0/3175869566 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:29.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.095+0000 7f16c2d9d640 1 --2- 172.21.15.102:0/2034413486 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f16c40cfaf0 0x7f16c40b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.095+0000 7f16c259c640 1 -- 172.21.15.102:0/2034413486 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f16c40cfaf0 msgr2=0x7f16c40b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.095+0000 7f16c259c640 1 --2- 172.21.15.102:0/2034413486 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f16c40cfaf0 0x7f16c40b2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.095+0000 7f16c259c640 1 -- 172.21.15.102:0/2034413486 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16c40cf710 msgr2=0x7f16c40c9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.095+0000 7f16c259c640 1 --2- 172.21.15.102:0/2034413486 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16c40cf710 0x7f16c40c9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.095+0000 7f16c259c640 1 -- 172.21.15.102:0/2034413486 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16bc009400 con 0x7f16c40b38e0 2023-10-14T09:37:29.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.097+0000 7f86037fe640 1 -- 172.21.15.102:0/1628225269 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8610088db0 con 0x7f8614054360 2023-10-14T09:37:29.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.095+0000 7f16c2d9d640 1 --2- 172.21.15.102:0/2034413486 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f16c40cfaf0 0x7f16c40b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:29.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.095+0000 7f16b9d9b640 1 --2- 172.21.15.102:0/2034413486 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16c40cf710 0x7f16c40c9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:37:29.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.097+0000 7f5d10cd5640 1 -- 172.21.15.102:0/3204515272 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5d0c0ce1c0 msgr2=0x7f5d0c146d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.097+0000 7f5d10cd5640 1 --2- 172.21.15.102:0/3204515272 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5d0c0ce1c0 0x7f5d0c146d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.097+0000 7f5d10cd5640 1 -- 172.21.15.102:0/3204515272 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5d0c158f60 msgr2=0x7f5d0c0c6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.097+0000 7f5d10cd5640 1 --2- 172.21.15.102:0/3204515272 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5d0c158f60 0x7f5d0c0c6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.097+0000 7f9acdfc5640 1 -- 172.21.15.102:0/2343947378 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac80c87a0 con 0x7f9ac80b38e0 2023-10-14T09:37:29.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.097+0000 7f5d10cd5640 1 -- 172.21.15.102:0/3204515272 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf8009400 con 0x7f5d0c06a4b0 2023-10-14T09:37:29.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.097+0000 7f861affd640 1 --2- 172.21.15.102:0/1628225269 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f860806aed0 0x7f860806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.098+0000 7f5d10cd5640 1 --2- 172.21.15.102:0/3204515272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d0c06a4b0 0x7f5d0c157470 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5d0000b410 tx=0x7f5d0000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:29.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.098+0000 7f16c259c640 1 --2- 172.21.15.102:0/2034413486 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f16c40b38e0 0x7f16c41551f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f16b400e900 tx=0x7f16b400edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:29.152 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.097+0000 7ff73bfff640 1 -- 172.21.15.102:0/3175869566 >> v2:172.21.15.129:3300/0 conn(0x7ff73c0cf710 msgr2=0x7ff73c0b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:29.152 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.097+0000 7ff73bfff640 1 --2- 172.21.15.102:0/3175869566 >> v2:172.21.15.129:3300/0 conn(0x7ff73c0cf710 0x7ff73c0b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.152 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.097+0000 7ff73bfff640 1 -- 172.21.15.102:0/3175869566 >> v1:172.21.15.129:6789/0 conn(0x7ff73c0cfaf0 legacy=0x7ff73c0d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:29.152 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.097+0000 7ff73bfff640 1 -- 172.21.15.102:0/3175869566 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff73c0ce910 con 0x7ff73c0b6cd0 2023-10-14T09:37:29.153 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.098+0000 7f58d1d9b640 1 --2- 172.21.15.102:0/3925450721 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f58d40addb0 0x7f58d41ff1d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f58c4033000 tx=0x7f58c4004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:29.153 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.098+0000 7f00a4656640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f009c0b3420 0x7f009c0b5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.098+0000 7f00a4656640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f009c0cfaf0 0x7f009c0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.098+0000 7f00a4656640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f009c0d3980 con 0x7f009c0cf710 2023-10-14T09:37:29.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.098+0000 7f00a4656640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f009c0d3c60 con 0x7f009c0b3420 2023-10-14T09:37:29.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.098+0000 7f00a4656640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f009c0ce630 con 0x7f009c0cfaf0 2023-10-14T09:37:29.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.099+0000 7f861affd640 1 --2- 172.21.15.102:0/1628225269 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f860806aed0 0x7f860806d390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f860c036000 tx=0x7f860c03b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:29.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.098+0000 7f16bb7fe640 1 -- 172.21.15.102:0/2034413486 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b4009660 con 0x7f16c40b38e0 2023-10-14T09:37:29.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.099+0000 7f16bb7fe640 1 -- 172.21.15.102:0/2034413486 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b400ca00 con 0x7f16c40b38e0 2023-10-14T09:37:29.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.099+0000 7f16c8a09640 1 -- 172.21.15.102:0/2034413486 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16ac009b30 con 0x7f16c40b38e0 2023-10-14T09:37:29.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.099+0000 7f58caffd640 1 -- 172.21.15.102:0/3925450721 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c4040650 con 0x7f58d40addb0 2023-10-14T09:37:29.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.099+0000 7f16bb7fe640 1 -- 172.21.15.102:0/2034413486 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b400cd70 con 0x7f16c40b38e0 2023-10-14T09:37:29.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.099+0000 7f58caffd640 1 -- 172.21.15.102:0/3925450721 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c40407b0 con 0x7f58d40addb0 2023-10-14T09:37:29.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.099+0000 7f58caffd640 1 -- 172.21.15.102:0/3925450721 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c4040b60 con 0x7f58d40addb0 2023-10-14T09:37:29.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.099+0000 7f16c8a09640 1 -- 172.21.15.102:0/2034413486 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c40cb3d0 con 0x7f16c40b38e0 2023-10-14T09:37:29.158 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.099+0000 7f00a23f2640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f009c0cf710 0x7f009c0b2d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.102:35482/0 (socket says 172.21.15.102:35482) 2023-10-14T09:37:29.158 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.099+0000 7f00a23f2640 1 -- 172.21.15.102:0/3445384790 learned_addr learned my addr 172.21.15.102:0/3445384790 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:29.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.099+0000 7f00a1bf1640 1 --2- 172.21.15.102:0/3445384790 >> v2:172.21.15.129:3300/0 conn(0x7f009c0b3420 0x7f009c0b5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.099+0000 7f00a2bf3640 1 --2- 172.21.15.102:0/3445384790 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f009c0cfaf0 0x7f009c0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.100+0000 7f00a1bf1640 1 -- 172.21.15.102:0/3445384790 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f009c0cfaf0 msgr2=0x7f009c0b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:29.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.100+0000 7f00a1bf1640 1 --2- 172.21.15.102:0/3445384790 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f009c0cfaf0 0x7f009c0b6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.100+0000 7f00a1bf1640 1 -- 172.21.15.102:0/3445384790 >> v1:172.21.15.129:6789/0 conn(0x7f009c0cf710 legacy=0x7f009c0b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:29.160 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.099+0000 7f58d8896640 1 -- 172.21.15.102:0/3925450721 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d40c4d20 con 0x7f58d40addb0 2023-10-14T09:37:29.160 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.099+0000 7f58d8896640 1 -- 172.21.15.102:0/3925450721 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d40c52e0 con 0x7f58d40addb0 2023-10-14T09:37:29.160 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.100+0000 7f00a1bf1640 1 -- 172.21.15.102:0/3445384790 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f009c0ce910 con 0x7f009c0b3420 2023-10-14T09:37:29.161 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.100+0000 7f16c8a09640 1 -- 172.21.15.102:0/2034413486 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c404e160 con 0x7f16c40b38e0 2023-10-14T09:37:29.161 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.101+0000 7f9aaffff640 1 -- 172.21.15.102:0/2343947378 <== mon.2 v2:172.21.15.129:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9abc009cf0 con 0x7f9ac80b38e0 2023-10-14T09:37:29.161 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.101+0000 7ff73bfff640 1 --2- 172.21.15.102:0/3175869566 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff73c0b6cd0 0x7ff73c0b3250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff734009e50 tx=0x7ff73402be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14e4ec422f12a9cf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:29.162 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.101+0000 7f00a1bf1640 1 --2- 172.21.15.102:0/3445384790 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f009c0b3420 0x7f009c0b5cc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f008c0097a0 tx=0x7f008c02b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ada45aca4bfa9d57 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:29.162 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.101+0000 7f58d8896640 1 -- 172.21.15.102:0/3925450721 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58ac005250 con 0x7f58d40addb0 2023-10-14T09:37:29.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.102+0000 7f9aaffff640 1 --2- 172.21.15.102:0/2343947378 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f9ab406aec0 0x7f9ab406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.102+0000 7f9aaffff640 1 -- 172.21.15.102:0/2343947378 <== mon.2 v2:172.21.15.129:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9abc0597b0 con 0x7f9ac80b38e0 2023-10-14T09:37:29.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.103+0000 7f16bb7fe640 1 -- 172.21.15.102:0/2034413486 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f16b4013470 con 0x7f16c40b38e0 2023-10-14T09:37:29.164 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.103+0000 7fe404990640 1 Processor -- start 2023-10-14T09:37:29.164 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.103+0000 7f9ac6ffd640 1 --2- 172.21.15.102:0/2343947378 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f9ab406aec0 0x7f9ab406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.164 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.103+0000 7fe404990640 1 -- start start 2023-10-14T09:37:29.165 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.104+0000 7f9ac6ffd640 1 --2- 172.21.15.102:0/2343947378 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f9ab406aec0 0x7f9ab406d380 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9ac815ec70 tx=0x7f9ab8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:29.165 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.104+0000 7fe404990640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fe4000cf710 0x7fe4000b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.165 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.104+0000 7f16bb7fe640 1 --2- 172.21.15.102:0/2034413486 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f16a806aef0 0x7f16a806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.166 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.104+0000 7fe404990640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe4000cfaf0 0x7fe4000b3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.166 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.105+0000 7fe404990640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4000d3980 con 0x7fe4000b38e0 2023-10-14T09:37:29.166 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.105+0000 7fe404990640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4000d3c60 con 0x7fe4000cf710 2023-10-14T09:37:29.167 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.105+0000 7fe404990640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4000ce630 con 0x7fe4000cfaf0 2023-10-14T09:37:29.167 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.105+0000 7f5d097fa640 1 -- 172.21.15.102:0/3204515272 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d00011830 con 0x7f5d0c06a4b0 2023-10-14T09:37:29.167 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.104+0000 7f16bb7fe640 1 -- 172.21.15.102:0/2034413486 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16b4089c50 con 0x7f16c40b38e0 2023-10-14T09:37:29.168 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.105+0000 7f16b9d9b640 1 --2- 172.21.15.102:0/2034413486 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f16a806aef0 0x7f16a806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.168 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.105+0000 7f5d097fa640 1 -- 172.21.15.102:0/3204515272 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d00011990 con 0x7f5d0c06a4b0 2023-10-14T09:37:29.168 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.105+0000 7f5d097fa640 1 -- 172.21.15.102:0/3204515272 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d00011d80 con 0x7f5d0c06a4b0 2023-10-14T09:37:29.168 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.105+0000 7f5d12f39640 1 -- 172.21.15.102:0/3204515272 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d0400c050 con 0x7f5d0c06a4b0 2023-10-14T09:37:29.169 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.105+0000 7f86037fe640 1 -- 172.21.15.102:0/1628225269 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f861008d070 con 0x7f8614054360 2023-10-14T09:37:29.169 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.105+0000 7f5d12f39640 1 -- 172.21.15.102:0/3204515272 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d0c156c70 con 0x7f5d0c06a4b0 2023-10-14T09:37:29.170 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.105+0000 7fe3f7fff640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe4000cfaf0 0x7fe4000b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.170 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.105+0000 7f58caffd640 1 -- 172.21.15.102:0/3925450721 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f58c4040cc0 con 0x7f58d40addb0 2023-10-14T09:37:29.170 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.105+0000 7fe3f7fff640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe4000cfaf0 0x7fe4000b3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.102:60674/0 (socket says 172.21.15.102:60674) 2023-10-14T09:37:29.171 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.105+0000 7fe3f7fff640 1 -- 172.21.15.102:0/1009031654 learned_addr learned my addr 172.21.15.102:0/1009031654 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:29.171 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.106+0000 7f58caffd640 1 --2- 172.21.15.102:0/3925450721 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f58b806ae70 0x7f58b806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.171 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.106+0000 7f16b9d9b640 1 --2- 172.21.15.102:0/2034413486 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f16a806aef0 0x7f16a806d3b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f16ac035000 tx=0x7f16ac030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:29.172 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.106+0000 7fe3f7fff640 1 -- 172.21.15.102:0/1009031654 >> v2:172.21.15.129:3300/0 conn(0x7fe4000cf710 msgr2=0x7fe4000b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:29.172 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.106+0000 7f58caffd640 1 -- 172.21.15.102:0/3925450721 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58c40ac5d0 con 0x7f58d40addb0 2023-10-14T09:37:29.173 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.106+0000 7fe3fe59c640 1 --2- 172.21.15.102:0/1009031654 >> v2:172.21.15.129:3300/0 conn(0x7fe4000cf710 0x7fe4000b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.173 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.106+0000 7fe3f7fff640 1 --2- 172.21.15.102:0/1009031654 >> v2:172.21.15.129:3300/0 conn(0x7fe4000cf710 0x7fe4000b2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.173 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.106+0000 7fe3f7fff640 1 -- 172.21.15.102:0/1009031654 >> v1:172.21.15.102:6789/0 conn(0x7fe4000b38e0 legacy=0x7fe4000d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.173 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.106+0000 7fe3f7fff640 1 -- 172.21.15.102:0/1009031654 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4000ce910 con 0x7fe4000cfaf0 2023-10-14T09:37:29.174 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.106+0000 7f58d259c640 1 --2- 172.21.15.102:0/3925450721 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f58b806ae70 0x7f58b806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.174 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.107+0000 7f5d12f39640 1 -- 172.21.15.102:0/3204515272 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d0c157190 con 0x7f5d0c06a4b0 2023-10-14T09:37:29.174 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.107+0000 7fe3fe59c640 1 --2- 172.21.15.102:0/1009031654 >> v2:172.21.15.129:3300/0 conn(0x7fe4000cf710 0x7fe4000b2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:29.175 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.107+0000 7f58d259c640 1 --2- 172.21.15.102:0/3925450721 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f58b806ae70 0x7f58b806d330 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f58cc000f60 tx=0x7f58cc007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:29.175 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.108+0000 7f5d097fa640 1 -- 172.21.15.102:0/3204515272 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5d0001a400 con 0x7f5d0c06a4b0 2023-10-14T09:37:29.176 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.109+0000 7f5d097fa640 1 --2- 172.21.15.102:0/3204515272 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f5cf006f2d0 0x7f5cf0071790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.176 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.109+0000 7fe3f7fff640 1 --2- 172.21.15.102:0/1009031654 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe4000cfaf0 0x7fe4000b3250 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8009870 tx=0x7fe3e802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=253e8cd8c6282995 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:29.177 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.109+0000 7f5d097fa640 1 -- 172.21.15.102:0/3204515272 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5d00089580 con 0x7f5d0c06a4b0 2023-10-14T09:37:29.177 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.109+0000 7f5d0bfff640 1 --2- 172.21.15.102:0/3204515272 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f5cf006f2d0 0x7f5cf0071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.177 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.110+0000 7f5d0bfff640 1 --2- 172.21.15.102:0/3204515272 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f5cf006f2d0 0x7f5cf0071790 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c0c5f30 tx=0x7f5cf8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:29.177 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.112+0000 7f5d097fa640 1 -- 172.21.15.102:0/3204515272 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5d0c157190 con 0x7f5d0c06a4b0 2023-10-14T09:37:29.178 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.117+0000 7fe3fdd9b640 1 -- 172.21.15.102:0/1009031654 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8031640 con 0x7fe4000cfaf0 2023-10-14T09:37:29.178 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.117+0000 7fe3fdd9b640 1 -- 172.21.15.102:0/1009031654 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e80317a0 con 0x7fe4000cfaf0 2023-10-14T09:37:29.178 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.117+0000 7fe3fdd9b640 1 -- 172.21.15.102:0/1009031654 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8031b30 con 0x7fe4000cfaf0 2023-10-14T09:37:29.179 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.118+0000 7ff73a7fc640 1 -- 172.21.15.102:0/3175869566 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73402c9e0 con 0x7ff73c0b6cd0 2023-10-14T09:37:29.179 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.118+0000 7ff73a7fc640 1 -- 172.21.15.102:0/3175869566 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73402cb40 con 0x7ff73c0b6cd0 2023-10-14T09:37:29.179 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.118+0000 7ff73a7fc640 1 -- 172.21.15.102:0/3175869566 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7340343f0 con 0x7ff73c0b6cd0 2023-10-14T09:37:29.179 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.118+0000 7f9aaffff640 1 -- 172.21.15.102:0/2343947378 <== mon.2 v2:172.21.15.129:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9abc055b80 con 0x7f9ac80b38e0 2023-10-14T09:37:29.180 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.119+0000 7ff741d55640 1 -- 172.21.15.102:0/3175869566 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff73c0b6cd0 msgr2=0x7ff73c0b3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.180 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.119+0000 7ff741d55640 1 --2- 172.21.15.102:0/3175869566 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff73c0b6cd0 0x7ff73c0b3250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff734009e50 tx=0x7ff73402be40 comp rx=0 tx=0).stop 2023-10-14T09:37:29.180 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.118+0000 7fe404990640 1 -- 172.21.15.102:0/1009031654 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe4000cfaf0 msgr2=0x7fe4000b3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.181 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.118+0000 7fe404990640 1 --2- 172.21.15.102:0/1009031654 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe4000cfaf0 0x7fe4000b3250 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8009870 tx=0x7fe3e802b8f0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.181 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.119+0000 7f00a13f0640 1 -- 172.21.15.102:0/3445384790 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c0316f0 con 0x7f009c0b3420 2023-10-14T09:37:29.181 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.119+0000 7fe404990640 1 -- 172.21.15.102:0/1009031654 shutdown_connections 2023-10-14T09:37:29.182 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.119+0000 7fe404990640 1 --2- 172.21.15.102:0/1009031654 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe4000cfaf0 0x7fe4000b3250 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.182 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.119+0000 7fe404990640 1 --2- 172.21.15.102:0/1009031654 >> v2:172.21.15.129:3300/0 conn(0x7fe4000cf710 0x7fe4000b2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.182 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.119+0000 7fe404990640 1 -- 172.21.15.102:0/1009031654 >> 172.21.15.102:0/1009031654 conn(0x7fe4000d2cc0 msgr2=0x7fe4000d30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:29.182 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.119+0000 7ff741d55640 1 -- 172.21.15.102:0/3175869566 shutdown_connections 2023-10-14T09:37:29.183 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.119+0000 7fe404990640 1 -- 172.21.15.102:0/1009031654 shutdown_connections 2023-10-14T09:37:29.183 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.119+0000 7fe404990640 1 -- 172.21.15.102:0/1009031654 wait complete. 2023-10-14T09:37:29.184 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.119+0000 7f16bb7fe640 1 -- 172.21.15.102:0/2034413486 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f16b4089e60 con 0x7f16c40b38e0 2023-10-14T09:37:29.184 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.119+0000 7ff741d55640 1 --2- 172.21.15.102:0/3175869566 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff73c0b6cd0 0x7ff73c0b3250 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.184 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.119+0000 7ff741d55640 1 --2- 172.21.15.102:0/3175869566 >> v2:172.21.15.129:3300/0 conn(0x7ff73c0cf710 0x7ff73c0b2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.119+0000 7ff741d55640 1 -- 172.21.15.102:0/3175869566 >> 172.21.15.102:0/3175869566 conn(0x7ff73c0d2cc0 msgr2=0x7ff73c0d30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:29.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.119+0000 7ff741d55640 1 -- 172.21.15.102:0/3175869566 shutdown_connections 2023-10-14T09:37:29.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.119+0000 7ff741d55640 1 -- 172.21.15.102:0/3175869566 wait complete. 2023-10-14T09:37:29.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.122+0000 7ff741d55640 1 Processor -- start 2023-10-14T09:37:29.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.122+0000 7fe404990640 1 Processor -- start 2023-10-14T09:37:29.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.122+0000 7ff741d55640 1 -- start start 2023-10-14T09:37:29.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.122+0000 7fe404990640 1 -- start start 2023-10-14T09:37:29.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.123+0000 7ff741d55640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff73c0b6cd0 0x7ff73c0c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.123+0000 7fe404990640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4000b38e0 0x7fe4000b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.123+0000 7fe404990640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe4000cf710 0x7fe4000cc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.188 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.123+0000 7fe404990640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe4000cfaf0 0x7fe400156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.188 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.123+0000 7fe404990640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4000cbf50 con 0x7fe4000b38e0 2023-10-14T09:37:29.188 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.123+0000 7fe404990640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4000c7410 con 0x7fe4000cfaf0 2023-10-14T09:37:29.188 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.123+0000 7fe404990640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4000cb890 con 0x7fe4000cf710 2023-10-14T09:37:29.188 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.123+0000 7ff741d55640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff73c0cf710 0x7ff73c1f6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.189 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.123+0000 7ff741d55640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff73c0cfaf0 0x7ff73c0afa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.189 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.123+0000 7ff741d55640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c15b1a0 con 0x7ff73c0cf710 2023-10-14T09:37:29.189 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.124+0000 7fe3fe59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4000b38e0 0x7fe4000b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.189 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.124+0000 7fe3fe59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4000b38e0 0x7fe4000b24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44902/0 (socket says 172.21.15.102:44902) 2023-10-14T09:37:29.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.124+0000 7fe3fe59c640 1 -- 172.21.15.102:0/3777082986 learned_addr learned my addr 172.21.15.102:0/3777082986 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:29.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.123+0000 7ff741d55640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c15b380 con 0x7ff73c0b6cd0 2023-10-14T09:37:29.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.123+0000 7ff741d55640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c15b660 con 0x7ff73c0cfaf0 2023-10-14T09:37:29.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.124+0000 7ff73affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff73c0cf710 0x7ff73c1f6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.124+0000 7ff73affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff73c0cf710 0x7ff73c1f6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44918/0 (socket says 172.21.15.102:44918) 2023-10-14T09:37:29.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.124+0000 7ff73affd640 1 -- 172.21.15.102:0/2433525069 learned_addr learned my addr 172.21.15.102:0/2433525069 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:29.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.124+0000 7fe3fed9d640 1 --2- 172.21.15.102:0/3777082986 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe4000cfaf0 0x7fe400156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.124+0000 7ff73bfff640 1 --2- 172.21.15.102:0/2433525069 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff73c0cfaf0 0x7ff73c0afa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.124+0000 7fe3fe59c640 1 -- 172.21.15.102:0/3777082986 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe4000cf710 msgr2=0x7fe4000cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.124+0000 7fe3fe59c640 1 --2- 172.21.15.102:0/3777082986 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe4000cf710 0x7fe4000cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.124+0000 7fe3fe59c640 1 -- 172.21.15.102:0/3777082986 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe4000cfaf0 msgr2=0x7fe400156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.124+0000 7fe3fe59c640 1 --2- 172.21.15.102:0/3777082986 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe4000cfaf0 0x7fe400156120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.193 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.124+0000 7fe3fe59c640 1 -- 172.21.15.102:0/3777082986 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e80094d0 con 0x7fe4000b38e0 2023-10-14T09:37:29.193 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.125+0000 7ff73b7fe640 1 --2- 172.21.15.102:0/2433525069 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff73c0b6cd0 0x7ff73c0c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.194 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.125+0000 7fe3fe59c640 1 --2- 172.21.15.102:0/3777082986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4000b38e0 0x7fe4000b24a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe3f000c7f0 tx=0x7fe3f000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:29.194 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.125+0000 7fe3f6ffd640 1 -- 172.21.15.102:0/3777082986 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0004220 con 0x7fe4000b38e0 2023-10-14T09:37:29.194 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.125+0000 7fe3f6ffd640 1 -- 172.21.15.102:0/3777082986 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f0004380 con 0x7fe4000b38e0 2023-10-14T09:37:29.194 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.125+0000 7fe3f6ffd640 1 -- 172.21.15.102:0/3777082986 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0005bb0 con 0x7fe4000b38e0 2023-10-14T09:37:29.194 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.125+0000 7fe404990640 1 -- 172.21.15.102:0/3777082986 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4000cbb70 con 0x7fe4000b38e0 2023-10-14T09:37:29.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.125+0000 7ff73affd640 1 -- 172.21.15.102:0/2433525069 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff73c0cfaf0 msgr2=0x7ff73c0afa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.125+0000 7ff73affd640 1 --2- 172.21.15.102:0/2433525069 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff73c0cfaf0 0x7ff73c0afa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.125+0000 7ff73affd640 1 -- 172.21.15.102:0/2433525069 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff73c0b6cd0 msgr2=0x7ff73c0c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.125+0000 7ff73affd640 1 --2- 172.21.15.102:0/2433525069 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff73c0b6cd0 0x7ff73c0c9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.125+0000 7ff73affd640 1 -- 172.21.15.102:0/2433525069 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff734009b30 con 0x7ff73c0cf710 2023-10-14T09:37:29.196 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.125+0000 7fe404990640 1 -- 172.21.15.102:0/3777082986 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe400156660 con 0x7fe4000b38e0 2023-10-14T09:37:29.196 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.127+0000 7ff73affd640 1 --2- 172.21.15.102:0/2433525069 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff73c0cf710 0x7ff73c1f6220 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff73000c430 tx=0x7ff73000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:29.197 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.128+0000 7ff723fff640 1 -- 172.21.15.102:0/2433525069 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff730011790 con 0x7ff73c0cf710 2023-10-14T09:37:29.197 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.128+0000 7ff723fff640 1 -- 172.21.15.102:0/2433525069 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7300118f0 con 0x7ff73c0cf710 2023-10-14T09:37:29.197 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.128+0000 7ff723fff640 1 -- 172.21.15.102:0/2433525069 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff730011ce0 con 0x7ff73c0cf710 2023-10-14T09:37:29.197 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.128+0000 7ff741d55640 1 -- 172.21.15.102:0/2433525069 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff73c15b940 con 0x7ff73c0cf710 2023-10-14T09:37:29.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.128+0000 7fe404990640 1 -- 172.21.15.102:0/3777082986 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3e4005250 con 0x7fe4000b38e0 2023-10-14T09:37:29.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.129+0000 7ff741d55640 1 -- 172.21.15.102:0/2433525069 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff73c1f6760 con 0x7ff73c0cf710 2023-10-14T09:37:29.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.128+0000 7fe3f6ffd640 1 -- 172.21.15.102:0/3777082986 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe3f0006030 con 0x7fe4000b38e0 2023-10-14T09:37:29.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.130+0000 7fe3f6ffd640 1 --2- 172.21.15.102:0/3777082986 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe3e006af40 0x7fe3e006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.130+0000 7fe3f6ffd640 1 -- 172.21.15.102:0/3777082986 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe3f0089a80 con 0x7fe4000b38e0 2023-10-14T09:37:29.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.131+0000 7fe3f7fff640 1 --2- 172.21.15.102:0/3777082986 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe3e006af40 0x7fe3e006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.131+0000 7ff741d55640 1 -- 172.21.15.102:0/2433525069 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff73c04e160 con 0x7ff73c0cf710 2023-10-14T09:37:29.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.131+0000 7ff723fff640 1 -- 172.21.15.102:0/2433525069 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff73001c460 con 0x7ff73c0cf710 2023-10-14T09:37:29.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.132+0000 7fe3f7fff640 1 --2- 172.21.15.102:0/3777082986 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe3e006af40 0x7fe3e006d400 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8036000 tx=0x7fe3e8030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:29.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.133+0000 7ff723fff640 1 --2- 172.21.15.102:0/2433525069 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff72806ae70 0x7ff72806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.201 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.133+0000 7ff73b7fe640 1 --2- 172.21.15.102:0/2433525069 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff72806ae70 0x7ff72806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.201 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.134+0000 7f00a13f0640 1 -- 172.21.15.102:0/3445384790 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008c031850 con 0x7f009c0b3420 2023-10-14T09:37:29.201 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.134+0000 7f00a13f0640 1 -- 172.21.15.102:0/3445384790 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c031be0 con 0x7f009c0b3420 2023-10-14T09:37:29.202 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.135+0000 7f58caffd640 1 -- 172.21.15.102:0/3925450721 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f58c40779c0 con 0x7f58d40addb0 2023-10-14T09:37:29.202 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.135+0000 7ff73b7fe640 1 --2- 172.21.15.102:0/2433525069 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff72806ae70 0x7ff72806d330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff72c009960 tx=0x7ff72c009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:29.203 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.135+0000 7f00a4656640 1 -- 172.21.15.102:0/3445384790 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f009c0b3420 msgr2=0x7f009c0b5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.203 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.135+0000 7f00a4656640 1 --2- 172.21.15.102:0/3445384790 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f009c0b3420 0x7f009c0b5cc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f008c0097a0 tx=0x7f008c02b790 comp rx=0 tx=0).stop 2023-10-14T09:37:29.203 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.135+0000 7f00a4656640 1 -- 172.21.15.102:0/3445384790 shutdown_connections 2023-10-14T09:37:29.203 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.135+0000 7f00a4656640 1 --2- 172.21.15.102:0/3445384790 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f009c0cfaf0 0x7f009c0b6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.203 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.135+0000 7f00a4656640 1 --2- 172.21.15.102:0/3445384790 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f009c0b3420 0x7f009c0b5cc0 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f008c0097a0 tx=0x7f008c02b790 comp rx=0 tx=0).stop 2023-10-14T09:37:29.204 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.135+0000 7f00a4656640 1 -- 172.21.15.102:0/3445384790 >> 172.21.15.102:0/3445384790 conn(0x7f009c0d2cc0 msgr2=0x7f009c0d30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:29.204 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.135+0000 7f00a4656640 1 -- 172.21.15.102:0/3445384790 shutdown_connections 2023-10-14T09:37:29.204 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.136+0000 7f00a4656640 1 -- 172.21.15.102:0/3445384790 wait complete. 2023-10-14T09:37:29.204 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.137+0000 7ff723fff640 1 -- 172.21.15.102:0/2433525069 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff730011e40 con 0x7ff73c0cf710 2023-10-14T09:37:29.205 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.138+0000 7fe3f6ffd640 1 -- 172.21.15.102:0/3777082986 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe3f0054ba0 con 0x7fe4000b38e0 2023-10-14T09:37:29.205 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.138+0000 7f00a4656640 1 Processor -- start 2023-10-14T09:37:29.205 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.142+0000 7ff723fff640 1 -- 172.21.15.102:0/2433525069 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff73008e060 con 0x7ff73c0cf710 2023-10-14T09:37:29.207 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.143+0000 7f00a4656640 1 -- start start 2023-10-14T09:37:29.207 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.145+0000 7f00a4656640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f009c0cf710 0x7f009c1fff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.208 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.145+0000 7f00a4656640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f009c0cfaf0 0x7f009c0cb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.208 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.145+0000 7f00a4656640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f009c09d0a0 0x7f009c15e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.208 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.146+0000 7f00a23f2640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f009c0cf710 0x7f009c1fff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.208 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.146+0000 7f00a23f2640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f009c0cf710 0x7f009c1fff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.102:60706/0 (socket says 172.21.15.102:60706) 2023-10-14T09:37:29.209 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.146+0000 7f00a1bf1640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f009c0cfaf0 0x7f009c0cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.209 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.146+0000 7f00a1bf1640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f009c0cfaf0 0x7f009c0cb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.102:57802/0 (socket says 172.21.15.102:57802) 2023-10-14T09:37:29.209 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.146+0000 7f00a2bf3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f009c09d0a0 0x7f009c15e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.209 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.146+0000 7f00a2bf3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f009c09d0a0 0x7f009c15e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44930/0 (socket says 172.21.15.102:44930) 2023-10-14T09:37:29.209 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.147+0000 7f00a4656640 1 -- 172.21.15.102:0/2816200620 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009c201360 con 0x7f009c09d0a0 2023-10-14T09:37:29.210 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.147+0000 7f00a23f2640 1 -- 172.21.15.102:0/2816200620 learned_addr learned my addr 172.21.15.102:0/2816200620 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:29.210 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.147+0000 7f00a4656640 1 -- 172.21.15.102:0/2816200620 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009c200750 con 0x7f009c0cfaf0 2023-10-14T09:37:29.210 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.147+0000 7f00a4656640 1 -- 172.21.15.102:0/2816200620 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f009c200a30 con 0x7f009c0cf710 2023-10-14T09:37:29.210 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.148+0000 7f00a2bf3640 1 -- 172.21.15.102:0/2816200620 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f009c0cf710 msgr2=0x7f009c1fff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.210 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.148+0000 7f00a2bf3640 1 --2- 172.21.15.102:0/2816200620 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f009c0cf710 0x7f009c1fff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.211 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.148+0000 7f00a2bf3640 1 -- 172.21.15.102:0/2816200620 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f009c0cfaf0 msgr2=0x7f009c0cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.211 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.148+0000 7f00a2bf3640 1 --2- 172.21.15.102:0/2816200620 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f009c0cfaf0 0x7f009c0cb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.211 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.148+0000 7f00a2bf3640 1 -- 172.21.15.102:0/2816200620 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f008c009400 con 0x7f009c09d0a0 2023-10-14T09:37:29.211 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.151+0000 7f00a2bf3640 1 --2- 172.21.15.102:0/2816200620 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f009c09d0a0 0x7f009c15e150 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0094007cf0 tx=0x7f009400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:29.211 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.151+0000 7f0092ffd640 1 -- 172.21.15.102:0/2816200620 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0094018070 con 0x7f009c09d0a0 2023-10-14T09:37:29.211 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.151+0000 7f0092ffd640 1 -- 172.21.15.102:0/2816200620 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009400edd0 con 0x7f009c09d0a0 2023-10-14T09:37:29.212 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.151+0000 7f0092ffd640 1 -- 172.21.15.102:0/2816200620 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0094003bb0 con 0x7f009c09d0a0 2023-10-14T09:37:29.212 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.153+0000 7f00a4656640 1 -- 172.21.15.102:0/2816200620 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f009c200d10 con 0x7f009c09d0a0 2023-10-14T09:37:29.212 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.153+0000 7f00a4656640 1 -- 172.21.15.102:0/2816200620 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f009c200440 con 0x7f009c09d0a0 2023-10-14T09:37:29.212 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.154+0000 7f00a4656640 1 -- 172.21.15.102:0/2816200620 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f009c2014d0 con 0x7f009c09d0a0 2023-10-14T09:37:29.212 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.167+0000 7f0092ffd640 1 -- 172.21.15.102:0/2816200620 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0094014420 con 0x7f009c09d0a0 2023-10-14T09:37:29.212 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.168+0000 7f0092ffd640 1 --2- 172.21.15.102:0/2816200620 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f008006af40 0x7f008006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:29.213 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.168+0000 7f0092ffd640 1 -- 172.21.15.102:0/2816200620 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f009408a5e0 con 0x7f009c09d0a0 2023-10-14T09:37:29.213 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.170+0000 7f00a23f2640 1 --2- 172.21.15.102:0/2816200620 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f008006af40 0x7f008006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:29.213 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.171+0000 7f00a23f2640 1 --2- 172.21.15.102:0/2816200620 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f008006af40 0x7f008006d400 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0098007c20 tx=0x7f0098007b70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:29.213 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.171+0000 7f0092ffd640 1 -- 172.21.15.102:0/2816200620 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0094055720 con 0x7f009c09d0a0 2023-10-14T09:37:29.507 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.505+0000 7f5d12f39640 1 -- 172.21.15.102:0/3204515272 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f5d0c157190 con 0x7f5d0c06a4b0 2023-10-14T09:37:29.508 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.506+0000 7f5d097fa640 1 -- 172.21.15.102:0/3204515272 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5d0c157190 con 0x7f5d0c06a4b0 2023-10-14T09:37:29.510 INFO:teuthology.orchestra.run.smithi102.stdout:64424509446 2023-10-14T09:37:29.511 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.509+0000 7f5d12f39640 1 -- 172.21.15.102:0/3204515272 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f5cf006f2d0 msgr2=0x7f5cf0071790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.511 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.509+0000 7f5d12f39640 1 --2- 172.21.15.102:0/3204515272 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f5cf006f2d0 0x7f5cf0071790 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c0c5f30 tx=0x7f5cf8008040 comp rx=0 tx=0).stop 2023-10-14T09:37:29.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.509+0000 7f5d12f39640 1 -- 172.21.15.102:0/3204515272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d0c06a4b0 msgr2=0x7f5d0c157470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.509+0000 7f5d12f39640 1 --2- 172.21.15.102:0/3204515272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d0c06a4b0 0x7f5d0c157470 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5d0000b410 tx=0x7f5d0000b8d0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.511+0000 7f5d12f39640 1 -- 172.21.15.102:0/3204515272 shutdown_connections 2023-10-14T09:37:29.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.511+0000 7f5d12f39640 1 --2- 172.21.15.102:0/3204515272 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f5cf006f2d0 0x7f5cf0071790 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.511+0000 7f5d12f39640 1 --2- 172.21.15.102:0/3204515272 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5d0c158f60 0x7f5d0c0c6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.511+0000 7f5d12f39640 1 --2- 172.21.15.102:0/3204515272 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5d0c0ce1c0 0x7f5d0c146d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.511+0000 7f5d12f39640 1 --2- 172.21.15.102:0/3204515272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d0c06a4b0 0x7f5d0c157470 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.511+0000 7f5d12f39640 1 -- 172.21.15.102:0/3204515272 >> 172.21.15.102:0/3204515272 conn(0x7f5d0c0ce9b0 msgr2=0x7f5d0c0ad6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:29.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.513+0000 7f5d12f39640 1 -- 172.21.15.102:0/3204515272 shutdown_connections 2023-10-14T09:37:29.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.513+0000 7f5d12f39640 1 -- 172.21.15.102:0/3204515272 wait complete. 2023-10-14T09:37:29.529 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.527+0000 7f862177c640 1 -- 172.21.15.102:0/1628225269 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f85fc005500 con 0x7f8614054360 2023-10-14T09:37:29.529 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.528+0000 7f86037fe640 1 -- 172.21.15.102:0/1628225269 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8610053dc0 con 0x7f8614054360 2023-10-14T09:37:29.530 INFO:teuthology.orchestra.run.smithi102.stdout:60129542149 2023-10-14T09:37:29.530 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.529+0000 7f9acdfc5640 1 -- 172.21.15.102:0/2343947378 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9ac80c87a0 con 0x7f9ac80b38e0 2023-10-14T09:37:29.531 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.530+0000 7f9aaffff640 1 -- 172.21.15.102:0/2343947378 <== mon.2 v2:172.21.15.129:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9ac80c87a0 con 0x7f9ac80b38e0 2023-10-14T09:37:29.532 INFO:teuthology.orchestra.run.smithi102.stdout:64424509446 2023-10-14T09:37:29.533 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.531+0000 7f862177c640 1 -- 172.21.15.102:0/1628225269 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f860806aed0 msgr2=0x7f860806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.533 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.531+0000 7f862177c640 1 --2- 172.21.15.102:0/1628225269 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f860806aed0 0x7f860806d390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f860c036000 tx=0x7f860c03b040 comp rx=0 tx=0).stop 2023-10-14T09:37:29.533 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.531+0000 7f862177c640 1 -- 172.21.15.102:0/1628225269 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8614054360 msgr2=0x7f861404cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.533 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.531+0000 7f862177c640 1 --2- 172.21.15.102:0/1628225269 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8614054360 0x7f861404cb40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f861000c480 tx=0x7f861000c940 comp rx=0 tx=0).stop 2023-10-14T09:37:29.534 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.532+0000 7f862177c640 1 -- 172.21.15.102:0/1628225269 shutdown_connections 2023-10-14T09:37:29.534 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.532+0000 7f862177c640 1 --2- 172.21.15.102:0/1628225269 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f860806aed0 0x7f860806d390 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.534 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.532+0000 7f862177c640 1 --2- 172.21.15.102:0/1628225269 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f86140e3070 0x7f861404d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.534 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.532+0000 7f862177c640 1 --2- 172.21.15.102:0/1628225269 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8614054360 0x7f861404cb40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.535 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.532+0000 7f862177c640 1 --2- 172.21.15.102:0/1628225269 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8614006b70 0x7f86140d3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.535 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.532+0000 7f862177c640 1 -- 172.21.15.102:0/1628225269 >> 172.21.15.102:0/1628225269 conn(0x7f8614055a90 msgr2=0x7f8614050760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:29.535 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.533+0000 7f9acdfc5640 1 -- 172.21.15.102:0/2343947378 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f9ab406aec0 msgr2=0x7f9ab406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.535 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.533+0000 7f9acdfc5640 1 --2- 172.21.15.102:0/2343947378 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f9ab406aec0 0x7f9ab406d380 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9ac815ec70 tx=0x7f9ab8009190 comp rx=0 tx=0).stop 2023-10-14T09:37:29.536 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.533+0000 7f9acdfc5640 1 -- 172.21.15.102:0/2343947378 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9ac80b38e0 msgr2=0x7f9ac80c6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.536 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.533+0000 7f9acdfc5640 1 --2- 172.21.15.102:0/2343947378 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9ac80b38e0 0x7f9ac80c6e20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9abc00d800 tx=0x7f9abc00dcc0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.536 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.533+0000 7f862177c640 1 -- 172.21.15.102:0/1628225269 shutdown_connections 2023-10-14T09:37:29.536 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.533+0000 7f862177c640 1 -- 172.21.15.102:0/1628225269 wait complete. 2023-10-14T09:37:29.537 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.533+0000 7f9acdfc5640 1 -- 172.21.15.102:0/2343947378 shutdown_connections 2023-10-14T09:37:29.537 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.533+0000 7f9acdfc5640 1 --2- 172.21.15.102:0/2343947378 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f9ab406aec0 0x7f9ab406d380 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.537 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.533+0000 7f9acdfc5640 1 --2- 172.21.15.102:0/2343947378 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ac80cfaf0 0x7f9ac80b6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.538 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.533+0000 7f9acdfc5640 1 --2- 172.21.15.102:0/2343947378 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ac80cf710 0x7f9ac80c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.538 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.533+0000 7f9acdfc5640 1 --2- 172.21.15.102:0/2343947378 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9ac80b38e0 0x7f9ac80c6e20 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.538 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.533+0000 7f9acdfc5640 1 -- 172.21.15.102:0/2343947378 >> 172.21.15.102:0/2343947378 conn(0x7f9ac80d2cc0 msgr2=0x7f9ac8160120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:29.538 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.534+0000 7f9acdfc5640 1 -- 172.21.15.102:0/2343947378 shutdown_connections 2023-10-14T09:37:29.538 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.534+0000 7f9acdfc5640 1 -- 172.21.15.102:0/2343947378 wait complete. 2023-10-14T09:37:29.540 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.539+0000 7f16c8a09640 1 -- 172.21.15.102:0/2034413486 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f16c40b10e0 con 0x7f16c40b38e0 2023-10-14T09:37:29.542 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.540+0000 7f16bb7fe640 1 -- 172.21.15.102:0/2034413486 <== mon.1 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f16b4021090 con 0x7f16c40b38e0 2023-10-14T09:37:29.542 INFO:teuthology.orchestra.run.smithi102.stdout:64424509446 2023-10-14T09:37:29.543 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.4 2023-10-14T09:37:29.545 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.544+0000 7f16c8a09640 1 -- 172.21.15.102:0/2034413486 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f16a806aef0 msgr2=0x7f16a806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.546 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.544+0000 7f16c8a09640 1 --2- 172.21.15.102:0/2034413486 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f16a806aef0 0x7f16a806d3b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f16ac035000 tx=0x7f16ac030000 comp rx=0 tx=0).stop 2023-10-14T09:37:29.546 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.544+0000 7f16c8a09640 1 -- 172.21.15.102:0/2034413486 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f16c40b38e0 msgr2=0x7f16c41551f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.546 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.544+0000 7f16c8a09640 1 --2- 172.21.15.102:0/2034413486 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f16c40b38e0 0x7f16c41551f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f16b400e900 tx=0x7f16b400edc0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.547 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.544+0000 7f16c8a09640 1 -- 172.21.15.102:0/2034413486 shutdown_connections 2023-10-14T09:37:29.547 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.544+0000 7f16c8a09640 1 --2- 172.21.15.102:0/2034413486 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f16a806aef0 0x7f16a806d3b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.547 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.544+0000 7f16c8a09640 1 --2- 172.21.15.102:0/2034413486 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f16c40cfaf0 0x7f16c40b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.547 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.544+0000 7f16c8a09640 1 --2- 172.21.15.102:0/2034413486 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16c40cf710 0x7f16c40c9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.547 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.544+0000 7f16c8a09640 1 --2- 172.21.15.102:0/2034413486 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f16c40b38e0 0x7f16c41551f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.548 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.544+0000 7f16c8a09640 1 -- 172.21.15.102:0/2034413486 >> 172.21.15.102:0/2034413486 conn(0x7f16c40d2cc0 msgr2=0x7f16c406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:29.548 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.544+0000 7f16c8a09640 1 -- 172.21.15.102:0/2034413486 shutdown_connections 2023-10-14T09:37:29.548 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.544+0000 7f16c8a09640 1 -- 172.21.15.102:0/2034413486 wait complete. 2023-10-14T09:37:29.548 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.545+0000 7f58d8896640 1 -- 172.21.15.102:0/3925450721 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f58ac0057d0 con 0x7f58d40addb0 2023-10-14T09:37:29.549 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.546+0000 7fe404990640 1 -- 172.21.15.102:0/3777082986 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fe3e4005500 con 0x7fe4000b38e0 2023-10-14T09:37:29.549 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.546+0000 7f58caffd640 1 -- 172.21.15.102:0/3925450721 <== mon.1 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f58c407afe0 con 0x7f58d40addb0 2023-10-14T09:37:29.550 INFO:teuthology.orchestra.run.smithi102.stdout:60129542149 2023-10-14T09:37:29.550 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.547+0000 7fe3f6ffd640 1 -- 172.21.15.102:0/3777082986 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe3f00581c0 con 0x7fe4000b38e0 2023-10-14T09:37:29.550 INFO:teuthology.orchestra.run.smithi102.stdout:64424509444 2023-10-14T09:37:29.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.549+0000 7fe404990640 1 -- 172.21.15.102:0/3777082986 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe3e006af40 msgr2=0x7fe3e006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.549+0000 7fe404990640 1 --2- 172.21.15.102:0/3777082986 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe3e006af40 0x7fe3e006d400 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8036000 tx=0x7fe3e8030000 comp rx=0 tx=0).stop 2023-10-14T09:37:29.552 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.549+0000 7fe404990640 1 -- 172.21.15.102:0/3777082986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4000b38e0 msgr2=0x7fe4000b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.552 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.549+0000 7fe404990640 1 --2- 172.21.15.102:0/3777082986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4000b38e0 0x7fe4000b24a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe3f000c7f0 tx=0x7fe3f000ccb0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.552 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.550+0000 7f58d8896640 1 -- 172.21.15.102:0/3925450721 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f58b806ae70 msgr2=0x7f58b806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.553 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.550+0000 7f58d8896640 1 --2- 172.21.15.102:0/3925450721 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f58b806ae70 0x7f58b806d330 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f58cc000f60 tx=0x7f58cc007d30 comp rx=0 tx=0).stop 2023-10-14T09:37:29.553 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.550+0000 7f58d8896640 1 -- 172.21.15.102:0/3925450721 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f58d40addb0 msgr2=0x7f58d41ff1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.553 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.550+0000 7f58d8896640 1 --2- 172.21.15.102:0/3925450721 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f58d40addb0 0x7f58d41ff1d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f58c4033000 tx=0x7f58c4004ab0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.553 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.550+0000 7f58d8896640 1 -- 172.21.15.102:0/3925450721 shutdown_connections 2023-10-14T09:37:29.553 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.550+0000 7f58d8896640 1 --2- 172.21.15.102:0/3925450721 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f58b806ae70 0x7f58b806d330 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.553 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.550+0000 7f58d8896640 1 --2- 172.21.15.102:0/3925450721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58d40caa80 0x7f58d40c4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.554 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.550+0000 7f58d8896640 1 --2- 172.21.15.102:0/3925450721 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f58d40addb0 0x7f58d41ff1d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.554 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.550+0000 7f58d8896640 1 --2- 172.21.15.102:0/3925450721 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f58d406a2e0 0x7f58d40c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.554 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.550+0000 7f58d8896640 1 -- 172.21.15.102:0/3925450721 >> 172.21.15.102:0/3925450721 conn(0x7f58d40ce9b0 msgr2=0x7f58d40c8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:29.554 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.550+0000 7fe404990640 1 -- 172.21.15.102:0/3777082986 shutdown_connections 2023-10-14T09:37:29.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.550+0000 7fe404990640 1 --2- 172.21.15.102:0/3777082986 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe3e006af40 0x7fe3e006d400 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.550+0000 7fe404990640 1 --2- 172.21.15.102:0/3777082986 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe4000cfaf0 0x7fe400156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.550+0000 7fe404990640 1 --2- 172.21.15.102:0/3777082986 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe4000cf710 0x7fe4000cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.550+0000 7fe404990640 1 --2- 172.21.15.102:0/3777082986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4000b38e0 0x7fe4000b24a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.550+0000 7fe404990640 1 -- 172.21.15.102:0/3777082986 >> 172.21.15.102:0/3777082986 conn(0x7fe4000d2cc0 msgr2=0x7fe4000b2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:29.556 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.550+0000 7f58d8896640 1 -- 172.21.15.102:0/3925450721 shutdown_connections 2023-10-14T09:37:29.556 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.551+0000 7fe404990640 1 -- 172.21.15.102:0/3777082986 shutdown_connections 2023-10-14T09:37:29.556 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.551+0000 7fe404990640 1 -- 172.21.15.102:0/3777082986 wait complete. 2023-10-14T09:37:29.557 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.551+0000 7f58d8896640 1 -- 172.21.15.102:0/3925450721 wait complete. 2023-10-14T09:37:29.563 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.562+0000 7ff741d55640 1 -- 172.21.15.102:0/2433525069 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff73c08cd30 con 0x7ff73c0cf710 2023-10-14T09:37:29.564 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.1 2023-10-14T09:37:29.565 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.0 2023-10-14T09:37:29.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.562+0000 7ff723fff640 1 -- 172.21.15.102:0/2433525069 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff730053d50 con 0x7ff73c0cf710 2023-10-14T09:37:29.565 INFO:teuthology.orchestra.run.smithi102.stdout:64424509445 2023-10-14T09:37:29.567 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.565+0000 7ff741d55640 1 -- 172.21.15.102:0/2433525069 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff72806ae70 msgr2=0x7ff72806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.567 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.565+0000 7ff741d55640 1 --2- 172.21.15.102:0/2433525069 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff72806ae70 0x7ff72806d330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff72c009960 tx=0x7ff72c009060 comp rx=0 tx=0).stop 2023-10-14T09:37:29.567 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.565+0000 7ff741d55640 1 -- 172.21.15.102:0/2433525069 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff73c0cf710 msgr2=0x7ff73c1f6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.567 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.565+0000 7ff741d55640 1 --2- 172.21.15.102:0/2433525069 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff73c0cf710 0x7ff73c1f6220 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff73000c430 tx=0x7ff73000c8f0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.565+0000 7ff741d55640 1 -- 172.21.15.102:0/2433525069 shutdown_connections 2023-10-14T09:37:29.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.565+0000 7ff741d55640 1 --2- 172.21.15.102:0/2433525069 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff72806ae70 0x7ff72806d330 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.565+0000 7ff741d55640 1 --2- 172.21.15.102:0/2433525069 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff73c0cfaf0 0x7ff73c0afa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.565+0000 7ff741d55640 1 --2- 172.21.15.102:0/2433525069 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff73c0cf710 0x7ff73c1f6220 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.565+0000 7ff741d55640 1 --2- 172.21.15.102:0/2433525069 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff73c0b6cd0 0x7ff73c0c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.565+0000 7ff741d55640 1 -- 172.21.15.102:0/2433525069 >> 172.21.15.102:0/2433525069 conn(0x7ff73c0d2cc0 msgr2=0x7ff73c0d0870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:29.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.566+0000 7ff741d55640 1 -- 172.21.15.102:0/2433525069 shutdown_connections 2023-10-14T09:37:29.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.566+0000 7ff741d55640 1 -- 172.21.15.102:0/2433525069 wait complete. 2023-10-14T09:37:29.573 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.7 2023-10-14T09:37:29.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.2 2023-10-14T09:37:29.579 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.5 2023-10-14T09:37:29.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.578+0000 7f00a4656640 1 -- 172.21.15.102:0/2816200620 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f009c04e160 con 0x7f009c09d0a0 2023-10-14T09:37:29.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.578+0000 7f0092ffd640 1 -- 172.21.15.102:0/2816200620 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0094058d40 con 0x7f009c09d0a0 2023-10-14T09:37:29.580 INFO:teuthology.orchestra.run.smithi102.stdout:64424509446 2023-10-14T09:37:29.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.580+0000 7f00a4656640 1 -- 172.21.15.102:0/2816200620 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f008006af40 msgr2=0x7f008006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.580+0000 7f00a4656640 1 --2- 172.21.15.102:0/2816200620 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f008006af40 0x7f008006d400 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0098007c20 tx=0x7f0098007b70 comp rx=0 tx=0).stop 2023-10-14T09:37:29.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.580+0000 7f00a4656640 1 -- 172.21.15.102:0/2816200620 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f009c09d0a0 msgr2=0x7f009c15e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:29.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.580+0000 7f00a4656640 1 --2- 172.21.15.102:0/2816200620 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f009c09d0a0 0x7f009c15e150 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0094007cf0 tx=0x7f009400e4b0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.580+0000 7f00a4656640 1 -- 172.21.15.102:0/2816200620 shutdown_connections 2023-10-14T09:37:29.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.580+0000 7f00a4656640 1 --2- 172.21.15.102:0/2816200620 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f008006af40 0x7f008006d400 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.580+0000 7f00a4656640 1 --2- 172.21.15.102:0/2816200620 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f009c09d0a0 0x7f009c15e150 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.580+0000 7f00a4656640 1 --2- 172.21.15.102:0/2816200620 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f009c0cfaf0 0x7f009c0cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.580+0000 7f00a4656640 1 --2- 172.21.15.102:0/2816200620 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f009c0cf710 0x7f009c1fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:29.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.580+0000 7f00a4656640 1 -- 172.21.15.102:0/2816200620 >> 172.21.15.102:0/2816200620 conn(0x7f009c0d2cc0 msgr2=0x7f009c0b62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:29.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.580+0000 7f00a4656640 1 -- 172.21.15.102:0/2816200620 shutdown_connections 2023-10-14T09:37:29.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:29.580+0000 7f00a4656640 1 -- 172.21.15.102:0/2816200620 wait complete. 2023-10-14T09:37:29.585 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.3 2023-10-14T09:37:29.598 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.6 2023-10-14T09:37:30.543 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-14T09:37:30.565 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-14T09:37:30.566 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-14T09:37:30.574 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-14T09:37:30.574 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-14T09:37:30.580 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-14T09:37:30.586 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-14T09:37:30.599 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-14T09:37:30.837 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.835+0000 7f5932fb6640 1 Processor -- start 2023-10-14T09:37:30.840 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.836+0000 7f5932fb6640 1 -- start start 2023-10-14T09:37:30.841 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.838+0000 7f5932fb6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f592c0b2030 0x7f592c06d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.841 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.838+0000 7f5932fb6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f592c06d4b0 con 0x7f592c159d50 2023-10-14T09:37:30.841 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.838+0000 7f5932fb6640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f592c06c8a0 con 0x7f592c159970 2023-10-14T09:37:30.841 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.838+0000 7f5932fb6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592c06cb80 con 0x7f592c0b2030 2023-10-14T09:37:30.842 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.839+0000 7f5931553640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f592c159d50 0x7f592c15d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:45708/0 (socket says 172.21.15.102:45708) 2023-10-14T09:37:30.842 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.839+0000 7f5931553640 1 -- 172.21.15.102:0/3497805096 learned_addr learned my addr 172.21.15.102:0/3497805096 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:30.842 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.839+0000 7f592bfff640 1 --2- 172.21.15.102:0/3497805096 >> v2:172.21.15.102:3300/0 conn(0x7f592c0b2030 0x7f592c06d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.843 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.841+0000 7f592bfff640 1 -- 172.21.15.102:0/3497805096 >> v1:172.21.15.129:6789/0 conn(0x7f592c159970 legacy=0x7f592c06be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:30.843 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.841+0000 7f592bfff640 1 -- 172.21.15.102:0/3497805096 >> v1:172.21.15.102:6789/0 conn(0x7f592c159d50 legacy=0x7f592c15d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:30.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.841+0000 7f592bfff640 1 -- 172.21.15.102:0/3497805096 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592c06ce60 con 0x7f592c0b2030 2023-10-14T09:37:30.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.843+0000 7f592bfff640 1 --2- 172.21.15.102:0/3497805096 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f592c0b2030 0x7f592c06d940 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f591c009a00 tx=0x7f591c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e4e87ef92438c87 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:30.845 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.844+0000 7f592b7fe640 1 -- 172.21.15.102:0/3497805096 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c032660 con 0x7f592c0b2030 2023-10-14T09:37:30.845 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.844+0000 7f592b7fe640 1 -- 172.21.15.102:0/3497805096 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591c0327c0 con 0x7f592c0b2030 2023-10-14T09:37:30.846 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.844+0000 7f592b7fe640 1 -- 172.21.15.102:0/3497805096 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c032b50 con 0x7f592c0b2030 2023-10-14T09:37:30.846 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.845+0000 7f5932fb6640 1 -- 172.21.15.102:0/3497805096 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f592c0b2030 msgr2=0x7f592c06d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:30.847 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.845+0000 7f5932fb6640 1 --2- 172.21.15.102:0/3497805096 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f592c0b2030 0x7f592c06d940 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f591c009a00 tx=0x7f591c02b8f0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.847 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.846+0000 7f5932fb6640 1 -- 172.21.15.102:0/3497805096 shutdown_connections 2023-10-14T09:37:30.848 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.846+0000 7f5932fb6640 1 --2- 172.21.15.102:0/3497805096 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f592c0b2030 0x7f592c06d940 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.848 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.846+0000 7f5932fb6640 1 -- 172.21.15.102:0/3497805096 >> 172.21.15.102:0/3497805096 conn(0x7f592c0b12e0 msgr2=0x7f592c0b16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:30.851 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.847+0000 7f5932fb6640 1 -- 172.21.15.102:0/3497805096 shutdown_connections 2023-10-14T09:37:30.851 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.847+0000 7f5932fb6640 1 -- 172.21.15.102:0/3497805096 wait complete. 2023-10-14T09:37:30.851 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.849+0000 7f5932fb6640 1 Processor -- start 2023-10-14T09:37:30.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.850+0000 7f5932fb6640 1 -- start start 2023-10-14T09:37:30.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.852+0000 7f5932fb6640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f592c0b2030 0x7f592c152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.852+0000 7f5932fb6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f592c159970 0x7f592c0c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.853+0000 7f5932fb6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f592c159d50 0x7f592c0c4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.856 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.854+0000 7f5931553640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f592c159d50 0x7f592c0c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.856 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.854+0000 7f5931553640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f592c159d50 0x7f592c0c4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44958/0 (socket says 172.21.15.102:44958) 2023-10-14T09:37:30.856 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.854+0000 7f5930d52640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f592c0b2030 0x7f592c152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.856 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.854+0000 7f5930d52640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f592c0b2030 0x7f592c152b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.102:60716/0 (socket says 172.21.15.102:60716) 2023-10-14T09:37:30.857 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.854+0000 7f592bfff640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f592c159970 0x7f592c0c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.857 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.854+0000 7f592bfff640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f592c159970 0x7f592c0c5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.102:57818/0 (socket says 172.21.15.102:57818) 2023-10-14T09:37:30.857 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.855+0000 7f5931553640 1 -- 172.21.15.102:0/3111325795 learned_addr learned my addr 172.21.15.102:0/3111325795 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:30.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.855+0000 7f5932fb6640 1 -- 172.21.15.102:0/3111325795 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c0c4eb0 con 0x7f592c159d50 2023-10-14T09:37:30.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.855+0000 7f5932fb6640 1 -- 172.21.15.102:0/3111325795 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c0c3cd0 con 0x7f592c159970 2023-10-14T09:37:30.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.855+0000 7f5932fb6640 1 -- 172.21.15.102:0/3111325795 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f592c0c33a0 con 0x7f592c0b2030 2023-10-14T09:37:30.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.856+0000 7f5931553640 1 -- 172.21.15.102:0/3111325795 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f592c0b2030 msgr2=0x7f592c152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:30.859 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.856+0000 7f5931553640 1 --2- 172.21.15.102:0/3111325795 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f592c0b2030 0x7f592c152b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.859 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.857+0000 7f5931553640 1 -- 172.21.15.102:0/3111325795 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f592c159970 msgr2=0x7f592c0c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:30.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.857+0000 7f5931553640 1 --2- 172.21.15.102:0/3111325795 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f592c159970 0x7f592c0c5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.857+0000 7f5931553640 1 -- 172.21.15.102:0/3111325795 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f591c009400 con 0x7f592c159d50 2023-10-14T09:37:30.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.857+0000 7f592bfff640 1 --2- 172.21.15.102:0/3111325795 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f592c159970 0x7f592c0c5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:37:30.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.858+0000 7f5931553640 1 --2- 172.21.15.102:0/3111325795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f592c159d50 0x7f592c0c4970 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f592400caf0 tx=0x7f592400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:30.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.859+0000 7f59297fa640 1 -- 172.21.15.102:0/3111325795 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5924004d60 con 0x7f592c159d50 2023-10-14T09:37:30.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.859+0000 7f59297fa640 1 -- 172.21.15.102:0/3111325795 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592400a890 con 0x7f592c159d50 2023-10-14T09:37:30.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.859+0000 7f59297fa640 1 -- 172.21.15.102:0/3111325795 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592400ac00 con 0x7f592c159d50 2023-10-14T09:37:30.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.860+0000 7f5932fb6640 1 -- 172.21.15.102:0/3111325795 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f592c0c3680 con 0x7f592c159d50 2023-10-14T09:37:30.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.861+0000 7f5932fb6640 1 -- 172.21.15.102:0/3111325795 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f592c0c50a0 con 0x7f592c159d50 2023-10-14T09:37:30.871 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.865+0000 7f5912ffd640 1 -- 172.21.15.102:0/3111325795 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5904005250 con 0x7f592c159d50 2023-10-14T09:37:30.871 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.870+0000 7f59297fa640 1 -- 172.21.15.102:0/3111325795 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f59240070d0 con 0x7f592c159d50 2023-10-14T09:37:30.876 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.871+0000 7f59297fa640 1 --2- 172.21.15.102:0/3111325795 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f591806af70 0x7f591806d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.879 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.877+0000 7f5930d52640 1 --2- 172.21.15.102:0/3111325795 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f591806af70 0x7f591806d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.882 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.878+0000 7f59297fa640 1 -- 172.21.15.102:0/3111325795 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5924088f10 con 0x7f592c159d50 2023-10-14T09:37:30.882 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.879+0000 7f5930d52640 1 --2- 172.21.15.102:0/3111325795 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f591806af70 0x7f591806d430 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5920000f60 tx=0x7f5920009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:30.882 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.880+0000 7f59297fa640 1 -- 172.21.15.102:0/3111325795 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f59240540e0 con 0x7f592c159d50 2023-10-14T09:37:30.890 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.888+0000 7f89ae264640 1 Processor -- start 2023-10-14T09:37:30.890 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.888+0000 7f89ae264640 1 -- start start 2023-10-14T09:37:30.892 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.890+0000 7f89ae264640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f89a00e18f0 0x7f89a00062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.892 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.890+0000 7f89ae264640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f89a00eb880 0x7f89a0057cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.893 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.890+0000 7f89ae264640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a0006b20 con 0x7f89a00e1cd0 2023-10-14T09:37:30.893 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.890+0000 7f89ae264640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89a0006e00 con 0x7f89a00e18f0 2023-10-14T09:37:30.893 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.890+0000 7f89ae264640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a00070e0 con 0x7f89a00eb880 2023-10-14T09:37:30.893 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.892+0000 7f89aca61640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f89a00e1cd0 0x7f89a00eb170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:45720/0 (socket says 172.21.15.102:45720) 2023-10-14T09:37:30.894 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.892+0000 7f1926840640 1 Processor -- start 2023-10-14T09:37:30.894 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.892+0000 7f89ada63640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f89a00eb880 0x7f89a0057cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.895 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.892+0000 7f89ada63640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f89a00eb880 0x7f89a0057cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.102:60718/0 (socket says 172.21.15.102:60718) 2023-10-14T09:37:30.895 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.892+0000 7f89ada63640 1 -- 172.21.15.102:0/2063479350 learned_addr learned my addr 172.21.15.102:0/2063479350 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:30.895 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.892+0000 7f89ad262640 1 --2- 172.21.15.102:0/2063479350 >> v2:172.21.15.129:3300/0 conn(0x7f89a00e18f0 0x7f89a00062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.895 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.893+0000 7f8242283640 1 Processor -- start 2023-10-14T09:37:30.896 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.893+0000 7f8242283640 1 -- start start 2023-10-14T09:37:30.896 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.893+0000 7f899ffff640 1 -- 172.21.15.102:0/2063479350 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2811775003 0 0) 0x7f89a0006b20 con 0x7f89a00e1cd0 2023-10-14T09:37:30.897 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.892+0000 7f1926840640 1 -- start start 2023-10-14T09:37:30.897 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.894+0000 7f1926840640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1920158f60 0x7f19200ade50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.897 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.894+0000 7f1926840640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f19200cf4d0 0x7f192006b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.898 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.894+0000 7f89ada63640 1 -- 172.21.15.102:0/2063479350 >> v2:172.21.15.129:3300/0 conn(0x7f89a00e18f0 msgr2=0x7f89a00062d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:30.898 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.894+0000 7f89ada63640 1 --2- 172.21.15.102:0/2063479350 >> v2:172.21.15.129:3300/0 conn(0x7f89a00e18f0 0x7f89a00062d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.898 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.894+0000 7f89ada63640 1 -- 172.21.15.102:0/2063479350 >> v1:172.21.15.102:6789/0 conn(0x7f89a00e1cd0 legacy=0x7f89a00eb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:30.898 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.894+0000 7f89ada63640 1 -- 172.21.15.102:0/2063479350 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a00073c0 con 0x7f89a00eb880 2023-10-14T09:37:30.899 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.894+0000 7f89ad262640 1 --2- 172.21.15.102:0/2063479350 >> v2:172.21.15.129:3300/0 conn(0x7f89a00e18f0 0x7f89a00062d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:37:30.899 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.894+0000 7f8242283640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f82340e3190 0x7f823403e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.899 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.894+0000 7f8242283640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f8234038180 0x7f8234053d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.900 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.894+0000 7f1926840640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f192006cf50 con 0x7f19200ce1c0 2023-10-14T09:37:30.900 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.894+0000 7f1926840640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f192015d970 con 0x7f1920158f60 2023-10-14T09:37:30.900 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.894+0000 7f1926840640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f192015ccf0 con 0x7f19200cf4d0 2023-10-14T09:37:30.900 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.894+0000 7f191ffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1920158f60 0x7f19200ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.894+0000 7f8242283640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f823403ee60 con 0x7f82340542d0 2023-10-14T09:37:30.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.894+0000 7f8242283640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f823403f100 con 0x7f8234038180 2023-10-14T09:37:30.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.894+0000 7f8242283640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8234007c40 con 0x7f82340e3190 2023-10-14T09:37:30.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.895+0000 7f8241a82640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f82340542d0 0x7f82340e6d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:45736/0 (socket says 172.21.15.102:45736) 2023-10-14T09:37:30.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.895+0000 7f8241a82640 1 -- 172.21.15.102:0/1794852350 learned_addr learned my addr 172.21.15.102:0/1794852350 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:30.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.895+0000 7f8241281640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f82340e3190 0x7f823403e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.895+0000 7f8240a80640 1 --2- 172.21.15.102:0/1794852350 >> v2:172.21.15.129:3300/0 conn(0x7f8234038180 0x7f8234053d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.896+0000 7f89ada63640 1 --2- 172.21.15.102:0/2063479350 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f89a00eb880 0x7f89a0057cf0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f89a8063e40 tx=0x7f89a80a5d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f15525b4d4ec4f01 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:30.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.896+0000 7f8233fff640 1 -- 172.21.15.102:0/1794852350 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2969497269 0 0) 0x7f823403ee60 con 0x7f82340542d0 2023-10-14T09:37:30.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.896+0000 7f8233fff640 1 -- 172.21.15.102:0/1794852350 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8228003520 con 0x7f82340542d0 2023-10-14T09:37:30.904 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.896+0000 7f899ffff640 1 -- 172.21.15.102:0/2063479350 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a80a6990 con 0x7f89a00eb880 2023-10-14T09:37:30.904 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.897+0000 7f899ffff640 1 -- 172.21.15.102:0/2063479350 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a80a6b30 con 0x7f89a00eb880 2023-10-14T09:37:30.904 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.897+0000 7f899ffff640 1 -- 172.21.15.102:0/2063479350 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a80a6990 con 0x7f89a00eb880 2023-10-14T09:37:30.905 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.898+0000 7f89ae264640 1 -- 172.21.15.102:0/2063479350 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f89a00eb880 msgr2=0x7f89a0057cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:30.905 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.898+0000 7f89ae264640 1 --2- 172.21.15.102:0/2063479350 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f89a00eb880 0x7f89a0057cf0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f89a8063e40 tx=0x7f89a80a5d30 comp rx=0 tx=0).stop 2023-10-14T09:37:30.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.897+0000 7f8240a80640 1 -- 172.21.15.102:0/1794852350 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f82340e3190 msgr2=0x7f823403e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:30.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.897+0000 7f8240a80640 1 --2- 172.21.15.102:0/1794852350 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f82340e3190 0x7f823403e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.897+0000 7f8240a80640 1 -- 172.21.15.102:0/1794852350 >> v1:172.21.15.102:6789/0 conn(0x7f82340542d0 legacy=0x7f82340e6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:30.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.897+0000 7f8240a80640 1 -- 172.21.15.102:0/1794852350 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8234006e80 con 0x7f8234038180 2023-10-14T09:37:30.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.895+0000 7f1924ddd640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f19200ce1c0 0x7f192006b570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.102:35490/0 (socket says 172.21.15.102:35490) 2023-10-14T09:37:30.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.895+0000 7f1924ddd640 1 -- 172.21.15.102:0/3113653146 learned_addr learned my addr 172.21.15.102:0/3113653146 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:30.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.895+0000 7f191f7fe640 1 --2- 172.21.15.102:0/3113653146 >> v2:172.21.15.129:3300/0 conn(0x7f19200cf4d0 0x7f192006b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.895+0000 7f191ffff640 1 -- 172.21.15.102:0/3113653146 >> v2:172.21.15.129:3300/0 conn(0x7f19200cf4d0 msgr2=0x7f192006b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:30.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.895+0000 7f191ffff640 1 --2- 172.21.15.102:0/3113653146 >> v2:172.21.15.129:3300/0 conn(0x7f19200cf4d0 0x7f192006b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.895+0000 7f191ffff640 1 -- 172.21.15.102:0/3113653146 >> v1:172.21.15.129:6789/0 conn(0x7f19200ce1c0 legacy=0x7f192006b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:30.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.895+0000 7f191ffff640 1 -- 172.21.15.102:0/3113653146 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192015cfd0 con 0x7f1920158f60 2023-10-14T09:37:30.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.898+0000 7f191ffff640 1 --2- 172.21.15.102:0/3113653146 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1920158f60 0x7f19200ade50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1920066920 tx=0x7f191802bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f41106954351cb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:30.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.898+0000 7f191effd640 1 -- 172.21.15.102:0/3113653146 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191802cab0 con 0x7f1920158f60 2023-10-14T09:37:30.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.898+0000 7f191effd640 1 -- 172.21.15.102:0/3113653146 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191802cc10 con 0x7f1920158f60 2023-10-14T09:37:30.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.899+0000 7f191effd640 1 -- 172.21.15.102:0/3113653146 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191802cab0 con 0x7f1920158f60 2023-10-14T09:37:30.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.899+0000 7f8240a80640 1 --2- 172.21.15.102:0/1794852350 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8234038180 0x7f8234053d90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f822c0097d0 tx=0x7f822c02b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a81f251e890c104 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:30.910 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.899+0000 7f811e735640 1 Processor -- start 2023-10-14T09:37:30.910 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.899+0000 7f89ae264640 1 -- 172.21.15.102:0/2063479350 shutdown_connections 2023-10-14T09:37:30.911 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.899+0000 7f89ae264640 1 --2- 172.21.15.102:0/2063479350 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f89a00eb880 0x7f89a0057cf0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.911 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.899+0000 7f89ae264640 1 --2- 172.21.15.102:0/2063479350 >> v2:172.21.15.129:3300/0 conn(0x7f89a00e18f0 0x7f89a00062d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.911 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.899+0000 7f89ae264640 1 -- 172.21.15.102:0/2063479350 >> 172.21.15.102:0/2063479350 conn(0x7f89a00590c0 msgr2=0x7f89a00594d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:30.911 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.899+0000 7f1926840640 1 -- 172.21.15.102:0/3113653146 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1920158f60 msgr2=0x7f19200ade50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:30.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.899+0000 7f1926840640 1 --2- 172.21.15.102:0/3113653146 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1920158f60 0x7f19200ade50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1920066920 tx=0x7f191802bf10 comp rx=0 tx=0).stop 2023-10-14T09:37:30.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.900+0000 7f811e735640 1 -- start start 2023-10-14T09:37:30.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.900+0000 7f89ae264640 1 -- 172.21.15.102:0/2063479350 shutdown_connections 2023-10-14T09:37:30.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.900+0000 7f89ae264640 1 -- 172.21.15.102:0/2063479350 wait complete. 2023-10-14T09:37:30.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.900+0000 7f1926840640 1 -- 172.21.15.102:0/3113653146 shutdown_connections 2023-10-14T09:37:30.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.900+0000 7f1926840640 1 --2- 172.21.15.102:0/3113653146 >> v2:172.21.15.129:3300/0 conn(0x7f19200cf4d0 0x7f192006b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.900+0000 7f1926840640 1 --2- 172.21.15.102:0/3113653146 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1920158f60 0x7f19200ade50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.900+0000 7f1926840640 1 -- 172.21.15.102:0/3113653146 >> 172.21.15.102:0/3113653146 conn(0x7f19200ce9b0 msgr2=0x7f19200cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:30.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.900+0000 7f8233fff640 1 -- 172.21.15.102:0/1794852350 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823c04e9b0 con 0x7f8234038180 2023-10-14T09:37:30.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.900+0000 7f8233fff640 1 -- 172.21.15.102:0/1794852350 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822c02e050 con 0x7f8234038180 2023-10-14T09:37:30.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.900+0000 7f8233fff640 1 -- 172.21.15.102:0/1794852350 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822c030730 con 0x7f8234038180 2023-10-14T09:37:30.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.900+0000 7f1926840640 1 -- 172.21.15.102:0/3113653146 shutdown_connections 2023-10-14T09:37:30.916 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.901+0000 7f8242283640 1 -- 172.21.15.102:0/1794852350 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8234038180 msgr2=0x7f8234053d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:30.916 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.900+0000 7f1926840640 1 -- 172.21.15.102:0/3113653146 wait complete. 2023-10-14T09:37:30.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.901+0000 7f8242283640 1 --2- 172.21.15.102:0/1794852350 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8234038180 0x7f8234053d90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f822c0097d0 tx=0x7f822c02b710 comp rx=0 tx=0).stop 2023-10-14T09:37:30.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.902+0000 7f811e735640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f8110006ff0 0x7f81100e6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.902+0000 7f811e735640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f811002f600 0x7f81100e7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.902+0000 7f811e735640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81100078f0 con 0x7f811003a8d0 2023-10-14T09:37:30.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.902+0000 7f811e735640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8110053060 con 0x7f8110006ff0 2023-10-14T09:37:30.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.902+0000 7f811e735640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8110053340 con 0x7f811002f600 2023-10-14T09:37:30.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.901+0000 7f8242283640 1 -- 172.21.15.102:0/1794852350 shutdown_connections 2023-10-14T09:37:30.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.901+0000 7f8242283640 1 --2- 172.21.15.102:0/1794852350 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8234038180 0x7f8234053d90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.901+0000 7f8242283640 1 --2- 172.21.15.102:0/1794852350 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f82340e3190 0x7f823403e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.901+0000 7f8242283640 1 -- 172.21.15.102:0/1794852350 >> 172.21.15.102:0/1794852350 conn(0x7f82340590c0 msgr2=0x7f82340594d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:30.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.902+0000 7f8242283640 1 -- 172.21.15.102:0/1794852350 shutdown_connections 2023-10-14T09:37:30.920 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.902+0000 7f811d733640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f811003a8d0 0x7f8110037d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.102:35492/0 (socket says 172.21.15.102:35492) 2023-10-14T09:37:30.920 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.902+0000 7f811d733640 1 -- 172.21.15.102:0/2970400399 learned_addr learned my addr 172.21.15.102:0/2970400399 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:30.920 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.903+0000 7f811cf32640 1 --2- 172.21.15.102:0/2970400399 >> v2:172.21.15.129:3300/0 conn(0x7f8110006ff0 0x7f81100e6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.920 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.903+0000 7f89ae264640 1 Processor -- start 2023-10-14T09:37:30.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.903+0000 7f811df34640 1 --2- 172.21.15.102:0/2970400399 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f811002f600 0x7f81100e7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.903+0000 7f89ae264640 1 -- start start 2023-10-14T09:37:30.922 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.903+0000 7f810ffff640 1 -- 172.21.15.102:0/2970400399 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2591740124 0 0) 0x7f81100078f0 con 0x7f811003a8d0 2023-10-14T09:37:30.922 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.903+0000 7f810ffff640 1 -- 172.21.15.102:0/2970400399 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8104003520 con 0x7f811003a8d0 2023-10-14T09:37:30.922 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.904+0000 7f84d8eda640 1 Processor -- start 2023-10-14T09:37:30.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.904+0000 7f84d8eda640 1 -- start start 2023-10-14T09:37:30.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.904+0000 7f811cf32640 1 -- 172.21.15.102:0/2970400399 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f811002f600 msgr2=0x7f81100e7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:30.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.904+0000 7f811cf32640 1 --2- 172.21.15.102:0/2970400399 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f811002f600 0x7f81100e7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.904+0000 7f811cf32640 1 -- 172.21.15.102:0/2970400399 >> v1:172.21.15.129:6789/0 conn(0x7f811003a8d0 legacy=0x7f8110037d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:30.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.904+0000 7f811cf32640 1 -- 172.21.15.102:0/2970400399 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8110053620 con 0x7f8110006ff0 2023-10-14T09:37:30.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.904+0000 7f811df34640 1 --2- 172.21.15.102:0/2970400399 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f811002f600 0x7f81100e7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:30.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.904+0000 7f1926840640 1 Processor -- start 2023-10-14T09:37:30.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.905+0000 7f4d907b7640 1 Processor -- start 2023-10-14T09:37:30.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.903+0000 7f8242283640 1 -- 172.21.15.102:0/1794852350 wait complete. 2023-10-14T09:37:30.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.905+0000 7f8242283640 1 Processor -- start 2023-10-14T09:37:30.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.905+0000 7f89ae264640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f89a00e18f0 0x7f89a00e5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.905+0000 7f8242283640 1 -- start start 2023-10-14T09:37:30.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.906+0000 7f89ae264640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f89a00e1cd0 0x7f89a004ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.906+0000 7f1926840640 1 -- start start 2023-10-14T09:37:30.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.906+0000 7f89ae264640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89a00eb880 0x7f89a004f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.906+0000 7f811cf32640 1 --2- 172.21.15.102:0/2970400399 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8110006ff0 0x7f81100e6dc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f81080097a0 tx=0x7f810802b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74949e1a3fdf02fd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:30.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.906+0000 7f89ad262640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f89a00e18f0 0x7f89a00e5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.906+0000 7f89ad262640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f89a00e18f0 0x7f89a00e5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.102:57850/0 (socket says 172.21.15.102:57850) 2023-10-14T09:37:30.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.906+0000 7f89ada63640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89a00eb880 0x7f89a004f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.907+0000 7f89aca61640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f89a00e1cd0 0x7f89a004ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.907+0000 7f89ada63640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89a00eb880 0x7f89a004f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44982/0 (socket says 172.21.15.102:44982) 2023-10-14T09:37:30.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.907+0000 7f810ffff640 1 -- 172.21.15.102:0/2970400399 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810802d040 con 0x7f8110006ff0 2023-10-14T09:37:30.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.907+0000 7f84d8eda640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f84d40caa80 0x7f84d4069da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.907+0000 7f84d8eda640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f84d406a2e0 0x7f84d41650d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.907+0000 7f84d8eda640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84d40caec0 con 0x7f84d40addb0 2023-10-14T09:37:30.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.907+0000 7f84d8eda640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84d4161a50 con 0x7f84d406a2e0 2023-10-14T09:37:30.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.907+0000 7f84d8eda640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d406a750 con 0x7f84d40caa80 2023-10-14T09:37:30.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.907+0000 7f810ffff640 1 -- 172.21.15.102:0/2970400399 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8108031810 con 0x7f8110006ff0 2023-10-14T09:37:30.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.907+0000 7f89aca61640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f89a00e1cd0 0x7f89a004ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.102:60748/0 (socket says 172.21.15.102:60748) 2023-10-14T09:37:30.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.907+0000 7f89ad262640 1 -- 172.21.15.102:0/3935761514 learned_addr learned my addr 172.21.15.102:0/3935761514 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:30.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.907+0000 7f8242283640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8234038180 0x7f82340374b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.907+0000 7f8242283640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f82340542d0 0x7f8234169ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.907+0000 7f8242283640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82340e3190 0x7f8234179030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.907+0000 7f8242283640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823416a430 con 0x7f82340e3190 2023-10-14T09:37:30.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.907+0000 7f8242283640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823416a660 con 0x7f82340542d0 2023-10-14T09:37:30.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.907+0000 7f8242283640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f823416a940 con 0x7f8234038180 2023-10-14T09:37:30.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.908+0000 7f84d1d9b640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f84d40caa80 0x7f84d4069da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.908+0000 7f84d2d9d640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f84d406a2e0 0x7f84d41650d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.908+0000 7f84d2d9d640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f84d406a2e0 0x7f84d41650d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.102:57866/0 (socket says 172.21.15.102:57866) 2023-10-14T09:37:30.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.908+0000 7f84d2d9d640 1 -- 172.21.15.102:0/1948715814 learned_addr learned my addr 172.21.15.102:0/1948715814 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:30.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.908+0000 7f84d259c640 1 --1- 172.21.15.102:0/1948715814 >> v1:172.21.15.102:6789/0 conn(0x7f84d40addb0 0x7f84d40c9000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:45740/0 (socket says 172.21.15.102:45740) 2023-10-14T09:37:30.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.908+0000 7f1926840640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f19200ce1c0 0x7f1920144a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.908+0000 7f1926840640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f19200cf4d0 0x7f19200c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.908+0000 7f810ffff640 1 -- 172.21.15.102:0/2970400399 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810802d040 con 0x7f8110006ff0 2023-10-14T09:37:30.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.908+0000 7f1926840640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1920158f60 0x7f19200c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.908+0000 7f1926840640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19200c7370 con 0x7f1920158f60 2023-10-14T09:37:30.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.908+0000 7f1926840640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19200c64a0 con 0x7f19200ce1c0 2023-10-14T09:37:30.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.908+0000 7f1926840640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19200c88d0 con 0x7f19200cf4d0 2023-10-14T09:37:30.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.908+0000 7f8240a80640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f82340542d0 0x7f8234169ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.908+0000 7f8240a80640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f82340542d0 0x7f8234169ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.102:57870/0 (socket says 172.21.15.102:57870) 2023-10-14T09:37:30.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.908+0000 7f8240a80640 1 -- 172.21.15.102:0/4133960340 learned_addr learned my addr 172.21.15.102:0/4133960340 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:30.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.908+0000 7f89ae264640 1 -- 172.21.15.102:0/3935761514 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a00e3fa0 con 0x7f89a00eb880 2023-10-14T09:37:30.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.908+0000 7f191ffff640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f19200ce1c0 0x7f1920144a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.908+0000 7f191ffff640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f19200ce1c0 0x7f1920144a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.102:57878/0 (socket says 172.21.15.102:57878) 2023-10-14T09:37:30.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.908+0000 7f191ffff640 1 -- 172.21.15.102:0/3263412724 learned_addr learned my addr 172.21.15.102:0/3263412724 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:30.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.909+0000 7f191f7fe640 1 --2- 172.21.15.102:0/3263412724 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f19200cf4d0 0x7f19200c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.941 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.909+0000 7f8241a82640 1 --2- 172.21.15.102:0/4133960340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82340e3190 0x7f8234179030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.941 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.905+0000 7f4d907b7640 1 -- start start 2023-10-14T09:37:30.941 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.907+0000 7f4d907b7640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4d880addb0 0x7f4d880caa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.942 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.907+0000 7f4d907b7640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f4d880c9000 0x7f4d88069da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.942 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.907+0000 7f4d907b7640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d880cb140 con 0x7f4d8806a2e0 2023-10-14T09:37:30.942 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.907+0000 7f4d907b7640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d88161a50 con 0x7f4d880c9000 2023-10-14T09:37:30.942 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.907+0000 7f4d907b7640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8806a750 con 0x7f4d880addb0 2023-10-14T09:37:30.942 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.908+0000 7f4d8dd52640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f4d880c9000 0x7f4d88069da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.943 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.908+0000 7f4d8e553640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4d880addb0 0x7f4d880caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.943 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.908+0000 7f4d8ed54640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f4d8806a2e0 0x7f4d880cc580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:45752/0 (socket says 172.21.15.102:45752) 2023-10-14T09:37:30.943 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.908+0000 7f4d8ed54640 1 -- 172.21.15.102:0/3418439251 learned_addr learned my addr 172.21.15.102:0/3418439251 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:30.943 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.909+0000 7f4d8d551640 1 -- 172.21.15.102:0/3418439251 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 520105386 0 0) 0x7f4d880cb140 con 0x7f4d8806a2e0 2023-10-14T09:37:30.943 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.909+0000 7f4d8d551640 1 -- 172.21.15.102:0/3418439251 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d78003520 con 0x7f4d8806a2e0 2023-10-14T09:37:30.944 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.909+0000 7f89ae264640 1 -- 172.21.15.102:0/3935761514 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a00e3680 con 0x7f89a00e18f0 2023-10-14T09:37:30.944 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.909+0000 7f1924ddd640 1 --2- 172.21.15.102:0/3263412724 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1920158f60 0x7f19200c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.945 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.909+0000 7f84d1d9b640 1 -- 172.21.15.102:0/1948715814 >> v2:172.21.15.129:3300/0 conn(0x7f84d406a2e0 msgr2=0x7f84d41650d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:30.945 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.909+0000 7f84d1d9b640 1 --2- 172.21.15.102:0/1948715814 >> v2:172.21.15.129:3300/0 conn(0x7f84d406a2e0 0x7f84d41650d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.945 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.909+0000 7f84d1d9b640 1 -- 172.21.15.102:0/1948715814 >> v1:172.21.15.102:6789/0 conn(0x7f84d40addb0 legacy=0x7f84d40c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:30.945 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.909+0000 7f84d159a640 1 -- 172.21.15.102:0/1948715814 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3760310778 0 0) 0x7f84d40caec0 con 0x7f84d40addb0 2023-10-14T09:37:30.946 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.909+0000 7f84d1d9b640 1 -- 172.21.15.102:0/1948715814 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d40cb140 con 0x7f84d40caa80 2023-10-14T09:37:30.946 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.909+0000 7f811e735640 1 -- 172.21.15.102:0/2970400399 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8110006ff0 msgr2=0x7f81100e6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:30.946 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.909+0000 7f811e735640 1 --2- 172.21.15.102:0/2970400399 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8110006ff0 0x7f81100e6dc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f81080097a0 tx=0x7f810802b8b0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.947 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.910+0000 7f1924ddd640 1 -- 172.21.15.102:0/3263412724 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f19200cf4d0 msgr2=0x7f19200c5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:30.947 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.909+0000 7f811e735640 1 -- 172.21.15.102:0/2970400399 shutdown_connections 2023-10-14T09:37:30.947 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.909+0000 7f811e735640 1 --2- 172.21.15.102:0/2970400399 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f811002f600 0x7f81100e7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.947 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.909+0000 7f811e735640 1 --2- 172.21.15.102:0/2970400399 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8110006ff0 0x7f81100e6dc0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.948 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.909+0000 7f811e735640 1 -- 172.21.15.102:0/2970400399 >> 172.21.15.102:0/2970400399 conn(0x7f8110054c10 msgr2=0x7f8110055020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:30.948 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.909+0000 7f4d8d551640 1 -- 172.21.15.102:0/3418439251 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4038161555 0 0) 0x7f4d78003520 con 0x7f4d8806a2e0 2023-10-14T09:37:30.948 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.909+0000 7f4d8d551640 1 -- 172.21.15.102:0/3418439251 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4d880addb0 msgr2=0x7f4d880caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:30.949 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.909+0000 7f4d8d551640 1 --2- 172.21.15.102:0/3418439251 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4d880addb0 0x7f4d880caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.949 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.909+0000 7f4d8d551640 1 -- 172.21.15.102:0/3418439251 >> v2:172.21.15.129:3300/0 conn(0x7f4d880c9000 msgr2=0x7f4d88069da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:30.949 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.909+0000 7f4d8d551640 1 --2- 172.21.15.102:0/3418439251 >> v2:172.21.15.129:3300/0 conn(0x7f4d880c9000 0x7f4d88069da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.949 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.909+0000 7f4d8d551640 1 -- 172.21.15.102:0/3418439251 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8806b030 con 0x7f4d8806a2e0 2023-10-14T09:37:30.949 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.909+0000 7f4d8d551640 1 -- 172.21.15.102:0/3418439251 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4030661168 0 0) 0x7f4d80001670 con 0x7f4d8806a2e0 2023-10-14T09:37:30.949 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.909+0000 7f4d8e553640 1 --2- 172.21.15.102:0/3418439251 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4d880addb0 0x7f4d880caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:37:30.950 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.909+0000 7f4d8d551640 1 -- 172.21.15.102:0/3418439251 >> v1:172.21.15.102:6789/0 conn(0x7f4d8806a2e0 legacy=0x7f4d880cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:30.950 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.909+0000 7f4d8d551640 1 --2- 172.21.15.102:0/3418439251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d780039a0 0x7f4d78003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.950 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.909+0000 7f4d8d551640 1 --2- 172.21.15.102:0/3418439251 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4d880addb0 0x7f4d780047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.950 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.910+0000 7f4d8d551640 1 --2- 172.21.15.102:0/3418439251 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4d78004d00 0x7f4d78005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.950 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.910+0000 7f4d8d551640 1 -- 172.21.15.102:0/3418439251 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d88161a50 con 0x7f4d780039a0 2023-10-14T09:37:30.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.910+0000 7f4d8d551640 1 -- 172.21.15.102:0/3418439251 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8806a750 con 0x7f4d78004d00 2023-10-14T09:37:30.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.910+0000 7f4d8d551640 1 -- 172.21.15.102:0/3418439251 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7800b980 con 0x7f4d880addb0 2023-10-14T09:37:30.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.910+0000 7f1924ddd640 1 --2- 172.21.15.102:0/3263412724 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f19200cf4d0 0x7f19200c5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.910+0000 7f1924ddd640 1 -- 172.21.15.102:0/3263412724 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f19200ce1c0 msgr2=0x7f1920144a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:30.952 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.910+0000 7f1924ddd640 1 --2- 172.21.15.102:0/3263412724 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f19200ce1c0 0x7f1920144a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.952 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.910+0000 7f1924ddd640 1 -- 172.21.15.102:0/3263412724 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f191800b4b0 con 0x7f1920158f60 2023-10-14T09:37:30.952 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.910+0000 7f191f7fe640 1 --2- 172.21.15.102:0/3263412724 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f19200cf4d0 0x7f19200c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:37:30.952 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.910+0000 7f89ae264640 1 -- 172.21.15.102:0/3935761514 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a004f6c0 con 0x7f89a00e1cd0 2023-10-14T09:37:30.953 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.909+0000 7f8241281640 1 --2- 172.21.15.102:0/4133960340 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8234038180 0x7f82340374b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.953 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.910+0000 7f1924ddd640 1 --2- 172.21.15.102:0/3263412724 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1920158f60 0x7f19200c8390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f190800caf0 tx=0x7f190800cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:30.954 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.910+0000 7f4d8dd52640 1 --2- 172.21.15.102:0/3418439251 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4d880addb0 0x7f4d780047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.954 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.910+0000 7f4d8e553640 1 --2- 172.21.15.102:0/3418439251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d780039a0 0x7f4d78003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.954 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.910+0000 7f4d8ed54640 1 --2- 172.21.15.102:0/3418439251 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4d78004d00 0x7f4d78005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.955 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.910+0000 7f89ada63640 1 -- 172.21.15.102:0/3935761514 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f89a00e1cd0 msgr2=0x7f89a004ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:30.955 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.910+0000 7f89ada63640 1 --2- 172.21.15.102:0/3935761514 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f89a00e1cd0 0x7f89a004ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.955 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.910+0000 7f89ada63640 1 -- 172.21.15.102:0/3935761514 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f89a00e18f0 msgr2=0x7f89a00e5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:30.955 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.910+0000 7f89ada63640 1 --2- 172.21.15.102:0/3935761514 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f89a00e18f0 0x7f89a00e5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.955 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.910+0000 7f89ada63640 1 -- 172.21.15.102:0/3935761514 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a4009400 con 0x7f89a00eb880 2023-10-14T09:37:30.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.911+0000 7f191cff9640 1 -- 172.21.15.102:0/3263412724 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190800abd0 con 0x7f1920158f60 2023-10-14T09:37:30.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.911+0000 7f191cff9640 1 -- 172.21.15.102:0/3263412724 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190800ad50 con 0x7f1920158f60 2023-10-14T09:37:30.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.911+0000 7f191cff9640 1 -- 172.21.15.102:0/3263412724 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1908012640 con 0x7f1920158f60 2023-10-14T09:37:30.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.911+0000 7f1926840640 1 -- 172.21.15.102:0/3263412724 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19200c8e10 con 0x7f1920158f60 2023-10-14T09:37:30.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.911+0000 7f1926840640 1 -- 172.21.15.102:0/3263412724 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1920145290 con 0x7f1920158f60 2023-10-14T09:37:30.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.911+0000 7f84d1d9b640 1 --2- 172.21.15.102:0/1948715814 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f84d40caa80 0x7f84d4069da0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f84c40097a0 tx=0x7f84c402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b49dafb6e69c5e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:30.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.911+0000 7f8240a80640 1 -- 172.21.15.102:0/4133960340 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8234038180 msgr2=0x7f82340374b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:30.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.911+0000 7f8240a80640 1 --2- 172.21.15.102:0/4133960340 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8234038180 0x7f82340374b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.911+0000 7f8240a80640 1 -- 172.21.15.102:0/4133960340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82340e3190 msgr2=0x7f8234179030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:30.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.911+0000 7f8240a80640 1 --2- 172.21.15.102:0/4133960340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82340e3190 0x7f8234179030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.911+0000 7f8240a80640 1 -- 172.21.15.102:0/4133960340 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f822c009400 con 0x7f82340542d0 2023-10-14T09:37:30.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.911+0000 7f89ada63640 1 --2- 172.21.15.102:0/3935761514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89a00eb880 0x7f89a004f180 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f89a8072680 tx=0x7f89a8067b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:30.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.911+0000 7f4d8dd52640 1 -- 172.21.15.102:0/3418439251 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4d78004d00 msgr2=0x7f4d78005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:30.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.911+0000 7f811e735640 1 -- 172.21.15.102:0/2970400399 shutdown_connections 2023-10-14T09:37:30.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.912+0000 7f84d159a640 1 -- 172.21.15.102:0/1948715814 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c4031830 con 0x7f84d40caa80 2023-10-14T09:37:30.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.912+0000 7f84d159a640 1 -- 172.21.15.102:0/1948715814 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c4031990 con 0x7f84d40caa80 2023-10-14T09:37:30.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.911+0000 7f8241a82640 1 --2- 172.21.15.102:0/4133960340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82340e3190 0x7f8234179030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:37:30.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.912+0000 7f8241281640 1 --2- 172.21.15.102:0/4133960340 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8234038180 0x7f82340374b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:37:30.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.912+0000 7f84d159a640 1 -- 172.21.15.102:0/1948715814 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c4031830 con 0x7f84d40caa80 2023-10-14T09:37:30.962 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.911+0000 7f4d8dd52640 1 --2- 172.21.15.102:0/3418439251 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4d78004d00 0x7f4d78005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.962 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.911+0000 7f4d8dd52640 1 -- 172.21.15.102:0/3418439251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d780039a0 msgr2=0x7f4d78003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:30.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.911+0000 7f4d8dd52640 1 --2- 172.21.15.102:0/3418439251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d780039a0 0x7f4d78003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.911+0000 7f4d8dd52640 1 -- 172.21.15.102:0/3418439251 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7c009a70 con 0x7f4d880addb0 2023-10-14T09:37:30.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.911+0000 7f4d8e553640 1 --2- 172.21.15.102:0/3418439251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d780039a0 0x7f4d78003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:37:30.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.912+0000 7f1926840640 1 -- 172.21.15.102:0/3263412724 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f192004e160 con 0x7f1920158f60 2023-10-14T09:37:30.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.912+0000 7f8240a80640 1 --2- 172.21.15.102:0/4133960340 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f82340542d0 0x7f8234169ef0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f822c0098f0 tx=0x7f822c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:30.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.913+0000 7f84d8eda640 1 -- 172.21.15.102:0/1948715814 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f84d40caa80 msgr2=0x7f84d4069da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:30.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.913+0000 7f84d8eda640 1 --2- 172.21.15.102:0/1948715814 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f84d40caa80 0x7f84d4069da0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f84c40097a0 tx=0x7f84c402b8d0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.913+0000 7f8231ffb640 1 -- 172.21.15.102:0/4133960340 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822c03c820 con 0x7f82340542d0 2023-10-14T09:37:30.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.913+0000 7f8231ffb640 1 -- 172.21.15.102:0/4133960340 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822c03c9a0 con 0x7f82340542d0 2023-10-14T09:37:30.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.913+0000 7f8231ffb640 1 -- 172.21.15.102:0/4133960340 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822c03cd50 con 0x7f82340542d0 2023-10-14T09:37:30.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.913+0000 7f8242283640 1 -- 172.21.15.102:0/4133960340 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f823416ac20 con 0x7f82340542d0 2023-10-14T09:37:30.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.913+0000 7f84d8eda640 1 -- 172.21.15.102:0/1948715814 shutdown_connections 2023-10-14T09:37:30.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.913+0000 7f84d8eda640 1 --2- 172.21.15.102:0/1948715814 >> v2:172.21.15.129:3300/0 conn(0x7f84d406a2e0 0x7f84d41650d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.913+0000 7f84d8eda640 1 --2- 172.21.15.102:0/1948715814 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f84d40caa80 0x7f84d4069da0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.913+0000 7f84d8eda640 1 -- 172.21.15.102:0/1948715814 >> 172.21.15.102:0/1948715814 conn(0x7f84d40ce9b0 msgr2=0x7f84d40cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:30.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.913+0000 7f84d8eda640 1 -- 172.21.15.102:0/1948715814 shutdown_connections 2023-10-14T09:37:30.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.913+0000 7f8242283640 1 -- 172.21.15.102:0/4133960340 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8234179570 con 0x7f82340542d0 2023-10-14T09:37:30.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.913+0000 7f84d8eda640 1 -- 172.21.15.102:0/1948715814 wait complete. 2023-10-14T09:37:30.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.915+0000 7f8242283640 1 -- 172.21.15.102:0/4133960340 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f823416b140 con 0x7f82340542d0 2023-10-14T09:37:30.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.915+0000 7f84d8eda640 1 Processor -- start 2023-10-14T09:37:30.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.913+0000 7f811e735640 1 -- 172.21.15.102:0/2970400399 wait complete. 2023-10-14T09:37:30.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.915+0000 7f811e735640 1 Processor -- start 2023-10-14T09:37:30.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.915+0000 7f811e735640 1 -- start start 2023-10-14T09:37:30.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.915+0000 7f84d8eda640 1 -- start start 2023-10-14T09:37:30.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.916+0000 7f4d8dd52640 1 --2- 172.21.15.102:0/3418439251 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4d880addb0 0x7f4d780047c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4d74009ac0 tx=0x7f4d780057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6972e3ac45b94d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:30.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.916+0000 7f4d8d551640 1 -- 172.21.15.102:0/3418439251 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7402c6f0 con 0x7f4d880addb0 2023-10-14T09:37:30.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.916+0000 7f4d8d551640 1 -- 172.21.15.102:0/3418439251 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7402c850 con 0x7f4d880addb0 2023-10-14T09:37:30.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.916+0000 7f811e735640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8110006ff0 0x7f811002cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.916+0000 7f811e735640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f811003a8d0 0x7f81100359a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.916+0000 7f811e735640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f81100d8440 0x7f8110035ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.917+0000 7f811e735640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81100df800 con 0x7f811003a8d0 2023-10-14T09:37:30.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.917+0000 7f811e735640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81100e2780 con 0x7f81100d8440 2023-10-14T09:37:30.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.917+0000 7f811e735640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81100e0490 con 0x7f8110006ff0 2023-10-14T09:37:30.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.917+0000 7f811cf32640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f811003a8d0 0x7f81100359a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.917+0000 7f811cf32640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f811003a8d0 0x7f81100359a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45020/0 (socket says 172.21.15.102:45020) 2023-10-14T09:37:30.974 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.917+0000 7f84d8eda640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f84d406a2e0 0x7f84d40c22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.974 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.917+0000 7f811cf32640 1 -- 172.21.15.102:0/478871051 learned_addr learned my addr 172.21.15.102:0/478871051 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:30.974 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.917+0000 7f811d733640 1 --2- 172.21.15.102:0/478871051 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8110006ff0 0x7f811002cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.975 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.917+0000 7f8231ffb640 1 -- 172.21.15.102:0/4133960340 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f822c039070 con 0x7f82340542d0 2023-10-14T09:37:30.975 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.917+0000 7f84d8eda640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84d40addb0 0x7f84d40b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.917+0000 7f811df34640 1 --2- 172.21.15.102:0/478871051 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f81100d8440 0x7f8110035ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.917+0000 7f4d907b7640 1 -- 172.21.15.102:0/3418439251 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4d880addb0 msgr2=0x7f4d780047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:30.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.917+0000 7f4d907b7640 1 --2- 172.21.15.102:0/3418439251 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4d880addb0 0x7f4d780047c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4d74009ac0 tx=0x7f4d780057f0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.918+0000 7f4d8ed54640 1 -- 172.21.15.102:0/3418439251 reap_dead start 2023-10-14T09:37:30.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.918+0000 7f4d907b7640 1 -- 172.21.15.102:0/3418439251 shutdown_connections 2023-10-14T09:37:30.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.918+0000 7f4d907b7640 1 -- 172.21.15.102:0/3418439251 >> 172.21.15.102:0/3418439251 conn(0x7f4d880ce9b0 msgr2=0x7f4d880cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:30.978 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.917+0000 7f84d8eda640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f84d40caa80 0x7f84d40b3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.978 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.917+0000 7f84d8eda640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d40c2830 con 0x7f84d40addb0 2023-10-14T09:37:30.978 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.917+0000 7f84d8eda640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d40c2a20 con 0x7f84d406a2e0 2023-10-14T09:37:30.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.917+0000 7f84d8eda640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d40c2d00 con 0x7f84d40caa80 2023-10-14T09:37:30.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.918+0000 7f84d259c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f84d406a2e0 0x7f84d40c22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.918+0000 7f811cf32640 1 -- 172.21.15.102:0/478871051 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8110006ff0 msgr2=0x7f811002cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:30.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.918+0000 7f811cf32640 1 --2- 172.21.15.102:0/478871051 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8110006ff0 0x7f811002cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.918+0000 7f811cf32640 1 -- 172.21.15.102:0/478871051 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f81100d8440 msgr2=0x7f8110035ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:30.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.918+0000 7f811cf32640 1 --2- 172.21.15.102:0/478871051 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f81100d8440 0x7f8110035ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.918+0000 7f811cf32640 1 -- 172.21.15.102:0/478871051 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8108009400 con 0x7f811003a8d0 2023-10-14T09:37:30.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.918+0000 7f84d259c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f84d406a2e0 0x7f84d40c22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.102:57896/0 (socket says 172.21.15.102:57896) 2023-10-14T09:37:30.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.918+0000 7f84d259c640 1 -- 172.21.15.102:0/509405632 learned_addr learned my addr 172.21.15.102:0/509405632 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:30.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.918+0000 7f4d907b7640 1 -- 172.21.15.102:0/3418439251 shutdown_connections 2023-10-14T09:37:30.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.918+0000 7f4d907b7640 1 -- 172.21.15.102:0/3418439251 wait complete. 2023-10-14T09:37:30.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.919+0000 7f8231ffb640 1 --2- 172.21.15.102:0/4133960340 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f822006ae70 0x7f822006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.918+0000 7f84d1d9b640 1 --2- 172.21.15.102:0/509405632 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84d40addb0 0x7f84d40b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.919+0000 7f811cf32640 1 --2- 172.21.15.102:0/478871051 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f811003a8d0 0x7f81100359a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f810802b8f0 tx=0x7f81080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:30.983 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.919+0000 7f84d2d9d640 1 --2- 172.21.15.102:0/509405632 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f84d40caa80 0x7f84d40b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.983 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.919+0000 7f84d1d9b640 1 -- 172.21.15.102:0/509405632 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f84d40caa80 msgr2=0x7f84d40b3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:30.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.919+0000 7f84d1d9b640 1 --2- 172.21.15.102:0/509405632 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f84d40caa80 0x7f84d40b3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.919+0000 7f84d1d9b640 1 -- 172.21.15.102:0/509405632 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f84d406a2e0 msgr2=0x7f84d40c22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:30.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.919+0000 7f84d1d9b640 1 --2- 172.21.15.102:0/509405632 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f84d406a2e0 0x7f84d40c22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.919+0000 7f84d1d9b640 1 -- 172.21.15.102:0/509405632 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c4009400 con 0x7f84d40addb0 2023-10-14T09:37:30.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.919+0000 7f84d2d9d640 1 --2- 172.21.15.102:0/509405632 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f84d40caa80 0x7f84d40b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:37:30.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.920+0000 7f84d259c640 1 --2- 172.21.15.102:0/509405632 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f84d406a2e0 0x7f84d40c22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:37:30.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.919+0000 7f8231ffb640 1 -- 172.21.15.102:0/4133960340 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f822c0ab2d0 con 0x7f82340542d0 2023-10-14T09:37:30.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.920+0000 7f8241281640 1 --2- 172.21.15.102:0/4133960340 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f822006ae70 0x7f822006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.920+0000 7f84d1d9b640 1 --2- 172.21.15.102:0/509405632 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84d40addb0 0x7f84d40b2bc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f84d40b15a0 tx=0x7f84c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:30.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.921+0000 7f191cff9640 1 -- 172.21.15.102:0/3263412724 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f19080127a0 con 0x7f1920158f60 2023-10-14T09:37:30.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.921+0000 7f899dffb640 1 -- 172.21.15.102:0/3935761514 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a80b7610 con 0x7f89a00eb880 2023-10-14T09:37:30.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.921+0000 7f899dffb640 1 -- 172.21.15.102:0/3935761514 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a80b7770 con 0x7f89a00eb880 2023-10-14T09:37:30.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.921+0000 7f899dffb640 1 -- 172.21.15.102:0/3935761514 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a80b7b20 con 0x7f89a00eb880 2023-10-14T09:37:30.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.921+0000 7f89ae264640 1 -- 172.21.15.102:0/3935761514 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a804f050 con 0x7f89a00eb880 2023-10-14T09:37:30.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.921+0000 7f89ae264640 1 -- 172.21.15.102:0/3935761514 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a00e38e0 con 0x7f89a00eb880 2023-10-14T09:37:30.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.922+0000 7f191cff9640 1 --2- 172.21.15.102:0/3263412724 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f190006ae70 0x7f190006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.922+0000 7f4d907b7640 1 Processor -- start 2023-10-14T09:37:30.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.922+0000 7f4d907b7640 1 -- start start 2023-10-14T09:37:30.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.922+0000 7f191ffff640 1 --2- 172.21.15.102:0/3263412724 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f190006ae70 0x7f190006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.923+0000 7f191cff9640 1 -- 172.21.15.102:0/3263412724 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f19080599c0 con 0x7f1920158f60 2023-10-14T09:37:30.990 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.923+0000 7f8241281640 1 --2- 172.21.15.102:0/4133960340 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f822006ae70 0x7f822006d330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8238009af0 tx=0x7f8238008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:30.990 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.923+0000 7f191ffff640 1 --2- 172.21.15.102:0/3263412724 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f190006ae70 0x7f190006d330 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f191802bf50 tx=0x7f1918030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:30.990 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.925+0000 7f89ae264640 1 -- 172.21.15.102:0/3935761514 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89a00e40e0 con 0x7f89a00eb880 2023-10-14T09:37:30.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.924+0000 7f4d907b7640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4d880addb0 0x7f4d88164ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.924+0000 7f4d907b7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d880cd1c0 0x7f4d88070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.924+0000 7f4d907b7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4d880c4380 0x7f4d880c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:30.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.924+0000 7f4d907b7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d880c6400 con 0x7f4d880cd1c0 2023-10-14T09:37:30.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.924+0000 7f4d8e553640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4d880addb0 0x7f4d88164ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.924+0000 7f4d8e553640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4d880addb0 0x7f4d88164ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.102:60832/0 (socket says 172.21.15.102:60832) 2023-10-14T09:37:30.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.924+0000 7f4d8e553640 1 -- 172.21.15.102:0/1057247283 learned_addr learned my addr 172.21.15.102:0/1057247283 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:30.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.924+0000 7f4d907b7640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d880c6650 con 0x7f4d880c4380 2023-10-14T09:37:30.993 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.924+0000 7f4d907b7640 1 -- 172.21.15.102:0/1057247283 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d880c6930 con 0x7f4d880addb0 2023-10-14T09:37:30.993 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.925+0000 7f4d8dd52640 1 --2- 172.21.15.102:0/1057247283 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d880cd1c0 0x7f4d88070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:30.993 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.925+0000 7f4d8e553640 1 -- 172.21.15.102:0/1057247283 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4d880c4380 msgr2=0x7f4d880c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:30.993 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.925+0000 7f4d8e553640 1 --2- 172.21.15.102:0/1057247283 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4d880c4380 0x7f4d880c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.993 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.925+0000 7f4d8e553640 1 -- 172.21.15.102:0/1057247283 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d880cd1c0 msgr2=0x7f4d88070ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:30.994 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.925+0000 7f4d8e553640 1 --2- 172.21.15.102:0/1057247283 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d880cd1c0 0x7f4d88070ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:30.994 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.925+0000 7f4d8e553640 1 -- 172.21.15.102:0/1057247283 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d88162e30 con 0x7f4d880addb0 2023-10-14T09:37:30.994 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.925+0000 7f4d8dd52640 1 --2- 172.21.15.102:0/1057247283 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d880cd1c0 0x7f4d88070ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:37:30.994 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.926+0000 7f810dffb640 1 -- 172.21.15.102:0/478871051 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810802d040 con 0x7f811003a8d0 2023-10-14T09:37:30.995 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.926+0000 7f4d8e553640 1 --2- 172.21.15.102:0/1057247283 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4d880addb0 0x7f4d88164ad0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c00f430 tx=0x7f4d7c00f8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:30.995 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.926+0000 7f811e735640 1 -- 172.21.15.102:0/478871051 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81100e0770 con 0x7f811003a8d0 2023-10-14T09:37:30.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.926+0000 7f191cff9640 1 -- 172.21.15.102:0/3263412724 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1908055600 con 0x7f1920158f60 2023-10-14T09:37:30.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.926+0000 7f811e735640 1 -- 172.21.15.102:0/478871051 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81100e0d30 con 0x7f811003a8d0 2023-10-14T09:37:30.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.927+0000 7f4d86ffd640 1 -- 172.21.15.102:0/1057247283 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c00e040 con 0x7f4d880addb0 2023-10-14T09:37:30.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.927+0000 7f4d907b7640 1 -- 172.21.15.102:0/1057247283 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d88163110 con 0x7f4d880addb0 2023-10-14T09:37:30.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.927+0000 7f4d907b7640 1 -- 172.21.15.102:0/1057247283 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d880711f0 con 0x7f4d880addb0 2023-10-14T09:37:30.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.928+0000 7f4d86ffd640 1 -- 172.21.15.102:0/1057247283 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7c00f040 con 0x7f4d880addb0 2023-10-14T09:37:30.998 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.928+0000 7f4d86ffd640 1 -- 172.21.15.102:0/1057247283 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c015a60 con 0x7f4d880addb0 2023-10-14T09:37:30.998 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.928+0000 7f811e735640 1 -- 172.21.15.102:0/478871051 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8110008b20 con 0x7f811003a8d0 2023-10-14T09:37:30.998 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.930+0000 7f810dffb640 1 -- 172.21.15.102:0/478871051 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8108006e10 con 0x7f811003a8d0 2023-10-14T09:37:30.999 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.930+0000 7f810dffb640 1 -- 172.21.15.102:0/478871051 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810804d450 con 0x7f811003a8d0 2023-10-14T09:37:30.999 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.930+0000 7f84c2ffd640 1 -- 172.21.15.102:0/509405632 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c4004510 con 0x7f84d40addb0 2023-10-14T09:37:30.999 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.930+0000 7f84c2ffd640 1 -- 172.21.15.102:0/509405632 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c403f070 con 0x7f84d40addb0 2023-10-14T09:37:30.999 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.930+0000 7f84c2ffd640 1 -- 172.21.15.102:0/509405632 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c4003810 con 0x7f84d40addb0 2023-10-14T09:37:31.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.930+0000 7f4d907b7640 1 -- 172.21.15.102:0/1057247283 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d70005250 con 0x7f4d880addb0 2023-10-14T09:37:31.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.930+0000 7f84d8eda640 1 -- 172.21.15.102:0/509405632 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d40c2fe0 con 0x7f84d40addb0 2023-10-14T09:37:31.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.930+0000 7f84d8eda640 1 -- 172.21.15.102:0/509405632 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d40c4330 con 0x7f84d40addb0 2023-10-14T09:37:31.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.932+0000 7f84d8eda640 1 -- 172.21.15.102:0/509405632 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84d40c3500 con 0x7f84d40addb0 2023-10-14T09:37:31.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.931+0000 7f899dffb640 1 -- 172.21.15.102:0/3935761514 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f89a80b5040 con 0x7f89a00eb880 2023-10-14T09:37:31.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.932+0000 7f899dffb640 1 --2- 172.21.15.102:0/3935761514 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f898c06af40 0x7f898c06d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:31.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.932+0000 7f899dffb640 1 -- 172.21.15.102:0/3935761514 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f89a81258c0 con 0x7f89a00eb880 2023-10-14T09:37:31.002 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.932+0000 7f8231ffb640 1 -- 172.21.15.102:0/4133960340 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f822c0763f0 con 0x7f82340542d0 2023-10-14T09:37:31.002 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.934+0000 7f89ad262640 1 --2- 172.21.15.102:0/3935761514 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f898c06af40 0x7f898c06d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:31.003 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.932+0000 7f4d86ffd640 1 -- 172.21.15.102:0/1057247283 <== mon.2 v2:172.21.15.129:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4d7c015bc0 con 0x7f4d880addb0 2023-10-14T09:37:31.003 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.934+0000 7f4d86ffd640 1 --2- 172.21.15.102:0/1057247283 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4d6c06aea0 0x7f4d6c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:31.003 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.934+0000 7f4d86ffd640 1 -- 172.21.15.102:0/1057247283 <== mon.2 v2:172.21.15.129:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d7c08a7c0 con 0x7f4d880addb0 2023-10-14T09:37:31.004 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.935+0000 7f4d8dd52640 1 --2- 172.21.15.102:0/1057247283 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4d6c06aea0 0x7f4d6c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:31.004 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.935+0000 7f899dffb640 1 -- 172.21.15.102:0/3935761514 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f89a80f0b00 con 0x7f89a00eb880 2023-10-14T09:37:31.004 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.937+0000 7f89ad262640 1 --2- 172.21.15.102:0/3935761514 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f898c06af40 0x7f898c06d400 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f89a4009c80 tx=0x7f89a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:31.005 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.937+0000 7f4d8dd52640 1 --2- 172.21.15.102:0/1057247283 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4d6c06aea0 0x7f4d6c06d360 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4d74036000 tx=0x7f4d74030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:31.005 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.937+0000 7f810dffb640 1 -- 172.21.15.102:0/478871051 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f810804d5b0 con 0x7f811003a8d0 2023-10-14T09:37:31.005 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.939+0000 7f810dffb640 1 --2- 172.21.15.102:0/478871051 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f80fc06ae70 0x7f80fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:31.006 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.939+0000 7f810dffb640 1 -- 172.21.15.102:0/478871051 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81080aba50 con 0x7f811003a8d0 2023-10-14T09:37:31.006 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.940+0000 7f811d733640 1 --2- 172.21.15.102:0/478871051 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f80fc06ae70 0x7f80fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:31.006 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.941+0000 7f84c2ffd640 1 -- 172.21.15.102:0/509405632 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f84c4003970 con 0x7f84d40addb0 2023-10-14T09:37:31.007 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.941+0000 7f811d733640 1 --2- 172.21.15.102:0/478871051 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f80fc06ae70 0x7f80fc06d330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f81140011e0 tx=0x7f8114007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:31.007 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.942+0000 7f84c2ffd640 1 --2- 172.21.15.102:0/509405632 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f84b406af40 0x7f84b406d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:31.008 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.943+0000 7f84c2ffd640 1 -- 172.21.15.102:0/509405632 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f84c4041070 con 0x7f84d40addb0 2023-10-14T09:37:31.008 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.943+0000 7f84d259c640 1 --2- 172.21.15.102:0/509405632 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f84b406af40 0x7f84b406d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:31.008 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.944+0000 7f84d259c640 1 --2- 172.21.15.102:0/509405632 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f84b406af40 0x7f84b406d400 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f84cc007fd0 tx=0x7f84cc005b70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:31.008 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.945+0000 7f810dffb640 1 -- 172.21.15.102:0/478871051 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8108076db0 con 0x7f811003a8d0 2023-10-14T09:37:31.009 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.947+0000 7f4d86ffd640 1 -- 172.21.15.102:0/1057247283 <== mon.2 v2:172.21.15.129:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4d7c055990 con 0x7f4d880addb0 2023-10-14T09:37:31.009 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.951+0000 7f84c2ffd640 1 -- 172.21.15.102:0/509405632 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f84c4077010 con 0x7f84d40addb0 2023-10-14T09:37:31.013 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.957+0000 7fc5a9202640 1 Processor -- start 2023-10-14T09:37:31.014 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.957+0000 7fc5a9202640 1 -- start start 2023-10-14T09:37:31.014 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.959+0000 7fc5a9202640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc5a415cd70 0x7fc5a40d2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:31.014 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.959+0000 7fc5a9202640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fc5a40b8480 0x7fc5a40cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:31.014 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.959+0000 7fc5a9202640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5a415d150 con 0x7fc5a40d0be0 2023-10-14T09:37:31.015 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.959+0000 7fc5a9202640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5a40d1180 con 0x7fc5a40b8480 2023-10-14T09:37:31.015 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.959+0000 7fc5a9202640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a40d1460 con 0x7fc5a415cd70 2023-10-14T09:37:31.015 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.959+0000 7fc5a3fff640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc5a415cd70 0x7fc5a40d2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:31.015 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.959+0000 7fc5a8a01640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fc5a40d0be0 0x7fc5a40b5c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:45754/0 (socket says 172.21.15.102:45754) 2023-10-14T09:37:31.015 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.959+0000 7fc5a8a01640 1 -- 172.21.15.102:0/4152949898 learned_addr learned my addr 172.21.15.102:0/4152949898 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:31.016 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.960+0000 7fc5a37fe640 1 --2- 172.21.15.102:0/4152949898 >> v2:172.21.15.129:3300/0 conn(0x7fc5a40b8480 0x7fc5a40cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:31.016 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.960+0000 7fc5a3fff640 1 -- 172.21.15.102:0/4152949898 >> v2:172.21.15.129:3300/0 conn(0x7fc5a40b8480 msgr2=0x7fc5a40cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:31.016 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.960+0000 7fc5a3fff640 1 --2- 172.21.15.102:0/4152949898 >> v2:172.21.15.129:3300/0 conn(0x7fc5a40b8480 0x7fc5a40cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.016 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.960+0000 7fc5a3fff640 1 -- 172.21.15.102:0/4152949898 >> v1:172.21.15.102:6789/0 conn(0x7fc5a40d0be0 legacy=0x7fc5a40b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:31.016 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.960+0000 7fc5a3fff640 1 -- 172.21.15.102:0/4152949898 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a40d1740 con 0x7fc5a415cd70 2023-10-14T09:37:31.017 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.963+0000 7fc5a3fff640 1 --2- 172.21.15.102:0/4152949898 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc5a415cd70 0x7fc5a40d2220 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc59c0097a0 tx=0x7fc59c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89c4bc27ff29346c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:31.017 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.963+0000 7fc5a2ffd640 1 -- 172.21.15.102:0/4152949898 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59c02d040 con 0x7fc5a415cd70 2023-10-14T09:37:31.017 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.964+0000 7fc5a2ffd640 1 -- 172.21.15.102:0/4152949898 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59c031810 con 0x7fc5a415cd70 2023-10-14T09:37:31.017 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.964+0000 7fc5a9202640 1 -- 172.21.15.102:0/4152949898 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc5a415cd70 msgr2=0x7fc5a40d2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:31.017 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.964+0000 7fc5a9202640 1 --2- 172.21.15.102:0/4152949898 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc5a415cd70 0x7fc5a40d2220 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc59c0097a0 tx=0x7fc59c02b8b0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.018 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.966+0000 7fc5a9202640 1 -- 172.21.15.102:0/4152949898 shutdown_connections 2023-10-14T09:37:31.018 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.966+0000 7fc5a9202640 1 --2- 172.21.15.102:0/4152949898 >> v2:172.21.15.129:3300/0 conn(0x7fc5a40b8480 0x7fc5a40cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.018 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.966+0000 7fc5a9202640 1 --2- 172.21.15.102:0/4152949898 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc5a415cd70 0x7fc5a40d2220 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.018 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.966+0000 7fc5a9202640 1 -- 172.21.15.102:0/4152949898 >> 172.21.15.102:0/4152949898 conn(0x7fc5a40cf570 msgr2=0x7fc5a40cf950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:31.018 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.966+0000 7fc5a9202640 1 -- 172.21.15.102:0/4152949898 shutdown_connections 2023-10-14T09:37:31.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.966+0000 7fc5a9202640 1 -- 172.21.15.102:0/4152949898 wait complete. 2023-10-14T09:37:31.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.969+0000 7fc5a9202640 1 Processor -- start 2023-10-14T09:37:31.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.969+0000 7fc5a9202640 1 -- start start 2023-10-14T09:37:31.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.972+0000 7fc5a9202640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc5a40b8480 0x7fc5a40c7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:31.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.972+0000 7fc5a9202640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5a40d0be0 0x7fc5a40cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:31.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.972+0000 7fc5a9202640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5a415cd70 0x7fc5a415a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:31.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.972+0000 7fc5a9202640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a414e320 con 0x7fc5a415cd70 2023-10-14T09:37:31.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.972+0000 7fc5a37fe640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5a40d0be0 0x7fc5a40cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:31.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.973+0000 7fc5a9202640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a40c9100 con 0x7fc5a40d0be0 2023-10-14T09:37:31.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.973+0000 7fc5a9202640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a414dcd0 con 0x7fc5a40b8480 2023-10-14T09:37:31.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.973+0000 7fc5a37fe640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5a40d0be0 0x7fc5a40cbfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.102:57920/0 (socket says 172.21.15.102:57920) 2023-10-14T09:37:31.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.973+0000 7fc5a37fe640 1 -- 172.21.15.102:0/3015154115 learned_addr learned my addr 172.21.15.102:0/3015154115 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:31.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.973+0000 7fc5a8a01640 1 --2- 172.21.15.102:0/3015154115 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5a415cd70 0x7fc5a415a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:31.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.973+0000 7fc5a37fe640 1 -- 172.21.15.102:0/3015154115 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc5a40b8480 msgr2=0x7fc5a40c7220 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T09:37:31.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.973+0000 7fc5a37fe640 1 --2- 172.21.15.102:0/3015154115 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc5a40b8480 0x7fc5a40c7220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.974+0000 7fc5a37fe640 1 -- 172.21.15.102:0/3015154115 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5a415cd70 msgr2=0x7fc5a415a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:31.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.974+0000 7fc5a37fe640 1 --2- 172.21.15.102:0/3015154115 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5a415cd70 0x7fc5a415a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.974+0000 7fc5a37fe640 1 -- 172.21.15.102:0/3015154115 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc59c009400 con 0x7fc5a40d0be0 2023-10-14T09:37:31.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.974+0000 7fc5a8a01640 1 --2- 172.21.15.102:0/3015154115 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5a415cd70 0x7fc5a415a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:37:31.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.974+0000 7fc5a37fe640 1 --2- 172.21.15.102:0/3015154115 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5a40d0be0 0x7fc5a40cbfa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc594007e40 tx=0x7fc59400e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:31.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.974+0000 7fc5a0ff9640 1 -- 172.21.15.102:0/3015154115 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc594014620 con 0x7fc5a40d0be0 2023-10-14T09:37:31.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.975+0000 7fc5a0ff9640 1 -- 172.21.15.102:0/3015154115 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59400ee90 con 0x7fc5a40d0be0 2023-10-14T09:37:31.023 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.975+0000 7fc5a0ff9640 1 -- 172.21.15.102:0/3015154115 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5940149c0 con 0x7fc5a40d0be0 2023-10-14T09:37:31.023 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.975+0000 7fc5a9202640 1 -- 172.21.15.102:0/3015154115 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5a414dfb0 con 0x7fc5a40d0be0 2023-10-14T09:37:31.023 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.975+0000 7fc5a9202640 1 -- 172.21.15.102:0/3015154115 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5a40c7760 con 0x7fc5a40d0be0 2023-10-14T09:37:31.023 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.976+0000 7fc5a9202640 1 -- 172.21.15.102:0/3015154115 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5a404e9b0 con 0x7fc5a40d0be0 2023-10-14T09:37:31.023 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.979+0000 7fc5a0ff9640 1 -- 172.21.15.102:0/3015154115 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc594014b20 con 0x7fc5a40d0be0 2023-10-14T09:37:31.024 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.980+0000 7fc5a0ff9640 1 --2- 172.21.15.102:0/3015154115 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc58406ae70 0x7fc58406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:31.024 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.980+0000 7fc5a0ff9640 1 -- 172.21.15.102:0/3015154115 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc59408a020 con 0x7fc5a40d0be0 2023-10-14T09:37:31.024 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.981+0000 7fc5a3fff640 1 --2- 172.21.15.102:0/3015154115 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc58406ae70 0x7fc58406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:31.024 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.982+0000 7fc5a3fff640 1 --2- 172.21.15.102:0/3015154115 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc58406ae70 0x7fc58406d330 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc59c036000 tx=0x7fc59c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:31.024 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:30.994+0000 7fc5a0ff9640 1 -- 172.21.15.102:0/3015154115 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc5940bcca0 con 0x7fc5a40d0be0 2023-10-14T09:37:31.143 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T09:37:31.163 DEBUG:teuthology.orchestra.run.smithi129:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T09:37:31.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.287+0000 7f5912ffd640 1 -- 172.21.15.102:0/3111325795 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f5904005500 con 0x7f592c159d50 2023-10-14T09:37:31.293 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.291+0000 7f59297fa640 1 -- 172.21.15.102:0/3111325795 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5924018020 con 0x7f592c159d50 2023-10-14T09:37:31.296 INFO:teuthology.orchestra.run.smithi102.stdout:64424509447 2023-10-14T09:37:31.297 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.295+0000 7f5912ffd640 1 -- 172.21.15.102:0/3111325795 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f591806af70 msgr2=0x7f591806d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:31.297 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.295+0000 7f5912ffd640 1 --2- 172.21.15.102:0/3111325795 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f591806af70 0x7f591806d430 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5920000f60 tx=0x7f5920009040 comp rx=0 tx=0).stop 2023-10-14T09:37:31.298 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.295+0000 7f5912ffd640 1 -- 172.21.15.102:0/3111325795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f592c159d50 msgr2=0x7f592c0c4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:31.300 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.295+0000 7f5912ffd640 1 --2- 172.21.15.102:0/3111325795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f592c159d50 0x7f592c0c4970 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f592400caf0 tx=0x7f592400a060 comp rx=0 tx=0).stop 2023-10-14T09:37:31.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.295+0000 7f5912ffd640 1 -- 172.21.15.102:0/3111325795 shutdown_connections 2023-10-14T09:37:31.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.295+0000 7f5912ffd640 1 --2- 172.21.15.102:0/3111325795 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f591806af70 0x7f591806d430 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.295+0000 7f5912ffd640 1 --2- 172.21.15.102:0/3111325795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f592c159d50 0x7f592c0c4970 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.295+0000 7f5912ffd640 1 --2- 172.21.15.102:0/3111325795 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f592c159970 0x7f592c0c5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.295+0000 7f5912ffd640 1 --2- 172.21.15.102:0/3111325795 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f592c0b2030 0x7f592c152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.295+0000 7f5912ffd640 1 -- 172.21.15.102:0/3111325795 >> 172.21.15.102:0/3111325795 conn(0x7f592c0b12e0 msgr2=0x7f592c0c9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:31.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.299+0000 7f5912ffd640 1 -- 172.21.15.102:0/3111325795 shutdown_connections 2023-10-14T09:37:31.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.299+0000 7f5912ffd640 1 -- 172.21.15.102:0/3111325795 wait complete. 2023-10-14T09:37:31.337 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.4 2023-10-14T09:37:31.337 DEBUG:teuthology.parallel:result is None 2023-10-14T09:37:31.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.349+0000 7f1926840640 1 -- 172.21.15.102:0/3263412724 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f192006c9e0 con 0x7f1920158f60 2023-10-14T09:37:31.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.350+0000 7f191cff9640 1 -- 172.21.15.102:0/3263412724 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1908058c20 con 0x7f1920158f60 2023-10-14T09:37:31.352 INFO:teuthology.orchestra.run.smithi102.stdout:60129542151 2023-10-14T09:37:31.355 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.353+0000 7f1926840640 1 -- 172.21.15.102:0/3263412724 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f190006ae70 msgr2=0x7f190006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:31.355 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.353+0000 7f1926840640 1 --2- 172.21.15.102:0/3263412724 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f190006ae70 0x7f190006d330 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f191802bf50 tx=0x7f1918030000 comp rx=0 tx=0).stop 2023-10-14T09:37:31.355 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.353+0000 7f1926840640 1 -- 172.21.15.102:0/3263412724 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1920158f60 msgr2=0x7f19200c8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:31.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.353+0000 7f1926840640 1 --2- 172.21.15.102:0/3263412724 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1920158f60 0x7f19200c8390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f190800caf0 tx=0x7f190800cef0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.353+0000 7f1926840640 1 -- 172.21.15.102:0/3263412724 shutdown_connections 2023-10-14T09:37:31.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.353+0000 7f1926840640 1 --2- 172.21.15.102:0/3263412724 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f190006ae70 0x7f190006d330 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f191802bf50 tx=0x7f1918030000 comp rx=0 tx=0).stop 2023-10-14T09:37:31.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.353+0000 7f1926840640 1 --2- 172.21.15.102:0/3263412724 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1920158f60 0x7f19200c8390 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.353+0000 7f1926840640 1 --2- 172.21.15.102:0/3263412724 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f19200cf4d0 0x7f19200c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.353+0000 7f1926840640 1 --2- 172.21.15.102:0/3263412724 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f19200ce1c0 0x7f1920144a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.353+0000 7f1926840640 1 -- 172.21.15.102:0/3263412724 >> 172.21.15.102:0/3263412724 conn(0x7f19200ce9b0 msgr2=0x7f1920156e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:31.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.353+0000 7f89ae264640 1 -- 172.21.15.102:0/3935761514 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f89a00e40e0 con 0x7f89a00eb880 2023-10-14T09:37:31.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.353+0000 7f899dffb640 1 -- 172.21.15.102:0/3935761514 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f89a00e40e0 con 0x7f89a00eb880 2023-10-14T09:37:31.358 INFO:teuthology.orchestra.run.smithi102.stdout:64424509447 2023-10-14T09:37:31.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.356+0000 7f1926840640 1 -- 172.21.15.102:0/3263412724 shutdown_connections 2023-10-14T09:37:31.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.356+0000 7f1926840640 1 -- 172.21.15.102:0/3263412724 wait complete. 2023-10-14T09:37:31.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.357+0000 7f89ae264640 1 -- 172.21.15.102:0/3935761514 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f898c06af40 msgr2=0x7f898c06d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:31.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.357+0000 7f89ae264640 1 --2- 172.21.15.102:0/3935761514 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f898c06af40 0x7f898c06d400 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f89a4009c80 tx=0x7f89a4008040 comp rx=0 tx=0).stop 2023-10-14T09:37:31.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.357+0000 7f89ae264640 1 -- 172.21.15.102:0/3935761514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89a00eb880 msgr2=0x7f89a004f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:31.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.357+0000 7f89ae264640 1 --2- 172.21.15.102:0/3935761514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89a00eb880 0x7f89a004f180 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f89a8072680 tx=0x7f89a8067b80 comp rx=0 tx=0).stop 2023-10-14T09:37:31.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.358+0000 7f89ae264640 1 -- 172.21.15.102:0/3935761514 shutdown_connections 2023-10-14T09:37:31.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.358+0000 7f89ae264640 1 --2- 172.21.15.102:0/3935761514 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f898c06af40 0x7f898c06d400 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.358+0000 7f89ae264640 1 --2- 172.21.15.102:0/3935761514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89a00eb880 0x7f89a004f180 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.358+0000 7f89ae264640 1 --2- 172.21.15.102:0/3935761514 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f89a00e1cd0 0x7f89a004ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.358+0000 7f89ae264640 1 --2- 172.21.15.102:0/3935761514 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f89a00e18f0 0x7f89a00e5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.358+0000 7f89ae264640 1 -- 172.21.15.102:0/3935761514 >> 172.21.15.102:0/3935761514 conn(0x7f89a00590c0 msgr2=0x7f89a00eacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:31.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.359+0000 7f89ae264640 1 -- 172.21.15.102:0/3935761514 shutdown_connections 2023-10-14T09:37:31.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.359+0000 7f89ae264640 1 -- 172.21.15.102:0/3935761514 wait complete. 2023-10-14T09:37:31.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.361+0000 7f8242283640 1 -- 172.21.15.102:0/4133960340 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f823416b140 con 0x7f82340542d0 2023-10-14T09:37:31.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.362+0000 7f8231ffb640 1 -- 172.21.15.102:0/4133960340 <== mon.1 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f823416b140 con 0x7f82340542d0 2023-10-14T09:37:31.364 INFO:teuthology.orchestra.run.smithi102.stdout:64424509445 2023-10-14T09:37:31.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.366+0000 7f8242283640 1 -- 172.21.15.102:0/4133960340 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f822006ae70 msgr2=0x7f822006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:31.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.366+0000 7f8242283640 1 --2- 172.21.15.102:0/4133960340 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f822006ae70 0x7f822006d330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8238009af0 tx=0x7f8238008040 comp rx=0 tx=0).stop 2023-10-14T09:37:31.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.366+0000 7f8242283640 1 -- 172.21.15.102:0/4133960340 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f82340542d0 msgr2=0x7f8234169ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:31.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.366+0000 7f8242283640 1 --2- 172.21.15.102:0/4133960340 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f82340542d0 0x7f8234169ef0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f822c0098f0 tx=0x7f822c0046c0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.368+0000 7f8242283640 1 -- 172.21.15.102:0/4133960340 shutdown_connections 2023-10-14T09:37:31.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.368+0000 7f8242283640 1 --2- 172.21.15.102:0/4133960340 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f822006ae70 0x7f822006d330 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.368+0000 7f8242283640 1 --2- 172.21.15.102:0/4133960340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82340e3190 0x7f8234179030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.368+0000 7f8242283640 1 --2- 172.21.15.102:0/4133960340 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f82340542d0 0x7f8234169ef0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.368+0000 7f8242283640 1 --2- 172.21.15.102:0/4133960340 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8234038180 0x7f82340374b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.371 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.368+0000 7f8242283640 1 -- 172.21.15.102:0/4133960340 >> 172.21.15.102:0/4133960340 conn(0x7f82340590c0 msgr2=0x7f823403ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:31.371 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.368+0000 7f8242283640 1 -- 172.21.15.102:0/4133960340 shutdown_connections 2023-10-14T09:37:31.371 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.368+0000 7f8242283640 1 -- 172.21.15.102:0/4133960340 wait complete. 2023-10-14T09:37:31.372 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.370+0000 7f811e735640 1 -- 172.21.15.102:0/478871051 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f81100e0f20 con 0x7f811003a8d0 2023-10-14T09:37:31.372 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.371+0000 7f810dffb640 1 -- 172.21.15.102:0/478871051 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8108035090 con 0x7f811003a8d0 2023-10-14T09:37:31.373 INFO:teuthology.orchestra.run.smithi102.stdout:64424509447 2023-10-14T09:37:31.376 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.374+0000 7f811e735640 1 -- 172.21.15.102:0/478871051 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f80fc06ae70 msgr2=0x7f80fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:31.376 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.374+0000 7f811e735640 1 --2- 172.21.15.102:0/478871051 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f80fc06ae70 0x7f80fc06d330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f81140011e0 tx=0x7f8114007d30 comp rx=0 tx=0).stop 2023-10-14T09:37:31.377 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.375+0000 7f811e735640 1 -- 172.21.15.102:0/478871051 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f811003a8d0 msgr2=0x7f81100359a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:31.377 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.375+0000 7f811e735640 1 --2- 172.21.15.102:0/478871051 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f811003a8d0 0x7f81100359a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f810802b8f0 tx=0x7f81080046c0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.377 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.374+0000 7f84d8eda640 1 -- 172.21.15.102:0/509405632 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f84d40c3500 con 0x7f84d40addb0 2023-10-14T09:37:31.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.375+0000 7f811e735640 1 -- 172.21.15.102:0/478871051 shutdown_connections 2023-10-14T09:37:31.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.375+0000 7f811e735640 1 --2- 172.21.15.102:0/478871051 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f80fc06ae70 0x7f80fc06d330 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.375+0000 7f811e735640 1 --2- 172.21.15.102:0/478871051 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f81100d8440 0x7f8110035ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.375+0000 7f811e735640 1 --2- 172.21.15.102:0/478871051 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f811003a8d0 0x7f81100359a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.375+0000 7f811e735640 1 --2- 172.21.15.102:0/478871051 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8110006ff0 0x7f811002cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.379 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.375+0000 7f811e735640 1 -- 172.21.15.102:0/478871051 >> 172.21.15.102:0/478871051 conn(0x7f8110054c10 msgr2=0x7f81100e6d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:31.379 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.375+0000 7f84c2ffd640 1 -- 172.21.15.102:0/509405632 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f84d40c3500 con 0x7f84d40addb0 2023-10-14T09:37:31.379 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.375+0000 7f811e735640 1 -- 172.21.15.102:0/478871051 shutdown_connections 2023-10-14T09:37:31.380 INFO:teuthology.orchestra.run.smithi102.stdout:60129542151 2023-10-14T09:37:31.380 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.376+0000 7f811e735640 1 -- 172.21.15.102:0/478871051 wait complete. 2023-10-14T09:37:31.381 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542151 for osd.0 2023-10-14T09:37:31.381 DEBUG:teuthology.parallel:result is None 2023-10-14T09:37:31.382 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.379+0000 7f84d8eda640 1 -- 172.21.15.102:0/509405632 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f84b406af40 msgr2=0x7f84b406d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:31.383 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.379+0000 7f84d8eda640 1 --2- 172.21.15.102:0/509405632 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f84b406af40 0x7f84b406d400 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f84cc007fd0 tx=0x7f84cc005b70 comp rx=0 tx=0).stop 2023-10-14T09:37:31.383 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.379+0000 7f84d8eda640 1 -- 172.21.15.102:0/509405632 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84d40addb0 msgr2=0x7f84d40b2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:31.383 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.379+0000 7f84d8eda640 1 --2- 172.21.15.102:0/509405632 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84d40addb0 0x7f84d40b2bc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f84d40b15a0 tx=0x7f84c40046c0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.383 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.379+0000 7f84d8eda640 1 -- 172.21.15.102:0/509405632 shutdown_connections 2023-10-14T09:37:31.383 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.379+0000 7f84d8eda640 1 --2- 172.21.15.102:0/509405632 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f84b406af40 0x7f84b406d400 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.384 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.379+0000 7f84d8eda640 1 --2- 172.21.15.102:0/509405632 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f84d40caa80 0x7f84d40b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.384 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.379+0000 7f84d8eda640 1 --2- 172.21.15.102:0/509405632 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84d40addb0 0x7f84d40b2bc0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.384 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.379+0000 7f84d8eda640 1 --2- 172.21.15.102:0/509405632 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f84d406a2e0 0x7f84d40c22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.384 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.379+0000 7f84d8eda640 1 -- 172.21.15.102:0/509405632 >> 172.21.15.102:0/509405632 conn(0x7f84d40ce9b0 msgr2=0x7f84d40cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:31.384 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.380+0000 7f84d8eda640 1 -- 172.21.15.102:0/509405632 shutdown_connections 2023-10-14T09:37:31.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.380+0000 7f84d8eda640 1 -- 172.21.15.102:0/509405632 wait complete. 2023-10-14T09:37:31.391 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.390+0000 7f4d907b7640 1 -- 172.21.15.102:0/1057247283 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4d700057d0 con 0x7f4d880addb0 2023-10-14T09:37:31.392 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.1 2023-10-14T09:37:31.393 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.391+0000 7f4d86ffd640 1 -- 172.21.15.102:0/1057247283 <== mon.2 v2:172.21.15.129:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4d7c022090 con 0x7f4d880addb0 2023-10-14T09:37:31.393 INFO:teuthology.orchestra.run.smithi102.stdout:64424509446 2023-10-14T09:37:31.393 DEBUG:teuthology.parallel:result is None 2023-10-14T09:37:31.395 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.7 2023-10-14T09:37:31.395 DEBUG:teuthology.parallel:result is None 2023-10-14T09:37:31.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.393+0000 7f4d907b7640 1 -- 172.21.15.102:0/1057247283 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4d6c06aea0 msgr2=0x7f4d6c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:31.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.394+0000 7f4d907b7640 1 --2- 172.21.15.102:0/1057247283 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4d6c06aea0 0x7f4d6c06d360 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4d74036000 tx=0x7f4d74030000 comp rx=0 tx=0).stop 2023-10-14T09:37:31.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.394+0000 7f4d907b7640 1 -- 172.21.15.102:0/1057247283 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4d880addb0 msgr2=0x7f4d88164ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:31.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.394+0000 7f4d907b7640 1 --2- 172.21.15.102:0/1057247283 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4d880addb0 0x7f4d88164ad0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c00f430 tx=0x7f4d7c00f8f0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.394+0000 7f4d907b7640 1 -- 172.21.15.102:0/1057247283 shutdown_connections 2023-10-14T09:37:31.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.394+0000 7f4d907b7640 1 --2- 172.21.15.102:0/1057247283 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4d6c06aea0 0x7f4d6c06d360 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.394+0000 7f4d907b7640 1 --2- 172.21.15.102:0/1057247283 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4d880c4380 0x7f4d880c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.394+0000 7f4d907b7640 1 --2- 172.21.15.102:0/1057247283 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d880cd1c0 0x7f4d88070ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.398 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.394+0000 7f4d907b7640 1 --2- 172.21.15.102:0/1057247283 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4d880addb0 0x7f4d88164ad0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.398 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.394+0000 7f4d907b7640 1 -- 172.21.15.102:0/1057247283 >> 172.21.15.102:0/1057247283 conn(0x7f4d880ce9b0 msgr2=0x7f4d880ae710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:31.398 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.394+0000 7f4d907b7640 1 -- 172.21.15.102:0/1057247283 shutdown_connections 2023-10-14T09:37:31.398 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.394+0000 7f4d907b7640 1 -- 172.21.15.102:0/1057247283 wait complete. 2023-10-14T09:37:31.399 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.2 2023-10-14T09:37:31.399 DEBUG:teuthology.parallel:result is None 2023-10-14T09:37:31.402 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542151 for osd.5 2023-10-14T09:37:31.402 DEBUG:teuthology.parallel:result is None 2023-10-14T09:37:31.412 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.3 2023-10-14T09:37:31.412 DEBUG:teuthology.parallel:result is None 2023-10-14T09:37:31.413 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.411+0000 7fc5a9202640 1 -- 172.21.15.102:0/3015154115 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fc5a40cff70 con 0x7fc5a40d0be0 2023-10-14T09:37:31.413 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.412+0000 7fc5a0ff9640 1 -- 172.21.15.102:0/3015154115 <== mon.1 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc594055030 con 0x7fc5a40d0be0 2023-10-14T09:37:31.414 INFO:teuthology.orchestra.run.smithi102.stdout:64424509447 2023-10-14T09:37:31.416 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.414+0000 7fc5a9202640 1 -- 172.21.15.102:0/3015154115 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc58406ae70 msgr2=0x7fc58406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:31.416 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.414+0000 7fc5a9202640 1 --2- 172.21.15.102:0/3015154115 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc58406ae70 0x7fc58406d330 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc59c036000 tx=0x7fc59c008030 comp rx=0 tx=0).stop 2023-10-14T09:37:31.417 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.414+0000 7fc5a9202640 1 -- 172.21.15.102:0/3015154115 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5a40d0be0 msgr2=0x7fc5a40cbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:31.417 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.414+0000 7fc5a9202640 1 --2- 172.21.15.102:0/3015154115 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5a40d0be0 0x7fc5a40cbfa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc594007e40 tx=0x7fc59400e4b0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.417 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.414+0000 7fc5a9202640 1 -- 172.21.15.102:0/3015154115 shutdown_connections 2023-10-14T09:37:31.417 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.414+0000 7fc5a9202640 1 --2- 172.21.15.102:0/3015154115 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc58406ae70 0x7fc58406d330 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.417 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.414+0000 7fc5a9202640 1 --2- 172.21.15.102:0/3015154115 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5a415cd70 0x7fc5a415a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.418 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.414+0000 7fc5a9202640 1 --2- 172.21.15.102:0/3015154115 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5a40d0be0 0x7fc5a40cbfa0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.418 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.414+0000 7fc5a9202640 1 --2- 172.21.15.102:0/3015154115 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc5a40b8480 0x7fc5a40c7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.418 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.414+0000 7fc5a9202640 1 -- 172.21.15.102:0/3015154115 >> 172.21.15.102:0/3015154115 conn(0x7fc5a40cf570 msgr2=0x7fc5a40b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:31.418 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.414+0000 7fc5a9202640 1 -- 172.21.15.102:0/3015154115 shutdown_connections 2023-10-14T09:37:31.418 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.414+0000 7fc5a9202640 1 -- 172.21.15.102:0/3015154115 wait complete. 2023-10-14T09:37:31.432 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.6 2023-10-14T09:37:31.432 DEBUG:teuthology.parallel:result is None 2023-10-14T09:37:31.432 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-14T09:37:31.433 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:37:31.681 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.679+0000 7f17f37d0640 1 Processor -- start 2023-10-14T09:37:31.681 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.679+0000 7f17f37d0640 1 -- start start 2023-10-14T09:37:31.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.680+0000 7f17f37d0640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f17ec0b0b20 0x7f17ec164b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:31.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.680+0000 7f17f37d0640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17ec06f7f0 con 0x7f17ec159f00 2023-10-14T09:37:31.683 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.680+0000 7f17f37d0640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17ec06c5e0 con 0x7f17ec159b20 2023-10-14T09:37:31.683 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.680+0000 7f17f37d0640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17ec06c8c0 con 0x7f17ec0b0b20 2023-10-14T09:37:31.683 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.681+0000 7f17f0d6b640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f17ec159f00 0x7f17ec0b0410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:45766/0 (socket says 172.21.15.102:45766) 2023-10-14T09:37:31.683 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.681+0000 7f17f0d6b640 1 -- 172.21.15.102:0/1008788003 learned_addr learned my addr 172.21.15.102:0/1008788003 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:31.686 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.681+0000 7f17f1d6d640 1 --2- 172.21.15.102:0/1008788003 >> v2:172.21.15.129:3300/0 conn(0x7f17ec0b0b20 0x7f17ec164b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:31.686 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.681+0000 7f17e3fff640 1 -- 172.21.15.102:0/1008788003 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 834693118 0 0) 0x7f17ec06f7f0 con 0x7f17ec159f00 2023-10-14T09:37:31.686 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.681+0000 7f17e3fff640 1 -- 172.21.15.102:0/1008788003 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17d8003520 con 0x7f17ec159f00 2023-10-14T09:37:31.686 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.681+0000 7f17e3fff640 1 -- 172.21.15.102:0/1008788003 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 433341163 0 0) 0x7f17d8003520 con 0x7f17ec159f00 2023-10-14T09:37:31.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.681+0000 7f17e3fff640 1 -- 172.21.15.102:0/1008788003 >> v2:172.21.15.129:3300/0 conn(0x7f17ec0b0b20 msgr2=0x7f17ec164b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:31.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.681+0000 7f17e3fff640 1 --2- 172.21.15.102:0/1008788003 >> v2:172.21.15.129:3300/0 conn(0x7f17ec0b0b20 0x7f17ec164b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.681+0000 7f17e3fff640 1 -- 172.21.15.102:0/1008788003 >> v1:172.21.15.129:6789/0 conn(0x7f17ec159b20 legacy=0x7f17ec06bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:31.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.681+0000 7f17e3fff640 1 -- 172.21.15.102:0/1008788003 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ec06cba0 con 0x7f17ec159f00 2023-10-14T09:37:31.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.681+0000 7f17e3fff640 1 -- 172.21.15.102:0/1008788003 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4030661168 0 0) 0x7f17dc001670 con 0x7f17ec159f00 2023-10-14T09:37:31.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.681+0000 7f17e3fff640 1 -- 172.21.15.102:0/1008788003 >> v1:172.21.15.102:6789/0 conn(0x7f17ec159f00 legacy=0x7f17ec0b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:31.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.682+0000 7f17e3fff640 1 --2- 172.21.15.102:0/1008788003 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17d8003970 0x7f17d8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:31.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.682+0000 7f17e3fff640 1 --2- 172.21.15.102:0/1008788003 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f17d80047c0 0x7f17d8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:31.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.682+0000 7f17e3fff640 1 --2- 172.21.15.102:0/1008788003 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f17d8005180 0x7f17d800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:31.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.682+0000 7f17e3fff640 1 -- 172.21.15.102:0/1008788003 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec06c8c0 con 0x7f17d8003970 2023-10-14T09:37:31.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.682+0000 7f17e3fff640 1 -- 172.21.15.102:0/1008788003 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d800c0d0 con 0x7f17d80047c0 2023-10-14T09:37:31.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.682+0000 7f17e3fff640 1 -- 172.21.15.102:0/1008788003 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d800e4a0 con 0x7f17d8005180 2023-10-14T09:37:31.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.682+0000 7f17f156c640 1 --2- 172.21.15.102:0/1008788003 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17d8003970 0x7f17d8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:31.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.682+0000 7f17f0d6b640 1 --2- 172.21.15.102:0/1008788003 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f17d80047c0 0x7f17d8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:31.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.682+0000 7f17f156c640 1 -- 172.21.15.102:0/1008788003 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f17d8005180 msgr2=0x7f17d800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:31.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.682+0000 7f17f156c640 1 --2- 172.21.15.102:0/1008788003 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f17d8005180 0x7f17d800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.690 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.682+0000 7f17f156c640 1 -- 172.21.15.102:0/1008788003 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f17d80047c0 msgr2=0x7f17d8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:31.690 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.682+0000 7f17f156c640 1 --2- 172.21.15.102:0/1008788003 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f17d80047c0 0x7f17d8004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.690 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.682+0000 7f17f156c640 1 -- 172.21.15.102:0/1008788003 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d8003520 con 0x7f17d8003970 2023-10-14T09:37:31.690 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.682+0000 7f17f1d6d640 1 -- 172.21.15.102:0/1008788003 reap_dead start 2023-10-14T09:37:31.690 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.683+0000 7f17f156c640 1 --2- 172.21.15.102:0/1008788003 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17d8003970 0x7f17d8003d90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f17e8001750 tx=0x7f17d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=838f3b33d2b4c9e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:31.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.683+0000 7f17e3fff640 1 -- 172.21.15.102:0/1008788003 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e80052d0 con 0x7f17d8003970 2023-10-14T09:37:31.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.683+0000 7f17e3fff640 1 -- 172.21.15.102:0/1008788003 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e802e050 con 0x7f17d8003970 2023-10-14T09:37:31.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.683+0000 7f17e3fff640 1 -- 172.21.15.102:0/1008788003 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e8003830 con 0x7f17d8003970 2023-10-14T09:37:31.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.684+0000 7f17f37d0640 1 -- 172.21.15.102:0/1008788003 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17d8003970 msgr2=0x7f17d8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:31.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.684+0000 7f17f37d0640 1 --2- 172.21.15.102:0/1008788003 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17d8003970 0x7f17d8003d90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f17e8001750 tx=0x7f17d80057f0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.684+0000 7f17f37d0640 1 -- 172.21.15.102:0/1008788003 shutdown_connections 2023-10-14T09:37:31.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.684+0000 7f17f37d0640 1 --2- 172.21.15.102:0/1008788003 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17d8003970 0x7f17d8003d90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.684+0000 7f17f37d0640 1 -- 172.21.15.102:0/1008788003 >> 172.21.15.102:0/1008788003 conn(0x7f17ec0cb410 msgr2=0x7f17ec0cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:31.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.684+0000 7f17f37d0640 1 -- 172.21.15.102:0/1008788003 shutdown_connections 2023-10-14T09:37:31.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.684+0000 7f17f37d0640 1 -- 172.21.15.102:0/1008788003 wait complete. 2023-10-14T09:37:31.695 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.686+0000 7f17f37d0640 1 Processor -- start 2023-10-14T09:37:31.695 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.686+0000 7f17f37d0640 1 -- start start 2023-10-14T09:37:31.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.687+0000 7f17f37d0640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f17d8003970 0x7f17ec150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:31.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.687+0000 7f17f37d0640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f17ec154ad0 0x7f17ec0c3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:31.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.687+0000 7f17f37d0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17ec0c78e0 0x7f17ec0b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:31.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.687+0000 7f17f37d0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec0c80c0 con 0x7f17ec0c78e0 2023-10-14T09:37:31.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.687+0000 7f17f37d0640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec0c25f0 con 0x7f17d8003970 2023-10-14T09:37:31.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.687+0000 7f17f37d0640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec0c38b0 con 0x7f17ec154ad0 2023-10-14T09:37:31.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.687+0000 7f17f1d6d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17ec0c78e0 0x7f17ec0b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:31.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.687+0000 7f17f1d6d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17ec0c78e0 0x7f17ec0b32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45066/0 (socket says 172.21.15.102:45066) 2023-10-14T09:37:31.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.687+0000 7f17f1d6d640 1 -- 172.21.15.102:0/1358088993 learned_addr learned my addr 172.21.15.102:0/1358088993 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:31.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.687+0000 7f17f156c640 1 --2- 172.21.15.102:0/1358088993 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f17d8003970 0x7f17ec150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:31.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.688+0000 7f17f0d6b640 1 --2- 172.21.15.102:0/1358088993 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f17ec154ad0 0x7f17ec0c3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:31.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.688+0000 7f17f1d6d640 1 -- 172.21.15.102:0/1358088993 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f17ec154ad0 msgr2=0x7f17ec0c3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:31.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.688+0000 7f17f1d6d640 1 --2- 172.21.15.102:0/1358088993 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f17ec154ad0 0x7f17ec0c3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.688+0000 7f17f1d6d640 1 -- 172.21.15.102:0/1358088993 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f17d8003970 msgr2=0x7f17ec150dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:31.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.688+0000 7f17f1d6d640 1 --2- 172.21.15.102:0/1358088993 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f17d8003970 0x7f17ec150dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.688+0000 7f17f1d6d640 1 -- 172.21.15.102:0/1358088993 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ec0c2890 con 0x7f17ec0c78e0 2023-10-14T09:37:31.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.688+0000 7f17f156c640 1 --2- 172.21.15.102:0/1358088993 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f17d8003970 0x7f17ec150dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:31.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.688+0000 7f17f0d6b640 1 --2- 172.21.15.102:0/1358088993 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f17ec154ad0 0x7f17ec0c3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:31.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.688+0000 7f17f1d6d640 1 --2- 172.21.15.102:0/1358088993 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17ec0c78e0 0x7f17ec0b32a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f17ec06d340 tx=0x7f17e400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:31.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.688+0000 7f17e1ffb640 1 -- 172.21.15.102:0/1358088993 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e4007e40 con 0x7f17ec0c78e0 2023-10-14T09:37:31.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.688+0000 7f17e1ffb640 1 -- 172.21.15.102:0/1358088993 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e4014420 con 0x7f17ec0c78e0 2023-10-14T09:37:31.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.688+0000 7f17f37d0640 1 -- 172.21.15.102:0/1358088993 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17ec0c2b70 con 0x7f17ec0c78e0 2023-10-14T09:37:31.701 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.688+0000 7f17e1ffb640 1 -- 172.21.15.102:0/1358088993 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e40147d0 con 0x7f17ec0c78e0 2023-10-14T09:37:31.702 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.688+0000 7f17f37d0640 1 -- 172.21.15.102:0/1358088993 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17ec0c7d60 con 0x7f17ec0c78e0 2023-10-14T09:37:31.702 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.689+0000 7f17f37d0640 1 -- 172.21.15.102:0/1358088993 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17ec0c3090 con 0x7f17ec0c78e0 2023-10-14T09:37:31.702 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.690+0000 7f17e1ffb640 1 -- 172.21.15.102:0/1358088993 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f17e4014930 con 0x7f17ec0c78e0 2023-10-14T09:37:31.702 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.691+0000 7f17e1ffb640 1 --2- 172.21.15.102:0/1358088993 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f17d006ae70 0x7f17d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:31.702 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.691+0000 7f17e1ffb640 1 -- 172.21.15.102:0/1358088993 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17e4089a60 con 0x7f17ec0c78e0 2023-10-14T09:37:31.703 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.691+0000 7f17f156c640 1 --2- 172.21.15.102:0/1358088993 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f17d006ae70 0x7f17d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:31.703 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.692+0000 7f17f156c640 1 --2- 172.21.15.102:0/1358088993 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f17d006ae70 0x7f17d006d330 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f17e8033000 tx=0x7f17e8009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:31.703 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.695+0000 7f17e1ffb640 1 -- 172.21.15.102:0/1358088993 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f17ec0c3090 con 0x7f17ec0c78e0 2023-10-14T09:37:31.871 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.869+0000 7f17f37d0640 1 -- 172.21.15.102:0/1358088993 --> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f17ec06ce80 con 0x7f17d006ae70 2023-10-14T09:37:31.878 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.876+0000 7f17e1ffb640 1 -- 172.21.15.102:0/1358088993 <== mgr.4104 v2:172.21.15.102:6832/1125265706 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264444 (secure 0 0 0) 0x7f17e8007040 con 0x7f17d006ae70 2023-10-14T09:37:31.882 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:37:31.883 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2023-10-14T09:37:31.885 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.882+0000 7f17f37d0640 1 -- 172.21.15.102:0/1358088993 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f17d006ae70 msgr2=0x7f17d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:31.885 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.882+0000 7f17f37d0640 1 --2- 172.21.15.102:0/1358088993 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f17d006ae70 0x7f17d006d330 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f17e8033000 tx=0x7f17e8009030 comp rx=0 tx=0).stop 2023-10-14T09:37:31.885 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.882+0000 7f17f37d0640 1 -- 172.21.15.102:0/1358088993 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17ec0c78e0 msgr2=0x7f17ec0b32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:31.885 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.882+0000 7f17f37d0640 1 --2- 172.21.15.102:0/1358088993 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17ec0c78e0 0x7f17ec0b32a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f17ec06d340 tx=0x7f17e400e4b0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.886 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.882+0000 7f17f37d0640 1 -- 172.21.15.102:0/1358088993 shutdown_connections 2023-10-14T09:37:31.886 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.882+0000 7f17f37d0640 1 --2- 172.21.15.102:0/1358088993 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f17d006ae70 0x7f17d006d330 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.886 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.882+0000 7f17f37d0640 1 --2- 172.21.15.102:0/1358088993 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17ec0c78e0 0x7f17ec0b32a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.886 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.882+0000 7f17f37d0640 1 --2- 172.21.15.102:0/1358088993 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f17ec154ad0 0x7f17ec0c3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.887 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.882+0000 7f17f37d0640 1 --2- 172.21.15.102:0/1358088993 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f17d8003970 0x7f17ec150dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:31.887 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.882+0000 7f17f37d0640 1 -- 172.21.15.102:0/1358088993 >> 172.21.15.102:0/1358088993 conn(0x7f17ec0cb410 msgr2=0x7f17ec0ccb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:31.887 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.882+0000 7f17f37d0640 1 -- 172.21.15.102:0/1358088993 shutdown_connections 2023-10-14T09:37:31.887 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:31.882+0000 7f17f37d0640 1 -- 172.21.15.102:0/1358088993 wait complete. 2023-10-14T09:37:31.902 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-10-14T09:37:29.879206+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219128,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755592,"statfs":{"total":773094113280,"available":772869726208,"internally_reserved":0,"allocated":3022848,"data_stored":1800068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.163349"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.007969+0000","last_change":"2023-10-14T09:37:21.757489+0000","last_active":"2023-10-14T09:37:23.007969+0000","last_peered":"2023-10-14T09:37:23.007969+0000","last_clean":"2023-10-14T09:37:23.007969+0000","last_became_active":"2023-10-14T09:37:21.757194+0000","last_became_peered":"2023-10-14T09:37:21.757194+0000","last_unstale":"2023-10-14T09:37:23.007969+0000","last_undegraded":"2023-10-14T09:37:23.007969+0000","last_fullsized":"2023-10-14T09:37:23.007969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:44:42.187325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.725772+0000","last_change":"2023-10-14T09:37:21.747083+0000","last_active":"2023-10-14T09:37:22.725772+0000","last_peered":"2023-10-14T09:37:22.725772+0000","last_clean":"2023-10-14T09:37:22.725772+0000","last_became_active":"2023-10-14T09:37:21.744916+0000","last_became_peered":"2023-10-14T09:37:21.744916+0000","last_unstale":"2023-10-14T09:37:22.725772+0000","last_undegraded":"2023-10-14T09:37:22.725772+0000","last_fullsized":"2023-10-14T09:37:22.725772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:47:20.056113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000967+0000","last_change":"2023-10-14T09:37:21.743145+0000","last_active":"2023-10-14T09:37:23.000967+0000","last_peered":"2023-10-14T09:37:23.000967+0000","last_clean":"2023-10-14T09:37:23.000967+0000","last_became_active":"2023-10-14T09:37:21.740942+0000","last_became_peered":"2023-10-14T09:37:21.740942+0000","last_unstale":"2023-10-14T09:37:23.000967+0000","last_undegraded":"2023-10-14T09:37:23.000967+0000","last_fullsized":"2023-10-14T09:37:23.000967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:13:11.995936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.727695+0000","last_change":"2023-10-14T09:37:21.756893+0000","last_active":"2023-10-14T09:37:22.727695+0000","last_peered":"2023-10-14T09:37:22.727695+0000","last_clean":"2023-10-14T09:37:22.727695+0000","last_became_active":"2023-10-14T09:37:21.752060+0000","last_became_peered":"2023-10-14T09:37:21.752060+0000","last_unstale":"2023-10-14T09:37:22.727695+0000","last_undegraded":"2023-10-14T09:37:22.727695+0000","last_fullsized":"2023-10-14T09:37:22.727695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:40:14.063216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.005308+0000","last_change":"2023-10-14T09:37:21.751922+0000","last_active":"2023-10-14T09:37:23.005308+0000","last_peered":"2023-10-14T09:37:23.005308+0000","last_clean":"2023-10-14T09:37:23.005308+0000","last_became_active":"2023-10-14T09:37:21.751652+0000","last_became_peered":"2023-10-14T09:37:21.751652+0000","last_unstale":"2023-10-14T09:37:23.005308+0000","last_undegraded":"2023-10-14T09:37:23.005308+0000","last_fullsized":"2023-10-14T09:37:23.005308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:18:14.767746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.727589+0000","last_change":"2023-10-14T09:37:21.754232+0000","last_active":"2023-10-14T09:37:22.727589+0000","last_peered":"2023-10-14T09:37:22.727589+0000","last_clean":"2023-10-14T09:37:22.727589+0000","last_became_active":"2023-10-14T09:37:21.751701+0000","last_became_peered":"2023-10-14T09:37:21.751701+0000","last_unstale":"2023-10-14T09:37:22.727589+0000","last_undegraded":"2023-10-14T09:37:22.727589+0000","last_fullsized":"2023-10-14T09:37:22.727589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:00:52.100349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.006549+0000","last_change":"2023-10-14T09:37:21.752184+0000","last_active":"2023-10-14T09:37:23.006549+0000","last_peered":"2023-10-14T09:37:23.006549+0000","last_clean":"2023-10-14T09:37:23.006549+0000","last_became_active":"2023-10-14T09:37:21.751858+0000","last_became_peered":"2023-10-14T09:37:21.751858+0000","last_unstale":"2023-10-14T09:37:23.006549+0000","last_undegraded":"2023-10-14T09:37:23.006549+0000","last_fullsized":"2023-10-14T09:37:23.006549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:46:09.236513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.837906+0000","last_change":"2023-10-14T09:37:21.755347+0000","last_active":"2023-10-14T09:37:22.837906+0000","last_peered":"2023-10-14T09:37:22.837906+0000","last_clean":"2023-10-14T09:37:22.837906+0000","last_became_active":"2023-10-14T09:37:21.755054+0000","last_became_peered":"2023-10-14T09:37:21.755054+0000","last_unstale":"2023-10-14T09:37:22.837906+0000","last_undegraded":"2023-10-14T09:37:22.837906+0000","last_fullsized":"2023-10-14T09:37:22.837906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:34:28.487519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.008184+0000","last_change":"2023-10-14T09:37:21.766430+0000","last_active":"2023-10-14T09:37:23.008184+0000","last_peered":"2023-10-14T09:37:23.008184+0000","last_clean":"2023-10-14T09:37:23.008184+0000","last_became_active":"2023-10-14T09:37:21.766106+0000","last_became_peered":"2023-10-14T09:37:21.766106+0000","last_unstale":"2023-10-14T09:37:23.008184+0000","last_undegraded":"2023-10-14T09:37:23.008184+0000","last_fullsized":"2023-10-14T09:37:23.008184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:49:59.016924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.004124+0000","last_change":"2023-10-14T09:37:21.756666+0000","last_active":"2023-10-14T09:37:23.004124+0000","last_peered":"2023-10-14T09:37:23.004124+0000","last_clean":"2023-10-14T09:37:23.004124+0000","last_became_active":"2023-10-14T09:37:21.756224+0000","last_became_peered":"2023-10-14T09:37:21.756224+0000","last_unstale":"2023-10-14T09:37:23.004124+0000","last_undegraded":"2023-10-14T09:37:23.004124+0000","last_fullsized":"2023-10-14T09:37:23.004124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:34:28.487519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.004690+0000","last_change":"2023-10-14T09:37:21.756982+0000","last_active":"2023-10-14T09:37:23.004690+0000","last_peered":"2023-10-14T09:37:23.004690+0000","last_clean":"2023-10-14T09:37:23.004690+0000","last_became_active":"2023-10-14T09:37:21.756163+0000","last_became_peered":"2023-10-14T09:37:21.756163+0000","last_unstale":"2023-10-14T09:37:23.004690+0000","last_undegraded":"2023-10-14T09:37:23.004690+0000","last_fullsized":"2023-10-14T09:37:23.004690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:31:03.601136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.006237+0000","last_change":"2023-10-14T09:37:21.748380+0000","last_active":"2023-10-14T09:37:23.006237+0000","last_peered":"2023-10-14T09:37:23.006237+0000","last_clean":"2023-10-14T09:37:23.006237+0000","last_became_active":"2023-10-14T09:37:21.747954+0000","last_became_peered":"2023-10-14T09:37:21.747954+0000","last_unstale":"2023-10-14T09:37:23.006237+0000","last_undegraded":"2023-10-14T09:37:23.006237+0000","last_fullsized":"2023-10-14T09:37:23.006237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:43.379673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.838389+0000","last_change":"2023-10-14T09:37:21.748806+0000","last_active":"2023-10-14T09:37:22.838389+0000","last_peered":"2023-10-14T09:37:22.838389+0000","last_clean":"2023-10-14T09:37:22.838389+0000","last_became_active":"2023-10-14T09:37:21.747465+0000","last_became_peered":"2023-10-14T09:37:21.747465+0000","last_unstale":"2023-10-14T09:37:22.838389+0000","last_undegraded":"2023-10-14T09:37:22.838389+0000","last_fullsized":"2023-10-14T09:37:22.838389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:13:19.086221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000271+0000","last_change":"2023-10-14T09:37:21.739392+0000","last_active":"2023-10-14T09:37:23.000271+0000","last_peered":"2023-10-14T09:37:23.000271+0000","last_clean":"2023-10-14T09:37:23.000271+0000","last_became_active":"2023-10-14T09:37:21.738904+0000","last_became_peered":"2023-10-14T09:37:21.738904+0000","last_unstale":"2023-10-14T09:37:23.000271+0000","last_undegraded":"2023-10-14T09:37:23.000271+0000","last_fullsized":"2023-10-14T09:37:23.000271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:25:54.495041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.725892+0000","last_change":"2023-10-14T09:37:21.751374+0000","last_active":"2023-10-14T09:37:22.725892+0000","last_peered":"2023-10-14T09:37:22.725892+0000","last_clean":"2023-10-14T09:37:22.725892+0000","last_became_active":"2023-10-14T09:37:21.750630+0000","last_became_peered":"2023-10-14T09:37:21.750630+0000","last_unstale":"2023-10-14T09:37:22.725892+0000","last_undegraded":"2023-10-14T09:37:22.725892+0000","last_fullsized":"2023-10-14T09:37:22.725892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:58.386910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.727052+0000","last_change":"2023-10-14T09:37:21.746739+0000","last_active":"2023-10-14T09:37:22.727052+0000","last_peered":"2023-10-14T09:37:22.727052+0000","last_clean":"2023-10-14T09:37:22.727052+0000","last_became_active":"2023-10-14T09:37:21.743095+0000","last_became_peered":"2023-10-14T09:37:21.743095+0000","last_unstale":"2023-10-14T09:37:22.727052+0000","last_undegraded":"2023-10-14T09:37:22.727052+0000","last_fullsized":"2023-10-14T09:37:22.727052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:55:22.366551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.728505+0000","last_change":"2023-10-14T09:37:21.758327+0000","last_active":"2023-10-14T09:37:22.728505+0000","last_peered":"2023-10-14T09:37:22.728505+0000","last_clean":"2023-10-14T09:37:22.728505+0000","last_became_active":"2023-10-14T09:37:21.757671+0000","last_became_peered":"2023-10-14T09:37:21.757671+0000","last_unstale":"2023-10-14T09:37:22.728505+0000","last_undegraded":"2023-10-14T09:37:22.728505+0000","last_fullsized":"2023-10-14T09:37:22.728505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:11:25.698621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000594+0000","last_change":"2023-10-14T09:37:21.746441+0000","last_active":"2023-10-14T09:37:23.000594+0000","last_peered":"2023-10-14T09:37:23.000594+0000","last_clean":"2023-10-14T09:37:23.000594+0000","last_became_active":"2023-10-14T09:37:21.746086+0000","last_became_peered":"2023-10-14T09:37:21.746086+0000","last_unstale":"2023-10-14T09:37:23.000594+0000","last_undegraded":"2023-10-14T09:37:23.000594+0000","last_fullsized":"2023-10-14T09:37:23.000594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:47:12.887313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.005539+0000","last_change":"2023-10-14T09:37:21.757982+0000","last_active":"2023-10-14T09:37:23.005539+0000","last_peered":"2023-10-14T09:37:23.005539+0000","last_clean":"2023-10-14T09:37:23.005539+0000","last_became_active":"2023-10-14T09:37:21.757246+0000","last_became_peered":"2023-10-14T09:37:21.757246+0000","last_unstale":"2023-10-14T09:37:23.005539+0000","last_undegraded":"2023-10-14T09:37:23.005539+0000","last_fullsized":"2023-10-14T09:37:23.005539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:57:10.220824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.004161+0000","last_change":"2023-10-14T09:37:21.752806+0000","last_active":"2023-10-14T09:37:23.004161+0000","last_peered":"2023-10-14T09:37:23.004161+0000","last_clean":"2023-10-14T09:37:23.004161+0000","last_became_active":"2023-10-14T09:37:21.752504+0000","last_became_peered":"2023-10-14T09:37:21.752504+0000","last_unstale":"2023-10-14T09:37:23.004161+0000","last_undegraded":"2023-10-14T09:37:23.004161+0000","last_fullsized":"2023-10-14T09:37:23.004161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:47:20.269302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000372+0000","last_change":"2023-10-14T09:37:21.743928+0000","last_active":"2023-10-14T09:37:23.000372+0000","last_peered":"2023-10-14T09:37:23.000372+0000","last_clean":"2023-10-14T09:37:23.000372+0000","last_became_active":"2023-10-14T09:37:21.743649+0000","last_became_peered":"2023-10-14T09:37:21.743649+0000","last_unstale":"2023-10-14T09:37:23.000372+0000","last_undegraded":"2023-10-14T09:37:23.000372+0000","last_fullsized":"2023-10-14T09:37:23.000372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:05:15.351817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.727982+0000","last_change":"2023-10-14T09:37:21.755428+0000","last_active":"2023-10-14T09:37:22.727982+0000","last_peered":"2023-10-14T09:37:22.727982+0000","last_clean":"2023-10-14T09:37:22.727982+0000","last_became_active":"2023-10-14T09:37:21.755003+0000","last_became_peered":"2023-10-14T09:37:21.755003+0000","last_unstale":"2023-10-14T09:37:22.727982+0000","last_undegraded":"2023-10-14T09:37:22.727982+0000","last_fullsized":"2023-10-14T09:37:22.727982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:37:17.999853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.837923+0000","last_change":"2023-10-14T09:37:21.751484+0000","last_active":"2023-10-14T09:37:22.837923+0000","last_peered":"2023-10-14T09:37:22.837923+0000","last_clean":"2023-10-14T09:37:22.837923+0000","last_became_active":"2023-10-14T09:37:21.751206+0000","last_became_peered":"2023-10-14T09:37:21.751206+0000","last_unstale":"2023-10-14T09:37:22.837923+0000","last_undegraded":"2023-10-14T09:37:22.837923+0000","last_fullsized":"2023-10-14T09:37:22.837923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:45.609123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.727258+0000","last_change":"2023-10-14T09:37:21.756153+0000","last_active":"2023-10-14T09:37:22.727258+0000","last_peered":"2023-10-14T09:37:22.727258+0000","last_clean":"2023-10-14T09:37:22.727258+0000","last_became_active":"2023-10-14T09:37:21.755888+0000","last_became_peered":"2023-10-14T09:37:21.755888+0000","last_unstale":"2023-10-14T09:37:22.727258+0000","last_undegraded":"2023-10-14T09:37:22.727258+0000","last_fullsized":"2023-10-14T09:37:22.727258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:33:39.761471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.838544+0000","last_change":"2023-10-14T09:37:21.756618+0000","last_active":"2023-10-14T09:37:22.838544+0000","last_peered":"2023-10-14T09:37:22.838544+0000","last_clean":"2023-10-14T09:37:22.838544+0000","last_became_active":"2023-10-14T09:37:21.756268+0000","last_became_peered":"2023-10-14T09:37:21.756268+0000","last_unstale":"2023-10-14T09:37:22.838544+0000","last_undegraded":"2023-10-14T09:37:22.838544+0000","last_fullsized":"2023-10-14T09:37:22.838544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:20:56.163594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.004153+0000","last_change":"2023-10-14T09:37:21.757751+0000","last_active":"2023-10-14T09:37:23.004153+0000","last_peered":"2023-10-14T09:37:23.004153+0000","last_clean":"2023-10-14T09:37:23.004153+0000","last_became_active":"2023-10-14T09:37:21.757484+0000","last_became_peered":"2023-10-14T09:37:21.757484+0000","last_unstale":"2023-10-14T09:37:23.004153+0000","last_undegraded":"2023-10-14T09:37:23.004153+0000","last_fullsized":"2023-10-14T09:37:23.004153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:45.609123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.726318+0000","last_change":"2023-10-14T09:37:21.748864+0000","last_active":"2023-10-14T09:37:22.726318+0000","last_peered":"2023-10-14T09:37:22.726318+0000","last_clean":"2023-10-14T09:37:22.726318+0000","last_became_active":"2023-10-14T09:37:21.748569+0000","last_became_peered":"2023-10-14T09:37:21.748569+0000","last_unstale":"2023-10-14T09:37:22.726318+0000","last_undegraded":"2023-10-14T09:37:22.726318+0000","last_fullsized":"2023-10-14T09:37:22.726318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:31:03.601136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.838561+0000","last_change":"2023-10-14T09:37:21.752356+0000","last_active":"2023-10-14T09:37:22.838561+0000","last_peered":"2023-10-14T09:37:22.838561+0000","last_clean":"2023-10-14T09:37:22.838561+0000","last_became_active":"2023-10-14T09:37:21.751916+0000","last_became_peered":"2023-10-14T09:37:21.751916+0000","last_unstale":"2023-10-14T09:37:22.838561+0000","last_undegraded":"2023-10-14T09:37:22.838561+0000","last_fullsized":"2023-10-14T09:37:22.838561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:18:14.767746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000415+0000","last_change":"2023-10-14T09:37:21.742511+0000","last_active":"2023-10-14T09:37:23.000415+0000","last_peered":"2023-10-14T09:37:23.000415+0000","last_clean":"2023-10-14T09:37:23.000415+0000","last_became_active":"2023-10-14T09:37:21.742202+0000","last_became_peered":"2023-10-14T09:37:21.742202+0000","last_unstale":"2023-10-14T09:37:23.000415+0000","last_undegraded":"2023-10-14T09:37:23.000415+0000","last_fullsized":"2023-10-14T09:37:23.000415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:24:01.166672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.728259+0000","last_change":"2023-10-14T09:37:21.750041+0000","last_active":"2023-10-14T09:37:22.728259+0000","last_peered":"2023-10-14T09:37:22.728259+0000","last_clean":"2023-10-14T09:37:22.728259+0000","last_became_active":"2023-10-14T09:37:21.749143+0000","last_became_peered":"2023-10-14T09:37:21.749143+0000","last_unstale":"2023-10-14T09:37:22.728259+0000","last_undegraded":"2023-10-14T09:37:22.728259+0000","last_fullsized":"2023-10-14T09:37:22.728259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:06:11.732279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000783+0000","last_change":"2023-10-14T09:37:21.753852+0000","last_active":"2023-10-14T09:37:23.000783+0000","last_peered":"2023-10-14T09:37:23.000783+0000","last_clean":"2023-10-14T09:37:23.000783+0000","last_became_active":"2023-10-14T09:37:21.753535+0000","last_became_peered":"2023-10-14T09:37:21.753535+0000","last_unstale":"2023-10-14T09:37:23.000783+0000","last_undegraded":"2023-10-14T09:37:23.000783+0000","last_fullsized":"2023-10-14T09:37:23.000783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:43.379673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.003190+0000","last_change":"2023-10-14T09:37:21.746670+0000","last_active":"2023-10-14T09:37:23.003190+0000","last_peered":"2023-10-14T09:37:23.003190+0000","last_clean":"2023-10-14T09:37:23.003190+0000","last_became_active":"2023-10-14T09:37:21.746392+0000","last_became_peered":"2023-10-14T09:37:21.746392+0000","last_unstale":"2023-10-14T09:37:23.003190+0000","last_undegraded":"2023-10-14T09:37:23.003190+0000","last_fullsized":"2023-10-14T09:37:23.003190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:59:41.080217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.005826+0000","last_change":"2023-10-14T09:37:21.740283+0000","last_active":"2023-10-14T09:37:23.005826+0000","last_peered":"2023-10-14T09:37:23.005826+0000","last_clean":"2023-10-14T09:37:23.005826+0000","last_became_active":"2023-10-14T09:37:21.740017+0000","last_became_peered":"2023-10-14T09:37:21.740017+0000","last_unstale":"2023-10-14T09:37:23.005826+0000","last_undegraded":"2023-10-14T09:37:23.005826+0000","last_fullsized":"2023-10-14T09:37:23.005826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:47:12.887313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.919472+0000","last_change":"2023-10-14T09:37:20.933870+0000","last_active":"2023-10-14T09:37:21.919472+0000","last_peered":"2023-10-14T09:37:21.919472+0000","last_clean":"2023-10-14T09:37:21.919472+0000","last_became_active":"2023-10-14T09:37:20.933620+0000","last_became_peered":"2023-10-14T09:37:20.933620+0000","last_unstale":"2023-10-14T09:37:21.919472+0000","last_undegraded":"2023-10-14T09:37:21.919472+0000","last_fullsized":"2023-10-14T09:37:21.919472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:25:18.109123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000783+0000","last_change":"2023-10-14T09:37:21.739293+0000","last_active":"2023-10-14T09:37:23.000783+0000","last_peered":"2023-10-14T09:37:23.000783+0000","last_clean":"2023-10-14T09:37:23.000783+0000","last_became_active":"2023-10-14T09:37:21.737376+0000","last_became_peered":"2023-10-14T09:37:21.737376+0000","last_unstale":"2023-10-14T09:37:23.000783+0000","last_undegraded":"2023-10-14T09:37:23.000783+0000","last_fullsized":"2023-10-14T09:37:23.000783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:19:35.129999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.932146+0000","last_change":"2023-10-14T09:37:20.926893+0000","last_active":"2023-10-14T09:37:21.932146+0000","last_peered":"2023-10-14T09:37:21.932146+0000","last_clean":"2023-10-14T09:37:21.932146+0000","last_became_active":"2023-10-14T09:37:20.926029+0000","last_became_peered":"2023-10-14T09:37:20.926029+0000","last_unstale":"2023-10-14T09:37:21.932146+0000","last_undegraded":"2023-10-14T09:37:21.932146+0000","last_fullsized":"2023-10-14T09:37:21.932146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:37:06.069126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.730625+0000","last_change":"2023-10-14T09:37:20.936214+0000","last_active":"2023-10-14T09:37:21.730625+0000","last_peered":"2023-10-14T09:37:21.730625+0000","last_clean":"2023-10-14T09:37:21.730625+0000","last_became_active":"2023-10-14T09:37:20.935904+0000","last_became_peered":"2023-10-14T09:37:20.935904+0000","last_unstale":"2023-10-14T09:37:21.730625+0000","last_undegraded":"2023-10-14T09:37:21.730625+0000","last_fullsized":"2023-10-14T09:37:21.730625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:40:10.259029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.837900+0000","last_change":"2023-10-14T09:37:21.742408+0000","last_active":"2023-10-14T09:37:22.837900+0000","last_peered":"2023-10-14T09:37:22.837900+0000","last_clean":"2023-10-14T09:37:22.837900+0000","last_became_active":"2023-10-14T09:37:21.741339+0000","last_became_peered":"2023-10-14T09:37:21.741339+0000","last_unstale":"2023-10-14T09:37:22.837900+0000","last_undegraded":"2023-10-14T09:37:22.837900+0000","last_fullsized":"2023-10-14T09:37:22.837900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:58.386910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.727298+0000","last_change":"2023-10-14T09:37:20.920967+0000","last_active":"2023-10-14T09:37:22.727298+0000","last_peered":"2023-10-14T09:37:22.727298+0000","last_clean":"2023-10-14T09:37:22.727298+0000","last_became_active":"2023-10-14T09:37:20.919427+0000","last_became_peered":"2023-10-14T09:37:20.919427+0000","last_unstale":"2023-10-14T09:37:22.727298+0000","last_undegraded":"2023-10-14T09:37:22.727298+0000","last_fullsized":"2023-10-14T09:37:22.727298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:36:06.124475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.726089+0000","last_change":"2023-10-14T09:37:21.745880+0000","last_active":"2023-10-14T09:37:22.726089+0000","last_peered":"2023-10-14T09:37:22.726089+0000","last_clean":"2023-10-14T09:37:22.726089+0000","last_became_active":"2023-10-14T09:37:21.745521+0000","last_became_peered":"2023-10-14T09:37:21.745521+0000","last_unstale":"2023-10-14T09:37:22.726089+0000","last_undegraded":"2023-10-14T09:37:22.726089+0000","last_fullsized":"2023-10-14T09:37:22.726089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:45.609123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.733782+0000","last_change":"2023-10-14T09:37:20.934454+0000","last_active":"2023-10-14T09:37:21.733782+0000","last_peered":"2023-10-14T09:37:21.733782+0000","last_clean":"2023-10-14T09:37:21.733782+0000","last_became_active":"2023-10-14T09:37:20.934153+0000","last_became_peered":"2023-10-14T09:37:20.934153+0000","last_unstale":"2023-10-14T09:37:21.733782+0000","last_undegraded":"2023-10-14T09:37:21.733782+0000","last_fullsized":"2023-10-14T09:37:21.733782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:36.063014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.728323+0000","last_change":"2023-10-14T09:37:21.755249+0000","last_active":"2023-10-14T09:37:22.728323+0000","last_peered":"2023-10-14T09:37:22.728323+0000","last_clean":"2023-10-14T09:37:22.728323+0000","last_became_active":"2023-10-14T09:37:21.754740+0000","last_became_peered":"2023-10-14T09:37:21.754740+0000","last_unstale":"2023-10-14T09:37:22.728323+0000","last_undegraded":"2023-10-14T09:37:22.728323+0000","last_fullsized":"2023-10-14T09:37:22.728323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:35:35.551195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.728656+0000","last_change":"2023-10-14T09:37:20.935194+0000","last_active":"2023-10-14T09:37:22.728656+0000","last_peered":"2023-10-14T09:37:22.728656+0000","last_clean":"2023-10-14T09:37:22.728656+0000","last_became_active":"2023-10-14T09:37:20.934945+0000","last_became_peered":"2023-10-14T09:37:20.934945+0000","last_unstale":"2023-10-14T09:37:22.728656+0000","last_undegraded":"2023-10-14T09:37:22.728656+0000","last_fullsized":"2023-10-14T09:37:22.728656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:24:00.151660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.001230+0000","last_change":"2023-10-14T09:37:21.755417+0000","last_active":"2023-10-14T09:37:23.001230+0000","last_peered":"2023-10-14T09:37:23.001230+0000","last_clean":"2023-10-14T09:37:23.001230+0000","last_became_active":"2023-10-14T09:37:21.755076+0000","last_became_peered":"2023-10-14T09:37:21.755076+0000","last_unstale":"2023-10-14T09:37:23.001230+0000","last_undegraded":"2023-10-14T09:37:23.001230+0000","last_fullsized":"2023-10-14T09:37:23.001230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:00:52.100349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.922965+0000","last_change":"2023-10-14T09:37:20.928928+0000","last_active":"2023-10-14T09:37:21.922965+0000","last_peered":"2023-10-14T09:37:21.922965+0000","last_clean":"2023-10-14T09:37:21.922965+0000","last_became_active":"2023-10-14T09:37:20.928584+0000","last_became_peered":"2023-10-14T09:37:20.928584+0000","last_unstale":"2023-10-14T09:37:21.922965+0000","last_undegraded":"2023-10-14T09:37:21.922965+0000","last_fullsized":"2023-10-14T09:37:21.922965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:59:40.065205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.006299+0000","last_change":"2023-10-14T09:37:21.750980+0000","last_active":"2023-10-14T09:37:23.006299+0000","last_peered":"2023-10-14T09:37:23.006299+0000","last_clean":"2023-10-14T09:37:23.006299+0000","last_became_active":"2023-10-14T09:37:21.750695+0000","last_became_peered":"2023-10-14T09:37:21.750695+0000","last_unstale":"2023-10-14T09:37:23.006299+0000","last_undegraded":"2023-10-14T09:37:23.006299+0000","last_fullsized":"2023-10-14T09:37:23.006299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:54:58.954523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.934827+0000","last_change":"2023-10-14T09:37:20.929237+0000","last_active":"2023-10-14T09:37:21.934827+0000","last_peered":"2023-10-14T09:37:21.934827+0000","last_clean":"2023-10-14T09:37:21.934827+0000","last_became_active":"2023-10-14T09:37:20.926149+0000","last_became_peered":"2023-10-14T09:37:20.926149+0000","last_unstale":"2023-10-14T09:37:21.934827+0000","last_undegraded":"2023-10-14T09:37:21.934827+0000","last_fullsized":"2023-10-14T09:37:21.934827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:42.364661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.004759+0000","last_change":"2023-10-14T09:37:21.758759+0000","last_active":"2023-10-14T09:37:23.004759+0000","last_peered":"2023-10-14T09:37:23.004759+0000","last_clean":"2023-10-14T09:37:23.004759+0000","last_became_active":"2023-10-14T09:37:21.757589+0000","last_became_peered":"2023-10-14T09:37:21.757589+0000","last_unstale":"2023-10-14T09:37:23.004759+0000","last_undegraded":"2023-10-14T09:37:23.004759+0000","last_fullsized":"2023-10-14T09:37:23.004759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:20:22.862559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000879+0000","last_change":"2023-10-14T09:37:20.929762+0000","last_active":"2023-10-14T09:37:23.000879+0000","last_peered":"2023-10-14T09:37:23.000879+0000","last_clean":"2023-10-14T09:37:23.000879+0000","last_became_active":"2023-10-14T09:37:20.929207+0000","last_became_peered":"2023-10-14T09:37:20.929207+0000","last_unstale":"2023-10-14T09:37:23.000879+0000","last_undegraded":"2023-10-14T09:37:23.000879+0000","last_fullsized":"2023-10-14T09:37:23.000879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:47:37.290001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000293+0000","last_change":"2023-10-14T09:37:21.749696+0000","last_active":"2023-10-14T09:37:23.000293+0000","last_peered":"2023-10-14T09:37:23.000293+0000","last_clean":"2023-10-14T09:37:23.000293+0000","last_became_active":"2023-10-14T09:37:21.749373+0000","last_became_peered":"2023-10-14T09:37:21.749373+0000","last_unstale":"2023-10-14T09:37:23.000293+0000","last_undegraded":"2023-10-14T09:37:23.000293+0000","last_fullsized":"2023-10-14T09:37:23.000293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:36:07.139487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.728249+0000","last_change":"2023-10-14T09:37:20.925825+0000","last_active":"2023-10-14T09:37:22.728249+0000","last_peered":"2023-10-14T09:37:22.728249+0000","last_clean":"2023-10-14T09:37:22.728249+0000","last_became_active":"2023-10-14T09:37:20.924728+0000","last_became_peered":"2023-10-14T09:37:20.924728+0000","last_unstale":"2023-10-14T09:37:22.728249+0000","last_undegraded":"2023-10-14T09:37:22.728249+0000","last_fullsized":"2023-10-14T09:37:22.728249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:05:14.336805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.005698+0000","last_change":"2023-10-14T09:37:21.754368+0000","last_active":"2023-10-14T09:37:23.005698+0000","last_peered":"2023-10-14T09:37:23.005698+0000","last_clean":"2023-10-14T09:37:23.005698+0000","last_became_active":"2023-10-14T09:37:21.754087+0000","last_became_peered":"2023-10-14T09:37:21.754087+0000","last_unstale":"2023-10-14T09:37:23.005698+0000","last_undegraded":"2023-10-14T09:37:23.005698+0000","last_fullsized":"2023-10-14T09:37:23.005698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:14:34.307289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.743028+0000","last_change":"2023-10-14T09:37:20.927507+0000","last_active":"2023-10-14T09:37:21.743028+0000","last_peered":"2023-10-14T09:37:21.743028+0000","last_clean":"2023-10-14T09:37:21.743028+0000","last_became_active":"2023-10-14T09:37:20.926661+0000","last_became_peered":"2023-10-14T09:37:20.926661+0000","last_unstale":"2023-10-14T09:37:21.743028+0000","last_undegraded":"2023-10-14T09:37:21.743028+0000","last_fullsized":"2023-10-14T09:37:21.743028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:11:56.674281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.003581+0000","last_change":"2023-10-14T09:37:21.746970+0000","last_active":"2023-10-14T09:37:23.003581+0000","last_peered":"2023-10-14T09:37:23.003581+0000","last_clean":"2023-10-14T09:37:23.003581+0000","last_became_active":"2023-10-14T09:37:21.746319+0000","last_became_peered":"2023-10-14T09:37:21.746319+0000","last_unstale":"2023-10-14T09:37:23.003581+0000","last_undegraded":"2023-10-14T09:37:23.003581+0000","last_fullsized":"2023-10-14T09:37:23.003581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:58.386910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.924816+0000","last_change":"2023-10-14T09:37:20.922802+0000","last_active":"2023-10-14T09:37:21.924816+0000","last_peered":"2023-10-14T09:37:21.924816+0000","last_clean":"2023-10-14T09:37:21.924816+0000","last_became_active":"2023-10-14T09:37:20.922500+0000","last_became_peered":"2023-10-14T09:37:20.922500+0000","last_unstale":"2023-10-14T09:37:21.924816+0000","last_undegraded":"2023-10-14T09:37:21.924816+0000","last_fullsized":"2023-10-14T09:37:21.924816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:06:47.039219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.006896+0000","last_change":"2023-10-14T09:37:21.762686+0000","last_active":"2023-10-14T09:37:23.006896+0000","last_peered":"2023-10-14T09:37:23.006896+0000","last_clean":"2023-10-14T09:37:23.006896+0000","last_became_active":"2023-10-14T09:37:21.761363+0000","last_became_peered":"2023-10-14T09:37:21.761363+0000","last_unstale":"2023-10-14T09:37:23.006896+0000","last_undegraded":"2023-10-14T09:37:23.006896+0000","last_fullsized":"2023-10-14T09:37:23.006896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:41:33.345823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.924183+0000","last_change":"2023-10-14T09:37:20.923259+0000","last_active":"2023-10-14T09:37:21.924183+0000","last_peered":"2023-10-14T09:37:21.924183+0000","last_clean":"2023-10-14T09:37:21.924183+0000","last_became_active":"2023-10-14T09:37:20.922949+0000","last_became_peered":"2023-10-14T09:37:20.922949+0000","last_unstale":"2023-10-14T09:37:21.924183+0000","last_undegraded":"2023-10-14T09:37:21.924183+0000","last_fullsized":"2023-10-14T09:37:21.924183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:36.063014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.007898+0000","last_change":"2023-10-14T09:37:21.757197+0000","last_active":"2023-10-14T09:37:23.007898+0000","last_peered":"2023-10-14T09:37:23.007898+0000","last_clean":"2023-10-14T09:37:23.007898+0000","last_became_active":"2023-10-14T09:37:21.756570+0000","last_became_peered":"2023-10-14T09:37:21.756570+0000","last_unstale":"2023-10-14T09:37:23.007898+0000","last_undegraded":"2023-10-14T09:37:23.007898+0000","last_fullsized":"2023-10-14T09:37:23.007898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:26:10.321772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.923988+0000","last_change":"2023-10-14T09:37:20.925144+0000","last_active":"2023-10-14T09:37:21.923988+0000","last_peered":"2023-10-14T09:37:21.923988+0000","last_clean":"2023-10-14T09:37:21.923988+0000","last_became_active":"2023-10-14T09:37:20.924857+0000","last_became_peered":"2023-10-14T09:37:20.924857+0000","last_unstale":"2023-10-14T09:37:21.923988+0000","last_undegraded":"2023-10-14T09:37:21.923988+0000","last_fullsized":"2023-10-14T09:37:21.923988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:40:10.259029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.008287+0000","last_change":"2023-10-14T09:37:21.760917+0000","last_active":"2023-10-14T09:37:23.008287+0000","last_peered":"2023-10-14T09:37:23.008287+0000","last_clean":"2023-10-14T09:37:23.008287+0000","last_became_active":"2023-10-14T09:37:21.760610+0000","last_became_peered":"2023-10-14T09:37:21.760610+0000","last_unstale":"2023-10-14T09:37:23.008287+0000","last_undegraded":"2023-10-14T09:37:23.008287+0000","last_fullsized":"2023-10-14T09:37:23.008287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:55:37.499900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.922672+0000","last_change":"2023-10-14T09:37:20.927543+0000","last_active":"2023-10-14T09:37:21.922672+0000","last_peered":"2023-10-14T09:37:21.922672+0000","last_clean":"2023-10-14T09:37:21.922672+0000","last_became_active":"2023-10-14T09:37:20.926596+0000","last_became_peered":"2023-10-14T09:37:20.926596+0000","last_unstale":"2023-10-14T09:37:21.922672+0000","last_undegraded":"2023-10-14T09:37:21.922672+0000","last_fullsized":"2023-10-14T09:37:21.922672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:41:25.240229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.728342+0000","last_change":"2023-10-14T09:37:21.757458+0000","last_active":"2023-10-14T09:37:22.728342+0000","last_peered":"2023-10-14T09:37:22.728342+0000","last_clean":"2023-10-14T09:37:22.728342+0000","last_became_active":"2023-10-14T09:37:21.755979+0000","last_became_peered":"2023-10-14T09:37:21.755979+0000","last_unstale":"2023-10-14T09:37:22.728342+0000","last_undegraded":"2023-10-14T09:37:22.728342+0000","last_fullsized":"2023-10-14T09:37:22.728342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:01:17.124198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.726389+0000","last_change":"2023-10-14T09:37:20.916979+0000","last_active":"2023-10-14T09:37:21.726389+0000","last_peered":"2023-10-14T09:37:21.726389+0000","last_clean":"2023-10-14T09:37:21.726389+0000","last_became_active":"2023-10-14T09:37:20.916624+0000","last_became_peered":"2023-10-14T09:37:20.916624+0000","last_unstale":"2023-10-14T09:37:21.726389+0000","last_undegraded":"2023-10-14T09:37:21.726389+0000","last_fullsized":"2023-10-14T09:37:21.726389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:25:18.109123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.004982+0000","last_change":"2023-10-14T09:37:21.760133+0000","last_active":"2023-10-14T09:37:23.004982+0000","last_peered":"2023-10-14T09:37:23.004982+0000","last_clean":"2023-10-14T09:37:23.004982+0000","last_became_active":"2023-10-14T09:37:21.756336+0000","last_became_peered":"2023-10-14T09:37:21.756336+0000","last_unstale":"2023-10-14T09:37:23.004982+0000","last_undegraded":"2023-10-14T09:37:23.004982+0000","last_fullsized":"2023-10-14T09:37:23.004982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:20:56.163594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.740212+0000","last_change":"2023-10-14T09:37:12.368000+0000","last_active":"2023-10-14T09:37:21.740212+0000","last_peered":"2023-10-14T09:37:21.740212+0000","last_clean":"2023-10-14T09:37:21.740212+0000","last_became_active":"2023-10-14T09:37:12.364623+0000","last_became_peered":"2023-10-14T09:37:12.364623+0000","last_unstale":"2023-10-14T09:37:21.740212+0000","last_undegraded":"2023-10-14T09:37:21.740212+0000","last_fullsized":"2023-10-14T09:37:21.740212+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:10.796841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:10.796841+0000","last_clean_scrub_stamp":"2023-10-14T09:37:10.796841+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:48.940536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.727610+0000","last_change":"2023-10-14T09:37:20.911869+0000","last_active":"2023-10-14T09:37:22.727610+0000","last_peered":"2023-10-14T09:37:22.727610+0000","last_clean":"2023-10-14T09:37:22.727610+0000","last_became_active":"2023-10-14T09:37:20.911115+0000","last_became_peered":"2023-10-14T09:37:20.911115+0000","last_unstale":"2023-10-14T09:37:22.727610+0000","last_undegraded":"2023-10-14T09:37:22.727610+0000","last_fullsized":"2023-10-14T09:37:22.727610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:19:34.114987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.838142+0000","last_change":"2023-10-14T09:37:21.762010+0000","last_active":"2023-10-14T09:37:22.838142+0000","last_peered":"2023-10-14T09:37:22.838142+0000","last_clean":"2023-10-14T09:37:22.838142+0000","last_became_active":"2023-10-14T09:37:21.761697+0000","last_became_peered":"2023-10-14T09:37:21.761697+0000","last_unstale":"2023-10-14T09:37:22.838142+0000","last_undegraded":"2023-10-14T09:37:22.838142+0000","last_fullsized":"2023-10-14T09:37:22.838142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:31:03.601136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.740046+0000","last_change":"2023-10-14T09:37:20.935352+0000","last_active":"2023-10-14T09:37:21.740046+0000","last_peered":"2023-10-14T09:37:21.740046+0000","last_clean":"2023-10-14T09:37:21.740046+0000","last_became_active":"2023-10-14T09:37:20.935068+0000","last_became_peered":"2023-10-14T09:37:20.935068+0000","last_unstale":"2023-10-14T09:37:21.740046+0000","last_undegraded":"2023-10-14T09:37:21.740046+0000","last_fullsized":"2023-10-14T09:37:21.740046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:11:56.674281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000129+0000","last_change":"2023-10-14T09:37:21.743003+0000","last_active":"2023-10-14T09:37:23.000129+0000","last_peered":"2023-10-14T09:37:23.000129+0000","last_clean":"2023-10-14T09:37:23.000129+0000","last_became_active":"2023-10-14T09:37:21.741330+0000","last_became_peered":"2023-10-14T09:37:21.741330+0000","last_unstale":"2023-10-14T09:37:23.000129+0000","last_undegraded":"2023-10-14T09:37:23.000129+0000","last_fullsized":"2023-10-14T09:37:23.000129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:25:03.218431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.727315+0000","last_change":"2023-10-14T09:37:20.925505+0000","last_active":"2023-10-14T09:37:21.727315+0000","last_peered":"2023-10-14T09:37:21.727315+0000","last_clean":"2023-10-14T09:37:21.727315+0000","last_became_active":"2023-10-14T09:37:20.925234+0000","last_became_peered":"2023-10-14T09:37:20.925234+0000","last_unstale":"2023-10-14T09:37:21.727315+0000","last_undegraded":"2023-10-14T09:37:21.727315+0000","last_fullsized":"2023-10-14T09:37:21.727315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:18:40.682886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.725905+0000","last_change":"2023-10-14T09:37:21.743561+0000","last_active":"2023-10-14T09:37:22.725905+0000","last_peered":"2023-10-14T09:37:22.725905+0000","last_clean":"2023-10-14T09:37:22.725905+0000","last_became_active":"2023-10-14T09:37:21.741553+0000","last_became_peered":"2023-10-14T09:37:21.741553+0000","last_unstale":"2023-10-14T09:37:22.725905+0000","last_undegraded":"2023-10-14T09:37:22.725905+0000","last_fullsized":"2023-10-14T09:37:22.725905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:34:28.487519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.728603+0000","last_change":"2023-10-14T09:37:20.926456+0000","last_active":"2023-10-14T09:37:22.728603+0000","last_peered":"2023-10-14T09:37:22.728603+0000","last_clean":"2023-10-14T09:37:22.728603+0000","last_became_active":"2023-10-14T09:37:20.926173+0000","last_became_peered":"2023-10-14T09:37:20.926173+0000","last_unstale":"2023-10-14T09:37:22.728603+0000","last_undegraded":"2023-10-14T09:37:22.728603+0000","last_fullsized":"2023-10-14T09:37:22.728603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:13:10.980924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.005737+0000","last_change":"2023-10-14T09:37:21.741615+0000","last_active":"2023-10-14T09:37:23.005737+0000","last_peered":"2023-10-14T09:37:23.005737+0000","last_clean":"2023-10-14T09:37:23.005737+0000","last_became_active":"2023-10-14T09:37:21.741104+0000","last_became_peered":"2023-10-14T09:37:21.741104+0000","last_unstale":"2023-10-14T09:37:23.005737+0000","last_undegraded":"2023-10-14T09:37:23.005737+0000","last_fullsized":"2023-10-14T09:37:23.005737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:18:41.697898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.735877+0000","last_change":"2023-10-14T09:37:20.927017+0000","last_active":"2023-10-14T09:37:21.735877+0000","last_peered":"2023-10-14T09:37:21.735877+0000","last_clean":"2023-10-14T09:37:21.735877+0000","last_became_active":"2023-10-14T09:37:20.925357+0000","last_became_peered":"2023-10-14T09:37:20.925357+0000","last_unstale":"2023-10-14T09:37:21.735877+0000","last_undegraded":"2023-10-14T09:37:21.735877+0000","last_fullsized":"2023-10-14T09:37:21.735877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:37:06.069126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.728396+0000","last_change":"2023-10-14T09:37:21.748586+0000","last_active":"2023-10-14T09:37:22.728396+0000","last_peered":"2023-10-14T09:37:22.728396+0000","last_clean":"2023-10-14T09:37:22.728396+0000","last_became_active":"2023-10-14T09:37:21.748040+0000","last_became_peered":"2023-10-14T09:37:21.748040+0000","last_unstale":"2023-10-14T09:37:22.728396+0000","last_undegraded":"2023-10-14T09:37:22.728396+0000","last_fullsized":"2023-10-14T09:37:22.728396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:29:10.224997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.741168+0000","last_change":"2023-10-14T09:37:20.936600+0000","last_active":"2023-10-14T09:37:21.741168+0000","last_peered":"2023-10-14T09:37:21.741168+0000","last_clean":"2023-10-14T09:37:21.741168+0000","last_became_active":"2023-10-14T09:37:20.936310+0000","last_became_peered":"2023-10-14T09:37:20.936310+0000","last_unstale":"2023-10-14T09:37:21.741168+0000","last_undegraded":"2023-10-14T09:37:21.741168+0000","last_fullsized":"2023-10-14T09:37:21.741168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:57.371898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.726291+0000","last_change":"2023-10-14T09:37:21.746713+0000","last_active":"2023-10-14T09:37:22.726291+0000","last_peered":"2023-10-14T09:37:22.726291+0000","last_clean":"2023-10-14T09:37:22.726291+0000","last_became_active":"2023-10-14T09:37:21.742406+0000","last_became_peered":"2023-10-14T09:37:21.742406+0000","last_unstale":"2023-10-14T09:37:22.726291+0000","last_undegraded":"2023-10-14T09:37:22.726291+0000","last_fullsized":"2023-10-14T09:37:22.726291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:47:20.269302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.725872+0000","last_change":"2023-10-14T09:37:20.936548+0000","last_active":"2023-10-14T09:37:22.725872+0000","last_peered":"2023-10-14T09:37:22.725872+0000","last_clean":"2023-10-14T09:37:22.725872+0000","last_became_active":"2023-10-14T09:37:20.936168+0000","last_became_peered":"2023-10-14T09:37:20.936168+0000","last_unstale":"2023-10-14T09:37:22.725872+0000","last_undegraded":"2023-10-14T09:37:22.725872+0000","last_fullsized":"2023-10-14T09:37:22.725872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:11:56.674281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.838498+0000","last_change":"2023-10-14T09:37:21.757494+0000","last_active":"2023-10-14T09:37:22.838498+0000","last_peered":"2023-10-14T09:37:22.838498+0000","last_clean":"2023-10-14T09:37:22.838498+0000","last_became_active":"2023-10-14T09:37:21.757272+0000","last_became_peered":"2023-10-14T09:37:21.757272+0000","last_unstale":"2023-10-14T09:37:22.838498+0000","last_undegraded":"2023-10-14T09:37:22.838498+0000","last_fullsized":"2023-10-14T09:37:22.838498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:20:22.862559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.931957+0000","last_change":"2023-10-14T09:37:20.938169+0000","last_active":"2023-10-14T09:37:21.931957+0000","last_peered":"2023-10-14T09:37:21.931957+0000","last_clean":"2023-10-14T09:37:21.931957+0000","last_became_active":"2023-10-14T09:37:20.937881+0000","last_became_peered":"2023-10-14T09:37:20.937881+0000","last_unstale":"2023-10-14T09:37:21.931957+0000","last_undegraded":"2023-10-14T09:37:21.931957+0000","last_fullsized":"2023-10-14T09:37:21.931957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:40:10.259029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.001082+0000","last_change":"2023-10-14T09:37:21.742197+0000","last_active":"2023-10-14T09:37:23.001082+0000","last_peered":"2023-10-14T09:37:23.001082+0000","last_clean":"2023-10-14T09:37:23.001082+0000","last_became_active":"2023-10-14T09:37:21.741895+0000","last_became_peered":"2023-10-14T09:37:21.741895+0000","last_unstale":"2023-10-14T09:37:23.001082+0000","last_undegraded":"2023-10-14T09:37:23.001082+0000","last_fullsized":"2023-10-14T09:37:23.001082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:55:22.366551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.739759+0000","last_change":"2023-10-14T09:37:20.933959+0000","last_active":"2023-10-14T09:37:21.739759+0000","last_peered":"2023-10-14T09:37:21.739759+0000","last_clean":"2023-10-14T09:37:21.739759+0000","last_became_active":"2023-10-14T09:37:20.933659+0000","last_became_peered":"2023-10-14T09:37:20.933659+0000","last_unstale":"2023-10-14T09:37:21.739759+0000","last_undegraded":"2023-10-14T09:37:21.739759+0000","last_fullsized":"2023-10-14T09:37:21.739759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:41:25.240229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.004951+0000","last_change":"2023-10-14T09:37:21.739948+0000","last_active":"2023-10-14T09:37:23.004951+0000","last_peered":"2023-10-14T09:37:23.004951+0000","last_clean":"2023-10-14T09:37:23.004951+0000","last_became_active":"2023-10-14T09:37:21.739597+0000","last_became_peered":"2023-10-14T09:37:21.739597+0000","last_unstale":"2023-10-14T09:37:23.004951+0000","last_undegraded":"2023-10-14T09:37:23.004951+0000","last_fullsized":"2023-10-14T09:37:23.004951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:25:19.124135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.733841+0000","last_change":"2023-10-14T09:37:20.932183+0000","last_active":"2023-10-14T09:37:21.733841+0000","last_peered":"2023-10-14T09:37:21.733841+0000","last_clean":"2023-10-14T09:37:21.733841+0000","last_became_active":"2023-10-14T09:37:20.931834+0000","last_became_peered":"2023-10-14T09:37:20.931834+0000","last_unstale":"2023-10-14T09:37:21.733841+0000","last_undegraded":"2023-10-14T09:37:21.733841+0000","last_fullsized":"2023-10-14T09:37:21.733841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:54:57.939511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.837982+0000","last_change":"2023-10-14T09:37:21.749015+0000","last_active":"2023-10-14T09:37:22.837982+0000","last_peered":"2023-10-14T09:37:22.837982+0000","last_clean":"2023-10-14T09:37:22.837982+0000","last_became_active":"2023-10-14T09:37:21.748596+0000","last_became_peered":"2023-10-14T09:37:21.748596+0000","last_unstale":"2023-10-14T09:37:22.837982+0000","last_undegraded":"2023-10-14T09:37:22.837982+0000","last_fullsized":"2023-10-14T09:37:22.837982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:47:20.269302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.735064+0000","last_change":"2023-10-14T09:37:20.929243+0000","last_active":"2023-10-14T09:37:21.735064+0000","last_peered":"2023-10-14T09:37:21.735064+0000","last_clean":"2023-10-14T09:37:21.735064+0000","last_became_active":"2023-10-14T09:37:20.928931+0000","last_became_peered":"2023-10-14T09:37:20.928931+0000","last_unstale":"2023-10-14T09:37:21.735064+0000","last_undegraded":"2023-10-14T09:37:21.735064+0000","last_fullsized":"2023-10-14T09:37:21.735064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:37:19.998680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.838457+0000","last_change":"2023-10-14T09:37:21.742020+0000","last_active":"2023-10-14T09:37:22.838457+0000","last_peered":"2023-10-14T09:37:22.838457+0000","last_clean":"2023-10-14T09:37:22.838457+0000","last_became_active":"2023-10-14T09:37:21.741732+0000","last_became_peered":"2023-10-14T09:37:21.741732+0000","last_unstale":"2023-10-14T09:37:22.838457+0000","last_undegraded":"2023-10-14T09:37:22.838457+0000","last_fullsized":"2023-10-14T09:37:22.838457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:14:40.914923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.931371+0000","last_change":"2023-10-14T09:37:20.939984+0000","last_active":"2023-10-14T09:37:21.931371+0000","last_peered":"2023-10-14T09:37:21.931371+0000","last_clean":"2023-10-14T09:37:21.931371+0000","last_became_active":"2023-10-14T09:37:20.937636+0000","last_became_peered":"2023-10-14T09:37:20.937636+0000","last_unstale":"2023-10-14T09:37:21.931371+0000","last_undegraded":"2023-10-14T09:37:21.931371+0000","last_fullsized":"2023-10-14T09:37:21.931371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:54:57.939511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.003333+0000","last_change":"2023-10-14T09:37:21.751303+0000","last_active":"2023-10-14T09:37:23.003333+0000","last_peered":"2023-10-14T09:37:23.003333+0000","last_clean":"2023-10-14T09:37:23.003333+0000","last_became_active":"2023-10-14T09:37:21.751037+0000","last_became_peered":"2023-10-14T09:37:21.751037+0000","last_unstale":"2023-10-14T09:37:23.003333+0000","last_undegraded":"2023-10-14T09:37:23.003333+0000","last_fullsized":"2023-10-14T09:37:23.003333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:47:20.056113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.727977+0000","last_change":"2023-10-14T09:37:21.753475+0000","last_active":"2023-10-14T09:37:22.727977+0000","last_peered":"2023-10-14T09:37:22.727977+0000","last_clean":"2023-10-14T09:37:22.727977+0000","last_became_active":"2023-10-14T09:37:21.751788+0000","last_became_peered":"2023-10-14T09:37:21.751788+0000","last_unstale":"2023-10-14T09:37:22.727977+0000","last_undegraded":"2023-10-14T09:37:22.727977+0000","last_fullsized":"2023-10-14T09:37:22.727977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:13:55.065205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.930531+0000","last_change":"2023-10-14T09:37:20.938049+0000","last_active":"2023-10-14T09:37:21.930531+0000","last_peered":"2023-10-14T09:37:21.930531+0000","last_clean":"2023-10-14T09:37:21.930531+0000","last_became_active":"2023-10-14T09:37:20.937761+0000","last_became_peered":"2023-10-14T09:37:20.937761+0000","last_unstale":"2023-10-14T09:37:21.930531+0000","last_undegraded":"2023-10-14T09:37:21.930531+0000","last_fullsized":"2023-10-14T09:37:21.930531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:25:18.109123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.728499+0000","last_change":"2023-10-14T09:37:21.746300+0000","last_active":"2023-10-14T09:37:22.728499+0000","last_peered":"2023-10-14T09:37:22.728499+0000","last_clean":"2023-10-14T09:37:22.728499+0000","last_became_active":"2023-10-14T09:37:21.743958+0000","last_became_peered":"2023-10-14T09:37:21.743958+0000","last_unstale":"2023-10-14T09:37:22.728499+0000","last_undegraded":"2023-10-14T09:37:22.728499+0000","last_fullsized":"2023-10-14T09:37:22.728499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:59:17.333518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.931999+0000","last_change":"2023-10-14T09:37:20.939300+0000","last_active":"2023-10-14T09:37:21.931999+0000","last_peered":"2023-10-14T09:37:21.931999+0000","last_clean":"2023-10-14T09:37:21.931999+0000","last_became_active":"2023-10-14T09:37:20.938957+0000","last_became_peered":"2023-10-14T09:37:20.938957+0000","last_unstale":"2023-10-14T09:37:21.931999+0000","last_undegraded":"2023-10-14T09:37:21.931999+0000","last_fullsized":"2023-10-14T09:37:21.931999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:59:40.065205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.001168+0000","last_change":"2023-10-14T09:37:21.755441+0000","last_active":"2023-10-14T09:37:23.001168+0000","last_peered":"2023-10-14T09:37:23.001168+0000","last_clean":"2023-10-14T09:37:23.001168+0000","last_became_active":"2023-10-14T09:37:21.755006+0000","last_became_peered":"2023-10-14T09:37:21.755006+0000","last_unstale":"2023-10-14T09:37:23.001168+0000","last_undegraded":"2023-10-14T09:37:23.001168+0000","last_fullsized":"2023-10-14T09:37:23.001168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:33:39.761471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.921465+0000","last_change":"2023-10-14T09:37:20.921785+0000","last_active":"2023-10-14T09:37:21.921465+0000","last_peered":"2023-10-14T09:37:21.921465+0000","last_clean":"2023-10-14T09:37:21.921465+0000","last_became_active":"2023-10-14T09:37:20.921514+0000","last_became_peered":"2023-10-14T09:37:20.921514+0000","last_unstale":"2023-10-14T09:37:21.921465+0000","last_undegraded":"2023-10-14T09:37:21.921465+0000","last_fullsized":"2023-10-14T09:37:21.921465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:37:19.998680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.838600+0000","last_change":"2023-10-14T09:37:21.748918+0000","last_active":"2023-10-14T09:37:22.838600+0000","last_peered":"2023-10-14T09:37:22.838600+0000","last_clean":"2023-10-14T09:37:22.838600+0000","last_became_active":"2023-10-14T09:37:21.746814+0000","last_became_peered":"2023-10-14T09:37:21.746814+0000","last_unstale":"2023-10-14T09:37:22.838600+0000","last_undegraded":"2023-10-14T09:37:22.838600+0000","last_fullsized":"2023-10-14T09:37:22.838600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:57:10.220824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.001310+0000","last_change":"2023-10-14T09:37:20.933646+0000","last_active":"2023-10-14T09:37:23.001310+0000","last_peered":"2023-10-14T09:37:23.001310+0000","last_clean":"2023-10-14T09:37:23.001310+0000","last_became_active":"2023-10-14T09:37:20.933289+0000","last_became_peered":"2023-10-14T09:37:20.933289+0000","last_unstale":"2023-10-14T09:37:23.001310+0000","last_undegraded":"2023-10-14T09:37:23.001310+0000","last_fullsized":"2023-10-14T09:37:23.001310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:56:57.656029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":819200,"data_stored":667764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.343}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.276}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.411}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3759999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6479999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":78426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4540000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.5419999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.478}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.786}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7290000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":76940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.389}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2549999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.484}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5660000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3420000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":78426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4359999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5149999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4850000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":76814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4239999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.23}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4510000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":76974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3109999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8580000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":76904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6479999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.397}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.712}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9630000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3039999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.093}]}]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":667820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.452}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4670000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T09:37:31.908 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:37:32.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.149+0000 7fafe527c640 1 Processor -- start 2023-10-14T09:37:32.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.149+0000 7fafe527c640 1 -- start start 2023-10-14T09:37:32.153 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.150+0000 7fafe527c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fafe00b0b20 0x7fafe01615f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:32.153 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.150+0000 7fafe527c640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fafe015d3f0 0x7fafe015d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:32.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.150+0000 7fafe527c640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe015e3e0 con 0x7fafe00cd0c0 2023-10-14T09:37:32.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.150+0000 7fafe527c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafe00cd4a0 con 0x7fafe00b0b20 2023-10-14T09:37:32.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.150+0000 7fafe527c640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe015e100 con 0x7fafe015d3f0 2023-10-14T09:37:32.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.151+0000 7fafde7fc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fafe00b0b20 0x7fafe01615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:32.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.151+0000 7fafde7fc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fafe00b0b20 0x7fafe01615f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33008/0 (socket says 172.21.15.102:33008) 2023-10-14T09:37:32.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.151+0000 7fafde7fc640 1 -- 172.21.15.102:0/1064488899 learned_addr learned my addr 172.21.15.102:0/1064488899 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:32.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.151+0000 7fafdf7fe640 1 --2- 172.21.15.102:0/1064488899 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fafe015d3f0 0x7fafe015d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:32.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.151+0000 7fafde7fc640 1 -- 172.21.15.102:0/1064488899 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fafe015d3f0 msgr2=0x7fafe015d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:32.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.151+0000 7fafde7fc640 1 --2- 172.21.15.102:0/1064488899 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fafe015d3f0 0x7fafe015d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:32.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.151+0000 7fafde7fc640 1 -- 172.21.15.102:0/1064488899 >> v1:172.21.15.129:6789/0 conn(0x7fafe00cd0c0 legacy=0x7fafe00b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:32.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.151+0000 7fafde7fc640 1 -- 172.21.15.102:0/1064488899 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe0160b10 con 0x7fafe00b0b20 2023-10-14T09:37:32.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.151+0000 7fafdf7fe640 1 --2- 172.21.15.102:0/1064488899 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fafe015d3f0 0x7fafe015d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:32.160 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.153+0000 7fafde7fc640 1 --2- 172.21.15.102:0/1064488899 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafe00b0b20 0x7fafe01615f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fafd4009870 tx=0x7fafd402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57684f41a4b70f56 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:32.160 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.153+0000 7fafddffb640 1 -- 172.21.15.102:0/1064488899 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd40317c0 con 0x7fafe00b0b20 2023-10-14T09:37:32.160 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.153+0000 7fafddffb640 1 -- 172.21.15.102:0/1064488899 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd4031920 con 0x7fafe00b0b20 2023-10-14T09:37:32.160 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.153+0000 7fafddffb640 1 -- 172.21.15.102:0/1064488899 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd4031cb0 con 0x7fafe00b0b20 2023-10-14T09:37:32.161 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.153+0000 7fafe527c640 1 -- 172.21.15.102:0/1064488899 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafe00b0b20 msgr2=0x7fafe01615f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:32.161 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.153+0000 7fafe527c640 1 --2- 172.21.15.102:0/1064488899 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafe00b0b20 0x7fafe01615f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fafd4009870 tx=0x7fafd402b860 comp rx=0 tx=0).stop 2023-10-14T09:37:32.161 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.153+0000 7fafe527c640 1 -- 172.21.15.102:0/1064488899 shutdown_connections 2023-10-14T09:37:32.161 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.153+0000 7fafe527c640 1 --2- 172.21.15.102:0/1064488899 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fafe015d3f0 0x7fafe015d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:32.161 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.153+0000 7fafe527c640 1 --2- 172.21.15.102:0/1064488899 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafe00b0b20 0x7fafe01615f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:32.162 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.153+0000 7fafe527c640 1 -- 172.21.15.102:0/1064488899 >> 172.21.15.102:0/1064488899 conn(0x7fafe00cb410 msgr2=0x7fafe00cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:32.162 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.154+0000 7fafe527c640 1 -- 172.21.15.102:0/1064488899 shutdown_connections 2023-10-14T09:37:32.162 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.154+0000 7fafe527c640 1 -- 172.21.15.102:0/1064488899 wait complete. 2023-10-14T09:37:32.162 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.155+0000 7fafe527c640 1 Processor -- start 2023-10-14T09:37:32.162 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.155+0000 7fafe527c640 1 -- start start 2023-10-14T09:37:32.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.156+0000 7fafe527c640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fafe00b0b20 0x7fafe00b0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:32.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.156+0000 7fafe527c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fafe00cd0c0 0x7fafe00c3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:32.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.156+0000 7fafe527c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafe015d3f0 0x7fafe0156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:32.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.156+0000 7fafe527c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe00b0690 con 0x7fafe015d3f0 2023-10-14T09:37:32.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.156+0000 7fafe527c640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe00c3ba0 con 0x7fafe00cd0c0 2023-10-14T09:37:32.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.156+0000 7fafe527c640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe00c3e40 con 0x7fafe00b0b20 2023-10-14T09:37:32.164 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.156+0000 7fafdf7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafe015d3f0 0x7fafe0156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:32.164 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.156+0000 7fafdf7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafe015d3f0 0x7fafe0156000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33012/0 (socket says 172.21.15.102:33012) 2023-10-14T09:37:32.164 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.157+0000 7fafdf7fe640 1 -- 172.21.15.102:0/504906088 learned_addr learned my addr 172.21.15.102:0/504906088 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:32.164 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.157+0000 7fafde7fc640 1 --2- 172.21.15.102:0/504906088 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fafe00cd0c0 0x7fafe00c3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:32.164 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.157+0000 7fafdeffd640 1 --2- 172.21.15.102:0/504906088 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fafe00b0b20 0x7fafe00b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:32.165 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.157+0000 7fafdf7fe640 1 -- 172.21.15.102:0/504906088 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fafe00b0b20 msgr2=0x7fafe00b0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:32.165 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.157+0000 7fafdf7fe640 1 --2- 172.21.15.102:0/504906088 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fafe00b0b20 0x7fafe00b0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:32.165 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.157+0000 7fafdf7fe640 1 -- 172.21.15.102:0/504906088 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fafe00cd0c0 msgr2=0x7fafe00c3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:32.165 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.157+0000 7fafdf7fe640 1 --2- 172.21.15.102:0/504906088 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fafe00cd0c0 0x7fafe00c3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:32.165 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.157+0000 7fafdf7fe640 1 -- 172.21.15.102:0/504906088 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd40094d0 con 0x7fafe015d3f0 2023-10-14T09:37:32.166 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.157+0000 7fafdeffd640 1 --2- 172.21.15.102:0/504906088 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fafe00b0b20 0x7fafe00b0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:32.166 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.157+0000 7fafdf7fe640 1 --2- 172.21.15.102:0/504906088 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafe015d3f0 0x7fafe0156000 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fafd800cef0 tx=0x7fafd800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:32.166 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.158+0000 7fafc77fe640 1 -- 172.21.15.102:0/504906088 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd800d840 con 0x7fafe015d3f0 2023-10-14T09:37:32.166 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.158+0000 7fafc77fe640 1 -- 172.21.15.102:0/504906088 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd800d9c0 con 0x7fafe015d3f0 2023-10-14T09:37:32.166 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.158+0000 7fafc77fe640 1 -- 172.21.15.102:0/504906088 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd800dd70 con 0x7fafe015d3f0 2023-10-14T09:37:32.167 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.158+0000 7fafe527c640 1 -- 172.21.15.102:0/504906088 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe00c4120 con 0x7fafe015d3f0 2023-10-14T09:37:32.167 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.158+0000 7fafe527c640 1 -- 172.21.15.102:0/504906088 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe00c46e0 con 0x7fafe015d3f0 2023-10-14T09:37:32.168 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.159+0000 7fafe527c640 1 -- 172.21.15.102:0/504906088 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe00cd5e0 con 0x7fafe015d3f0 2023-10-14T09:37:32.168 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.160+0000 7fafc77fe640 1 -- 172.21.15.102:0/504906088 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fafd801e3b0 con 0x7fafe015d3f0 2023-10-14T09:37:32.168 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.160+0000 7fafc77fe640 1 --2- 172.21.15.102:0/504906088 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fafcc06aea0 0x7fafcc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:32.168 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.161+0000 7fafc77fe640 1 -- 172.21.15.102:0/504906088 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fafd808a020 con 0x7fafe015d3f0 2023-10-14T09:37:32.169 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.161+0000 7fafdeffd640 1 --2- 172.21.15.102:0/504906088 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fafcc06aea0 0x7fafcc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:32.169 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.161+0000 7fafdeffd640 1 --2- 172.21.15.102:0/504906088 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fafcc06aea0 0x7fafcc06d360 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fafe00ccdf0 tx=0x7fafd0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:32.169 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.165+0000 7fafc77fe640 1 -- 172.21.15.102:0/504906088 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fafd8055220 con 0x7fafe015d3f0 2023-10-14T09:37:32.338 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.336+0000 7fafe527c640 1 -- 172.21.15.102:0/504906088 --> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fafe01610d0 con 0x7fafcc06aea0 2023-10-14T09:37:32.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.356+0000 7fafc77fe640 1 -- 172.21.15.102:0/504906088 <== mgr.4104 v2:172.21.15.102:6832/1125265706 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264453 (secure 0 0 0) 0x7fafd000a420 con 0x7fafcc06aea0 2023-10-14T09:37:32.359 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:37:32.363 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2023-10-14T09:37:32.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.362+0000 7fafe527c640 1 -- 172.21.15.102:0/504906088 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fafcc06aea0 msgr2=0x7fafcc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:32.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.362+0000 7fafe527c640 1 --2- 172.21.15.102:0/504906088 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fafcc06aea0 0x7fafcc06d360 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fafe00ccdf0 tx=0x7fafd0008040 comp rx=0 tx=0).stop 2023-10-14T09:37:32.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.362+0000 7fafe527c640 1 -- 172.21.15.102:0/504906088 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafe015d3f0 msgr2=0x7fafe0156000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:32.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.362+0000 7fafe527c640 1 --2- 172.21.15.102:0/504906088 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafe015d3f0 0x7fafe0156000 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fafd800cef0 tx=0x7fafd800a710 comp rx=0 tx=0).stop 2023-10-14T09:37:32.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.362+0000 7fafe527c640 1 -- 172.21.15.102:0/504906088 shutdown_connections 2023-10-14T09:37:32.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.362+0000 7fafe527c640 1 --2- 172.21.15.102:0/504906088 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fafcc06aea0 0x7fafcc06d360 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:32.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.362+0000 7fafe527c640 1 --2- 172.21.15.102:0/504906088 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafe015d3f0 0x7fafe0156000 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:32.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.362+0000 7fafe527c640 1 --2- 172.21.15.102:0/504906088 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fafe00cd0c0 0x7fafe00c3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:32.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.362+0000 7fafe527c640 1 --2- 172.21.15.102:0/504906088 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fafe00b0b20 0x7fafe00b0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:32.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.362+0000 7fafe527c640 1 -- 172.21.15.102:0/504906088 >> 172.21.15.102:0/504906088 conn(0x7fafe00cb410 msgr2=0x7fafe00caad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:32.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.362+0000 7fafe527c640 1 -- 172.21.15.102:0/504906088 shutdown_connections 2023-10-14T09:37:32.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.362+0000 7fafe527c640 1 -- 172.21.15.102:0/504906088 wait complete. 2023-10-14T09:37:32.381 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-10-14T09:37:31.880055+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219128,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755592,"statfs":{"total":773094113280,"available":772869726208,"internally_reserved":0,"allocated":3022848,"data_stored":1800068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003390"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.007969+0000","last_change":"2023-10-14T09:37:21.757489+0000","last_active":"2023-10-14T09:37:23.007969+0000","last_peered":"2023-10-14T09:37:23.007969+0000","last_clean":"2023-10-14T09:37:23.007969+0000","last_became_active":"2023-10-14T09:37:21.757194+0000","last_became_peered":"2023-10-14T09:37:21.757194+0000","last_unstale":"2023-10-14T09:37:23.007969+0000","last_undegraded":"2023-10-14T09:37:23.007969+0000","last_fullsized":"2023-10-14T09:37:23.007969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:44:42.187325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.725772+0000","last_change":"2023-10-14T09:37:21.747083+0000","last_active":"2023-10-14T09:37:22.725772+0000","last_peered":"2023-10-14T09:37:22.725772+0000","last_clean":"2023-10-14T09:37:22.725772+0000","last_became_active":"2023-10-14T09:37:21.744916+0000","last_became_peered":"2023-10-14T09:37:21.744916+0000","last_unstale":"2023-10-14T09:37:22.725772+0000","last_undegraded":"2023-10-14T09:37:22.725772+0000","last_fullsized":"2023-10-14T09:37:22.725772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:47:20.056113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000967+0000","last_change":"2023-10-14T09:37:21.743145+0000","last_active":"2023-10-14T09:37:23.000967+0000","last_peered":"2023-10-14T09:37:23.000967+0000","last_clean":"2023-10-14T09:37:23.000967+0000","last_became_active":"2023-10-14T09:37:21.740942+0000","last_became_peered":"2023-10-14T09:37:21.740942+0000","last_unstale":"2023-10-14T09:37:23.000967+0000","last_undegraded":"2023-10-14T09:37:23.000967+0000","last_fullsized":"2023-10-14T09:37:23.000967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:13:11.995936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.727695+0000","last_change":"2023-10-14T09:37:21.756893+0000","last_active":"2023-10-14T09:37:22.727695+0000","last_peered":"2023-10-14T09:37:22.727695+0000","last_clean":"2023-10-14T09:37:22.727695+0000","last_became_active":"2023-10-14T09:37:21.752060+0000","last_became_peered":"2023-10-14T09:37:21.752060+0000","last_unstale":"2023-10-14T09:37:22.727695+0000","last_undegraded":"2023-10-14T09:37:22.727695+0000","last_fullsized":"2023-10-14T09:37:22.727695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:40:14.063216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.005308+0000","last_change":"2023-10-14T09:37:21.751922+0000","last_active":"2023-10-14T09:37:23.005308+0000","last_peered":"2023-10-14T09:37:23.005308+0000","last_clean":"2023-10-14T09:37:23.005308+0000","last_became_active":"2023-10-14T09:37:21.751652+0000","last_became_peered":"2023-10-14T09:37:21.751652+0000","last_unstale":"2023-10-14T09:37:23.005308+0000","last_undegraded":"2023-10-14T09:37:23.005308+0000","last_fullsized":"2023-10-14T09:37:23.005308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:18:14.767746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.727589+0000","last_change":"2023-10-14T09:37:21.754232+0000","last_active":"2023-10-14T09:37:22.727589+0000","last_peered":"2023-10-14T09:37:22.727589+0000","last_clean":"2023-10-14T09:37:22.727589+0000","last_became_active":"2023-10-14T09:37:21.751701+0000","last_became_peered":"2023-10-14T09:37:21.751701+0000","last_unstale":"2023-10-14T09:37:22.727589+0000","last_undegraded":"2023-10-14T09:37:22.727589+0000","last_fullsized":"2023-10-14T09:37:22.727589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:00:52.100349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.006549+0000","last_change":"2023-10-14T09:37:21.752184+0000","last_active":"2023-10-14T09:37:23.006549+0000","last_peered":"2023-10-14T09:37:23.006549+0000","last_clean":"2023-10-14T09:37:23.006549+0000","last_became_active":"2023-10-14T09:37:21.751858+0000","last_became_peered":"2023-10-14T09:37:21.751858+0000","last_unstale":"2023-10-14T09:37:23.006549+0000","last_undegraded":"2023-10-14T09:37:23.006549+0000","last_fullsized":"2023-10-14T09:37:23.006549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:46:09.236513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.837906+0000","last_change":"2023-10-14T09:37:21.755347+0000","last_active":"2023-10-14T09:37:22.837906+0000","last_peered":"2023-10-14T09:37:22.837906+0000","last_clean":"2023-10-14T09:37:22.837906+0000","last_became_active":"2023-10-14T09:37:21.755054+0000","last_became_peered":"2023-10-14T09:37:21.755054+0000","last_unstale":"2023-10-14T09:37:22.837906+0000","last_undegraded":"2023-10-14T09:37:22.837906+0000","last_fullsized":"2023-10-14T09:37:22.837906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:34:28.487519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.008184+0000","last_change":"2023-10-14T09:37:21.766430+0000","last_active":"2023-10-14T09:37:23.008184+0000","last_peered":"2023-10-14T09:37:23.008184+0000","last_clean":"2023-10-14T09:37:23.008184+0000","last_became_active":"2023-10-14T09:37:21.766106+0000","last_became_peered":"2023-10-14T09:37:21.766106+0000","last_unstale":"2023-10-14T09:37:23.008184+0000","last_undegraded":"2023-10-14T09:37:23.008184+0000","last_fullsized":"2023-10-14T09:37:23.008184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:49:59.016924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.004124+0000","last_change":"2023-10-14T09:37:21.756666+0000","last_active":"2023-10-14T09:37:23.004124+0000","last_peered":"2023-10-14T09:37:23.004124+0000","last_clean":"2023-10-14T09:37:23.004124+0000","last_became_active":"2023-10-14T09:37:21.756224+0000","last_became_peered":"2023-10-14T09:37:21.756224+0000","last_unstale":"2023-10-14T09:37:23.004124+0000","last_undegraded":"2023-10-14T09:37:23.004124+0000","last_fullsized":"2023-10-14T09:37:23.004124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:34:28.487519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.004690+0000","last_change":"2023-10-14T09:37:21.756982+0000","last_active":"2023-10-14T09:37:23.004690+0000","last_peered":"2023-10-14T09:37:23.004690+0000","last_clean":"2023-10-14T09:37:23.004690+0000","last_became_active":"2023-10-14T09:37:21.756163+0000","last_became_peered":"2023-10-14T09:37:21.756163+0000","last_unstale":"2023-10-14T09:37:23.004690+0000","last_undegraded":"2023-10-14T09:37:23.004690+0000","last_fullsized":"2023-10-14T09:37:23.004690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:31:03.601136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.006237+0000","last_change":"2023-10-14T09:37:21.748380+0000","last_active":"2023-10-14T09:37:23.006237+0000","last_peered":"2023-10-14T09:37:23.006237+0000","last_clean":"2023-10-14T09:37:23.006237+0000","last_became_active":"2023-10-14T09:37:21.747954+0000","last_became_peered":"2023-10-14T09:37:21.747954+0000","last_unstale":"2023-10-14T09:37:23.006237+0000","last_undegraded":"2023-10-14T09:37:23.006237+0000","last_fullsized":"2023-10-14T09:37:23.006237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:43.379673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.838389+0000","last_change":"2023-10-14T09:37:21.748806+0000","last_active":"2023-10-14T09:37:22.838389+0000","last_peered":"2023-10-14T09:37:22.838389+0000","last_clean":"2023-10-14T09:37:22.838389+0000","last_became_active":"2023-10-14T09:37:21.747465+0000","last_became_peered":"2023-10-14T09:37:21.747465+0000","last_unstale":"2023-10-14T09:37:22.838389+0000","last_undegraded":"2023-10-14T09:37:22.838389+0000","last_fullsized":"2023-10-14T09:37:22.838389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:13:19.086221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000271+0000","last_change":"2023-10-14T09:37:21.739392+0000","last_active":"2023-10-14T09:37:23.000271+0000","last_peered":"2023-10-14T09:37:23.000271+0000","last_clean":"2023-10-14T09:37:23.000271+0000","last_became_active":"2023-10-14T09:37:21.738904+0000","last_became_peered":"2023-10-14T09:37:21.738904+0000","last_unstale":"2023-10-14T09:37:23.000271+0000","last_undegraded":"2023-10-14T09:37:23.000271+0000","last_fullsized":"2023-10-14T09:37:23.000271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:25:54.495041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.725892+0000","last_change":"2023-10-14T09:37:21.751374+0000","last_active":"2023-10-14T09:37:22.725892+0000","last_peered":"2023-10-14T09:37:22.725892+0000","last_clean":"2023-10-14T09:37:22.725892+0000","last_became_active":"2023-10-14T09:37:21.750630+0000","last_became_peered":"2023-10-14T09:37:21.750630+0000","last_unstale":"2023-10-14T09:37:22.725892+0000","last_undegraded":"2023-10-14T09:37:22.725892+0000","last_fullsized":"2023-10-14T09:37:22.725892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:58.386910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.727052+0000","last_change":"2023-10-14T09:37:21.746739+0000","last_active":"2023-10-14T09:37:22.727052+0000","last_peered":"2023-10-14T09:37:22.727052+0000","last_clean":"2023-10-14T09:37:22.727052+0000","last_became_active":"2023-10-14T09:37:21.743095+0000","last_became_peered":"2023-10-14T09:37:21.743095+0000","last_unstale":"2023-10-14T09:37:22.727052+0000","last_undegraded":"2023-10-14T09:37:22.727052+0000","last_fullsized":"2023-10-14T09:37:22.727052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:55:22.366551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.728505+0000","last_change":"2023-10-14T09:37:21.758327+0000","last_active":"2023-10-14T09:37:22.728505+0000","last_peered":"2023-10-14T09:37:22.728505+0000","last_clean":"2023-10-14T09:37:22.728505+0000","last_became_active":"2023-10-14T09:37:21.757671+0000","last_became_peered":"2023-10-14T09:37:21.757671+0000","last_unstale":"2023-10-14T09:37:22.728505+0000","last_undegraded":"2023-10-14T09:37:22.728505+0000","last_fullsized":"2023-10-14T09:37:22.728505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:11:25.698621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000594+0000","last_change":"2023-10-14T09:37:21.746441+0000","last_active":"2023-10-14T09:37:23.000594+0000","last_peered":"2023-10-14T09:37:23.000594+0000","last_clean":"2023-10-14T09:37:23.000594+0000","last_became_active":"2023-10-14T09:37:21.746086+0000","last_became_peered":"2023-10-14T09:37:21.746086+0000","last_unstale":"2023-10-14T09:37:23.000594+0000","last_undegraded":"2023-10-14T09:37:23.000594+0000","last_fullsized":"2023-10-14T09:37:23.000594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:47:12.887313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.005539+0000","last_change":"2023-10-14T09:37:21.757982+0000","last_active":"2023-10-14T09:37:23.005539+0000","last_peered":"2023-10-14T09:37:23.005539+0000","last_clean":"2023-10-14T09:37:23.005539+0000","last_became_active":"2023-10-14T09:37:21.757246+0000","last_became_peered":"2023-10-14T09:37:21.757246+0000","last_unstale":"2023-10-14T09:37:23.005539+0000","last_undegraded":"2023-10-14T09:37:23.005539+0000","last_fullsized":"2023-10-14T09:37:23.005539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:57:10.220824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.004161+0000","last_change":"2023-10-14T09:37:21.752806+0000","last_active":"2023-10-14T09:37:23.004161+0000","last_peered":"2023-10-14T09:37:23.004161+0000","last_clean":"2023-10-14T09:37:23.004161+0000","last_became_active":"2023-10-14T09:37:21.752504+0000","last_became_peered":"2023-10-14T09:37:21.752504+0000","last_unstale":"2023-10-14T09:37:23.004161+0000","last_undegraded":"2023-10-14T09:37:23.004161+0000","last_fullsized":"2023-10-14T09:37:23.004161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:47:20.269302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000372+0000","last_change":"2023-10-14T09:37:21.743928+0000","last_active":"2023-10-14T09:37:23.000372+0000","last_peered":"2023-10-14T09:37:23.000372+0000","last_clean":"2023-10-14T09:37:23.000372+0000","last_became_active":"2023-10-14T09:37:21.743649+0000","last_became_peered":"2023-10-14T09:37:21.743649+0000","last_unstale":"2023-10-14T09:37:23.000372+0000","last_undegraded":"2023-10-14T09:37:23.000372+0000","last_fullsized":"2023-10-14T09:37:23.000372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:05:15.351817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.727982+0000","last_change":"2023-10-14T09:37:21.755428+0000","last_active":"2023-10-14T09:37:22.727982+0000","last_peered":"2023-10-14T09:37:22.727982+0000","last_clean":"2023-10-14T09:37:22.727982+0000","last_became_active":"2023-10-14T09:37:21.755003+0000","last_became_peered":"2023-10-14T09:37:21.755003+0000","last_unstale":"2023-10-14T09:37:22.727982+0000","last_undegraded":"2023-10-14T09:37:22.727982+0000","last_fullsized":"2023-10-14T09:37:22.727982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:37:17.999853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.837923+0000","last_change":"2023-10-14T09:37:21.751484+0000","last_active":"2023-10-14T09:37:22.837923+0000","last_peered":"2023-10-14T09:37:22.837923+0000","last_clean":"2023-10-14T09:37:22.837923+0000","last_became_active":"2023-10-14T09:37:21.751206+0000","last_became_peered":"2023-10-14T09:37:21.751206+0000","last_unstale":"2023-10-14T09:37:22.837923+0000","last_undegraded":"2023-10-14T09:37:22.837923+0000","last_fullsized":"2023-10-14T09:37:22.837923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:45.609123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.727258+0000","last_change":"2023-10-14T09:37:21.756153+0000","last_active":"2023-10-14T09:37:22.727258+0000","last_peered":"2023-10-14T09:37:22.727258+0000","last_clean":"2023-10-14T09:37:22.727258+0000","last_became_active":"2023-10-14T09:37:21.755888+0000","last_became_peered":"2023-10-14T09:37:21.755888+0000","last_unstale":"2023-10-14T09:37:22.727258+0000","last_undegraded":"2023-10-14T09:37:22.727258+0000","last_fullsized":"2023-10-14T09:37:22.727258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:33:39.761471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.838544+0000","last_change":"2023-10-14T09:37:21.756618+0000","last_active":"2023-10-14T09:37:22.838544+0000","last_peered":"2023-10-14T09:37:22.838544+0000","last_clean":"2023-10-14T09:37:22.838544+0000","last_became_active":"2023-10-14T09:37:21.756268+0000","last_became_peered":"2023-10-14T09:37:21.756268+0000","last_unstale":"2023-10-14T09:37:22.838544+0000","last_undegraded":"2023-10-14T09:37:22.838544+0000","last_fullsized":"2023-10-14T09:37:22.838544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:20:56.163594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.004153+0000","last_change":"2023-10-14T09:37:21.757751+0000","last_active":"2023-10-14T09:37:23.004153+0000","last_peered":"2023-10-14T09:37:23.004153+0000","last_clean":"2023-10-14T09:37:23.004153+0000","last_became_active":"2023-10-14T09:37:21.757484+0000","last_became_peered":"2023-10-14T09:37:21.757484+0000","last_unstale":"2023-10-14T09:37:23.004153+0000","last_undegraded":"2023-10-14T09:37:23.004153+0000","last_fullsized":"2023-10-14T09:37:23.004153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:45.609123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.726318+0000","last_change":"2023-10-14T09:37:21.748864+0000","last_active":"2023-10-14T09:37:22.726318+0000","last_peered":"2023-10-14T09:37:22.726318+0000","last_clean":"2023-10-14T09:37:22.726318+0000","last_became_active":"2023-10-14T09:37:21.748569+0000","last_became_peered":"2023-10-14T09:37:21.748569+0000","last_unstale":"2023-10-14T09:37:22.726318+0000","last_undegraded":"2023-10-14T09:37:22.726318+0000","last_fullsized":"2023-10-14T09:37:22.726318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:31:03.601136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.838561+0000","last_change":"2023-10-14T09:37:21.752356+0000","last_active":"2023-10-14T09:37:22.838561+0000","last_peered":"2023-10-14T09:37:22.838561+0000","last_clean":"2023-10-14T09:37:22.838561+0000","last_became_active":"2023-10-14T09:37:21.751916+0000","last_became_peered":"2023-10-14T09:37:21.751916+0000","last_unstale":"2023-10-14T09:37:22.838561+0000","last_undegraded":"2023-10-14T09:37:22.838561+0000","last_fullsized":"2023-10-14T09:37:22.838561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:18:14.767746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000415+0000","last_change":"2023-10-14T09:37:21.742511+0000","last_active":"2023-10-14T09:37:23.000415+0000","last_peered":"2023-10-14T09:37:23.000415+0000","last_clean":"2023-10-14T09:37:23.000415+0000","last_became_active":"2023-10-14T09:37:21.742202+0000","last_became_peered":"2023-10-14T09:37:21.742202+0000","last_unstale":"2023-10-14T09:37:23.000415+0000","last_undegraded":"2023-10-14T09:37:23.000415+0000","last_fullsized":"2023-10-14T09:37:23.000415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:24:01.166672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.728259+0000","last_change":"2023-10-14T09:37:21.750041+0000","last_active":"2023-10-14T09:37:22.728259+0000","last_peered":"2023-10-14T09:37:22.728259+0000","last_clean":"2023-10-14T09:37:22.728259+0000","last_became_active":"2023-10-14T09:37:21.749143+0000","last_became_peered":"2023-10-14T09:37:21.749143+0000","last_unstale":"2023-10-14T09:37:22.728259+0000","last_undegraded":"2023-10-14T09:37:22.728259+0000","last_fullsized":"2023-10-14T09:37:22.728259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:06:11.732279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000783+0000","last_change":"2023-10-14T09:37:21.753852+0000","last_active":"2023-10-14T09:37:23.000783+0000","last_peered":"2023-10-14T09:37:23.000783+0000","last_clean":"2023-10-14T09:37:23.000783+0000","last_became_active":"2023-10-14T09:37:21.753535+0000","last_became_peered":"2023-10-14T09:37:21.753535+0000","last_unstale":"2023-10-14T09:37:23.000783+0000","last_undegraded":"2023-10-14T09:37:23.000783+0000","last_fullsized":"2023-10-14T09:37:23.000783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:43.379673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.003190+0000","last_change":"2023-10-14T09:37:21.746670+0000","last_active":"2023-10-14T09:37:23.003190+0000","last_peered":"2023-10-14T09:37:23.003190+0000","last_clean":"2023-10-14T09:37:23.003190+0000","last_became_active":"2023-10-14T09:37:21.746392+0000","last_became_peered":"2023-10-14T09:37:21.746392+0000","last_unstale":"2023-10-14T09:37:23.003190+0000","last_undegraded":"2023-10-14T09:37:23.003190+0000","last_fullsized":"2023-10-14T09:37:23.003190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:59:41.080217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.005826+0000","last_change":"2023-10-14T09:37:21.740283+0000","last_active":"2023-10-14T09:37:23.005826+0000","last_peered":"2023-10-14T09:37:23.005826+0000","last_clean":"2023-10-14T09:37:23.005826+0000","last_became_active":"2023-10-14T09:37:21.740017+0000","last_became_peered":"2023-10-14T09:37:21.740017+0000","last_unstale":"2023-10-14T09:37:23.005826+0000","last_undegraded":"2023-10-14T09:37:23.005826+0000","last_fullsized":"2023-10-14T09:37:23.005826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:47:12.887313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.919472+0000","last_change":"2023-10-14T09:37:20.933870+0000","last_active":"2023-10-14T09:37:21.919472+0000","last_peered":"2023-10-14T09:37:21.919472+0000","last_clean":"2023-10-14T09:37:21.919472+0000","last_became_active":"2023-10-14T09:37:20.933620+0000","last_became_peered":"2023-10-14T09:37:20.933620+0000","last_unstale":"2023-10-14T09:37:21.919472+0000","last_undegraded":"2023-10-14T09:37:21.919472+0000","last_fullsized":"2023-10-14T09:37:21.919472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:25:18.109123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000783+0000","last_change":"2023-10-14T09:37:21.739293+0000","last_active":"2023-10-14T09:37:23.000783+0000","last_peered":"2023-10-14T09:37:23.000783+0000","last_clean":"2023-10-14T09:37:23.000783+0000","last_became_active":"2023-10-14T09:37:21.737376+0000","last_became_peered":"2023-10-14T09:37:21.737376+0000","last_unstale":"2023-10-14T09:37:23.000783+0000","last_undegraded":"2023-10-14T09:37:23.000783+0000","last_fullsized":"2023-10-14T09:37:23.000783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:19:35.129999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.932146+0000","last_change":"2023-10-14T09:37:20.926893+0000","last_active":"2023-10-14T09:37:21.932146+0000","last_peered":"2023-10-14T09:37:21.932146+0000","last_clean":"2023-10-14T09:37:21.932146+0000","last_became_active":"2023-10-14T09:37:20.926029+0000","last_became_peered":"2023-10-14T09:37:20.926029+0000","last_unstale":"2023-10-14T09:37:21.932146+0000","last_undegraded":"2023-10-14T09:37:21.932146+0000","last_fullsized":"2023-10-14T09:37:21.932146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:37:06.069126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.730625+0000","last_change":"2023-10-14T09:37:20.936214+0000","last_active":"2023-10-14T09:37:21.730625+0000","last_peered":"2023-10-14T09:37:21.730625+0000","last_clean":"2023-10-14T09:37:21.730625+0000","last_became_active":"2023-10-14T09:37:20.935904+0000","last_became_peered":"2023-10-14T09:37:20.935904+0000","last_unstale":"2023-10-14T09:37:21.730625+0000","last_undegraded":"2023-10-14T09:37:21.730625+0000","last_fullsized":"2023-10-14T09:37:21.730625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:40:10.259029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.837900+0000","last_change":"2023-10-14T09:37:21.742408+0000","last_active":"2023-10-14T09:37:22.837900+0000","last_peered":"2023-10-14T09:37:22.837900+0000","last_clean":"2023-10-14T09:37:22.837900+0000","last_became_active":"2023-10-14T09:37:21.741339+0000","last_became_peered":"2023-10-14T09:37:21.741339+0000","last_unstale":"2023-10-14T09:37:22.837900+0000","last_undegraded":"2023-10-14T09:37:22.837900+0000","last_fullsized":"2023-10-14T09:37:22.837900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:58.386910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.727298+0000","last_change":"2023-10-14T09:37:20.920967+0000","last_active":"2023-10-14T09:37:22.727298+0000","last_peered":"2023-10-14T09:37:22.727298+0000","last_clean":"2023-10-14T09:37:22.727298+0000","last_became_active":"2023-10-14T09:37:20.919427+0000","last_became_peered":"2023-10-14T09:37:20.919427+0000","last_unstale":"2023-10-14T09:37:22.727298+0000","last_undegraded":"2023-10-14T09:37:22.727298+0000","last_fullsized":"2023-10-14T09:37:22.727298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:36:06.124475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.726089+0000","last_change":"2023-10-14T09:37:21.745880+0000","last_active":"2023-10-14T09:37:22.726089+0000","last_peered":"2023-10-14T09:37:22.726089+0000","last_clean":"2023-10-14T09:37:22.726089+0000","last_became_active":"2023-10-14T09:37:21.745521+0000","last_became_peered":"2023-10-14T09:37:21.745521+0000","last_unstale":"2023-10-14T09:37:22.726089+0000","last_undegraded":"2023-10-14T09:37:22.726089+0000","last_fullsized":"2023-10-14T09:37:22.726089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:45.609123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.733782+0000","last_change":"2023-10-14T09:37:20.934454+0000","last_active":"2023-10-14T09:37:21.733782+0000","last_peered":"2023-10-14T09:37:21.733782+0000","last_clean":"2023-10-14T09:37:21.733782+0000","last_became_active":"2023-10-14T09:37:20.934153+0000","last_became_peered":"2023-10-14T09:37:20.934153+0000","last_unstale":"2023-10-14T09:37:21.733782+0000","last_undegraded":"2023-10-14T09:37:21.733782+0000","last_fullsized":"2023-10-14T09:37:21.733782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:36.063014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.728323+0000","last_change":"2023-10-14T09:37:21.755249+0000","last_active":"2023-10-14T09:37:22.728323+0000","last_peered":"2023-10-14T09:37:22.728323+0000","last_clean":"2023-10-14T09:37:22.728323+0000","last_became_active":"2023-10-14T09:37:21.754740+0000","last_became_peered":"2023-10-14T09:37:21.754740+0000","last_unstale":"2023-10-14T09:37:22.728323+0000","last_undegraded":"2023-10-14T09:37:22.728323+0000","last_fullsized":"2023-10-14T09:37:22.728323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:35:35.551195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.728656+0000","last_change":"2023-10-14T09:37:20.935194+0000","last_active":"2023-10-14T09:37:22.728656+0000","last_peered":"2023-10-14T09:37:22.728656+0000","last_clean":"2023-10-14T09:37:22.728656+0000","last_became_active":"2023-10-14T09:37:20.934945+0000","last_became_peered":"2023-10-14T09:37:20.934945+0000","last_unstale":"2023-10-14T09:37:22.728656+0000","last_undegraded":"2023-10-14T09:37:22.728656+0000","last_fullsized":"2023-10-14T09:37:22.728656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:24:00.151660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.001230+0000","last_change":"2023-10-14T09:37:21.755417+0000","last_active":"2023-10-14T09:37:23.001230+0000","last_peered":"2023-10-14T09:37:23.001230+0000","last_clean":"2023-10-14T09:37:23.001230+0000","last_became_active":"2023-10-14T09:37:21.755076+0000","last_became_peered":"2023-10-14T09:37:21.755076+0000","last_unstale":"2023-10-14T09:37:23.001230+0000","last_undegraded":"2023-10-14T09:37:23.001230+0000","last_fullsized":"2023-10-14T09:37:23.001230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:00:52.100349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.922965+0000","last_change":"2023-10-14T09:37:20.928928+0000","last_active":"2023-10-14T09:37:21.922965+0000","last_peered":"2023-10-14T09:37:21.922965+0000","last_clean":"2023-10-14T09:37:21.922965+0000","last_became_active":"2023-10-14T09:37:20.928584+0000","last_became_peered":"2023-10-14T09:37:20.928584+0000","last_unstale":"2023-10-14T09:37:21.922965+0000","last_undegraded":"2023-10-14T09:37:21.922965+0000","last_fullsized":"2023-10-14T09:37:21.922965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:59:40.065205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.006299+0000","last_change":"2023-10-14T09:37:21.750980+0000","last_active":"2023-10-14T09:37:23.006299+0000","last_peered":"2023-10-14T09:37:23.006299+0000","last_clean":"2023-10-14T09:37:23.006299+0000","last_became_active":"2023-10-14T09:37:21.750695+0000","last_became_peered":"2023-10-14T09:37:21.750695+0000","last_unstale":"2023-10-14T09:37:23.006299+0000","last_undegraded":"2023-10-14T09:37:23.006299+0000","last_fullsized":"2023-10-14T09:37:23.006299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:54:58.954523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.934827+0000","last_change":"2023-10-14T09:37:20.929237+0000","last_active":"2023-10-14T09:37:21.934827+0000","last_peered":"2023-10-14T09:37:21.934827+0000","last_clean":"2023-10-14T09:37:21.934827+0000","last_became_active":"2023-10-14T09:37:20.926149+0000","last_became_peered":"2023-10-14T09:37:20.926149+0000","last_unstale":"2023-10-14T09:37:21.934827+0000","last_undegraded":"2023-10-14T09:37:21.934827+0000","last_fullsized":"2023-10-14T09:37:21.934827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:42.364661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.004759+0000","last_change":"2023-10-14T09:37:21.758759+0000","last_active":"2023-10-14T09:37:23.004759+0000","last_peered":"2023-10-14T09:37:23.004759+0000","last_clean":"2023-10-14T09:37:23.004759+0000","last_became_active":"2023-10-14T09:37:21.757589+0000","last_became_peered":"2023-10-14T09:37:21.757589+0000","last_unstale":"2023-10-14T09:37:23.004759+0000","last_undegraded":"2023-10-14T09:37:23.004759+0000","last_fullsized":"2023-10-14T09:37:23.004759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:20:22.862559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000879+0000","last_change":"2023-10-14T09:37:20.929762+0000","last_active":"2023-10-14T09:37:23.000879+0000","last_peered":"2023-10-14T09:37:23.000879+0000","last_clean":"2023-10-14T09:37:23.000879+0000","last_became_active":"2023-10-14T09:37:20.929207+0000","last_became_peered":"2023-10-14T09:37:20.929207+0000","last_unstale":"2023-10-14T09:37:23.000879+0000","last_undegraded":"2023-10-14T09:37:23.000879+0000","last_fullsized":"2023-10-14T09:37:23.000879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:47:37.290001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000293+0000","last_change":"2023-10-14T09:37:21.749696+0000","last_active":"2023-10-14T09:37:23.000293+0000","last_peered":"2023-10-14T09:37:23.000293+0000","last_clean":"2023-10-14T09:37:23.000293+0000","last_became_active":"2023-10-14T09:37:21.749373+0000","last_became_peered":"2023-10-14T09:37:21.749373+0000","last_unstale":"2023-10-14T09:37:23.000293+0000","last_undegraded":"2023-10-14T09:37:23.000293+0000","last_fullsized":"2023-10-14T09:37:23.000293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:36:07.139487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.728249+0000","last_change":"2023-10-14T09:37:20.925825+0000","last_active":"2023-10-14T09:37:22.728249+0000","last_peered":"2023-10-14T09:37:22.728249+0000","last_clean":"2023-10-14T09:37:22.728249+0000","last_became_active":"2023-10-14T09:37:20.924728+0000","last_became_peered":"2023-10-14T09:37:20.924728+0000","last_unstale":"2023-10-14T09:37:22.728249+0000","last_undegraded":"2023-10-14T09:37:22.728249+0000","last_fullsized":"2023-10-14T09:37:22.728249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:05:14.336805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.005698+0000","last_change":"2023-10-14T09:37:21.754368+0000","last_active":"2023-10-14T09:37:23.005698+0000","last_peered":"2023-10-14T09:37:23.005698+0000","last_clean":"2023-10-14T09:37:23.005698+0000","last_became_active":"2023-10-14T09:37:21.754087+0000","last_became_peered":"2023-10-14T09:37:21.754087+0000","last_unstale":"2023-10-14T09:37:23.005698+0000","last_undegraded":"2023-10-14T09:37:23.005698+0000","last_fullsized":"2023-10-14T09:37:23.005698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:14:34.307289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.743028+0000","last_change":"2023-10-14T09:37:20.927507+0000","last_active":"2023-10-14T09:37:21.743028+0000","last_peered":"2023-10-14T09:37:21.743028+0000","last_clean":"2023-10-14T09:37:21.743028+0000","last_became_active":"2023-10-14T09:37:20.926661+0000","last_became_peered":"2023-10-14T09:37:20.926661+0000","last_unstale":"2023-10-14T09:37:21.743028+0000","last_undegraded":"2023-10-14T09:37:21.743028+0000","last_fullsized":"2023-10-14T09:37:21.743028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:11:56.674281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.003581+0000","last_change":"2023-10-14T09:37:21.746970+0000","last_active":"2023-10-14T09:37:23.003581+0000","last_peered":"2023-10-14T09:37:23.003581+0000","last_clean":"2023-10-14T09:37:23.003581+0000","last_became_active":"2023-10-14T09:37:21.746319+0000","last_became_peered":"2023-10-14T09:37:21.746319+0000","last_unstale":"2023-10-14T09:37:23.003581+0000","last_undegraded":"2023-10-14T09:37:23.003581+0000","last_fullsized":"2023-10-14T09:37:23.003581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:58.386910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.924816+0000","last_change":"2023-10-14T09:37:20.922802+0000","last_active":"2023-10-14T09:37:21.924816+0000","last_peered":"2023-10-14T09:37:21.924816+0000","last_clean":"2023-10-14T09:37:21.924816+0000","last_became_active":"2023-10-14T09:37:20.922500+0000","last_became_peered":"2023-10-14T09:37:20.922500+0000","last_unstale":"2023-10-14T09:37:21.924816+0000","last_undegraded":"2023-10-14T09:37:21.924816+0000","last_fullsized":"2023-10-14T09:37:21.924816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:06:47.039219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.006896+0000","last_change":"2023-10-14T09:37:21.762686+0000","last_active":"2023-10-14T09:37:23.006896+0000","last_peered":"2023-10-14T09:37:23.006896+0000","last_clean":"2023-10-14T09:37:23.006896+0000","last_became_active":"2023-10-14T09:37:21.761363+0000","last_became_peered":"2023-10-14T09:37:21.761363+0000","last_unstale":"2023-10-14T09:37:23.006896+0000","last_undegraded":"2023-10-14T09:37:23.006896+0000","last_fullsized":"2023-10-14T09:37:23.006896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:41:33.345823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.924183+0000","last_change":"2023-10-14T09:37:20.923259+0000","last_active":"2023-10-14T09:37:21.924183+0000","last_peered":"2023-10-14T09:37:21.924183+0000","last_clean":"2023-10-14T09:37:21.924183+0000","last_became_active":"2023-10-14T09:37:20.922949+0000","last_became_peered":"2023-10-14T09:37:20.922949+0000","last_unstale":"2023-10-14T09:37:21.924183+0000","last_undegraded":"2023-10-14T09:37:21.924183+0000","last_fullsized":"2023-10-14T09:37:21.924183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:36.063014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.007898+0000","last_change":"2023-10-14T09:37:21.757197+0000","last_active":"2023-10-14T09:37:23.007898+0000","last_peered":"2023-10-14T09:37:23.007898+0000","last_clean":"2023-10-14T09:37:23.007898+0000","last_became_active":"2023-10-14T09:37:21.756570+0000","last_became_peered":"2023-10-14T09:37:21.756570+0000","last_unstale":"2023-10-14T09:37:23.007898+0000","last_undegraded":"2023-10-14T09:37:23.007898+0000","last_fullsized":"2023-10-14T09:37:23.007898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:26:10.321772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.923988+0000","last_change":"2023-10-14T09:37:20.925144+0000","last_active":"2023-10-14T09:37:21.923988+0000","last_peered":"2023-10-14T09:37:21.923988+0000","last_clean":"2023-10-14T09:37:21.923988+0000","last_became_active":"2023-10-14T09:37:20.924857+0000","last_became_peered":"2023-10-14T09:37:20.924857+0000","last_unstale":"2023-10-14T09:37:21.923988+0000","last_undegraded":"2023-10-14T09:37:21.923988+0000","last_fullsized":"2023-10-14T09:37:21.923988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:40:10.259029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.008287+0000","last_change":"2023-10-14T09:37:21.760917+0000","last_active":"2023-10-14T09:37:23.008287+0000","last_peered":"2023-10-14T09:37:23.008287+0000","last_clean":"2023-10-14T09:37:23.008287+0000","last_became_active":"2023-10-14T09:37:21.760610+0000","last_became_peered":"2023-10-14T09:37:21.760610+0000","last_unstale":"2023-10-14T09:37:23.008287+0000","last_undegraded":"2023-10-14T09:37:23.008287+0000","last_fullsized":"2023-10-14T09:37:23.008287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:55:37.499900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.922672+0000","last_change":"2023-10-14T09:37:20.927543+0000","last_active":"2023-10-14T09:37:21.922672+0000","last_peered":"2023-10-14T09:37:21.922672+0000","last_clean":"2023-10-14T09:37:21.922672+0000","last_became_active":"2023-10-14T09:37:20.926596+0000","last_became_peered":"2023-10-14T09:37:20.926596+0000","last_unstale":"2023-10-14T09:37:21.922672+0000","last_undegraded":"2023-10-14T09:37:21.922672+0000","last_fullsized":"2023-10-14T09:37:21.922672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:41:25.240229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.728342+0000","last_change":"2023-10-14T09:37:21.757458+0000","last_active":"2023-10-14T09:37:22.728342+0000","last_peered":"2023-10-14T09:37:22.728342+0000","last_clean":"2023-10-14T09:37:22.728342+0000","last_became_active":"2023-10-14T09:37:21.755979+0000","last_became_peered":"2023-10-14T09:37:21.755979+0000","last_unstale":"2023-10-14T09:37:22.728342+0000","last_undegraded":"2023-10-14T09:37:22.728342+0000","last_fullsized":"2023-10-14T09:37:22.728342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:01:17.124198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.726389+0000","last_change":"2023-10-14T09:37:20.916979+0000","last_active":"2023-10-14T09:37:21.726389+0000","last_peered":"2023-10-14T09:37:21.726389+0000","last_clean":"2023-10-14T09:37:21.726389+0000","last_became_active":"2023-10-14T09:37:20.916624+0000","last_became_peered":"2023-10-14T09:37:20.916624+0000","last_unstale":"2023-10-14T09:37:21.726389+0000","last_undegraded":"2023-10-14T09:37:21.726389+0000","last_fullsized":"2023-10-14T09:37:21.726389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:25:18.109123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.004982+0000","last_change":"2023-10-14T09:37:21.760133+0000","last_active":"2023-10-14T09:37:23.004982+0000","last_peered":"2023-10-14T09:37:23.004982+0000","last_clean":"2023-10-14T09:37:23.004982+0000","last_became_active":"2023-10-14T09:37:21.756336+0000","last_became_peered":"2023-10-14T09:37:21.756336+0000","last_unstale":"2023-10-14T09:37:23.004982+0000","last_undegraded":"2023-10-14T09:37:23.004982+0000","last_fullsized":"2023-10-14T09:37:23.004982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:20:56.163594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.740212+0000","last_change":"2023-10-14T09:37:12.368000+0000","last_active":"2023-10-14T09:37:21.740212+0000","last_peered":"2023-10-14T09:37:21.740212+0000","last_clean":"2023-10-14T09:37:21.740212+0000","last_became_active":"2023-10-14T09:37:12.364623+0000","last_became_peered":"2023-10-14T09:37:12.364623+0000","last_unstale":"2023-10-14T09:37:21.740212+0000","last_undegraded":"2023-10-14T09:37:21.740212+0000","last_fullsized":"2023-10-14T09:37:21.740212+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:10.796841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:10.796841+0000","last_clean_scrub_stamp":"2023-10-14T09:37:10.796841+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:48.940536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.727610+0000","last_change":"2023-10-14T09:37:20.911869+0000","last_active":"2023-10-14T09:37:22.727610+0000","last_peered":"2023-10-14T09:37:22.727610+0000","last_clean":"2023-10-14T09:37:22.727610+0000","last_became_active":"2023-10-14T09:37:20.911115+0000","last_became_peered":"2023-10-14T09:37:20.911115+0000","last_unstale":"2023-10-14T09:37:22.727610+0000","last_undegraded":"2023-10-14T09:37:22.727610+0000","last_fullsized":"2023-10-14T09:37:22.727610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:19:34.114987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.838142+0000","last_change":"2023-10-14T09:37:21.762010+0000","last_active":"2023-10-14T09:37:22.838142+0000","last_peered":"2023-10-14T09:37:22.838142+0000","last_clean":"2023-10-14T09:37:22.838142+0000","last_became_active":"2023-10-14T09:37:21.761697+0000","last_became_peered":"2023-10-14T09:37:21.761697+0000","last_unstale":"2023-10-14T09:37:22.838142+0000","last_undegraded":"2023-10-14T09:37:22.838142+0000","last_fullsized":"2023-10-14T09:37:22.838142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:31:03.601136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.740046+0000","last_change":"2023-10-14T09:37:20.935352+0000","last_active":"2023-10-14T09:37:21.740046+0000","last_peered":"2023-10-14T09:37:21.740046+0000","last_clean":"2023-10-14T09:37:21.740046+0000","last_became_active":"2023-10-14T09:37:20.935068+0000","last_became_peered":"2023-10-14T09:37:20.935068+0000","last_unstale":"2023-10-14T09:37:21.740046+0000","last_undegraded":"2023-10-14T09:37:21.740046+0000","last_fullsized":"2023-10-14T09:37:21.740046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:11:56.674281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.000129+0000","last_change":"2023-10-14T09:37:21.743003+0000","last_active":"2023-10-14T09:37:23.000129+0000","last_peered":"2023-10-14T09:37:23.000129+0000","last_clean":"2023-10-14T09:37:23.000129+0000","last_became_active":"2023-10-14T09:37:21.741330+0000","last_became_peered":"2023-10-14T09:37:21.741330+0000","last_unstale":"2023-10-14T09:37:23.000129+0000","last_undegraded":"2023-10-14T09:37:23.000129+0000","last_fullsized":"2023-10-14T09:37:23.000129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:25:03.218431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.727315+0000","last_change":"2023-10-14T09:37:20.925505+0000","last_active":"2023-10-14T09:37:21.727315+0000","last_peered":"2023-10-14T09:37:21.727315+0000","last_clean":"2023-10-14T09:37:21.727315+0000","last_became_active":"2023-10-14T09:37:20.925234+0000","last_became_peered":"2023-10-14T09:37:20.925234+0000","last_unstale":"2023-10-14T09:37:21.727315+0000","last_undegraded":"2023-10-14T09:37:21.727315+0000","last_fullsized":"2023-10-14T09:37:21.727315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:18:40.682886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.725905+0000","last_change":"2023-10-14T09:37:21.743561+0000","last_active":"2023-10-14T09:37:22.725905+0000","last_peered":"2023-10-14T09:37:22.725905+0000","last_clean":"2023-10-14T09:37:22.725905+0000","last_became_active":"2023-10-14T09:37:21.741553+0000","last_became_peered":"2023-10-14T09:37:21.741553+0000","last_unstale":"2023-10-14T09:37:22.725905+0000","last_undegraded":"2023-10-14T09:37:22.725905+0000","last_fullsized":"2023-10-14T09:37:22.725905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:34:28.487519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.728603+0000","last_change":"2023-10-14T09:37:20.926456+0000","last_active":"2023-10-14T09:37:22.728603+0000","last_peered":"2023-10-14T09:37:22.728603+0000","last_clean":"2023-10-14T09:37:22.728603+0000","last_became_active":"2023-10-14T09:37:20.926173+0000","last_became_peered":"2023-10-14T09:37:20.926173+0000","last_unstale":"2023-10-14T09:37:22.728603+0000","last_undegraded":"2023-10-14T09:37:22.728603+0000","last_fullsized":"2023-10-14T09:37:22.728603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:13:10.980924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.005737+0000","last_change":"2023-10-14T09:37:21.741615+0000","last_active":"2023-10-14T09:37:23.005737+0000","last_peered":"2023-10-14T09:37:23.005737+0000","last_clean":"2023-10-14T09:37:23.005737+0000","last_became_active":"2023-10-14T09:37:21.741104+0000","last_became_peered":"2023-10-14T09:37:21.741104+0000","last_unstale":"2023-10-14T09:37:23.005737+0000","last_undegraded":"2023-10-14T09:37:23.005737+0000","last_fullsized":"2023-10-14T09:37:23.005737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:18:41.697898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.735877+0000","last_change":"2023-10-14T09:37:20.927017+0000","last_active":"2023-10-14T09:37:21.735877+0000","last_peered":"2023-10-14T09:37:21.735877+0000","last_clean":"2023-10-14T09:37:21.735877+0000","last_became_active":"2023-10-14T09:37:20.925357+0000","last_became_peered":"2023-10-14T09:37:20.925357+0000","last_unstale":"2023-10-14T09:37:21.735877+0000","last_undegraded":"2023-10-14T09:37:21.735877+0000","last_fullsized":"2023-10-14T09:37:21.735877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:37:06.069126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.728396+0000","last_change":"2023-10-14T09:37:21.748586+0000","last_active":"2023-10-14T09:37:22.728396+0000","last_peered":"2023-10-14T09:37:22.728396+0000","last_clean":"2023-10-14T09:37:22.728396+0000","last_became_active":"2023-10-14T09:37:21.748040+0000","last_became_peered":"2023-10-14T09:37:21.748040+0000","last_unstale":"2023-10-14T09:37:22.728396+0000","last_undegraded":"2023-10-14T09:37:22.728396+0000","last_fullsized":"2023-10-14T09:37:22.728396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:29:10.224997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.741168+0000","last_change":"2023-10-14T09:37:20.936600+0000","last_active":"2023-10-14T09:37:21.741168+0000","last_peered":"2023-10-14T09:37:21.741168+0000","last_clean":"2023-10-14T09:37:21.741168+0000","last_became_active":"2023-10-14T09:37:20.936310+0000","last_became_peered":"2023-10-14T09:37:20.936310+0000","last_unstale":"2023-10-14T09:37:21.741168+0000","last_undegraded":"2023-10-14T09:37:21.741168+0000","last_fullsized":"2023-10-14T09:37:21.741168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:57.371898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.726291+0000","last_change":"2023-10-14T09:37:21.746713+0000","last_active":"2023-10-14T09:37:22.726291+0000","last_peered":"2023-10-14T09:37:22.726291+0000","last_clean":"2023-10-14T09:37:22.726291+0000","last_became_active":"2023-10-14T09:37:21.742406+0000","last_became_peered":"2023-10-14T09:37:21.742406+0000","last_unstale":"2023-10-14T09:37:22.726291+0000","last_undegraded":"2023-10-14T09:37:22.726291+0000","last_fullsized":"2023-10-14T09:37:22.726291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:47:20.269302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.725872+0000","last_change":"2023-10-14T09:37:20.936548+0000","last_active":"2023-10-14T09:37:22.725872+0000","last_peered":"2023-10-14T09:37:22.725872+0000","last_clean":"2023-10-14T09:37:22.725872+0000","last_became_active":"2023-10-14T09:37:20.936168+0000","last_became_peered":"2023-10-14T09:37:20.936168+0000","last_unstale":"2023-10-14T09:37:22.725872+0000","last_undegraded":"2023-10-14T09:37:22.725872+0000","last_fullsized":"2023-10-14T09:37:22.725872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:11:56.674281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.838498+0000","last_change":"2023-10-14T09:37:21.757494+0000","last_active":"2023-10-14T09:37:22.838498+0000","last_peered":"2023-10-14T09:37:22.838498+0000","last_clean":"2023-10-14T09:37:22.838498+0000","last_became_active":"2023-10-14T09:37:21.757272+0000","last_became_peered":"2023-10-14T09:37:21.757272+0000","last_unstale":"2023-10-14T09:37:22.838498+0000","last_undegraded":"2023-10-14T09:37:22.838498+0000","last_fullsized":"2023-10-14T09:37:22.838498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:20:22.862559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.931957+0000","last_change":"2023-10-14T09:37:20.938169+0000","last_active":"2023-10-14T09:37:21.931957+0000","last_peered":"2023-10-14T09:37:21.931957+0000","last_clean":"2023-10-14T09:37:21.931957+0000","last_became_active":"2023-10-14T09:37:20.937881+0000","last_became_peered":"2023-10-14T09:37:20.937881+0000","last_unstale":"2023-10-14T09:37:21.931957+0000","last_undegraded":"2023-10-14T09:37:21.931957+0000","last_fullsized":"2023-10-14T09:37:21.931957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:40:10.259029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.001082+0000","last_change":"2023-10-14T09:37:21.742197+0000","last_active":"2023-10-14T09:37:23.001082+0000","last_peered":"2023-10-14T09:37:23.001082+0000","last_clean":"2023-10-14T09:37:23.001082+0000","last_became_active":"2023-10-14T09:37:21.741895+0000","last_became_peered":"2023-10-14T09:37:21.741895+0000","last_unstale":"2023-10-14T09:37:23.001082+0000","last_undegraded":"2023-10-14T09:37:23.001082+0000","last_fullsized":"2023-10-14T09:37:23.001082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:55:22.366551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.739759+0000","last_change":"2023-10-14T09:37:20.933959+0000","last_active":"2023-10-14T09:37:21.739759+0000","last_peered":"2023-10-14T09:37:21.739759+0000","last_clean":"2023-10-14T09:37:21.739759+0000","last_became_active":"2023-10-14T09:37:20.933659+0000","last_became_peered":"2023-10-14T09:37:20.933659+0000","last_unstale":"2023-10-14T09:37:21.739759+0000","last_undegraded":"2023-10-14T09:37:21.739759+0000","last_fullsized":"2023-10-14T09:37:21.739759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:41:25.240229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.004951+0000","last_change":"2023-10-14T09:37:21.739948+0000","last_active":"2023-10-14T09:37:23.004951+0000","last_peered":"2023-10-14T09:37:23.004951+0000","last_clean":"2023-10-14T09:37:23.004951+0000","last_became_active":"2023-10-14T09:37:21.739597+0000","last_became_peered":"2023-10-14T09:37:21.739597+0000","last_unstale":"2023-10-14T09:37:23.004951+0000","last_undegraded":"2023-10-14T09:37:23.004951+0000","last_fullsized":"2023-10-14T09:37:23.004951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:25:19.124135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.733841+0000","last_change":"2023-10-14T09:37:20.932183+0000","last_active":"2023-10-14T09:37:21.733841+0000","last_peered":"2023-10-14T09:37:21.733841+0000","last_clean":"2023-10-14T09:37:21.733841+0000","last_became_active":"2023-10-14T09:37:20.931834+0000","last_became_peered":"2023-10-14T09:37:20.931834+0000","last_unstale":"2023-10-14T09:37:21.733841+0000","last_undegraded":"2023-10-14T09:37:21.733841+0000","last_fullsized":"2023-10-14T09:37:21.733841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:54:57.939511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.837982+0000","last_change":"2023-10-14T09:37:21.749015+0000","last_active":"2023-10-14T09:37:22.837982+0000","last_peered":"2023-10-14T09:37:22.837982+0000","last_clean":"2023-10-14T09:37:22.837982+0000","last_became_active":"2023-10-14T09:37:21.748596+0000","last_became_peered":"2023-10-14T09:37:21.748596+0000","last_unstale":"2023-10-14T09:37:22.837982+0000","last_undegraded":"2023-10-14T09:37:22.837982+0000","last_fullsized":"2023-10-14T09:37:22.837982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:47:20.269302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.735064+0000","last_change":"2023-10-14T09:37:20.929243+0000","last_active":"2023-10-14T09:37:21.735064+0000","last_peered":"2023-10-14T09:37:21.735064+0000","last_clean":"2023-10-14T09:37:21.735064+0000","last_became_active":"2023-10-14T09:37:20.928931+0000","last_became_peered":"2023-10-14T09:37:20.928931+0000","last_unstale":"2023-10-14T09:37:21.735064+0000","last_undegraded":"2023-10-14T09:37:21.735064+0000","last_fullsized":"2023-10-14T09:37:21.735064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:37:19.998680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.838457+0000","last_change":"2023-10-14T09:37:21.742020+0000","last_active":"2023-10-14T09:37:22.838457+0000","last_peered":"2023-10-14T09:37:22.838457+0000","last_clean":"2023-10-14T09:37:22.838457+0000","last_became_active":"2023-10-14T09:37:21.741732+0000","last_became_peered":"2023-10-14T09:37:21.741732+0000","last_unstale":"2023-10-14T09:37:22.838457+0000","last_undegraded":"2023-10-14T09:37:22.838457+0000","last_fullsized":"2023-10-14T09:37:22.838457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:14:40.914923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.931371+0000","last_change":"2023-10-14T09:37:20.939984+0000","last_active":"2023-10-14T09:37:21.931371+0000","last_peered":"2023-10-14T09:37:21.931371+0000","last_clean":"2023-10-14T09:37:21.931371+0000","last_became_active":"2023-10-14T09:37:20.937636+0000","last_became_peered":"2023-10-14T09:37:20.937636+0000","last_unstale":"2023-10-14T09:37:21.931371+0000","last_undegraded":"2023-10-14T09:37:21.931371+0000","last_fullsized":"2023-10-14T09:37:21.931371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:54:57.939511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.003333+0000","last_change":"2023-10-14T09:37:21.751303+0000","last_active":"2023-10-14T09:37:23.003333+0000","last_peered":"2023-10-14T09:37:23.003333+0000","last_clean":"2023-10-14T09:37:23.003333+0000","last_became_active":"2023-10-14T09:37:21.751037+0000","last_became_peered":"2023-10-14T09:37:21.751037+0000","last_unstale":"2023-10-14T09:37:23.003333+0000","last_undegraded":"2023-10-14T09:37:23.003333+0000","last_fullsized":"2023-10-14T09:37:23.003333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:47:20.056113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.727977+0000","last_change":"2023-10-14T09:37:21.753475+0000","last_active":"2023-10-14T09:37:22.727977+0000","last_peered":"2023-10-14T09:37:22.727977+0000","last_clean":"2023-10-14T09:37:22.727977+0000","last_became_active":"2023-10-14T09:37:21.751788+0000","last_became_peered":"2023-10-14T09:37:21.751788+0000","last_unstale":"2023-10-14T09:37:22.727977+0000","last_undegraded":"2023-10-14T09:37:22.727977+0000","last_fullsized":"2023-10-14T09:37:22.727977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:13:55.065205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.930531+0000","last_change":"2023-10-14T09:37:20.938049+0000","last_active":"2023-10-14T09:37:21.930531+0000","last_peered":"2023-10-14T09:37:21.930531+0000","last_clean":"2023-10-14T09:37:21.930531+0000","last_became_active":"2023-10-14T09:37:20.937761+0000","last_became_peered":"2023-10-14T09:37:20.937761+0000","last_unstale":"2023-10-14T09:37:21.930531+0000","last_undegraded":"2023-10-14T09:37:21.930531+0000","last_fullsized":"2023-10-14T09:37:21.930531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:25:18.109123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.728499+0000","last_change":"2023-10-14T09:37:21.746300+0000","last_active":"2023-10-14T09:37:22.728499+0000","last_peered":"2023-10-14T09:37:22.728499+0000","last_clean":"2023-10-14T09:37:22.728499+0000","last_became_active":"2023-10-14T09:37:21.743958+0000","last_became_peered":"2023-10-14T09:37:21.743958+0000","last_unstale":"2023-10-14T09:37:22.728499+0000","last_undegraded":"2023-10-14T09:37:22.728499+0000","last_fullsized":"2023-10-14T09:37:22.728499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:59:17.333518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.931999+0000","last_change":"2023-10-14T09:37:20.939300+0000","last_active":"2023-10-14T09:37:21.931999+0000","last_peered":"2023-10-14T09:37:21.931999+0000","last_clean":"2023-10-14T09:37:21.931999+0000","last_became_active":"2023-10-14T09:37:20.938957+0000","last_became_peered":"2023-10-14T09:37:20.938957+0000","last_unstale":"2023-10-14T09:37:21.931999+0000","last_undegraded":"2023-10-14T09:37:21.931999+0000","last_fullsized":"2023-10-14T09:37:21.931999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:59:40.065205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.001168+0000","last_change":"2023-10-14T09:37:21.755441+0000","last_active":"2023-10-14T09:37:23.001168+0000","last_peered":"2023-10-14T09:37:23.001168+0000","last_clean":"2023-10-14T09:37:23.001168+0000","last_became_active":"2023-10-14T09:37:21.755006+0000","last_became_peered":"2023-10-14T09:37:21.755006+0000","last_unstale":"2023-10-14T09:37:23.001168+0000","last_undegraded":"2023-10-14T09:37:23.001168+0000","last_fullsized":"2023-10-14T09:37:23.001168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:33:39.761471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T09:37:21.921465+0000","last_change":"2023-10-14T09:37:20.921785+0000","last_active":"2023-10-14T09:37:21.921465+0000","last_peered":"2023-10-14T09:37:21.921465+0000","last_clean":"2023-10-14T09:37:21.921465+0000","last_became_active":"2023-10-14T09:37:20.921514+0000","last_became_peered":"2023-10-14T09:37:20.921514+0000","last_unstale":"2023-10-14T09:37:21.921465+0000","last_undegraded":"2023-10-14T09:37:21.921465+0000","last_fullsized":"2023-10-14T09:37:21.921465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:37:19.998680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:22.838600+0000","last_change":"2023-10-14T09:37:21.748918+0000","last_active":"2023-10-14T09:37:22.838600+0000","last_peered":"2023-10-14T09:37:22.838600+0000","last_clean":"2023-10-14T09:37:22.838600+0000","last_became_active":"2023-10-14T09:37:21.746814+0000","last_became_peered":"2023-10-14T09:37:21.746814+0000","last_unstale":"2023-10-14T09:37:22.838600+0000","last_undegraded":"2023-10-14T09:37:22.838600+0000","last_fullsized":"2023-10-14T09:37:22.838600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:20.876103+0000","last_clean_scrub_stamp":"2023-10-14T09:37:20.876103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:57:10.220824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T09:37:23.001310+0000","last_change":"2023-10-14T09:37:20.933646+0000","last_active":"2023-10-14T09:37:23.001310+0000","last_peered":"2023-10-14T09:37:23.001310+0000","last_clean":"2023-10-14T09:37:23.001310+0000","last_became_active":"2023-10-14T09:37:20.933289+0000","last_became_peered":"2023-10-14T09:37:20.933289+0000","last_unstale":"2023-10-14T09:37:23.001310+0000","last_undegraded":"2023-10-14T09:37:23.001310+0000","last_fullsized":"2023-10-14T09:37:23.001310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:19.861091+0000","last_clean_scrub_stamp":"2023-10-14T09:37:19.861091+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:56:57.656029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":819200,"data_stored":667764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.343}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.276}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.411}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3759999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6479999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":78426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4540000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.5419999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.478}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.786}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7290000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":76940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.389}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2549999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.484}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5660000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3420000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":78426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6829999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6469999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":76814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4890000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0270000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":76974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3109999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8580000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":76904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6479999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.397}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.712}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9630000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3039999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.093}]}]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":667820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.452}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4670000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T09:37:32.387 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-14T09:37:32.387 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-14T09:37:32.387 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-14T09:37:32.388 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-14T09:37:32.628 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.626+0000 7efc4b790640 1 Processor -- start 2023-10-14T09:37:32.629 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.627+0000 7efc4b790640 1 -- start start 2023-10-14T09:37:32.630 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.628+0000 7efc4b790640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7efc4415ad70 0x7efc44069da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:32.630 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.628+0000 7efc4b790640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7efc440caac0 0x7efc4406a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:32.630 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.628+0000 7efc4b790640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc440cb030 con 0x7efc440c9ca0 2023-10-14T09:37:32.630 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.628+0000 7efc4b790640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc440c91c0 con 0x7efc440caac0 2023-10-14T09:37:32.631 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.628+0000 7efc4b790640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc440c94a0 con 0x7efc4415ad70 2023-10-14T09:37:32.632 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.629+0000 7efc49d2d640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7efc440caac0 0x7efc4406a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:32.632 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.629+0000 7efc49d2d640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7efc440caac0 0x7efc4406a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.102:42264/0 (socket says 172.21.15.102:42264) 2023-10-14T09:37:32.632 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.629+0000 7efc4952c640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7efc4415ad70 0x7efc44069da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:32.632 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.629+0000 7efc48d2b640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7efc440c9ca0 0x7efc440ca3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.102:55046/0 (socket says 172.21.15.102:55046) 2023-10-14T09:37:32.633 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.629+0000 7efc49d2d640 1 -- 172.21.15.102:0/701150921 learned_addr learned my addr 172.21.15.102:0/701150921 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:32.633 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.629+0000 7efc43fff640 1 -- 172.21.15.102:0/701150921 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4197551166 0 0) 0x7efc440cb030 con 0x7efc440c9ca0 2023-10-14T09:37:32.633 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.629+0000 7efc43fff640 1 -- 172.21.15.102:0/701150921 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc34003520 con 0x7efc440c9ca0 2023-10-14T09:37:32.633 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.629+0000 7efc4952c640 1 -- 172.21.15.102:0/701150921 >> v2:172.21.15.129:3300/0 conn(0x7efc440caac0 msgr2=0x7efc4406a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:32.633 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.629+0000 7efc4952c640 1 --2- 172.21.15.102:0/701150921 >> v2:172.21.15.129:3300/0 conn(0x7efc440caac0 0x7efc4406a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:32.634 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.629+0000 7efc4952c640 1 -- 172.21.15.102:0/701150921 >> v1:172.21.15.129:6789/0 conn(0x7efc440c9ca0 legacy=0x7efc440ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:32.634 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.629+0000 7efc4952c640 1 -- 172.21.15.102:0/701150921 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc440c9780 con 0x7efc4415ad70 2023-10-14T09:37:32.635 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.631+0000 7efc4952c640 1 --2- 172.21.15.102:0/701150921 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7efc4415ad70 0x7efc44069da0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efc38009d90 tx=0x7efc3802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=faf612def6cd6505 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:32.635 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.631+0000 7efc43fff640 1 -- 172.21.15.102:0/701150921 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3802cc50 con 0x7efc4415ad70 2023-10-14T09:37:32.636 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.631+0000 7efc43fff640 1 -- 172.21.15.102:0/701150921 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3802cdb0 con 0x7efc4415ad70 2023-10-14T09:37:32.636 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.631+0000 7efc43fff640 1 -- 172.21.15.102:0/701150921 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc38034640 con 0x7efc4415ad70 2023-10-14T09:37:32.636 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.632+0000 7efc4b790640 1 -- 172.21.15.102:0/701150921 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7efc4415ad70 msgr2=0x7efc44069da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:32.636 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.632+0000 7efc4b790640 1 --2- 172.21.15.102:0/701150921 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7efc4415ad70 0x7efc44069da0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efc38009d90 tx=0x7efc3802bea0 comp rx=0 tx=0).stop 2023-10-14T09:37:32.637 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.632+0000 7efc4b790640 1 -- 172.21.15.102:0/701150921 shutdown_connections 2023-10-14T09:37:32.637 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.632+0000 7efc4b790640 1 --2- 172.21.15.102:0/701150921 >> v2:172.21.15.129:3300/0 conn(0x7efc440caac0 0x7efc4406a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:32.637 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.632+0000 7efc4b790640 1 --2- 172.21.15.102:0/701150921 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7efc4415ad70 0x7efc44069da0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:32.637 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.632+0000 7efc4b790640 1 -- 172.21.15.102:0/701150921 >> 172.21.15.102:0/701150921 conn(0x7efc440ce9b0 msgr2=0x7efc440cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:32.637 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.632+0000 7efc4b790640 1 -- 172.21.15.102:0/701150921 shutdown_connections 2023-10-14T09:37:32.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.632+0000 7efc4b790640 1 -- 172.21.15.102:0/701150921 wait complete. 2023-10-14T09:37:32.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.634+0000 7efc4b790640 1 Processor -- start 2023-10-14T09:37:32.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.634+0000 7efc4b790640 1 -- start start 2023-10-14T09:37:32.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.635+0000 7efc4b790640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efc440c9ca0 0x7efc4414de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:32.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.635+0000 7efc4b790640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7efc440caac0 0x7efc440c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:32.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.635+0000 7efc4b790640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc4415ad70 0x7efc440c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:32.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.635+0000 7efc4b790640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc440c79a0 con 0x7efc4415ad70 2023-10-14T09:37:32.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.635+0000 7efc4b790640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc440c6ad0 con 0x7efc440c9ca0 2023-10-14T09:37:32.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.635+0000 7efc4b790640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc440c6d20 con 0x7efc440caac0 2023-10-14T09:37:32.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.635+0000 7efc49d2d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc4415ad70 0x7efc440c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:32.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.635+0000 7efc49d2d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc4415ad70 0x7efc440c8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33020/0 (socket says 172.21.15.102:33020) 2023-10-14T09:37:32.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.635+0000 7efc49d2d640 1 -- 172.21.15.102:0/4275800533 learned_addr learned my addr 172.21.15.102:0/4275800533 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:32.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.635+0000 7efc4952c640 1 --2- 172.21.15.102:0/4275800533 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efc440c9ca0 0x7efc4414de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:32.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.635+0000 7efc49d2d640 1 -- 172.21.15.102:0/4275800533 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7efc440caac0 msgr2=0x7efc440c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:32.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.635+0000 7efc49d2d640 1 --2- 172.21.15.102:0/4275800533 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7efc440caac0 0x7efc440c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:32.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.635+0000 7efc49d2d640 1 -- 172.21.15.102:0/4275800533 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efc440c9ca0 msgr2=0x7efc4414de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:32.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.635+0000 7efc49d2d640 1 --2- 172.21.15.102:0/4275800533 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efc440c9ca0 0x7efc4414de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:32.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.635+0000 7efc49d2d640 1 -- 172.21.15.102:0/4275800533 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc38009a70 con 0x7efc4415ad70 2023-10-14T09:37:32.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.636+0000 7efc49d2d640 1 --2- 172.21.15.102:0/4275800533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc4415ad70 0x7efc440c8500 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efc3c00e870 tx=0x7efc3c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:32.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.636+0000 7efc41ffb640 1 -- 172.21.15.102:0/4275800533 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c00c940 con 0x7efc4415ad70 2023-10-14T09:37:32.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.636+0000 7efc41ffb640 1 -- 172.21.15.102:0/4275800533 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3c00caa0 con 0x7efc4415ad70 2023-10-14T09:37:32.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.636+0000 7efc41ffb640 1 -- 172.21.15.102:0/4275800533 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c00ce50 con 0x7efc4415ad70 2023-10-14T09:37:32.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.636+0000 7efc4b790640 1 -- 172.21.15.102:0/4275800533 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc440c7000 con 0x7efc4415ad70 2023-10-14T09:37:32.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.636+0000 7efc4b790640 1 -- 172.21.15.102:0/4275800533 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc440c75c0 con 0x7efc4415ad70 2023-10-14T09:37:32.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.637+0000 7efc4b790640 1 -- 172.21.15.102:0/4275800533 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc4404e160 con 0x7efc4415ad70 2023-10-14T09:37:32.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.638+0000 7efc41ffb640 1 -- 172.21.15.102:0/4275800533 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efc3c013470 con 0x7efc4415ad70 2023-10-14T09:37:32.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.639+0000 7efc41ffb640 1 --2- 172.21.15.102:0/4275800533 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7efc2806ae70 0x7efc2806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:32.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.639+0000 7efc41ffb640 1 -- 172.21.15.102:0/4275800533 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc3c0897b0 con 0x7efc4415ad70 2023-10-14T09:37:32.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.639+0000 7efc4952c640 1 --2- 172.21.15.102:0/4275800533 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7efc2806ae70 0x7efc2806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:32.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.640+0000 7efc4952c640 1 --2- 172.21.15.102:0/4275800533 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7efc2806ae70 0x7efc2806d330 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efc38036000 tx=0x7efc38030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:32.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.644+0000 7efc41ffb640 1 -- 172.21.15.102:0/4275800533 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efc3c0548f0 con 0x7efc4415ad70 2023-10-14T09:37:32.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.857+0000 7efc4b790640 1 -- 172.21.15.102:0/4275800533 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7efc440af1d0 con 0x7efc4415ad70 2023-10-14T09:37:32.859 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.858+0000 7efc41ffb640 1 -- 172.21.15.102:0/4275800533 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7efc3c057f10 con 0x7efc4415ad70 2023-10-14T09:37:32.860 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:37:32.860 INFO:teuthology.orchestra.run.smithi102.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-14T09:37:32.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.860+0000 7efc4b790640 1 -- 172.21.15.102:0/4275800533 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7efc2806ae70 msgr2=0x7efc2806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:32.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.860+0000 7efc4b790640 1 --2- 172.21.15.102:0/4275800533 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7efc2806ae70 0x7efc2806d330 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efc38036000 tx=0x7efc38030000 comp rx=0 tx=0).stop 2023-10-14T09:37:32.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.860+0000 7efc4b790640 1 -- 172.21.15.102:0/4275800533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc4415ad70 msgr2=0x7efc440c8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:32.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.860+0000 7efc4b790640 1 --2- 172.21.15.102:0/4275800533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc4415ad70 0x7efc440c8500 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efc3c00e870 tx=0x7efc3c00ed30 comp rx=0 tx=0).stop 2023-10-14T09:37:32.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.860+0000 7efc4b790640 1 -- 172.21.15.102:0/4275800533 shutdown_connections 2023-10-14T09:37:32.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.860+0000 7efc4b790640 1 --2- 172.21.15.102:0/4275800533 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7efc2806ae70 0x7efc2806d330 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:32.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.860+0000 7efc4b790640 1 --2- 172.21.15.102:0/4275800533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc4415ad70 0x7efc440c8500 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:32.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.860+0000 7efc4b790640 1 --2- 172.21.15.102:0/4275800533 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7efc440caac0 0x7efc440c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:32.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.860+0000 7efc4b790640 1 --2- 172.21.15.102:0/4275800533 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efc440c9ca0 0x7efc4414de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:32.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.860+0000 7efc4b790640 1 -- 172.21.15.102:0/4275800533 >> 172.21.15.102:0/4275800533 conn(0x7efc440ce9b0 msgr2=0x7efc440af9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:32.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.860+0000 7efc4b790640 1 -- 172.21.15.102:0/4275800533 shutdown_connections 2023-10-14T09:37:32.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:32.860+0000 7efc4b790640 1 -- 172.21.15.102:0/4275800533 wait complete. 2023-10-14T09:37:32.878 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-14T09:37:32.879 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:37:33.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.079+0000 7f6bcd2ec640 1 Processor -- start 2023-10-14T09:37:33.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.080+0000 7f6bcd2ec640 1 -- start start 2023-10-14T09:37:33.085 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.081+0000 7f6bcd2ec640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f6bc80b3070 0x7f6bc80cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:33.086 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.081+0000 7f6bcd2ec640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6bc80d1b10 0x7f6bc80cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:33.086 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.081+0000 7f6bcd2ec640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc80b3940 con 0x7f6bc80b3e70 2023-10-14T09:37:33.086 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.081+0000 7f6bcd2ec640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc80b45e0 con 0x7f6bc80b3070 2023-10-14T09:37:33.087 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.081+0000 7f6bcd2ec640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc80b3b90 con 0x7f6bc80d1b10 2023-10-14T09:37:33.087 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.081+0000 7f6bc67fc640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f6bc80b3e70 0x7f6bc80c6870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:50332/0 (socket says 172.21.15.102:50332) 2023-10-14T09:37:33.087 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.081+0000 7f6bc67fc640 1 -- 172.21.15.102:0/3791769222 learned_addr learned my addr 172.21.15.102:0/3791769222 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:33.093 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.082+0000 7f6bc77fe640 1 --2- 172.21.15.102:0/3791769222 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6bc80d1b10 0x7f6bc80cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:33.093 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.082+0000 7f6bc5ffb640 1 -- 172.21.15.102:0/3791769222 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 180399815 0 0) 0x7f6bc80b3940 con 0x7f6bc80b3e70 2023-10-14T09:37:33.094 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.082+0000 7f6bc5ffb640 1 -- 172.21.15.102:0/3791769222 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bb4003520 con 0x7f6bc80b3e70 2023-10-14T09:37:33.094 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.082+0000 7f6bc5ffb640 1 -- 172.21.15.102:0/3791769222 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1074568627 0 0) 0x7f6bb4003520 con 0x7f6bc80b3e70 2023-10-14T09:37:33.094 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.082+0000 7f6bc5ffb640 1 -- 172.21.15.102:0/3791769222 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6bc80d1b10 msgr2=0x7f6bc80cfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:33.094 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.082+0000 7f6bc5ffb640 1 --2- 172.21.15.102:0/3791769222 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6bc80d1b10 0x7f6bc80cfa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:33.094 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.082+0000 7f6bc5ffb640 1 -- 172.21.15.102:0/3791769222 >> v2:172.21.15.129:3300/0 conn(0x7f6bc80b3070 msgr2=0x7f6bc80cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:33.095 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.082+0000 7f6bc6ffd640 1 --2- 172.21.15.102:0/3791769222 >> v2:172.21.15.129:3300/0 conn(0x7f6bc80b3070 0x7f6bc80cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:33.095 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.082+0000 7f6bc5ffb640 1 --2- 172.21.15.102:0/3791769222 >> v2:172.21.15.129:3300/0 conn(0x7f6bc80b3070 0x7f6bc80cf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:33.095 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.082+0000 7f6bc5ffb640 1 -- 172.21.15.102:0/3791769222 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc80d3840 con 0x7f6bc80b3e70 2023-10-14T09:37:33.095 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.082+0000 7f6bc5ffb640 1 -- 172.21.15.102:0/3791769222 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4030661168 0 0) 0x7f6bb0001670 con 0x7f6bc80b3e70 2023-10-14T09:37:33.095 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.082+0000 7f6bc5ffb640 1 -- 172.21.15.102:0/3791769222 >> v1:172.21.15.102:6789/0 conn(0x7f6bc80b3e70 legacy=0x7f6bc80c6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:33.095 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.082+0000 7f6bc5ffb640 1 --2- 172.21.15.102:0/3791769222 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6bb4003970 0x7f6bb4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:33.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.082+0000 7f6bc5ffb640 1 --2- 172.21.15.102:0/3791769222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bb40047c0 0x7f6bb4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:33.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.082+0000 7f6bc5ffb640 1 --2- 172.21.15.102:0/3791769222 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6bc80d1b10 0x7f6bb40051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:33.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.082+0000 7f6bc5ffb640 1 -- 172.21.15.102:0/3791769222 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc80b45e0 con 0x7f6bb40047c0 2023-10-14T09:37:33.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.082+0000 7f6bc5ffb640 1 -- 172.21.15.102:0/3791769222 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc80b3b90 con 0x7f6bb4003970 2023-10-14T09:37:33.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.082+0000 7f6bc5ffb640 1 -- 172.21.15.102:0/3791769222 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb400bb10 con 0x7f6bc80d1b10 2023-10-14T09:37:33.097 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.083+0000 7f6bc67fc640 1 --2- 172.21.15.102:0/3791769222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bb40047c0 0x7f6bb4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:33.097 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.083+0000 7f6bc6ffd640 1 --2- 172.21.15.102:0/3791769222 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6bb4003970 0x7f6bb4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:33.097 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.083+0000 7f6bc77fe640 1 --2- 172.21.15.102:0/3791769222 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6bc80d1b10 0x7f6bb40051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:33.097 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.083+0000 7f6bc67fc640 1 -- 172.21.15.102:0/3791769222 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6bc80d1b10 msgr2=0x7f6bb40051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:33.097 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.083+0000 7f6bc67fc640 1 --2- 172.21.15.102:0/3791769222 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6bc80d1b10 0x7f6bb40051a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:33.098 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.083+0000 7f6bc67fc640 1 -- 172.21.15.102:0/3791769222 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6bb4003970 msgr2=0x7f6bb4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:33.098 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.083+0000 7f6bc67fc640 1 --2- 172.21.15.102:0/3791769222 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6bb4003970 0x7f6bb4003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:33.098 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.083+0000 7f6bc67fc640 1 -- 172.21.15.102:0/3791769222 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb4003520 con 0x7f6bb40047c0 2023-10-14T09:37:33.098 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.084+0000 7f6bc67fc640 1 --2- 172.21.15.102:0/3791769222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bb40047c0 0x7f6bb4004c40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6bb000c290 tx=0x7f6bb40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93ab52f7dafd46b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:33.098 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.084+0000 7f6bc5ffb640 1 -- 172.21.15.102:0/3791769222 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0005ad0 con 0x7f6bb40047c0 2023-10-14T09:37:33.099 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.084+0000 7f6bc5ffb640 1 -- 172.21.15.102:0/3791769222 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb0005c30 con 0x7f6bb40047c0 2023-10-14T09:37:33.099 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.084+0000 7f6bc5ffb640 1 -- 172.21.15.102:0/3791769222 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb002c8d0 con 0x7f6bb40047c0 2023-10-14T09:37:33.099 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.084+0000 7f6bcd2ec640 1 -- 172.21.15.102:0/3791769222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bb40047c0 msgr2=0x7f6bb4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:33.099 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.085+0000 7f6bcd2ec640 1 --2- 172.21.15.102:0/3791769222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bb40047c0 0x7f6bb4004c40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6bb000c290 tx=0x7f6bb40057f0 comp rx=0 tx=0).stop 2023-10-14T09:37:33.099 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.085+0000 7f6bc77fe640 1 -- 172.21.15.102:0/3791769222 reap_dead start 2023-10-14T09:37:33.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.085+0000 7f6bcd2ec640 1 -- 172.21.15.102:0/3791769222 shutdown_connections 2023-10-14T09:37:33.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.085+0000 7f6bcd2ec640 1 -- 172.21.15.102:0/3791769222 >> 172.21.15.102:0/3791769222 conn(0x7f6bc80d2d20 msgr2=0x7f6bc80d3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:33.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.085+0000 7f6bcd2ec640 1 -- 172.21.15.102:0/3791769222 shutdown_connections 2023-10-14T09:37:33.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.085+0000 7f6bcd2ec640 1 -- 172.21.15.102:0/3791769222 wait complete. 2023-10-14T09:37:33.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.086+0000 7f6bcd2ec640 1 Processor -- start 2023-10-14T09:37:33.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.087+0000 7f6bcd2ec640 1 -- start start 2023-10-14T09:37:33.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.087+0000 7f6bcd2ec640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6bb40047c0 0x7f6bc80af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:33.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.087+0000 7f6bcd2ec640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bc8156380 0x7f6bc80b7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:33.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.087+0000 7f6bcd2ec640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6bc815cba0 0x7f6bc815d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:33.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.087+0000 7f6bcd2ec640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc815d590 con 0x7f6bc8156380 2023-10-14T09:37:33.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.087+0000 7f6bcd2ec640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc8156800 con 0x7f6bb40047c0 2023-10-14T09:37:33.102 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.087+0000 7f6bcd2ec640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc80b7ca0 con 0x7f6bc815cba0 2023-10-14T09:37:33.102 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.088+0000 7f6bc67fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bc8156380 0x7f6bc80b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:33.102 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.088+0000 7f6bc67fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bc8156380 0x7f6bc80b7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33034/0 (socket says 172.21.15.102:33034) 2023-10-14T09:37:33.102 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.088+0000 7f6bc67fc640 1 -- 172.21.15.102:0/3111683562 learned_addr learned my addr 172.21.15.102:0/3111683562 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:33.102 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.088+0000 7f6bc67fc640 1 -- 172.21.15.102:0/3111683562 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6bc815cba0 msgr2=0x7f6bc815d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:33.103 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.088+0000 7f6bc6ffd640 1 --2- 172.21.15.102:0/3111683562 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6bb40047c0 0x7f6bc80af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:33.103 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.088+0000 7f6bc67fc640 1 --2- 172.21.15.102:0/3111683562 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6bc815cba0 0x7f6bc815d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:33.103 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.088+0000 7f6bc67fc640 1 -- 172.21.15.102:0/3111683562 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6bb40047c0 msgr2=0x7f6bc80af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:33.103 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.088+0000 7f6bc67fc640 1 --2- 172.21.15.102:0/3111683562 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6bb40047c0 0x7f6bc80af8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:33.103 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.088+0000 7f6bc67fc640 1 -- 172.21.15.102:0/3111683562 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc80aff60 con 0x7f6bc8156380 2023-10-14T09:37:33.103 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.088+0000 7f6bc67fc640 1 --2- 172.21.15.102:0/3111683562 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bc8156380 0x7f6bc80b7760 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6bb002c470 tx=0x7f6bb0000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:33.104 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.089+0000 7f6bbf7fe640 1 -- 172.21.15.102:0/3111683562 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0039070 con 0x7f6bc8156380 2023-10-14T09:37:33.104 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.089+0000 7f6bbf7fe640 1 -- 172.21.15.102:0/3111683562 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb002de10 con 0x7f6bc8156380 2023-10-14T09:37:33.104 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.089+0000 7f6bbf7fe640 1 -- 172.21.15.102:0/3111683562 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb00072b0 con 0x7f6bc8156380 2023-10-14T09:37:33.104 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.089+0000 7f6bcd2ec640 1 -- 172.21.15.102:0/3111683562 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc80b0240 con 0x7f6bc8156380 2023-10-14T09:37:33.104 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.089+0000 7f6bcd2ec640 1 -- 172.21.15.102:0/3111683562 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc80b0800 con 0x7f6bc8156380 2023-10-14T09:37:33.105 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.090+0000 7f6bcd2ec640 1 -- 172.21.15.102:0/3111683562 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc804e160 con 0x7f6bc8156380 2023-10-14T09:37:33.105 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.091+0000 7f6bbf7fe640 1 -- 172.21.15.102:0/3111683562 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6bb0032070 con 0x7f6bc8156380 2023-10-14T09:37:33.105 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.092+0000 7f6bbf7fe640 1 --2- 172.21.15.102:0/3111683562 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f6ba806ae70 0x7f6ba806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:33.105 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.092+0000 7f6bbf7fe640 1 -- 172.21.15.102:0/3111683562 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6bb003c040 con 0x7f6bc8156380 2023-10-14T09:37:33.105 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.092+0000 7f6bc6ffd640 1 --2- 172.21.15.102:0/3111683562 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f6ba806ae70 0x7f6ba806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:33.106 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.092+0000 7f6bc6ffd640 1 --2- 172.21.15.102:0/3111683562 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f6ba806ae70 0x7f6ba806d330 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8009fb0 tx=0x7f6bb8009500 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:33.106 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.096+0000 7f6bbf7fe640 1 -- 172.21.15.102:0/3111683562 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6bb0075c40 con 0x7f6bc8156380 2023-10-14T09:37:33.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.288+0000 7f6bcd2ec640 1 -- 172.21.15.102:0/3111683562 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6bc80c6330 con 0x7f6bc8156380 2023-10-14T09:37:33.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.290+0000 7f6bbf7fe640 1 -- 172.21.15.102:0/3111683562 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f6bb0079260 con 0x7f6bc8156380 2023-10-14T09:37:33.292 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:37:33.293 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":22,"fsid":"8a6cd69d-7f5b-4f2a-806a-0176c10aed50","created":"2023-10-14T09:36:56.745172+0000","modified":"2023-10-14T09:37:22.712469+0000","last_up_change":"2023-10-14T09:37:09.791473+0000","last_in_change":"2023-10-14T09:37:00.547186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:37:09.952407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:37:19.560925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:37:20.363385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e5aef8f3-878f-482b-b522-9a5b958b90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6801","nonce":1727250718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6803","nonce":1727250718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6807","nonce":1727250718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6805","nonce":1727250718}]},"public_addr":"172.21.15.102:6801/1727250718","cluster_addr":"172.21.15.102:6803/1727250718","heartbeat_back_addr":"172.21.15.102:6807/1727250718","heartbeat_front_addr":"172.21.15.102:6805/1727250718","state":["exists","up"]},{"osd":1,"uuid":"4a8cf50e-387b-4d47-9588-bd22e375a9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6809","nonce":1095651107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6811","nonce":1095651107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6815","nonce":1095651107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6813","nonce":1095651107}]},"public_addr":"172.21.15.102:6809/1095651107","cluster_addr":"172.21.15.102:6811/1095651107","heartbeat_back_addr":"172.21.15.102:6815/1095651107","heartbeat_front_addr":"172.21.15.102:6813/1095651107","state":["exists","up"]},{"osd":2,"uuid":"009ef55f-8a63-4219-bacd-d7c7b4500867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6820","nonce":2198222556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6825","nonce":2198222556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6831","nonce":2198222556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6829","nonce":2198222556}]},"public_addr":"172.21.15.102:6820/2198222556","cluster_addr":"172.21.15.102:6825/2198222556","heartbeat_back_addr":"172.21.15.102:6831/2198222556","heartbeat_front_addr":"172.21.15.102:6829/2198222556","state":["exists","up"]},{"osd":3,"uuid":"f2110eae-2ff9-4ed9-93d6-bd2361618211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6818","nonce":654726740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6821","nonce":654726740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6827","nonce":654726740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6823","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6824","nonce":654726740}]},"public_addr":"172.21.15.102:6818/654726740","cluster_addr":"172.21.15.102:6821/654726740","heartbeat_back_addr":"172.21.15.102:6827/654726740","heartbeat_front_addr":"172.21.15.102:6824/654726740","state":["exists","up"]},{"osd":4,"uuid":"33f1ae34-3100-40f7-9cb8-0eca2b358693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6817","nonce":507586170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6819","nonce":507586170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6823","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6825","nonce":507586170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6821","nonce":507586170}]},"public_addr":"172.21.15.129:6817/507586170","cluster_addr":"172.21.15.129:6819/507586170","heartbeat_back_addr":"172.21.15.129:6825/507586170","heartbeat_front_addr":"172.21.15.129:6821/507586170","state":["exists","up"]},{"osd":5,"uuid":"fab2fc62-3f3e-450d-93e0-770f39e80710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6801","nonce":1913451073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6803","nonce":1913451073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6807","nonce":1913451073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6805","nonce":1913451073}]},"public_addr":"172.21.15.129:6801/1913451073","cluster_addr":"172.21.15.129:6803/1913451073","heartbeat_back_addr":"172.21.15.129:6807/1913451073","heartbeat_front_addr":"172.21.15.129:6805/1913451073","state":["exists","up"]},{"osd":6,"uuid":"d7cc1d69-92e7-4253-a127-cfc0444a4809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6809","nonce":2853291511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6811","nonce":2853291511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6815","nonce":2853291511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6813","nonce":2853291511}]},"public_addr":"172.21.15.129:6809/2853291511","cluster_addr":"172.21.15.129:6811/2853291511","heartbeat_back_addr":"172.21.15.129:6815/2853291511","heartbeat_front_addr":"172.21.15.129:6813/2853291511","state":["exists","up"]},{"osd":7,"uuid":"1e403de1-09e2-4370-b9a7-e790ac44bbee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6824","nonce":2933886914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6827","nonce":2933886914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6831","nonce":2933886914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6829","nonce":2933886914}]},"public_addr":"172.21.15.129:6824/2933886914","cluster_addr":"172.21.15.129:6827/2933886914","heartbeat_back_addr":"172.21.15.129:6831/2933886914","heartbeat_front_addr":"172.21.15.129:6829/2933886914","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.849661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.868113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.933488+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.891794+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.901861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.858750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.911712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.996765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:37:33.295 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.293+0000 7f6bcd2ec640 1 -- 172.21.15.102:0/3111683562 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f6ba806ae70 msgr2=0x7f6ba806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:33.295 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.293+0000 7f6bcd2ec640 1 --2- 172.21.15.102:0/3111683562 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f6ba806ae70 0x7f6ba806d330 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8009fb0 tx=0x7f6bb8009500 comp rx=0 tx=0).stop 2023-10-14T09:37:33.295 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.293+0000 7f6bcd2ec640 1 -- 172.21.15.102:0/3111683562 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bc8156380 msgr2=0x7f6bc80b7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:33.296 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.293+0000 7f6bcd2ec640 1 --2- 172.21.15.102:0/3111683562 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bc8156380 0x7f6bc80b7760 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6bb002c470 tx=0x7f6bb0000fe0 comp rx=0 tx=0).stop 2023-10-14T09:37:33.296 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.293+0000 7f6bcd2ec640 1 -- 172.21.15.102:0/3111683562 shutdown_connections 2023-10-14T09:37:33.296 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.293+0000 7f6bcd2ec640 1 --2- 172.21.15.102:0/3111683562 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f6ba806ae70 0x7f6ba806d330 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:33.296 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.293+0000 7f6bcd2ec640 1 --2- 172.21.15.102:0/3111683562 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6bc815cba0 0x7f6bc815d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:33.296 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.293+0000 7f6bcd2ec640 1 --2- 172.21.15.102:0/3111683562 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bc8156380 0x7f6bc80b7760 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:33.296 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.293+0000 7f6bcd2ec640 1 --2- 172.21.15.102:0/3111683562 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6bb40047c0 0x7f6bc80af8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:33.297 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.293+0000 7f6bcd2ec640 1 -- 172.21.15.102:0/3111683562 >> 172.21.15.102:0/3111683562 conn(0x7f6bc80d2d20 msgr2=0x7f6bc806b950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:33.297 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.293+0000 7f6bcd2ec640 1 -- 172.21.15.102:0/3111683562 shutdown_connections 2023-10-14T09:37:33.297 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.293+0000 7f6bcd2ec640 1 -- 172.21.15.102:0/3111683562 wait complete. 2023-10-14T09:37:33.312 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T09:37:09.952407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T09:37:19.560925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T09:37:20.363385+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T09:37:33.313 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T09:37:33.529 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.527+0000 7f2ff989b640 1 Processor -- start 2023-10-14T09:37:33.530 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.528+0000 7f2ff989b640 1 -- start start 2023-10-14T09:37:33.532 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.530+0000 7f2ff989b640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2ff4070830 0x7f2ff406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:33.532 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.530+0000 7f2ff989b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2ff40cf5f0 0x7f2ff406c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:33.533 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.530+0000 7f2ff989b640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f2ff4070c10 0x7f2ff40cd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:33.533 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.530+0000 7f2ff989b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ff4161740 con 0x7f2ff40cf5f0 2023-10-14T09:37:33.533 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.530+0000 7f2ff989b640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ff406c680 con 0x7f2ff4070c10 2023-10-14T09:37:33.533 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.530+0000 7f2ff989b640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff40cdbd0 con 0x7f2ff4070830 2023-10-14T09:37:33.533 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.530+0000 7f2febfff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2ff40cf5f0 0x7f2ff406c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:33.534 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.530+0000 7f2febfff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2ff40cf5f0 0x7f2ff406c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33042/0 (socket says 172.21.15.102:33042) 2023-10-14T09:37:33.534 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.530+0000 7f2febfff640 1 -- 172.21.15.102:0/650130494 learned_addr learned my addr 172.21.15.102:0/650130494 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:33.534 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.530+0000 7f2ff37fe640 1 --2- 172.21.15.102:0/650130494 >> v2:172.21.15.129:3300/0 conn(0x7f2ff4070c10 0x7f2ff40cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:33.534 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.530+0000 7f2febfff640 1 -- 172.21.15.102:0/650130494 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2ff4070830 msgr2=0x7f2ff406d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:33.534 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.530+0000 7f2febfff640 1 --2- 172.21.15.102:0/650130494 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2ff4070830 0x7f2ff406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:33.535 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.530+0000 7f2febfff640 1 -- 172.21.15.102:0/650130494 >> v2:172.21.15.129:3300/0 conn(0x7f2ff4070c10 msgr2=0x7f2ff40cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:33.535 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.530+0000 7f2febfff640 1 --2- 172.21.15.102:0/650130494 >> v2:172.21.15.129:3300/0 conn(0x7f2ff4070c10 0x7f2ff40cd690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:33.535 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.530+0000 7f2febfff640 1 -- 172.21.15.102:0/650130494 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff406b0f0 con 0x7f2ff40cf5f0 2023-10-14T09:37:33.536 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.532+0000 7f2febfff640 1 --2- 172.21.15.102:0/650130494 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ff40cf5f0 0x7f2ff406c140 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2ff406d900 tx=0x7f2fdc02b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4092d643ce17c2d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:33.537 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.532+0000 7f2ff27fc640 1 -- 172.21.15.102:0/650130494 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc031740 con 0x7f2ff40cf5f0 2023-10-14T09:37:33.537 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.532+0000 7f2ff27fc640 1 -- 172.21.15.102:0/650130494 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fdc0318a0 con 0x7f2ff40cf5f0 2023-10-14T09:37:33.537 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.532+0000 7f2ff27fc640 1 -- 172.21.15.102:0/650130494 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc031c30 con 0x7f2ff40cf5f0 2023-10-14T09:37:33.537 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.533+0000 7f2ff989b640 1 -- 172.21.15.102:0/650130494 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ff40cf5f0 msgr2=0x7f2ff406c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:33.537 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.533+0000 7f2ff989b640 1 --2- 172.21.15.102:0/650130494 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ff40cf5f0 0x7f2ff406c140 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2ff406d900 tx=0x7f2fdc02b7e0 comp rx=0 tx=0).stop 2023-10-14T09:37:33.538 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.533+0000 7f2ff989b640 1 -- 172.21.15.102:0/650130494 shutdown_connections 2023-10-14T09:37:33.538 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.533+0000 7f2ff989b640 1 --2- 172.21.15.102:0/650130494 >> v2:172.21.15.129:3300/0 conn(0x7f2ff4070c10 0x7f2ff40cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:33.538 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.533+0000 7f2ff989b640 1 --2- 172.21.15.102:0/650130494 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ff40cf5f0 0x7f2ff406c140 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:33.538 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.533+0000 7f2ff989b640 1 --2- 172.21.15.102:0/650130494 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2ff4070830 0x7f2ff406d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:33.538 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.533+0000 7f2ff989b640 1 -- 172.21.15.102:0/650130494 >> 172.21.15.102:0/650130494 conn(0x7f2ff40cfac0 msgr2=0x7f2ff40cfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:33.539 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.533+0000 7f2ff989b640 1 -- 172.21.15.102:0/650130494 shutdown_connections 2023-10-14T09:37:33.539 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.533+0000 7f2ff989b640 1 -- 172.21.15.102:0/650130494 wait complete. 2023-10-14T09:37:33.539 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.535+0000 7f2ff989b640 1 Processor -- start 2023-10-14T09:37:33.539 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.535+0000 7f2ff989b640 1 -- start start 2023-10-14T09:37:33.541 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.536+0000 7f2ff989b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2ff4070830 0x7f2ff415e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:33.541 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.536+0000 7f2ff989b640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2ff4070c10 0x7f2ff41f5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:33.542 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.536+0000 7f2ff989b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ff40cf5f0 0x7f2ff40afe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:33.542 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.536+0000 7f2ff989b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff40afa30 con 0x7f2ff40cf5f0 2023-10-14T09:37:33.542 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.536+0000 7f2ff989b640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff41f6dd0 con 0x7f2ff4070830 2023-10-14T09:37:33.542 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.536+0000 7f2ff989b640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff415e9a0 con 0x7f2ff4070c10 2023-10-14T09:37:33.542 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.536+0000 7f2ff37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ff40cf5f0 0x7f2ff40afe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:33.543 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.536+0000 7f2ff37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ff40cf5f0 0x7f2ff40afe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33054/0 (socket says 172.21.15.102:33054) 2023-10-14T09:37:33.543 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.536+0000 7f2ff37fe640 1 -- 172.21.15.102:0/1357383171 learned_addr learned my addr 172.21.15.102:0/1357383171 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:33.543 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.536+0000 7f2ff2ffd640 1 --2- 172.21.15.102:0/1357383171 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2ff4070830 0x7f2ff415e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:33.543 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.537+0000 7f2febfff640 1 --2- 172.21.15.102:0/1357383171 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2ff4070c10 0x7f2ff41f5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:33.543 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.537+0000 7f2ff37fe640 1 -- 172.21.15.102:0/1357383171 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2ff4070c10 msgr2=0x7f2ff41f5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:33.544 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.537+0000 7f2ff37fe640 1 --2- 172.21.15.102:0/1357383171 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2ff4070c10 0x7f2ff41f5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:33.544 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.537+0000 7f2ff37fe640 1 -- 172.21.15.102:0/1357383171 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2ff4070830 msgr2=0x7f2ff415e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:33.544 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.537+0000 7f2ff37fe640 1 --2- 172.21.15.102:0/1357383171 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2ff4070830 0x7f2ff415e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:33.544 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.537+0000 7f2ff37fe640 1 -- 172.21.15.102:0/1357383171 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fdc0094d0 con 0x7f2ff40cf5f0 2023-10-14T09:37:33.544 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.537+0000 7f2ff37fe640 1 --2- 172.21.15.102:0/1357383171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ff40cf5f0 0x7f2ff40afe50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2fec00cc90 tx=0x7f2fec00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:33.544 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.537+0000 7f2ff0ff9640 1 -- 172.21.15.102:0/1357383171 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fec00cea0 con 0x7f2ff40cf5f0 2023-10-14T09:37:33.545 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.537+0000 7f2ff0ff9640 1 -- 172.21.15.102:0/1357383171 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fec003990 con 0x7f2ff40cf5f0 2023-10-14T09:37:33.545 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.537+0000 7f2ff989b640 1 -- 172.21.15.102:0/1357383171 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ff41f6810 con 0x7f2ff40cf5f0 2023-10-14T09:37:33.545 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.537+0000 7f2ff0ff9640 1 -- 172.21.15.102:0/1357383171 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fec003d20 con 0x7f2ff40cf5f0 2023-10-14T09:37:33.545 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.537+0000 7f2ff989b640 1 -- 172.21.15.102:0/1357383171 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ff40af650 con 0x7f2ff40cf5f0 2023-10-14T09:37:33.545 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.538+0000 7f2ff989b640 1 -- 172.21.15.102:0/1357383171 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ff40afb70 con 0x7f2ff40cf5f0 2023-10-14T09:37:33.546 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.539+0000 7f2ff0ff9640 1 -- 172.21.15.102:0/1357383171 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2fec003e80 con 0x7f2ff40cf5f0 2023-10-14T09:37:33.546 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.540+0000 7f2ff0ff9640 1 --2- 172.21.15.102:0/1357383171 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2fd406ae70 0x7f2fd406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:33.547 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.540+0000 7f2ff0ff9640 1 -- 172.21.15.102:0/1357383171 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2fec089a10 con 0x7f2ff40cf5f0 2023-10-14T09:37:33.547 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.540+0000 7f2ff2ffd640 1 --2- 172.21.15.102:0/1357383171 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2fd406ae70 0x7f2fd406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:33.547 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.541+0000 7f2ff2ffd640 1 --2- 172.21.15.102:0/1357383171 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2fd406ae70 0x7f2fd406d330 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2ff40b5800 tx=0x7f2fe4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:33.547 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.544+0000 7f2ff0ff9640 1 -- 172.21.15.102:0/1357383171 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2ff40afb70 con 0x7f2ff40cf5f0 2023-10-14T09:37:33.727 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.726+0000 7f2ff989b640 1 -- 172.21.15.102:0/1357383171 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2ff40afb70 con 0x7f2ff40cf5f0 2023-10-14T09:37:33.728 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.727+0000 7f2ff0ff9640 1 -- 172.21.15.102:0/1357383171 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2ff40afb70 con 0x7f2ff40cf5f0 2023-10-14T09:37:33.729 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2023-10-14T09:37:33.732 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.729+0000 7f2ff989b640 1 -- 172.21.15.102:0/1357383171 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2fd406ae70 msgr2=0x7f2fd406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:33.732 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.729+0000 7f2ff989b640 1 --2- 172.21.15.102:0/1357383171 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2fd406ae70 0x7f2fd406d330 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2ff40b5800 tx=0x7f2fe4008040 comp rx=0 tx=0).stop 2023-10-14T09:37:33.732 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.729+0000 7f2ff989b640 1 -- 172.21.15.102:0/1357383171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ff40cf5f0 msgr2=0x7f2ff40afe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:33.732 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.729+0000 7f2ff989b640 1 --2- 172.21.15.102:0/1357383171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ff40cf5f0 0x7f2ff40afe50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2fec00cc90 tx=0x7f2fec00a5c0 comp rx=0 tx=0).stop 2023-10-14T09:37:33.733 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.729+0000 7f2ff989b640 1 -- 172.21.15.102:0/1357383171 shutdown_connections 2023-10-14T09:37:33.733 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.729+0000 7f2ff989b640 1 --2- 172.21.15.102:0/1357383171 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2fd406ae70 0x7f2fd406d330 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:33.733 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.729+0000 7f2ff989b640 1 --2- 172.21.15.102:0/1357383171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ff40cf5f0 0x7f2ff40afe50 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:33.733 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.729+0000 7f2ff989b640 1 --2- 172.21.15.102:0/1357383171 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2ff4070c10 0x7f2ff41f5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:33.734 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.729+0000 7f2ff989b640 1 --2- 172.21.15.102:0/1357383171 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2ff4070830 0x7f2ff415e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:33.734 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.729+0000 7f2ff989b640 1 -- 172.21.15.102:0/1357383171 >> 172.21.15.102:0/1357383171 conn(0x7f2ff40cfac0 msgr2=0x7f2ff40ad380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:33.734 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.730+0000 7f2ff989b640 1 -- 172.21.15.102:0/1357383171 shutdown_connections 2023-10-14T09:37:33.734 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.730+0000 7f2ff989b640 1 -- 172.21.15.102:0/1357383171 wait complete. 2023-10-14T09:37:33.749 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T09:37:33.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.957+0000 7f0186d6c640 1 Processor -- start 2023-10-14T09:37:33.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.957+0000 7f0186d6c640 1 -- start start 2023-10-14T09:37:33.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.958+0000 7f0186d6c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f018015d410 0x7f01800d1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:33.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.958+0000 7f0186d6c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01800b5d90 con 0x7f01800cd260 2023-10-14T09:37:33.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.958+0000 7f0186d6c640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0180160fc0 con 0x7f018015d030 2023-10-14T09:37:33.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.958+0000 7f0186d6c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01800d2b50 con 0x7f018015d410 2023-10-14T09:37:33.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.959+0000 7f017ffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f018015d410 0x7f01800d1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:33.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.959+0000 7f017ffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f018015d410 0x7f01800d1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33064/0 (socket says 172.21.15.102:33064) 2023-10-14T09:37:33.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.959+0000 7f017ffff640 1 -- 172.21.15.102:0/4125243805 learned_addr learned my addr 172.21.15.102:0/4125243805 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:33.962 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.959+0000 7f0185309640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f01800cd260 0x7f01800b4720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:50334/0 (socket says 172.21.15.102:50334) 2023-10-14T09:37:33.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.959+0000 7f017ffff640 1 -- 172.21.15.102:0/4125243805 >> v1:172.21.15.129:6789/0 conn(0x7f018015d030 legacy=0x7f0180161450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:33.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.959+0000 7f017f7fe640 1 -- 172.21.15.102:0/4125243805 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2375712143 0 0) 0x7f01800b5d90 con 0x7f01800cd260 2023-10-14T09:37:33.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.959+0000 7f017ffff640 1 -- 172.21.15.102:0/4125243805 >> v1:172.21.15.102:6789/0 conn(0x7f01800cd260 legacy=0x7f01800b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:33.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.959+0000 7f017ffff640 1 -- 172.21.15.102:0/4125243805 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01800d25d0 con 0x7f018015d410 2023-10-14T09:37:33.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.960+0000 7f017ffff640 1 --2- 172.21.15.102:0/4125243805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f018015d410 0x7f01800d1630 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f016c009870 tx=0x7f016c02bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=620765d11f3f0e36 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:33.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.961+0000 7f017f7fe640 1 -- 172.21.15.102:0/4125243805 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016c02d870 con 0x7f018015d410 2023-10-14T09:37:33.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.961+0000 7f017f7fe640 1 -- 172.21.15.102:0/4125243805 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016c02d9d0 con 0x7f018015d410 2023-10-14T09:37:33.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.961+0000 7f017f7fe640 1 -- 172.21.15.102:0/4125243805 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016c02dd60 con 0x7f018015d410 2023-10-14T09:37:33.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.961+0000 7f0186d6c640 1 -- 172.21.15.102:0/4125243805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f018015d410 msgr2=0x7f01800d1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:33.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.961+0000 7f0186d6c640 1 --2- 172.21.15.102:0/4125243805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f018015d410 0x7f01800d1630 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f016c009870 tx=0x7f016c02bab0 comp rx=0 tx=0).stop 2023-10-14T09:37:33.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.961+0000 7f0186d6c640 1 -- 172.21.15.102:0/4125243805 shutdown_connections 2023-10-14T09:37:33.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.961+0000 7f0186d6c640 1 --2- 172.21.15.102:0/4125243805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f018015d410 0x7f01800d1630 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:33.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.961+0000 7f0186d6c640 1 -- 172.21.15.102:0/4125243805 >> 172.21.15.102:0/4125243805 conn(0x7f01800cf720 msgr2=0x7f01800cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:33.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.961+0000 7f0186d6c640 1 -- 172.21.15.102:0/4125243805 shutdown_connections 2023-10-14T09:37:33.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.961+0000 7f0186d6c640 1 -- 172.21.15.102:0/4125243805 wait complete. 2023-10-14T09:37:33.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.963+0000 7f0186d6c640 1 Processor -- start 2023-10-14T09:37:33.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.963+0000 7f0186d6c640 1 -- start start 2023-10-14T09:37:33.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.964+0000 7f0186d6c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01800cd260 0x7f01801f66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:33.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.964+0000 7f0186d6c640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f018015d030 0x7f01800b75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:33.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.964+0000 7f0186d6c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f018015d410 0x7f01800c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:33.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.964+0000 7f0186d6c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f018015a730 con 0x7f01800cd260 2023-10-14T09:37:33.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.964+0000 7f0186d6c640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01801f6c00 con 0x7f018015d410 2023-10-14T09:37:33.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.964+0000 7f0186d6c640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f018015e6e0 con 0x7f018015d030 2023-10-14T09:37:33.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.964+0000 7f0184b08640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01800cd260 0x7f01801f66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:33.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.964+0000 7f0184b08640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01800cd260 0x7f01801f66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33080/0 (socket says 172.21.15.102:33080) 2023-10-14T09:37:33.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.964+0000 7f0184b08640 1 -- 172.21.15.102:0/2455161919 learned_addr learned my addr 172.21.15.102:0/2455161919 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:33.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.965+0000 7f0184b08640 1 -- 172.21.15.102:0/2455161919 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f018015d030 msgr2=0x7f01800b75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:33.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.965+0000 7f0184b08640 1 --2- 172.21.15.102:0/2455161919 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f018015d030 0x7f01800b75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:33.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.965+0000 7f0184b08640 1 -- 172.21.15.102:0/2455161919 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f018015d410 msgr2=0x7f01800c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:33.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.965+0000 7f0184b08640 1 --2- 172.21.15.102:0/2455161919 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f018015d410 0x7f01800c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:33.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.965+0000 7f0184b08640 1 -- 172.21.15.102:0/2455161919 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f016c0094d0 con 0x7f01800cd260 2023-10-14T09:37:33.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.965+0000 7f0184b08640 1 --2- 172.21.15.102:0/2455161919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01800cd260 0x7f01801f66c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f017400c450 tx=0x7f017400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:33.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.965+0000 7f017d7fa640 1 -- 172.21.15.102:0/2455161919 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01740052d0 con 0x7f01800cd260 2023-10-14T09:37:33.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.965+0000 7f017d7fa640 1 -- 172.21.15.102:0/2455161919 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0174005430 con 0x7f01800cd260 2023-10-14T09:37:33.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.965+0000 7f0186d6c640 1 -- 172.21.15.102:0/2455161919 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0180154b30 con 0x7f01800cd260 2023-10-14T09:37:33.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.965+0000 7f017d7fa640 1 -- 172.21.15.102:0/2455161919 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0174012870 con 0x7f01800cd260 2023-10-14T09:37:33.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.965+0000 7f0186d6c640 1 -- 172.21.15.102:0/2455161919 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f018015a500 con 0x7f01800cd260 2023-10-14T09:37:33.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.967+0000 7f0186d6c640 1 -- 172.21.15.102:0/2455161919 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f018004e160 con 0x7f01800cd260 2023-10-14T09:37:33.974 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.967+0000 7f017d7fa640 1 -- 172.21.15.102:0/2455161919 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f01740129d0 con 0x7f01800cd260 2023-10-14T09:37:33.975 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.969+0000 7f017d7fa640 1 --2- 172.21.15.102:0/2455161919 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f016406ae70 0x7f016406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:33.975 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.969+0000 7f017d7fa640 1 -- 172.21.15.102:0/2455161919 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0174089160 con 0x7f01800cd260 2023-10-14T09:37:33.975 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.969+0000 7f017ffff640 1 --2- 172.21.15.102:0/2455161919 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f016406ae70 0x7f016406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:33.975 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.970+0000 7f017ffff640 1 --2- 172.21.15.102:0/2455161919 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f016406ae70 0x7f016406d330 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f016c036000 tx=0x7f016c039040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:33.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:33.974+0000 7f017d7fa640 1 -- 172.21.15.102:0/2455161919 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0174054210 con 0x7f01800cd260 2023-10-14T09:37:34.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.151+0000 7f0186d6c640 1 -- 172.21.15.102:0/2455161919 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f01801606e0 con 0x7f01800cd260 2023-10-14T09:37:34.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.152+0000 7f017d7fa640 1 -- 172.21.15.102:0/2455161919 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0174057830 con 0x7f01800cd260 2023-10-14T09:37:34.155 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2023-10-14T09:37:34.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.155+0000 7f0186d6c640 1 -- 172.21.15.102:0/2455161919 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f016406ae70 msgr2=0x7f016406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:34.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.155+0000 7f0186d6c640 1 --2- 172.21.15.102:0/2455161919 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f016406ae70 0x7f016406d330 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f016c036000 tx=0x7f016c039040 comp rx=0 tx=0).stop 2023-10-14T09:37:34.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.155+0000 7f0186d6c640 1 -- 172.21.15.102:0/2455161919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01800cd260 msgr2=0x7f01801f66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:34.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.155+0000 7f0186d6c640 1 --2- 172.21.15.102:0/2455161919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01800cd260 0x7f01801f66c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f017400c450 tx=0x7f017400c910 comp rx=0 tx=0).stop 2023-10-14T09:37:34.158 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.155+0000 7f0186d6c640 1 -- 172.21.15.102:0/2455161919 shutdown_connections 2023-10-14T09:37:34.158 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.155+0000 7f0186d6c640 1 --2- 172.21.15.102:0/2455161919 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f016406ae70 0x7f016406d330 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:34.158 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.155+0000 7f0186d6c640 1 --2- 172.21.15.102:0/2455161919 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f018015d410 0x7f01800c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:34.158 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.155+0000 7f0186d6c640 1 --2- 172.21.15.102:0/2455161919 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f018015d030 0x7f01800b75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:34.158 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.155+0000 7f0186d6c640 1 --2- 172.21.15.102:0/2455161919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01800cd260 0x7f01801f66c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:34.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.155+0000 7f0186d6c640 1 -- 172.21.15.102:0/2455161919 >> 172.21.15.102:0/2455161919 conn(0x7f01800cf720 msgr2=0x7f018015bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:34.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.155+0000 7f0186d6c640 1 -- 172.21.15.102:0/2455161919 shutdown_connections 2023-10-14T09:37:34.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.155+0000 7f0186d6c640 1 -- 172.21.15.102:0/2455161919 wait complete. 2023-10-14T09:37:34.174 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T09:37:34.382 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.380+0000 7fd8320b4640 1 Processor -- start 2023-10-14T09:37:34.382 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.380+0000 7fd8320b4640 1 -- start start 2023-10-14T09:37:34.384 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.381+0000 7fd8320b4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd82c159ab0 0x7fd82c0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:34.384 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.381+0000 7fd8320b4640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd82c159e90 0x7fd82c06fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:34.384 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.381+0000 7fd8320b4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd82c0cd1f0 con 0x7fd82c06c140 2023-10-14T09:37:34.384 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.381+0000 7fd8320b4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd82c15d890 con 0x7fd82c159ab0 2023-10-14T09:37:34.384 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.381+0000 7fd8320b4640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c0cd4d0 con 0x7fd82c159e90 2023-10-14T09:37:34.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.382+0000 7fd82b7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd82c159ab0 0x7fd82c0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:34.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.382+0000 7fd82b7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd82c159ab0 0x7fd82c0ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33090/0 (socket says 172.21.15.102:33090) 2023-10-14T09:37:34.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.382+0000 7fd82b7fe640 1 -- 172.21.15.102:0/549696595 learned_addr learned my addr 172.21.15.102:0/549696595 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:34.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.382+0000 7fd823fff640 1 --2- 172.21.15.102:0/549696595 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd82c159e90 0x7fd82c06fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:34.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.382+0000 7fd82b7fe640 1 -- 172.21.15.102:0/549696595 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd82c159e90 msgr2=0x7fd82c06fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:34.386 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.382+0000 7fd82b7fe640 1 --2- 172.21.15.102:0/549696595 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd82c159e90 0x7fd82c06fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:34.386 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.382+0000 7fd82b7fe640 1 -- 172.21.15.102:0/549696595 >> v1:172.21.15.102:6789/0 conn(0x7fd82c06c140 legacy=0x7fd82c15dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:34.386 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.382+0000 7fd82b7fe640 1 -- 172.21.15.102:0/549696595 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82c0cd7b0 con 0x7fd82c159ab0 2023-10-14T09:37:34.387 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.383+0000 7fd82b7fe640 1 --2- 172.21.15.102:0/549696595 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd82c159ab0 0x7fd82c0ce370 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd81c0098a0 tx=0x7fd81c02b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b3fd28969716e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:34.388 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.383+0000 7fd82affd640 1 -- 172.21.15.102:0/549696595 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81c032640 con 0x7fd82c159ab0 2023-10-14T09:37:34.388 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.383+0000 7fd82affd640 1 -- 172.21.15.102:0/549696595 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd81c02e070 con 0x7fd82c159ab0 2023-10-14T09:37:34.388 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.383+0000 7fd82affd640 1 -- 172.21.15.102:0/549696595 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81c0329c0 con 0x7fd82c159ab0 2023-10-14T09:37:34.388 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.384+0000 7fd8320b4640 1 -- 172.21.15.102:0/549696595 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd82c159ab0 msgr2=0x7fd82c0ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:34.389 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.384+0000 7fd8320b4640 1 --2- 172.21.15.102:0/549696595 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd82c159ab0 0x7fd82c0ce370 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd81c0098a0 tx=0x7fd81c02b850 comp rx=0 tx=0).stop 2023-10-14T09:37:34.389 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.384+0000 7fd8320b4640 1 -- 172.21.15.102:0/549696595 shutdown_connections 2023-10-14T09:37:34.389 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.384+0000 7fd8320b4640 1 --2- 172.21.15.102:0/549696595 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd82c159e90 0x7fd82c06fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:34.389 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.384+0000 7fd8320b4640 1 --2- 172.21.15.102:0/549696595 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd82c159ab0 0x7fd82c0ce370 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:34.389 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.384+0000 7fd8320b4640 1 -- 172.21.15.102:0/549696595 >> 172.21.15.102:0/549696595 conn(0x7fd82c0ce9b0 msgr2=0x7fd82c0cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:34.390 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.384+0000 7fd8320b4640 1 -- 172.21.15.102:0/549696595 shutdown_connections 2023-10-14T09:37:34.390 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.384+0000 7fd8320b4640 1 -- 172.21.15.102:0/549696595 wait complete. 2023-10-14T09:37:34.390 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.386+0000 7fd8320b4640 1 Processor -- start 2023-10-14T09:37:34.391 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.386+0000 7fd8320b4640 1 -- start start 2023-10-14T09:37:34.392 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.387+0000 7fd8320b4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd82c06c140 0x7fd82c156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:34.393 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.387+0000 7fd8320b4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd82c159ab0 0x7fd82c0af360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:34.393 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.387+0000 7fd8320b4640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd82c159e90 0x7fd82c15ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:34.393 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.387+0000 7fd8320b4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c1447f0 con 0x7fd82c06c140 2023-10-14T09:37:34.393 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.387+0000 7fd8320b4640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c144a40 con 0x7fd82c159ab0 2023-10-14T09:37:34.394 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.387+0000 7fd8320b4640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c144d20 con 0x7fd82c159e90 2023-10-14T09:37:34.394 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.387+0000 7fd82b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd82c06c140 0x7fd82c156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:34.394 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.387+0000 7fd82b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd82c06c140 0x7fd82c156da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33096/0 (socket says 172.21.15.102:33096) 2023-10-14T09:37:34.394 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.387+0000 7fd82b7fe640 1 -- 172.21.15.102:0/517233810 learned_addr learned my addr 172.21.15.102:0/517233810 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:34.394 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.387+0000 7fd82b7fe640 1 -- 172.21.15.102:0/517233810 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd82c159e90 msgr2=0x7fd82c15ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:34.395 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.387+0000 7fd82b7fe640 1 --2- 172.21.15.102:0/517233810 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd82c159e90 0x7fd82c15ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:34.395 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.387+0000 7fd82b7fe640 1 -- 172.21.15.102:0/517233810 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd82c159ab0 msgr2=0x7fd82c0af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:34.395 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.387+0000 7fd82b7fe640 1 --2- 172.21.15.102:0/517233810 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd82c159ab0 0x7fd82c0af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:34.395 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.387+0000 7fd82b7fe640 1 -- 172.21.15.102:0/517233810 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd81c0094d0 con 0x7fd82c06c140 2023-10-14T09:37:34.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.388+0000 7fd82b7fe640 1 --2- 172.21.15.102:0/517233810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd82c06c140 0x7fd82c156da0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd81c000c00 tx=0x7fd81c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:34.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.388+0000 7fd828ff9640 1 -- 172.21.15.102:0/517233810 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81c03b800 con 0x7fd82c06c140 2023-10-14T09:37:34.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.388+0000 7fd828ff9640 1 -- 172.21.15.102:0/517233810 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd81c03b980 con 0x7fd82c06c140 2023-10-14T09:37:34.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.388+0000 7fd828ff9640 1 -- 172.21.15.102:0/517233810 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81c03bd30 con 0x7fd82c06c140 2023-10-14T09:37:34.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.388+0000 7fd8320b4640 1 -- 172.21.15.102:0/517233810 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd82c145000 con 0x7fd82c06c140 2023-10-14T09:37:34.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.388+0000 7fd8320b4640 1 -- 172.21.15.102:0/517233810 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd82c15d380 con 0x7fd82c06c140 2023-10-14T09:37:34.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.389+0000 7fd8320b4640 1 -- 172.21.15.102:0/517233810 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd82c04e160 con 0x7fd82c06c140 2023-10-14T09:37:34.398 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.390+0000 7fd828ff9640 1 -- 172.21.15.102:0/517233810 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd81c04d3f0 con 0x7fd82c06c140 2023-10-14T09:37:34.399 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.391+0000 7fd828ff9640 1 --2- 172.21.15.102:0/517233810 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd80c06ae70 0x7fd80c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:34.399 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.391+0000 7fd828ff9640 1 -- 172.21.15.102:0/517233810 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd81c0ab260 con 0x7fd82c06c140 2023-10-14T09:37:34.400 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.392+0000 7fd823fff640 1 --2- 172.21.15.102:0/517233810 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd80c06ae70 0x7fd80c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:34.400 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.392+0000 7fd823fff640 1 --2- 172.21.15.102:0/517233810 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd80c06ae70 0x7fd80c06d330 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd814006fd0 tx=0x7fd814008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:34.400 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.396+0000 7fd828ff9640 1 -- 172.21.15.102:0/517233810 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd81c076270 con 0x7fd82c06c140 2023-10-14T09:37:34.572 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.570+0000 7fd8320b4640 1 -- 172.21.15.102:0/517233810 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd82c0ccb60 con 0x7fd82c06c140 2023-10-14T09:37:34.572 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.571+0000 7fd828ff9640 1 -- 172.21.15.102:0/517233810 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd81c079890 con 0x7fd82c06c140 2023-10-14T09:37:34.573 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2023-10-14T09:37:34.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.573+0000 7fd8320b4640 1 -- 172.21.15.102:0/517233810 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd80c06ae70 msgr2=0x7fd80c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:34.576 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.573+0000 7fd8320b4640 1 --2- 172.21.15.102:0/517233810 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd80c06ae70 0x7fd80c06d330 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd814006fd0 tx=0x7fd814008040 comp rx=0 tx=0).stop 2023-10-14T09:37:34.576 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.573+0000 7fd8320b4640 1 -- 172.21.15.102:0/517233810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd82c06c140 msgr2=0x7fd82c156da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:34.576 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.573+0000 7fd8320b4640 1 --2- 172.21.15.102:0/517233810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd82c06c140 0x7fd82c156da0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd81c000c00 tx=0x7fd81c0046c0 comp rx=0 tx=0).stop 2023-10-14T09:37:34.576 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.573+0000 7fd8320b4640 1 -- 172.21.15.102:0/517233810 shutdown_connections 2023-10-14T09:37:34.576 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.573+0000 7fd8320b4640 1 --2- 172.21.15.102:0/517233810 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd80c06ae70 0x7fd80c06d330 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:34.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.573+0000 7fd8320b4640 1 --2- 172.21.15.102:0/517233810 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd82c159e90 0x7fd82c15ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:34.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.573+0000 7fd8320b4640 1 --2- 172.21.15.102:0/517233810 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd82c159ab0 0x7fd82c0af360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:34.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.573+0000 7fd8320b4640 1 --2- 172.21.15.102:0/517233810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd82c06c140 0x7fd82c156da0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:34.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.573+0000 7fd8320b4640 1 -- 172.21.15.102:0/517233810 >> 172.21.15.102:0/517233810 conn(0x7fd82c0ce9b0 msgr2=0x7fd82c158d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:34.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.574+0000 7fd8320b4640 1 -- 172.21.15.102:0/517233810 shutdown_connections 2023-10-14T09:37:34.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.574+0000 7fd8320b4640 1 -- 172.21.15.102:0/517233810 wait complete. 2023-10-14T09:37:34.594 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:37:34.805 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.804+0000 7f27fdfe9640 1 Processor -- start 2023-10-14T09:37:34.806 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.804+0000 7f27fdfe9640 1 -- start start 2023-10-14T09:37:34.808 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.805+0000 7f27fdfe9640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f27f815c9f0 0x7f27f80c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:34.808 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.805+0000 7f27fdfe9640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f27f815dde0 0x7f27f80ac890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:34.808 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.805+0000 7f27fdfe9640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f8160a90 con 0x7f27f80c9230 2023-10-14T09:37:34.809 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.805+0000 7f27fdfe9640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f80cdec0 con 0x7f27f815dde0 2023-10-14T09:37:34.809 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.805+0000 7f27fdfe9640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f80cd900 con 0x7f27f815c9f0 2023-10-14T09:37:34.809 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.805+0000 7f27fd7e8640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f27f815dde0 0x7f27f80ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:34.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.806+0000 7f27fd7e8640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f27f815dde0 0x7f27f80ac890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33098/0 (socket says 172.21.15.102:33098) 2023-10-14T09:37:34.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.806+0000 7f27fd7e8640 1 -- 172.21.15.102:0/1881938056 learned_addr learned my addr 172.21.15.102:0/1881938056 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:34.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.806+0000 7f27f7fff640 1 --1- 172.21.15.102:0/1881938056 >> v1:172.21.15.102:6789/0 conn(0x7f27f80c9230 0x7f27f80709e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:50362/0 (socket says 172.21.15.102:50362) 2023-10-14T09:37:34.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.806+0000 7f27fcfe7640 1 --2- 172.21.15.102:0/1881938056 >> v2:172.21.15.129:3300/0 conn(0x7f27f815c9f0 0x7f27f80c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:34.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.806+0000 7f27fd7e8640 1 -- 172.21.15.102:0/1881938056 >> v2:172.21.15.129:3300/0 conn(0x7f27f815c9f0 msgr2=0x7f27f80c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:34.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.806+0000 7f27fd7e8640 1 --2- 172.21.15.102:0/1881938056 >> v2:172.21.15.129:3300/0 conn(0x7f27f815c9f0 0x7f27f80c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:34.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.806+0000 7f27fd7e8640 1 -- 172.21.15.102:0/1881938056 >> v1:172.21.15.102:6789/0 conn(0x7f27f80c9230 legacy=0x7f27f80709e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:34.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.806+0000 7f27fd7e8640 1 -- 172.21.15.102:0/1881938056 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f80cdbe0 con 0x7f27f815dde0 2023-10-14T09:37:34.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.807+0000 7f27fd7e8640 1 --2- 172.21.15.102:0/1881938056 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27f815dde0 0x7f27f80ac890 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f27f80ad4e0 tx=0x7f27f002bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f5d7d4be85264e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:34.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.807+0000 7f27f77fe640 1 -- 172.21.15.102:0/1881938056 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f002cb10 con 0x7f27f815dde0 2023-10-14T09:37:34.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.807+0000 7f27f77fe640 1 -- 172.21.15.102:0/1881938056 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f002cc70 con 0x7f27f815dde0 2023-10-14T09:37:34.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.807+0000 7f27f77fe640 1 -- 172.21.15.102:0/1881938056 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f00343f0 con 0x7f27f815dde0 2023-10-14T09:37:34.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.808+0000 7f27fdfe9640 1 -- 172.21.15.102:0/1881938056 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27f815dde0 msgr2=0x7f27f80ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:34.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.808+0000 7f27fdfe9640 1 --2- 172.21.15.102:0/1881938056 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27f815dde0 0x7f27f80ac890 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f27f80ad4e0 tx=0x7f27f002bf70 comp rx=0 tx=0).stop 2023-10-14T09:37:34.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.808+0000 7f27fdfe9640 1 -- 172.21.15.102:0/1881938056 shutdown_connections 2023-10-14T09:37:34.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.808+0000 7f27fdfe9640 1 --2- 172.21.15.102:0/1881938056 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27f815dde0 0x7f27f80ac890 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:34.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.808+0000 7f27fdfe9640 1 --2- 172.21.15.102:0/1881938056 >> v2:172.21.15.129:3300/0 conn(0x7f27f815c9f0 0x7f27f80c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:34.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.808+0000 7f27fdfe9640 1 -- 172.21.15.102:0/1881938056 >> 172.21.15.102:0/1881938056 conn(0x7f27f80ce6a0 msgr2=0x7f27f80ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:34.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.808+0000 7f27fdfe9640 1 -- 172.21.15.102:0/1881938056 shutdown_connections 2023-10-14T09:37:34.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.808+0000 7f27fdfe9640 1 -- 172.21.15.102:0/1881938056 wait complete. 2023-10-14T09:37:34.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.810+0000 7f27fdfe9640 1 Processor -- start 2023-10-14T09:37:34.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.810+0000 7f27fdfe9640 1 -- start start 2023-10-14T09:37:34.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.811+0000 7f27fdfe9640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f27f80c9230 0x7f27f80c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:34.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.811+0000 7f27fdfe9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27f815c9f0 0x7f27f80b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:34.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.811+0000 7f27fdfe9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f27f815dde0 0x7f27f806c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:34.818 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.811+0000 7f27fdfe9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f80b10a0 con 0x7f27f815c9f0 2023-10-14T09:37:34.818 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.811+0000 7f27fdfe9640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f806a590 con 0x7f27f815dde0 2023-10-14T09:37:34.818 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.811+0000 7f27fdfe9640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f80b0b20 con 0x7f27f80c9230 2023-10-14T09:37:34.818 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.811+0000 7f27f7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27f815c9f0 0x7f27f80b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:34.819 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.811+0000 7f27f7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27f815c9f0 0x7f27f80b05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33114/0 (socket says 172.21.15.102:33114) 2023-10-14T09:37:34.819 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.811+0000 7f27f7fff640 1 -- 172.21.15.102:0/1382472333 learned_addr learned my addr 172.21.15.102:0/1382472333 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:34.819 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.811+0000 7f27fcfe7640 1 --2- 172.21.15.102:0/1382472333 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f27f80c9230 0x7f27f80c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:34.819 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.811+0000 7f27fd7e8640 1 --2- 172.21.15.102:0/1382472333 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f27f815dde0 0x7f27f806c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:34.819 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.811+0000 7f27f7fff640 1 -- 172.21.15.102:0/1382472333 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f27f80c9230 msgr2=0x7f27f80c7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:34.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.811+0000 7f27f7fff640 1 --2- 172.21.15.102:0/1382472333 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f27f80c9230 0x7f27f80c7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:34.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.811+0000 7f27f7fff640 1 -- 172.21.15.102:0/1382472333 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f27f815dde0 msgr2=0x7f27f806c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:34.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.811+0000 7f27f7fff640 1 --2- 172.21.15.102:0/1382472333 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f27f815dde0 0x7f27f806c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:34.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.811+0000 7f27f7fff640 1 -- 172.21.15.102:0/1382472333 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f0009b30 con 0x7f27f815c9f0 2023-10-14T09:37:34.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.811+0000 7f27fcfe7640 1 --2- 172.21.15.102:0/1382472333 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f27f80c9230 0x7f27f80c7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:34.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.811+0000 7f27fd7e8640 1 --2- 172.21.15.102:0/1382472333 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f27f815dde0 0x7f27f806c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:34.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.812+0000 7f27f7fff640 1 --2- 172.21.15.102:0/1382472333 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27f815c9f0 0x7f27f80b05e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f27e400c4d0 tx=0x7f27e400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:34.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.812+0000 7f27f57fa640 1 -- 172.21.15.102:0/1382472333 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e4007480 con 0x7f27f815c9f0 2023-10-14T09:37:34.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.812+0000 7f27f57fa640 1 -- 172.21.15.102:0/1382472333 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e40075e0 con 0x7f27f815c9f0 2023-10-14T09:37:34.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.812+0000 7f27f57fa640 1 -- 172.21.15.102:0/1382472333 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e40049e0 con 0x7f27f815c9f0 2023-10-14T09:37:34.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.812+0000 7f27fdfe9640 1 -- 172.21.15.102:0/1382472333 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f80b0dc0 con 0x7f27f815c9f0 2023-10-14T09:37:34.822 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.812+0000 7f27fdfe9640 1 -- 172.21.15.102:0/1382472333 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f806a220 con 0x7f27f815c9f0 2023-10-14T09:37:34.823 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.813+0000 7f27fdfe9640 1 -- 172.21.15.102:0/1382472333 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f8069da0 con 0x7f27f815c9f0 2023-10-14T09:37:34.823 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.814+0000 7f27f57fa640 1 -- 172.21.15.102:0/1382472333 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f27e4004b40 con 0x7f27f815c9f0 2023-10-14T09:37:34.823 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.815+0000 7f27f57fa640 1 --2- 172.21.15.102:0/1382472333 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f27dc06aea0 0x7f27dc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:34.823 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.815+0000 7f27f57fa640 1 -- 172.21.15.102:0/1382472333 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27e40887a0 con 0x7f27f815c9f0 2023-10-14T09:37:34.824 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.815+0000 7f27fcfe7640 1 --2- 172.21.15.102:0/1382472333 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f27dc06aea0 0x7f27dc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:34.824 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.816+0000 7f27fcfe7640 1 --2- 172.21.15.102:0/1382472333 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f27dc06aea0 0x7f27dc06d360 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f27ec006fd0 tx=0x7f27ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:34.824 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:34.819+0000 7f27f57fa640 1 -- 172.21.15.102:0/1382472333 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f27f8069da0 con 0x7f27f815c9f0 2023-10-14T09:37:35.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.043+0000 7f27fdfe9640 1 -- 172.21.15.102:0/1382472333 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27f8069da0 con 0x7f27f815c9f0 2023-10-14T09:37:35.046 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.044+0000 7f27f57fa640 1 -- 172.21.15.102:0/1382472333 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4916 (secure 0 0 0) 0x7f27f8069da0 con 0x7f27f815c9f0 2023-10-14T09:37:35.047 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:37:35.047 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6835/3867702876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6833","nonce":3867702876},{"type":"v1","addr":"172.21.15.129:6835","nonce":3867702876}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6834/1559210030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":1559210030},{"type":"v1","addr":"172.21.15.129:6834","nonce":1559210030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1277026451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1277026451},{"type":"v1","addr":"172.21.15.102:6835","nonce":1277026451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T09:37:21.362625+0000","modified":"2023-10-14T09:37:24.408132+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6837/527707922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":527707922},{"type":"v1","addr":"172.21.15.102:6837","nonce":527707922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T09:37:35.047 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 8 2023-10-14T09:37:35.049 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.047+0000 7f27fdfe9640 1 -- 172.21.15.102:0/1382472333 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f27dc06aea0 msgr2=0x7f27dc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:35.049 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.047+0000 7f27fdfe9640 1 --2- 172.21.15.102:0/1382472333 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f27dc06aea0 0x7f27dc06d360 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f27ec006fd0 tx=0x7f27ec008040 comp rx=0 tx=0).stop 2023-10-14T09:37:35.049 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.047+0000 7f27fdfe9640 1 -- 172.21.15.102:0/1382472333 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27f815c9f0 msgr2=0x7f27f80b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:35.049 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.047+0000 7f27fdfe9640 1 --2- 172.21.15.102:0/1382472333 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27f815c9f0 0x7f27f80b05e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f27e400c4d0 tx=0x7f27e400c990 comp rx=0 tx=0).stop 2023-10-14T09:37:35.050 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.047+0000 7f27fdfe9640 1 -- 172.21.15.102:0/1382472333 shutdown_connections 2023-10-14T09:37:35.050 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.047+0000 7f27fdfe9640 1 --2- 172.21.15.102:0/1382472333 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f27dc06aea0 0x7f27dc06d360 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:35.050 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.047+0000 7f27fdfe9640 1 --2- 172.21.15.102:0/1382472333 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f27f815dde0 0x7f27f806c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:35.050 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.047+0000 7f27fdfe9640 1 --2- 172.21.15.102:0/1382472333 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27f815c9f0 0x7f27f80b05e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:35.050 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.047+0000 7f27fdfe9640 1 --2- 172.21.15.102:0/1382472333 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f27f80c9230 0x7f27f80c7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:35.051 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.047+0000 7f27fdfe9640 1 -- 172.21.15.102:0/1382472333 >> 172.21.15.102:0/1382472333 conn(0x7f27f80ce6a0 msgr2=0x7f27f80cea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:35.051 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.047+0000 7f27fdfe9640 1 -- 172.21.15.102:0/1382472333 shutdown_connections 2023-10-14T09:37:35.051 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.048+0000 7f27fdfe9640 1 -- 172.21.15.102:0/1382472333 wait complete. 2023-10-14T09:37:35.068 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:37:35.277 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.275+0000 7f77fb50a640 1 Processor -- start 2023-10-14T09:37:35.277 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.275+0000 7f77fb50a640 1 -- start start 2023-10-14T09:37:35.279 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.277+0000 7f77fb50a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f77f415dde0 0x7f77f40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:35.279 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.277+0000 7f77fb50a640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f77f4070f20 0x7f77f40ac890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:35.279 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.277+0000 7f77fb50a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f4160a90 con 0x7f77f415c9f0 2023-10-14T09:37:35.280 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.277+0000 7f77fb50a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77f4071350 con 0x7f77f415dde0 2023-10-14T09:37:35.280 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.277+0000 7f77fb50a640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77f40cdec0 con 0x7f77f4070f20 2023-10-14T09:37:35.280 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.277+0000 7f77f9d07640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f77f415dde0 0x7f77f40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:35.280 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.277+0000 7f77f9d07640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f77f415dde0 0x7f77f40709e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33118/0 (socket says 172.21.15.102:33118) 2023-10-14T09:37:35.280 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.277+0000 7f77f9d07640 1 -- 172.21.15.102:0/2521206927 learned_addr learned my addr 172.21.15.102:0/2521206927 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:35.280 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.277+0000 7f77fa508640 1 --1- 172.21.15.102:0/2521206927 >> v1:172.21.15.102:6789/0 conn(0x7f77f415c9f0 0x7f77f40c8cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:50374/0 (socket says 172.21.15.102:50374) 2023-10-14T09:37:35.281 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.278+0000 7f77f9d07640 1 -- 172.21.15.102:0/2521206927 >> v2:172.21.15.129:3300/0 conn(0x7f77f4070f20 msgr2=0x7f77f40ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:35.281 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.278+0000 7f77f9d07640 1 --2- 172.21.15.102:0/2521206927 >> v2:172.21.15.129:3300/0 conn(0x7f77f4070f20 0x7f77f40ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:35.281 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.278+0000 7f77f9d07640 1 -- 172.21.15.102:0/2521206927 >> v1:172.21.15.102:6789/0 conn(0x7f77f415c9f0 legacy=0x7f77f40c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:35.281 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.278+0000 7f77f9d07640 1 -- 172.21.15.102:0/2521206927 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f40cd900 con 0x7f77f415dde0 2023-10-14T09:37:35.282 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.279+0000 7f77f9d07640 1 --2- 172.21.15.102:0/2521206927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77f415dde0 0x7f77f40709e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f77f406fcc0 tx=0x7f77e402b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30371ce723b94487 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:35.282 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.279+0000 7f77f9506640 1 -- 172.21.15.102:0/2521206927 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e4030870 con 0x7f77f415dde0 2023-10-14T09:37:35.283 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.279+0000 7f77f9506640 1 -- 172.21.15.102:0/2521206927 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e40309d0 con 0x7f77f415dde0 2023-10-14T09:37:35.283 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.279+0000 7f77f9506640 1 -- 172.21.15.102:0/2521206927 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e4030d60 con 0x7f77f415dde0 2023-10-14T09:37:35.283 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.279+0000 7f77fb50a640 1 -- 172.21.15.102:0/2521206927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77f415dde0 msgr2=0x7f77f40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:35.283 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.279+0000 7f77fb50a640 1 --2- 172.21.15.102:0/2521206927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77f415dde0 0x7f77f40709e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f77f406fcc0 tx=0x7f77e402b9b0 comp rx=0 tx=0).stop 2023-10-14T09:37:35.283 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.280+0000 7f77fb50a640 1 -- 172.21.15.102:0/2521206927 shutdown_connections 2023-10-14T09:37:35.284 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.280+0000 7f77fb50a640 1 --2- 172.21.15.102:0/2521206927 >> v2:172.21.15.129:3300/0 conn(0x7f77f4070f20 0x7f77f40ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:35.284 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.280+0000 7f77fb50a640 1 --2- 172.21.15.102:0/2521206927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77f415dde0 0x7f77f40709e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:35.284 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.280+0000 7f77fb50a640 1 -- 172.21.15.102:0/2521206927 >> 172.21.15.102:0/2521206927 conn(0x7f77f40ce6a0 msgr2=0x7f77f40ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:35.284 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.280+0000 7f77fb50a640 1 -- 172.21.15.102:0/2521206927 shutdown_connections 2023-10-14T09:37:35.284 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.280+0000 7f77fb50a640 1 -- 172.21.15.102:0/2521206927 wait complete. 2023-10-14T09:37:35.286 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.281+0000 7f77fb50a640 1 Processor -- start 2023-10-14T09:37:35.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.282+0000 7f77fb50a640 1 -- start start 2023-10-14T09:37:35.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.282+0000 7f77fb50a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77f4070f20 0x7f77f406c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:35.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.283+0000 7f77fb50a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f77f415c9f0 0x7f77f406b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:35.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.283+0000 7f77fb50a640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f77f415dde0 0x7f77f40c5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:35.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.283+0000 7f77fb50a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f40c3130 con 0x7f77f4070f20 2023-10-14T09:37:35.288 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.283+0000 7f77fb50a640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f40c8910 con 0x7f77f415c9f0 2023-10-14T09:37:35.288 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.283+0000 7f77fb50a640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f40c21d0 con 0x7f77f415dde0 2023-10-14T09:37:35.288 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.283+0000 7f77fa508640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77f4070f20 0x7f77f406c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:35.288 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.283+0000 7f77fa508640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77f4070f20 0x7f77f406c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33122/0 (socket says 172.21.15.102:33122) 2023-10-14T09:37:35.288 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.283+0000 7f77fa508640 1 -- 172.21.15.102:0/3999801434 learned_addr learned my addr 172.21.15.102:0/3999801434 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:35.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.283+0000 7f77fa508640 1 -- 172.21.15.102:0/3999801434 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f77f415dde0 msgr2=0x7f77f40c5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:35.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.283+0000 7f77fa508640 1 --2- 172.21.15.102:0/3999801434 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f77f415dde0 0x7f77f40c5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:35.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.283+0000 7f77fa508640 1 -- 172.21.15.102:0/3999801434 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f77f415c9f0 msgr2=0x7f77f406b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:35.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.283+0000 7f77fa508640 1 --2- 172.21.15.102:0/3999801434 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f77f415c9f0 0x7f77f406b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:35.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.283+0000 7f77fa508640 1 -- 172.21.15.102:0/3999801434 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e40094d0 con 0x7f77f4070f20 2023-10-14T09:37:35.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.283+0000 7f77fa508640 1 --2- 172.21.15.102:0/3999801434 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77f4070f20 0x7f77f406c620 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f77f000c4d0 tx=0x7f77f000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:35.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.284+0000 7f77eaffd640 1 -- 172.21.15.102:0/3999801434 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f0007480 con 0x7f77f4070f20 2023-10-14T09:37:35.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.284+0000 7f77eaffd640 1 -- 172.21.15.102:0/3999801434 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f00075e0 con 0x7f77f4070f20 2023-10-14T09:37:35.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.284+0000 7f77fb50a640 1 -- 172.21.15.102:0/3999801434 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f40c24b0 con 0x7f77f4070f20 2023-10-14T09:37:35.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.284+0000 7f77eaffd640 1 -- 172.21.15.102:0/3999801434 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f00049e0 con 0x7f77f4070f20 2023-10-14T09:37:35.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.284+0000 7f77fb50a640 1 -- 172.21.15.102:0/3999801434 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f40c2a70 con 0x7f77f4070f20 2023-10-14T09:37:35.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.285+0000 7f77fb50a640 1 -- 172.21.15.102:0/3999801434 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f404e9b0 con 0x7f77f4070f20 2023-10-14T09:37:35.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.286+0000 7f77eaffd640 1 -- 172.21.15.102:0/3999801434 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f77f0004b40 con 0x7f77f4070f20 2023-10-14T09:37:35.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.287+0000 7f77eaffd640 1 --2- 172.21.15.102:0/3999801434 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f77d806aea0 0x7f77d806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:35.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.287+0000 7f77eaffd640 1 -- 172.21.15.102:0/3999801434 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77f0088be0 con 0x7f77f4070f20 2023-10-14T09:37:35.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.288+0000 7f77f9d07640 1 --2- 172.21.15.102:0/3999801434 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f77d806aea0 0x7f77d806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:35.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.288+0000 7f77f9d07640 1 --2- 172.21.15.102:0/3999801434 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f77d806aea0 0x7f77d806d360 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f77e4036000 tx=0x7f77e403b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:35.294 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.292+0000 7f77eaffd640 1 -- 172.21.15.102:0/3999801434 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f77f0053bf0 con 0x7f77f4070f20 2023-10-14T09:37:35.483 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.481+0000 7f77fb50a640 1 -- 172.21.15.102:0/3999801434 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77f415a870 con 0x7f77f4070f20 2023-10-14T09:37:35.484 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.483+0000 7f77eaffd640 1 -- 172.21.15.102:0/3999801434 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f77f0018020 con 0x7f77f4070f20 2023-10-14T09:37:35.485 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:37:35.485 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":22,"fsid":"8a6cd69d-7f5b-4f2a-806a-0176c10aed50","created":"2023-10-14T09:36:56.745172+0000","modified":"2023-10-14T09:37:22.712469+0000","last_up_change":"2023-10-14T09:37:09.791473+0000","last_in_change":"2023-10-14T09:37:00.547186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:37:09.952407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:37:19.560925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:37:20.363385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e5aef8f3-878f-482b-b522-9a5b958b90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6801","nonce":1727250718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6803","nonce":1727250718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6807","nonce":1727250718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6805","nonce":1727250718}]},"public_addr":"172.21.15.102:6801/1727250718","cluster_addr":"172.21.15.102:6803/1727250718","heartbeat_back_addr":"172.21.15.102:6807/1727250718","heartbeat_front_addr":"172.21.15.102:6805/1727250718","state":["exists","up"]},{"osd":1,"uuid":"4a8cf50e-387b-4d47-9588-bd22e375a9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6809","nonce":1095651107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6811","nonce":1095651107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6815","nonce":1095651107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6813","nonce":1095651107}]},"public_addr":"172.21.15.102:6809/1095651107","cluster_addr":"172.21.15.102:6811/1095651107","heartbeat_back_addr":"172.21.15.102:6815/1095651107","heartbeat_front_addr":"172.21.15.102:6813/1095651107","state":["exists","up"]},{"osd":2,"uuid":"009ef55f-8a63-4219-bacd-d7c7b4500867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6820","nonce":2198222556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6825","nonce":2198222556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6831","nonce":2198222556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6829","nonce":2198222556}]},"public_addr":"172.21.15.102:6820/2198222556","cluster_addr":"172.21.15.102:6825/2198222556","heartbeat_back_addr":"172.21.15.102:6831/2198222556","heartbeat_front_addr":"172.21.15.102:6829/2198222556","state":["exists","up"]},{"osd":3,"uuid":"f2110eae-2ff9-4ed9-93d6-bd2361618211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6818","nonce":654726740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6821","nonce":654726740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6827","nonce":654726740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6823","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6824","nonce":654726740}]},"public_addr":"172.21.15.102:6818/654726740","cluster_addr":"172.21.15.102:6821/654726740","heartbeat_back_addr":"172.21.15.102:6827/654726740","heartbeat_front_addr":"172.21.15.102:6824/654726740","state":["exists","up"]},{"osd":4,"uuid":"33f1ae34-3100-40f7-9cb8-0eca2b358693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6817","nonce":507586170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6819","nonce":507586170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6823","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6825","nonce":507586170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6821","nonce":507586170}]},"public_addr":"172.21.15.129:6817/507586170","cluster_addr":"172.21.15.129:6819/507586170","heartbeat_back_addr":"172.21.15.129:6825/507586170","heartbeat_front_addr":"172.21.15.129:6821/507586170","state":["exists","up"]},{"osd":5,"uuid":"fab2fc62-3f3e-450d-93e0-770f39e80710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6801","nonce":1913451073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6803","nonce":1913451073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6807","nonce":1913451073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6805","nonce":1913451073}]},"public_addr":"172.21.15.129:6801/1913451073","cluster_addr":"172.21.15.129:6803/1913451073","heartbeat_back_addr":"172.21.15.129:6807/1913451073","heartbeat_front_addr":"172.21.15.129:6805/1913451073","state":["exists","up"]},{"osd":6,"uuid":"d7cc1d69-92e7-4253-a127-cfc0444a4809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6809","nonce":2853291511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6811","nonce":2853291511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6815","nonce":2853291511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6813","nonce":2853291511}]},"public_addr":"172.21.15.129:6809/2853291511","cluster_addr":"172.21.15.129:6811/2853291511","heartbeat_back_addr":"172.21.15.129:6815/2853291511","heartbeat_front_addr":"172.21.15.129:6813/2853291511","state":["exists","up"]},{"osd":7,"uuid":"1e403de1-09e2-4370-b9a7-e790ac44bbee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6824","nonce":2933886914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6827","nonce":2933886914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6831","nonce":2933886914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6829","nonce":2933886914}]},"public_addr":"172.21.15.129:6824/2933886914","cluster_addr":"172.21.15.129:6827/2933886914","heartbeat_back_addr":"172.21.15.129:6831/2933886914","heartbeat_front_addr":"172.21.15.129:6829/2933886914","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.849661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.868113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.933488+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.891794+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.901861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.858750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.911712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.996765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:37:35.487 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.485+0000 7f77fb50a640 1 -- 172.21.15.102:0/3999801434 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f77d806aea0 msgr2=0x7f77d806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:35.488 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.485+0000 7f77fb50a640 1 --2- 172.21.15.102:0/3999801434 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f77d806aea0 0x7f77d806d360 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f77e4036000 tx=0x7f77e403b040 comp rx=0 tx=0).stop 2023-10-14T09:37:35.488 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.485+0000 7f77fb50a640 1 -- 172.21.15.102:0/3999801434 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77f4070f20 msgr2=0x7f77f406c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:35.488 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.485+0000 7f77fb50a640 1 --2- 172.21.15.102:0/3999801434 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77f4070f20 0x7f77f406c620 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f77f000c4d0 tx=0x7f77f000c990 comp rx=0 tx=0).stop 2023-10-14T09:37:35.489 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.485+0000 7f77fb50a640 1 -- 172.21.15.102:0/3999801434 shutdown_connections 2023-10-14T09:37:35.489 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.485+0000 7f77fb50a640 1 --2- 172.21.15.102:0/3999801434 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f77d806aea0 0x7f77d806d360 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:35.489 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.485+0000 7f77fb50a640 1 --2- 172.21.15.102:0/3999801434 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f77f415dde0 0x7f77f40c5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:35.489 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.485+0000 7f77fb50a640 1 --2- 172.21.15.102:0/3999801434 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f77f415c9f0 0x7f77f406b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:35.490 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.485+0000 7f77fb50a640 1 --2- 172.21.15.102:0/3999801434 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77f4070f20 0x7f77f406c620 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:35.490 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.485+0000 7f77fb50a640 1 -- 172.21.15.102:0/3999801434 >> 172.21.15.102:0/3999801434 conn(0x7f77f40ce6a0 msgr2=0x7f77f40aecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:35.490 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.486+0000 7f77fb50a640 1 -- 172.21.15.102:0/3999801434 shutdown_connections 2023-10-14T09:37:35.490 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.486+0000 7f77fb50a640 1 -- 172.21.15.102:0/3999801434 wait complete. 2023-10-14T09:37:35.506 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T09:37:09.952407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T09:37:19.560925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T09:37:20.363385+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T09:37:35.507 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T09:37:35.713 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.711+0000 7f1a86da4640 1 Processor -- start 2023-10-14T09:37:35.713 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.711+0000 7f1a86da4640 1 -- start start 2023-10-14T09:37:35.715 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.713+0000 7f1a86da4640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f1a800ad350 0x7f1a80069da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:35.715 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.713+0000 7f1a86da4640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1a8006a2e0 0x7f1a800c9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:35.715 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.713+0000 7f1a86da4640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a8006a730 con 0x7f1a8015d150 2023-10-14T09:37:35.716 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.713+0000 7f1a86da4640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a8015d530 con 0x7f1a800ad350 2023-10-14T09:37:35.716 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.713+0000 7f1a86da4640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a800ac890 con 0x7f1a8006a2e0 2023-10-14T09:37:35.717 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.714+0000 7f1a7ffff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f1a800ad350 0x7f1a80069da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:35.717 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.714+0000 7f1a7ffff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f1a800ad350 0x7f1a80069da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.102:42408/0 (socket says 172.21.15.102:42408) 2023-10-14T09:37:35.717 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.714+0000 7f1a7ffff640 1 -- 172.21.15.102:0/2729090456 learned_addr learned my addr 172.21.15.102:0/2729090456 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:35.718 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.714+0000 7f1a85341640 1 --2- 172.21.15.102:0/2729090456 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1a8006a2e0 0x7f1a800c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:35.718 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.714+0000 7f1a84b40640 1 --1- 172.21.15.102:0/2729090456 >> v1:172.21.15.129:6789/0 conn(0x7f1a8015d150 0x7f1a80160b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.102:55064/0 (socket says 172.21.15.102:55064) 2023-10-14T09:37:35.718 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.715+0000 7f1a85341640 1 -- 172.21.15.102:0/2729090456 >> v2:172.21.15.129:3300/0 conn(0x7f1a800ad350 msgr2=0x7f1a80069da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:35.718 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.715+0000 7f1a85341640 1 --2- 172.21.15.102:0/2729090456 >> v2:172.21.15.129:3300/0 conn(0x7f1a800ad350 0x7f1a80069da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:35.718 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.715+0000 7f1a85341640 1 -- 172.21.15.102:0/2729090456 >> v1:172.21.15.129:6789/0 conn(0x7f1a8015d150 legacy=0x7f1a80160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:35.719 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.715+0000 7f1a85341640 1 -- 172.21.15.102:0/2729090456 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a800ad7a0 con 0x7f1a8006a2e0 2023-10-14T09:37:35.719 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.715+0000 7f1a7ffff640 1 --2- 172.21.15.102:0/2729090456 >> v2:172.21.15.129:3300/0 conn(0x7f1a800ad350 0x7f1a80069da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:37:35.720 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.716+0000 7f1a85341640 1 --2- 172.21.15.102:0/2729090456 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1a8006a2e0 0x7f1a800c9000 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1a78009d90 tx=0x7f1a7802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99c8a3c29fce88a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:35.720 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.716+0000 7f1a7f7fe640 1 -- 172.21.15.102:0/2729090456 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7802cc50 con 0x7f1a8006a2e0 2023-10-14T09:37:35.721 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.716+0000 7f1a7f7fe640 1 -- 172.21.15.102:0/2729090456 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7802cdb0 con 0x7f1a8006a2e0 2023-10-14T09:37:35.721 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.717+0000 7f1a7f7fe640 1 -- 172.21.15.102:0/2729090456 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a78034660 con 0x7f1a8006a2e0 2023-10-14T09:37:35.721 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.717+0000 7f1a86da4640 1 -- 172.21.15.102:0/2729090456 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1a8006a2e0 msgr2=0x7f1a800c9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:35.721 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.717+0000 7f1a86da4640 1 --2- 172.21.15.102:0/2729090456 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1a8006a2e0 0x7f1a800c9000 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1a78009d90 tx=0x7f1a7802bea0 comp rx=0 tx=0).stop 2023-10-14T09:37:35.721 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.717+0000 7f1a86da4640 1 -- 172.21.15.102:0/2729090456 shutdown_connections 2023-10-14T09:37:35.722 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.717+0000 7f1a86da4640 1 --2- 172.21.15.102:0/2729090456 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1a8006a2e0 0x7f1a800c9000 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:35.722 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.717+0000 7f1a86da4640 1 --2- 172.21.15.102:0/2729090456 >> v2:172.21.15.129:3300/0 conn(0x7f1a800ad350 0x7f1a80069da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:35.722 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.717+0000 7f1a86da4640 1 -- 172.21.15.102:0/2729090456 >> 172.21.15.102:0/2729090456 conn(0x7f1a800ce9b0 msgr2=0x7f1a800cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:35.722 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.717+0000 7f1a86da4640 1 -- 172.21.15.102:0/2729090456 shutdown_connections 2023-10-14T09:37:35.723 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.717+0000 7f1a86da4640 1 -- 172.21.15.102:0/2729090456 wait complete. 2023-10-14T09:37:35.725 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.719+0000 7f1a86da4640 1 Processor -- start 2023-10-14T09:37:35.725 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.719+0000 7f1a86da4640 1 -- start start 2023-10-14T09:37:35.726 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.720+0000 7f1a86da4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a8006a2e0 0x7f1a800c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:35.726 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.720+0000 7f1a86da4640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1a800ad350 0x7f1a800b3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:35.726 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.720+0000 7f1a86da4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1a8015d150 0x7f1a8015d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:35.726 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.720+0000 7f1a86da4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a801e8820 con 0x7f1a8006a2e0 2023-10-14T09:37:35.727 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.720+0000 7f1a86da4640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a800c8820 con 0x7f1a8015d150 2023-10-14T09:37:35.727 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.720+0000 7f1a86da4640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a801e7c10 con 0x7f1a800ad350 2023-10-14T09:37:35.727 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.720+0000 7f1a84b40640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a8006a2e0 0x7f1a800c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:35.727 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.720+0000 7f1a84b40640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a8006a2e0 0x7f1a800c82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33136/0 (socket says 172.21.15.102:33136) 2023-10-14T09:37:35.727 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.720+0000 7f1a84b40640 1 -- 172.21.15.102:0/347176166 learned_addr learned my addr 172.21.15.102:0/347176166 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:35.728 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.721+0000 7f1a7ffff640 1 --2- 172.21.15.102:0/347176166 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1a800ad350 0x7f1a800b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:35.728 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.721+0000 7f1a85341640 1 --2- 172.21.15.102:0/347176166 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1a8015d150 0x7f1a8015d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:35.728 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.721+0000 7f1a84b40640 1 -- 172.21.15.102:0/347176166 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1a800ad350 msgr2=0x7f1a800b3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:35.728 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.721+0000 7f1a84b40640 1 --2- 172.21.15.102:0/347176166 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1a800ad350 0x7f1a800b3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:35.729 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.721+0000 7f1a84b40640 1 -- 172.21.15.102:0/347176166 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1a8015d150 msgr2=0x7f1a8015d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:35.729 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.721+0000 7f1a84b40640 1 --2- 172.21.15.102:0/347176166 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1a8015d150 0x7f1a8015d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:35.729 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.721+0000 7f1a84b40640 1 -- 172.21.15.102:0/347176166 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a6c0094d0 con 0x7f1a8006a2e0 2023-10-14T09:37:35.729 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.721+0000 7f1a84b40640 1 --2- 172.21.15.102:0/347176166 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a8006a2e0 0x7f1a800c82e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400c3f0 tx=0x7f1a7400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:35.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.721+0000 7f1a7d7fa640 1 -- 172.21.15.102:0/347176166 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a740074e0 con 0x7f1a8006a2e0 2023-10-14T09:37:35.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.721+0000 7f1a7d7fa640 1 -- 172.21.15.102:0/347176166 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a74007660 con 0x7f1a8006a2e0 2023-10-14T09:37:35.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.721+0000 7f1a86da4640 1 -- 172.21.15.102:0/347176166 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a78009a70 con 0x7f1a8006a2e0 2023-10-14T09:37:35.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.721+0000 7f1a7d7fa640 1 -- 172.21.15.102:0/347176166 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a74004a20 con 0x7f1a8006a2e0 2023-10-14T09:37:35.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.722+0000 7f1a86da4640 1 -- 172.21.15.102:0/347176166 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a801e81d0 con 0x7f1a8006a2e0 2023-10-14T09:37:35.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.723+0000 7f1a86da4640 1 -- 172.21.15.102:0/347176166 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a8004e160 con 0x7f1a8006a2e0 2023-10-14T09:37:35.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.723+0000 7f1a7d7fa640 1 -- 172.21.15.102:0/347176166 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1a74004b80 con 0x7f1a8006a2e0 2023-10-14T09:37:35.732 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.724+0000 7f1a7d7fa640 1 --2- 172.21.15.102:0/347176166 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1a6406ae70 0x7f1a6406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:35.732 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.724+0000 7f1a7d7fa640 1 -- 172.21.15.102:0/347176166 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a74088ec0 con 0x7f1a8006a2e0 2023-10-14T09:37:35.733 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.725+0000 7f1a7ffff640 1 --2- 172.21.15.102:0/347176166 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1a6406ae70 0x7f1a6406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:35.733 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.725+0000 7f1a7ffff640 1 --2- 172.21.15.102:0/347176166 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1a6406ae70 0x7f1a6406d330 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1a80158ff0 tx=0x7f1a6c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:35.733 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.729+0000 7f1a7d7fa640 1 -- 172.21.15.102:0/347176166 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1a74053ed0 con 0x7f1a8006a2e0 2023-10-14T09:37:35.920 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.918+0000 7f1a86da4640 1 -- 172.21.15.102:0/347176166 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1a8006a730 con 0x7f1a8006a2e0 2023-10-14T09:37:35.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.919+0000 7f1a7d7fa640 1 -- 172.21.15.102:0/347176166 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1a8006a730 con 0x7f1a8006a2e0 2023-10-14T09:37:35.921 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2023-10-14T09:37:35.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.922+0000 7f1a86da4640 1 -- 172.21.15.102:0/347176166 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1a6406ae70 msgr2=0x7f1a6406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:35.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.922+0000 7f1a86da4640 1 --2- 172.21.15.102:0/347176166 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1a6406ae70 0x7f1a6406d330 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1a80158ff0 tx=0x7f1a6c008040 comp rx=0 tx=0).stop 2023-10-14T09:37:35.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.922+0000 7f1a86da4640 1 -- 172.21.15.102:0/347176166 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a8006a2e0 msgr2=0x7f1a800c82e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:35.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.922+0000 7f1a86da4640 1 --2- 172.21.15.102:0/347176166 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a8006a2e0 0x7f1a800c82e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400c3f0 tx=0x7f1a7400c8b0 comp rx=0 tx=0).stop 2023-10-14T09:37:35.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.922+0000 7f1a86da4640 1 -- 172.21.15.102:0/347176166 shutdown_connections 2023-10-14T09:37:35.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.922+0000 7f1a86da4640 1 --2- 172.21.15.102:0/347176166 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1a6406ae70 0x7f1a6406d330 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:35.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.922+0000 7f1a86da4640 1 --2- 172.21.15.102:0/347176166 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1a8015d150 0x7f1a8015d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:35.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.922+0000 7f1a86da4640 1 --2- 172.21.15.102:0/347176166 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1a800ad350 0x7f1a800b3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:35.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.922+0000 7f1a86da4640 1 --2- 172.21.15.102:0/347176166 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a8006a2e0 0x7f1a800c82e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:35.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.922+0000 7f1a86da4640 1 -- 172.21.15.102:0/347176166 >> 172.21.15.102:0/347176166 conn(0x7f1a800ce9b0 msgr2=0x7f1a800b15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:35.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.922+0000 7f1a86da4640 1 -- 172.21.15.102:0/347176166 shutdown_connections 2023-10-14T09:37:35.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:35.922+0000 7f1a86da4640 1 -- 172.21.15.102:0/347176166 wait complete. 2023-10-14T09:37:35.943 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T09:37:36.158 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.156+0000 7f321d9ed640 1 Processor -- start 2023-10-14T09:37:36.158 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.156+0000 7f321d9ed640 1 -- start start 2023-10-14T09:37:36.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.157+0000 7f321d9ed640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f321806c040 0x7f321806c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:36.160 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.157+0000 7f321d9ed640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f32180ad970 0x7f321815e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:36.160 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.158+0000 7f321d9ed640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f321806c960 con 0x7f321815ebc0 2023-10-14T09:37:36.160 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.158+0000 7f321d9ed640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f321815b9d0 con 0x7f321806c040 2023-10-14T09:37:36.160 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.158+0000 7f321d9ed640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f321815bcb0 con 0x7f32180ad970 2023-10-14T09:37:36.161 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.158+0000 7f321c9eb640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f321806c040 0x7f321806c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:36.161 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.158+0000 7f321c9eb640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f321806c040 0x7f321806c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33148/0 (socket says 172.21.15.102:33148) 2023-10-14T09:37:36.161 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.158+0000 7f321c9eb640 1 -- 172.21.15.102:0/3424803911 learned_addr learned my addr 172.21.15.102:0/3424803911 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:36.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.158+0000 7f3217fff640 1 --2- 172.21.15.102:0/3424803911 >> v2:172.21.15.129:3300/0 conn(0x7f32180ad970 0x7f321815e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:36.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.158+0000 7f321c9eb640 1 -- 172.21.15.102:0/3424803911 >> v2:172.21.15.129:3300/0 conn(0x7f32180ad970 msgr2=0x7f321815e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:36.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.158+0000 7f321c9eb640 1 --2- 172.21.15.102:0/3424803911 >> v2:172.21.15.129:3300/0 conn(0x7f32180ad970 0x7f321815e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:36.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.158+0000 7f321c9eb640 1 -- 172.21.15.102:0/3424803911 >> v1:172.21.15.129:6789/0 conn(0x7f321815ebc0 legacy=0x7f32180cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:36.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.158+0000 7f321c9eb640 1 -- 172.21.15.102:0/3424803911 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f321815bf90 con 0x7f321806c040 2023-10-14T09:37:36.164 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.158+0000 7f3217fff640 1 --2- 172.21.15.102:0/3424803911 >> v2:172.21.15.129:3300/0 conn(0x7f32180ad970 0x7f321815e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:36.164 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.159+0000 7f321c9eb640 1 --2- 172.21.15.102:0/3424803911 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f321806c040 0x7f321806c420 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f32180cb060 tx=0x7f320c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40dcb779b1b17ec0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:36.164 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.160+0000 7f32177fe640 1 -- 172.21.15.102:0/3424803911 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320c031870 con 0x7f321806c040 2023-10-14T09:37:36.164 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.160+0000 7f32177fe640 1 -- 172.21.15.102:0/3424803911 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f320c0319d0 con 0x7f321806c040 2023-10-14T09:37:36.164 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.160+0000 7f32177fe640 1 -- 172.21.15.102:0/3424803911 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320c031d60 con 0x7f321806c040 2023-10-14T09:37:36.164 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.160+0000 7f321d9ed640 1 -- 172.21.15.102:0/3424803911 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f321806c040 msgr2=0x7f321806c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:36.165 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.160+0000 7f321d9ed640 1 --2- 172.21.15.102:0/3424803911 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f321806c040 0x7f321806c420 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f32180cb060 tx=0x7f320c02b910 comp rx=0 tx=0).stop 2023-10-14T09:37:36.165 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.161+0000 7f321d9ed640 1 -- 172.21.15.102:0/3424803911 shutdown_connections 2023-10-14T09:37:36.165 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.161+0000 7f321d9ed640 1 --2- 172.21.15.102:0/3424803911 >> v2:172.21.15.129:3300/0 conn(0x7f32180ad970 0x7f321815e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:36.165 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.161+0000 7f321d9ed640 1 --2- 172.21.15.102:0/3424803911 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f321806c040 0x7f321806c420 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:36.165 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.161+0000 7f321d9ed640 1 -- 172.21.15.102:0/3424803911 >> 172.21.15.102:0/3424803911 conn(0x7f32180ce6a0 msgr2=0x7f32180ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:36.166 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.161+0000 7f321d9ed640 1 -- 172.21.15.102:0/3424803911 shutdown_connections 2023-10-14T09:37:36.166 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.161+0000 7f321d9ed640 1 -- 172.21.15.102:0/3424803911 wait complete. 2023-10-14T09:37:36.168 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.162+0000 7f321d9ed640 1 Processor -- start 2023-10-14T09:37:36.168 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.163+0000 7f321d9ed640 1 -- start start 2023-10-14T09:37:36.168 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.163+0000 7f321d9ed640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f321806c040 0x7f321815a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:36.168 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.163+0000 7f321d9ed640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32180ad970 0x7f32180b2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:36.168 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.163+0000 7f321d9ed640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f321815ebc0 0x7f32180ae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:36.169 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.163+0000 7f321d9ed640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32180b3cb0 con 0x7f32180ad970 2023-10-14T09:37:36.169 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.163+0000 7f321d9ed640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32180b2c10 con 0x7f321815ebc0 2023-10-14T09:37:36.169 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.163+0000 7f321d9ed640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32180b2ef0 con 0x7f321806c040 2023-10-14T09:37:36.169 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.164+0000 7f3217fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32180ad970 0x7f32180b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:36.169 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.164+0000 7f3217fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32180ad970 0x7f32180b2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33152/0 (socket says 172.21.15.102:33152) 2023-10-14T09:37:36.170 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.164+0000 7f3217fff640 1 -- 172.21.15.102:0/3443583691 learned_addr learned my addr 172.21.15.102:0/3443583691 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:36.170 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.164+0000 7f3217fff640 1 -- 172.21.15.102:0/3443583691 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f321806c040 msgr2=0x7f321815a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:36.170 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.164+0000 7f3217fff640 1 --2- 172.21.15.102:0/3443583691 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f321806c040 0x7f321815a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:36.170 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.164+0000 7f3217fff640 1 -- 172.21.15.102:0/3443583691 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f321815ebc0 msgr2=0x7f32180ae100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:36.170 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.164+0000 7f3217fff640 1 --2- 172.21.15.102:0/3443583691 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f321815ebc0 0x7f32180ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:36.171 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.164+0000 7f3217fff640 1 -- 172.21.15.102:0/3443583691 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f320c0094d0 con 0x7f32180ad970 2023-10-14T09:37:36.171 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.164+0000 7f3217fff640 1 --2- 172.21.15.102:0/3443583691 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32180ad970 0x7f32180b2310 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f320400c7f0 tx=0x7f320400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:36.171 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.165+0000 7f32157fa640 1 -- 172.21.15.102:0/3443583691 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3204007820 con 0x7f32180ad970 2023-10-14T09:37:36.171 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.165+0000 7f32157fa640 1 -- 172.21.15.102:0/3443583691 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3204007980 con 0x7f32180ad970 2023-10-14T09:37:36.171 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.165+0000 7f321d9ed640 1 -- 172.21.15.102:0/3443583691 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32180b31d0 con 0x7f32180ad970 2023-10-14T09:37:36.171 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.165+0000 7f32157fa640 1 -- 172.21.15.102:0/3443583691 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3204007d30 con 0x7f32180ad970 2023-10-14T09:37:36.172 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.165+0000 7f321d9ed640 1 -- 172.21.15.102:0/3443583691 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32180b3790 con 0x7f32180ad970 2023-10-14T09:37:36.172 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.166+0000 7f321d9ed640 1 -- 172.21.15.102:0/3443583691 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32180b3950 con 0x7f32180ad970 2023-10-14T09:37:36.173 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.167+0000 7f32157fa640 1 -- 172.21.15.102:0/3443583691 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f32040113f0 con 0x7f32180ad970 2023-10-14T09:37:36.173 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.168+0000 7f32157fa640 1 --2- 172.21.15.102:0/3443583691 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f31fc06ae70 0x7f31fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:36.173 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.168+0000 7f32157fa640 1 -- 172.21.15.102:0/3443583691 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f32040898d0 con 0x7f32180ad970 2023-10-14T09:37:36.173 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.168+0000 7f321c9eb640 1 --2- 172.21.15.102:0/3443583691 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f31fc06ae70 0x7f31fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:36.173 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.169+0000 7f321c9eb640 1 --2- 172.21.15.102:0/3443583691 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f31fc06ae70 0x7f31fc06d330 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f320c036000 tx=0x7f320c030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:36.174 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.173+0000 7f32157fa640 1 -- 172.21.15.102:0/3443583691 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3204054970 con 0x7f32180ad970 2023-10-14T09:37:36.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.359+0000 7f321d9ed640 1 -- 172.21.15.102:0/3443583691 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f321806b330 con 0x7f32180ad970 2023-10-14T09:37:36.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.360+0000 7f32157fa640 1 -- 172.21.15.102:0/3443583691 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f320401f020 con 0x7f32180ad970 2023-10-14T09:37:36.362 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2023-10-14T09:37:36.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.362+0000 7f321d9ed640 1 -- 172.21.15.102:0/3443583691 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f31fc06ae70 msgr2=0x7f31fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:36.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.362+0000 7f321d9ed640 1 --2- 172.21.15.102:0/3443583691 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f31fc06ae70 0x7f31fc06d330 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f320c036000 tx=0x7f320c030000 comp rx=0 tx=0).stop 2023-10-14T09:37:36.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.362+0000 7f321d9ed640 1 -- 172.21.15.102:0/3443583691 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32180ad970 msgr2=0x7f32180b2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:36.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.362+0000 7f321d9ed640 1 --2- 172.21.15.102:0/3443583691 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32180ad970 0x7f32180b2310 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f320400c7f0 tx=0x7f320400ccb0 comp rx=0 tx=0).stop 2023-10-14T09:37:36.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.363+0000 7f321d9ed640 1 -- 172.21.15.102:0/3443583691 shutdown_connections 2023-10-14T09:37:36.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.363+0000 7f321d9ed640 1 --2- 172.21.15.102:0/3443583691 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f31fc06ae70 0x7f31fc06d330 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:36.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.363+0000 7f321d9ed640 1 --2- 172.21.15.102:0/3443583691 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f321815ebc0 0x7f32180ae100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:36.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.363+0000 7f321d9ed640 1 --2- 172.21.15.102:0/3443583691 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32180ad970 0x7f32180b2310 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:36.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.363+0000 7f321d9ed640 1 --2- 172.21.15.102:0/3443583691 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f321806c040 0x7f321815a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:36.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.363+0000 7f321d9ed640 1 -- 172.21.15.102:0/3443583691 >> 172.21.15.102:0/3443583691 conn(0x7f32180ce6a0 msgr2=0x7f32180cd200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:36.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.363+0000 7f321d9ed640 1 -- 172.21.15.102:0/3443583691 shutdown_connections 2023-10-14T09:37:36.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.363+0000 7f321d9ed640 1 -- 172.21.15.102:0/3443583691 wait complete. 2023-10-14T09:37:36.381 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T09:37:36.587 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.585+0000 7fc1f218a640 1 Processor -- start 2023-10-14T09:37:36.587 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.585+0000 7fc1f218a640 1 -- start start 2023-10-14T09:37:36.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.587+0000 7fc1f218a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc1ec06c850 0x7fc1ec0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:36.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.587+0000 7fc1f218a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1ec070360 con 0x7fc1ec159ab0 2023-10-14T09:37:36.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.587+0000 7fc1f218a640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1ec0cd1f0 con 0x7fc1ec159e90 2023-10-14T09:37:36.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.587+0000 7fc1f218a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1ec15d890 con 0x7fc1ec06c850 2023-10-14T09:37:36.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.587+0000 7fc1eb7fe640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fc1ec159ab0 0x7fc1ec06fc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:50380/0 (socket says 172.21.15.102:50380) 2023-10-14T09:37:36.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.587+0000 7fc1eb7fe640 1 -- 172.21.15.102:0/3063653784 learned_addr learned my addr 172.21.15.102:0/3063653784 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:36.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.587+0000 7fc1ebfff640 1 --2- 172.21.15.102:0/3063653784 >> v2:172.21.15.102:3300/0 conn(0x7fc1ec06c850 0x7fc1ec0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:36.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.587+0000 7fc1ea7fc640 1 -- 172.21.15.102:0/3063653784 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3848298955 0 0) 0x7fc1ec070360 con 0x7fc1ec159ab0 2023-10-14T09:37:36.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.588+0000 7fc1ea7fc640 1 -- 172.21.15.102:0/3063653784 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1d8005730 con 0x7fc1ec159ab0 2023-10-14T09:37:36.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.588+0000 7fc1ebfff640 1 -- 172.21.15.102:0/3063653784 >> v1:172.21.15.129:6789/0 conn(0x7fc1ec159e90 legacy=0x7fc1ec06c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:36.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.588+0000 7fc1ebfff640 1 -- 172.21.15.102:0/3063653784 >> v1:172.21.15.102:6789/0 conn(0x7fc1ec159ab0 legacy=0x7fc1ec06fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:36.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.588+0000 7fc1ebfff640 1 -- 172.21.15.102:0/3063653784 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ec0cd4d0 con 0x7fc1ec06c850 2023-10-14T09:37:36.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.589+0000 7fc1ebfff640 1 --2- 172.21.15.102:0/3063653784 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1ec06c850 0x7fc1ec0ce370 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc1e40097a0 tx=0x7fc1e402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11db36b1565af7c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:36.593 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.589+0000 7fc1ea7fc640 1 -- 172.21.15.102:0/3063653784 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e402f050 con 0x7fc1ec06c850 2023-10-14T09:37:36.593 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.589+0000 7fc1ea7fc640 1 -- 172.21.15.102:0/3063653784 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e4031700 con 0x7fc1ec06c850 2023-10-14T09:37:36.593 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.589+0000 7fc1ea7fc640 1 -- 172.21.15.102:0/3063653784 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4031a70 con 0x7fc1ec06c850 2023-10-14T09:37:36.593 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.590+0000 7fc1f218a640 1 -- 172.21.15.102:0/3063653784 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1ec06c850 msgr2=0x7fc1ec0ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:36.593 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.590+0000 7fc1f218a640 1 --2- 172.21.15.102:0/3063653784 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1ec06c850 0x7fc1ec0ce370 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc1e40097a0 tx=0x7fc1e402b7a0 comp rx=0 tx=0).stop 2023-10-14T09:37:36.594 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.590+0000 7fc1f218a640 1 -- 172.21.15.102:0/3063653784 shutdown_connections 2023-10-14T09:37:36.594 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.590+0000 7fc1f218a640 1 --2- 172.21.15.102:0/3063653784 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1ec06c850 0x7fc1ec0ce370 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:36.594 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.590+0000 7fc1f218a640 1 -- 172.21.15.102:0/3063653784 >> 172.21.15.102:0/3063653784 conn(0x7fc1ec0ce9b0 msgr2=0x7fc1ec0cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:36.594 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.590+0000 7fc1f218a640 1 -- 172.21.15.102:0/3063653784 shutdown_connections 2023-10-14T09:37:36.594 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.590+0000 7fc1f218a640 1 -- 172.21.15.102:0/3063653784 wait complete. 2023-10-14T09:37:36.597 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.592+0000 7fc1f218a640 1 Processor -- start 2023-10-14T09:37:36.597 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.592+0000 7fc1f218a640 1 -- start start 2023-10-14T09:37:36.597 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.593+0000 7fc1f218a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1ec06c850 0x7fc1ec145740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:36.597 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.593+0000 7fc1f218a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc1ec159ab0 0x7fc1ec06b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:36.597 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.593+0000 7fc1f218a640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc1ec159e90 0x7fc1ec06b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:36.598 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.593+0000 7fc1f218a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec1e5750 con 0x7fc1ec06c850 2023-10-14T09:37:36.598 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.593+0000 7fc1f218a640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec148f30 con 0x7fc1ec159ab0 2023-10-14T09:37:36.598 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.593+0000 7fc1f218a640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec1e6f10 con 0x7fc1ec159e90 2023-10-14T09:37:36.598 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.593+0000 7fc1eb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1ec06c850 0x7fc1ec145740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:36.598 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.593+0000 7fc1eb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1ec06c850 0x7fc1ec145740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33178/0 (socket says 172.21.15.102:33178) 2023-10-14T09:37:36.599 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.593+0000 7fc1eb7fe640 1 -- 172.21.15.102:0/342841338 learned_addr learned my addr 172.21.15.102:0/342841338 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:36.599 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.594+0000 7fc1eaffd640 1 --2- 172.21.15.102:0/342841338 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc1ec159ab0 0x7fc1ec06b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:36.599 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.594+0000 7fc1ebfff640 1 --2- 172.21.15.102:0/342841338 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc1ec159e90 0x7fc1ec06b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:36.599 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.594+0000 7fc1eb7fe640 1 -- 172.21.15.102:0/342841338 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc1ec159e90 msgr2=0x7fc1ec06b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:36.599 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.594+0000 7fc1eb7fe640 1 --2- 172.21.15.102:0/342841338 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc1ec159e90 0x7fc1ec06b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:36.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.594+0000 7fc1eb7fe640 1 -- 172.21.15.102:0/342841338 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc1ec159ab0 msgr2=0x7fc1ec06b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:36.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.594+0000 7fc1eb7fe640 1 --2- 172.21.15.102:0/342841338 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc1ec159ab0 0x7fc1ec06b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:36.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.594+0000 7fc1eb7fe640 1 -- 172.21.15.102:0/342841338 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e4009400 con 0x7fc1ec06c850 2023-10-14T09:37:36.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.594+0000 7fc1eaffd640 1 --2- 172.21.15.102:0/342841338 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc1ec159ab0 0x7fc1ec06b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:36.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.594+0000 7fc1ebfff640 1 --2- 172.21.15.102:0/342841338 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc1ec159e90 0x7fc1ec06b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:36.601 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.594+0000 7fc1eb7fe640 1 --2- 172.21.15.102:0/342841338 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1ec06c850 0x7fc1ec145740 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc1d40010e0 tx=0x7fc1d400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:36.601 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.594+0000 7fc1e3fff640 1 -- 172.21.15.102:0/342841338 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d4005ce0 con 0x7fc1ec06c850 2023-10-14T09:37:36.601 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.594+0000 7fc1e3fff640 1 -- 172.21.15.102:0/342841338 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d4005e60 con 0x7fc1ec06c850 2023-10-14T09:37:36.601 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.594+0000 7fc1f218a640 1 -- 172.21.15.102:0/342841338 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1ec1e71f0 con 0x7fc1ec06c850 2023-10-14T09:37:36.601 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.594+0000 7fc1e3fff640 1 -- 172.21.15.102:0/342841338 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d40072b0 con 0x7fc1ec06c850 2023-10-14T09:37:36.602 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.594+0000 7fc1f218a640 1 -- 172.21.15.102:0/342841338 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1ec1e6b90 con 0x7fc1ec06c850 2023-10-14T09:37:36.602 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.595+0000 7fc1f218a640 1 -- 172.21.15.102:0/342841338 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1ec1e7710 con 0x7fc1ec06c850 2023-10-14T09:37:36.603 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.596+0000 7fc1e3fff640 1 -- 172.21.15.102:0/342841338 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc1d4007410 con 0x7fc1ec06c850 2023-10-14T09:37:36.603 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.597+0000 7fc1e3fff640 1 --2- 172.21.15.102:0/342841338 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc1cc06ae70 0x7fc1cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:36.603 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.597+0000 7fc1e3fff640 1 -- 172.21.15.102:0/342841338 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1d4088cb0 con 0x7fc1ec06c850 2023-10-14T09:37:36.603 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.597+0000 7fc1eaffd640 1 --2- 172.21.15.102:0/342841338 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc1cc06ae70 0x7fc1cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:36.604 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.598+0000 7fc1eaffd640 1 --2- 172.21.15.102:0/342841338 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc1cc06ae70 0x7fc1cc06d330 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec1f5bd0 tx=0x7fc1dc0073a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:36.604 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.601+0000 7fc1e3fff640 1 -- 172.21.15.102:0/342841338 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc1ec1e7710 con 0x7fc1ec06c850 2023-10-14T09:37:36.793 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.791+0000 7fc1f218a640 1 -- 172.21.15.102:0/342841338 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc1ec1e7710 con 0x7fc1ec06c850 2023-10-14T09:37:36.794 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.792+0000 7fc1e3fff640 1 -- 172.21.15.102:0/342841338 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc1ec1e7710 con 0x7fc1ec06c850 2023-10-14T09:37:36.794 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2023-10-14T09:37:36.797 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.794+0000 7fc1f218a640 1 -- 172.21.15.102:0/342841338 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc1cc06ae70 msgr2=0x7fc1cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:36.797 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.794+0000 7fc1f218a640 1 --2- 172.21.15.102:0/342841338 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc1cc06ae70 0x7fc1cc06d330 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec1f5bd0 tx=0x7fc1dc0073a0 comp rx=0 tx=0).stop 2023-10-14T09:37:36.797 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.795+0000 7fc1f218a640 1 -- 172.21.15.102:0/342841338 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1ec06c850 msgr2=0x7fc1ec145740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:36.797 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.795+0000 7fc1f218a640 1 --2- 172.21.15.102:0/342841338 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1ec06c850 0x7fc1ec145740 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc1d40010e0 tx=0x7fc1d400c960 comp rx=0 tx=0).stop 2023-10-14T09:37:36.797 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.795+0000 7fc1f218a640 1 -- 172.21.15.102:0/342841338 shutdown_connections 2023-10-14T09:37:36.798 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.795+0000 7fc1f218a640 1 --2- 172.21.15.102:0/342841338 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc1cc06ae70 0x7fc1cc06d330 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:36.798 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.795+0000 7fc1f218a640 1 --2- 172.21.15.102:0/342841338 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc1ec159e90 0x7fc1ec06b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:36.798 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.795+0000 7fc1f218a640 1 --2- 172.21.15.102:0/342841338 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc1ec159ab0 0x7fc1ec06b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:36.798 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.795+0000 7fc1f218a640 1 --2- 172.21.15.102:0/342841338 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1ec06c850 0x7fc1ec145740 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:36.798 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.795+0000 7fc1f218a640 1 -- 172.21.15.102:0/342841338 >> 172.21.15.102:0/342841338 conn(0x7fc1ec0ce9b0 msgr2=0x7fc1ec158a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:36.799 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.795+0000 7fc1f218a640 1 -- 172.21.15.102:0/342841338 shutdown_connections 2023-10-14T09:37:36.799 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:36.795+0000 7fc1f218a640 1 -- 172.21.15.102:0/342841338 wait complete. 2023-10-14T09:37:36.813 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:37:37.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.018+0000 7f1a7635e640 1 Processor -- start 2023-10-14T09:37:37.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.018+0000 7f1a7635e640 1 -- start start 2023-10-14T09:37:37.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.020+0000 7f1a7635e640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f1a700b0b20 0x7f1a701615f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:37.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.020+0000 7f1a7635e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1a7015d3f0 0x7f1a7015d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:37.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.020+0000 7f1a7635e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a7015e3e0 con 0x7f1a700cd0c0 2023-10-14T09:37:37.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.020+0000 7f1a7635e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a700cd4a0 con 0x7f1a7015d3f0 2023-10-14T09:37:37.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.020+0000 7f1a7635e640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a7015e100 con 0x7f1a700b0b20 2023-10-14T09:37:37.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.020+0000 7f1a6ffff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f1a700cd0c0 0x7f1a700b0410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:50386/0 (socket says 172.21.15.102:50386) 2023-10-14T09:37:37.023 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.020+0000 7f1a6ffff640 1 -- 172.21.15.102:0/142265829 learned_addr learned my addr 172.21.15.102:0/142265829 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:37.023 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.020+0000 7f1a748fb640 1 --2- 172.21.15.102:0/142265829 >> v2:172.21.15.102:3300/0 conn(0x7f1a7015d3f0 0x7f1a7015d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:37.024 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.020+0000 7f1a6f7fe640 1 --2- 172.21.15.102:0/142265829 >> v2:172.21.15.129:3300/0 conn(0x7f1a700b0b20 0x7f1a701615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:37.024 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.020+0000 7f1a6effd640 1 -- 172.21.15.102:0/142265829 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 931557634 0 0) 0x7f1a7015e3e0 con 0x7f1a700cd0c0 2023-10-14T09:37:37.025 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.021+0000 7f1a6effd640 1 -- 172.21.15.102:0/142265829 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a58003520 con 0x7f1a700cd0c0 2023-10-14T09:37:37.025 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.021+0000 7f1a748fb640 1 -- 172.21.15.102:0/142265829 >> v2:172.21.15.129:3300/0 conn(0x7f1a700b0b20 msgr2=0x7f1a701615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:37.025 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.021+0000 7f1a748fb640 1 --2- 172.21.15.102:0/142265829 >> v2:172.21.15.129:3300/0 conn(0x7f1a700b0b20 0x7f1a701615f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:37.025 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.021+0000 7f1a748fb640 1 -- 172.21.15.102:0/142265829 >> v1:172.21.15.102:6789/0 conn(0x7f1a700cd0c0 legacy=0x7f1a700b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:37.026 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.021+0000 7f1a748fb640 1 -- 172.21.15.102:0/142265829 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a70160b10 con 0x7f1a7015d3f0 2023-10-14T09:37:37.026 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.021+0000 7f1a6f7fe640 1 --2- 172.21.15.102:0/142265829 >> v2:172.21.15.129:3300/0 conn(0x7f1a700b0b20 0x7f1a701615f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:37:37.026 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.022+0000 7f1a748fb640 1 --2- 172.21.15.102:0/142265829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a7015d3f0 0x7f1a7015d820 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1a7015afc0 tx=0x7f1a6802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f8933c7734789 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:37.026 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.022+0000 7f1a6effd640 1 -- 172.21.15.102:0/142265829 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6802cbf0 con 0x7f1a7015d3f0 2023-10-14T09:37:37.026 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.022+0000 7f1a6effd640 1 -- 172.21.15.102:0/142265829 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6802cd50 con 0x7f1a7015d3f0 2023-10-14T09:37:37.026 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.022+0000 7f1a6effd640 1 -- 172.21.15.102:0/142265829 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a68034660 con 0x7f1a7015d3f0 2023-10-14T09:37:37.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.022+0000 7f1a7635e640 1 -- 172.21.15.102:0/142265829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a7015d3f0 msgr2=0x7f1a7015d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:37.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.022+0000 7f1a7635e640 1 --2- 172.21.15.102:0/142265829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a7015d3f0 0x7f1a7015d820 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1a7015afc0 tx=0x7f1a6802be40 comp rx=0 tx=0).stop 2023-10-14T09:37:37.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.023+0000 7f1a7635e640 1 -- 172.21.15.102:0/142265829 shutdown_connections 2023-10-14T09:37:37.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.023+0000 7f1a7635e640 1 --2- 172.21.15.102:0/142265829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a7015d3f0 0x7f1a7015d820 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:37.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.023+0000 7f1a7635e640 1 --2- 172.21.15.102:0/142265829 >> v2:172.21.15.129:3300/0 conn(0x7f1a700b0b20 0x7f1a701615f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:37.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.023+0000 7f1a7635e640 1 -- 172.21.15.102:0/142265829 >> 172.21.15.102:0/142265829 conn(0x7f1a700cb410 msgr2=0x7f1a700cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:37.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.023+0000 7f1a7635e640 1 -- 172.21.15.102:0/142265829 shutdown_connections 2023-10-14T09:37:37.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.023+0000 7f1a7635e640 1 -- 172.21.15.102:0/142265829 wait complete. 2023-10-14T09:37:37.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.024+0000 7f1a7635e640 1 Processor -- start 2023-10-14T09:37:37.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.025+0000 7f1a7635e640 1 -- start start 2023-10-14T09:37:37.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.026+0000 7f1a7635e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1a700b0b20 0x7f1a70156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:37.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.026+0000 7f1a7635e640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1a700cd0c0 0x7f1a700b2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:37.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.026+0000 7f1a7635e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a7015d3f0 0x7f1a700b3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:37.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.026+0000 7f1a7635e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a700c3c80 con 0x7f1a7015d3f0 2023-10-14T09:37:37.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.026+0000 7f1a7635e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a700c3070 con 0x7f1a700b0b20 2023-10-14T09:37:37.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.026+0000 7f1a7635e640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a700c3350 con 0x7f1a700cd0c0 2023-10-14T09:37:37.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.026+0000 7f1a748fb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a7015d3f0 0x7f1a700b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:37.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.026+0000 7f1a748fb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a7015d3f0 0x7f1a700b3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33198/0 (socket says 172.21.15.102:33198) 2023-10-14T09:37:37.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.026+0000 7f1a748fb640 1 -- 172.21.15.102:0/1580589453 learned_addr learned my addr 172.21.15.102:0/1580589453 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:37.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.026+0000 7f1a6ffff640 1 --2- 172.21.15.102:0/1580589453 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1a700b0b20 0x7f1a70156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:37.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.026+0000 7f1a6f7fe640 1 --2- 172.21.15.102:0/1580589453 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1a700cd0c0 0x7f1a700b2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:37.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.026+0000 7f1a748fb640 1 -- 172.21.15.102:0/1580589453 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1a700cd0c0 msgr2=0x7f1a700b2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:37.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.026+0000 7f1a748fb640 1 --2- 172.21.15.102:0/1580589453 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1a700cd0c0 0x7f1a700b2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:37.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.026+0000 7f1a748fb640 1 -- 172.21.15.102:0/1580589453 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1a700b0b20 msgr2=0x7f1a70156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:37.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.026+0000 7f1a748fb640 1 --2- 172.21.15.102:0/1580589453 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1a700b0b20 0x7f1a70156e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:37.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.026+0000 7f1a748fb640 1 -- 172.21.15.102:0/1580589453 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a68009a70 con 0x7f1a7015d3f0 2023-10-14T09:37:37.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.027+0000 7f1a748fb640 1 --2- 172.21.15.102:0/1580589453 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a7015d3f0 0x7f1a700b3030 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1a68009e80 tx=0x7f1a68004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:37.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.027+0000 7f1a6cff9640 1 -- 172.21.15.102:0/1580589453 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a68040650 con 0x7f1a7015d3f0 2023-10-14T09:37:37.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.027+0000 7f1a6cff9640 1 -- 172.21.15.102:0/1580589453 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a680407b0 con 0x7f1a7015d3f0 2023-10-14T09:37:37.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.027+0000 7f1a6cff9640 1 -- 172.21.15.102:0/1580589453 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a68040b60 con 0x7f1a7015d3f0 2023-10-14T09:37:37.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.027+0000 7f1a7635e640 1 -- 172.21.15.102:0/1580589453 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a700c3630 con 0x7f1a7015d3f0 2023-10-14T09:37:37.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.027+0000 7f1a7635e640 1 -- 172.21.15.102:0/1580589453 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a70157360 con 0x7f1a7015d3f0 2023-10-14T09:37:37.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.028+0000 7f1a7635e640 1 -- 172.21.15.102:0/1580589453 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a700c3df0 con 0x7f1a7015d3f0 2023-10-14T09:37:37.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.029+0000 7f1a6cff9640 1 -- 172.21.15.102:0/1580589453 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1a68040cc0 con 0x7f1a7015d3f0 2023-10-14T09:37:37.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.030+0000 7f1a6cff9640 1 --2- 172.21.15.102:0/1580589453 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1a5c06ae70 0x7f1a5c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:37.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.030+0000 7f1a6cff9640 1 -- 172.21.15.102:0/1580589453 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a680ac470 con 0x7f1a7015d3f0 2023-10-14T09:37:37.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.030+0000 7f1a6ffff640 1 --2- 172.21.15.102:0/1580589453 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1a5c06ae70 0x7f1a5c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:37.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.031+0000 7f1a6ffff640 1 --2- 172.21.15.102:0/1580589453 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1a5c06ae70 0x7f1a5c06d330 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1a600011e0 tx=0x7f1a60009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:37.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.035+0000 7f1a6cff9640 1 -- 172.21.15.102:0/1580589453 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1a68077480 con 0x7f1a7015d3f0 2023-10-14T09:37:37.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.262+0000 7f1a7635e640 1 -- 172.21.15.102:0/1580589453 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a7004e160 con 0x7f1a7015d3f0 2023-10-14T09:37:37.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.263+0000 7f1a6cff9640 1 -- 172.21.15.102:0/1580589453 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4916 (secure 0 0 0) 0x7f1a68009450 con 0x7f1a7015d3f0 2023-10-14T09:37:37.265 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:37:37.265 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6835/3867702876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6833","nonce":3867702876},{"type":"v1","addr":"172.21.15.129:6835","nonce":3867702876}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6834/1559210030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":1559210030},{"type":"v1","addr":"172.21.15.129:6834","nonce":1559210030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1277026451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1277026451},{"type":"v1","addr":"172.21.15.102:6835","nonce":1277026451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T09:37:21.362625+0000","modified":"2023-10-14T09:37:24.408132+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6837/527707922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":527707922},{"type":"v1","addr":"172.21.15.102:6837","nonce":527707922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T09:37:37.265 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 8 2023-10-14T09:37:37.267 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.265+0000 7f1a7635e640 1 -- 172.21.15.102:0/1580589453 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1a5c06ae70 msgr2=0x7f1a5c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:37.267 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.265+0000 7f1a7635e640 1 --2- 172.21.15.102:0/1580589453 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1a5c06ae70 0x7f1a5c06d330 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1a600011e0 tx=0x7f1a60009040 comp rx=0 tx=0).stop 2023-10-14T09:37:37.267 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.265+0000 7f1a7635e640 1 -- 172.21.15.102:0/1580589453 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a7015d3f0 msgr2=0x7f1a700b3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:37.267 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.265+0000 7f1a7635e640 1 --2- 172.21.15.102:0/1580589453 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a7015d3f0 0x7f1a700b3030 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1a68009e80 tx=0x7f1a68004a40 comp rx=0 tx=0).stop 2023-10-14T09:37:37.268 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.265+0000 7f1a7635e640 1 -- 172.21.15.102:0/1580589453 shutdown_connections 2023-10-14T09:37:37.268 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.265+0000 7f1a7635e640 1 --2- 172.21.15.102:0/1580589453 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1a5c06ae70 0x7f1a5c06d330 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:37.268 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.265+0000 7f1a7635e640 1 --2- 172.21.15.102:0/1580589453 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a7015d3f0 0x7f1a700b3030 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:37.268 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.265+0000 7f1a7635e640 1 --2- 172.21.15.102:0/1580589453 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1a700cd0c0 0x7f1a700b2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:37.268 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.265+0000 7f1a7635e640 1 --2- 172.21.15.102:0/1580589453 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1a700b0b20 0x7f1a70156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:37.269 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.265+0000 7f1a7635e640 1 -- 172.21.15.102:0/1580589453 >> 172.21.15.102:0/1580589453 conn(0x7f1a700cb410 msgr2=0x7f1a70160170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:37.269 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.265+0000 7f1a7635e640 1 -- 172.21.15.102:0/1580589453 shutdown_connections 2023-10-14T09:37:37.269 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.265+0000 7f1a7635e640 1 -- 172.21.15.102:0/1580589453 wait complete. 2023-10-14T09:37:37.285 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:37:37.493 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.491+0000 7ffbe1ca9640 1 Processor -- start 2023-10-14T09:37:37.493 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.491+0000 7ffbe1ca9640 1 -- start start 2023-10-14T09:37:37.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.492+0000 7ffbe1ca9640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ffbdc15aaa0 0x7ffbdc15e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:37.495 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.492+0000 7ffbe1ca9640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7ffbdc15ae80 0x7ffbdc0cc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:37.495 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.493+0000 7ffbe1ca9640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbdc15ed60 con 0x7ffbdc0ccaa0 2023-10-14T09:37:37.495 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.493+0000 7ffbe1ca9640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbdc06b810 con 0x7ffbdc15aaa0 2023-10-14T09:37:37.495 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.493+0000 7ffbe1ca9640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbdc0707e0 con 0x7ffbdc15ae80 2023-10-14T09:37:37.495 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.493+0000 7ffbdbfff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7ffbdc0ccaa0 0x7ffbdc070f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:50394/0 (socket says 172.21.15.102:50394) 2023-10-14T09:37:37.496 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.493+0000 7ffbdbfff640 1 -- 172.21.15.102:0/1395797105 learned_addr learned my addr 172.21.15.102:0/1395797105 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:37.496 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.493+0000 7ffbdb7fe640 1 --2- 172.21.15.102:0/1395797105 >> v2:172.21.15.102:3300/0 conn(0x7ffbdc15aaa0 0x7ffbdc15e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:37.498 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.493+0000 7ffbd2ffd640 1 --2- 172.21.15.102:0/1395797105 >> v2:172.21.15.129:3300/0 conn(0x7ffbdc15ae80 0x7ffbdc0cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:37.498 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.493+0000 7ffbdb7fe640 1 -- 172.21.15.102:0/1395797105 >> v2:172.21.15.129:3300/0 conn(0x7ffbdc15ae80 msgr2=0x7ffbdc0cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:37.498 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.493+0000 7ffbdb7fe640 1 --2- 172.21.15.102:0/1395797105 >> v2:172.21.15.129:3300/0 conn(0x7ffbdc15ae80 0x7ffbdc0cc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:37.498 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.493+0000 7ffbdb7fe640 1 -- 172.21.15.102:0/1395797105 >> v1:172.21.15.102:6789/0 conn(0x7ffbdc0ccaa0 legacy=0x7ffbdc070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:37.498 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.493+0000 7ffbdb7fe640 1 -- 172.21.15.102:0/1395797105 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbdc15ef90 con 0x7ffbdc15aaa0 2023-10-14T09:37:37.499 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.493+0000 7ffbdaffd640 1 -- 172.21.15.102:0/1395797105 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3867473204 0 0) 0x7ffbdc15ed60 con 0x7ffbdc0ccaa0 2023-10-14T09:37:37.499 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.494+0000 7ffbdb7fe640 1 --2- 172.21.15.102:0/1395797105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbdc15aaa0 0x7ffbdc15e820 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc0c59c0 tx=0x7ffbcc02bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7a3ef92f8ff49a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:37.499 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.495+0000 7ffbdaffd640 1 -- 172.21.15.102:0/1395797105 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc02cc70 con 0x7ffbdc15aaa0 2023-10-14T09:37:37.499 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.495+0000 7ffbdaffd640 1 -- 172.21.15.102:0/1395797105 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbcc02cdd0 con 0x7ffbdc15aaa0 2023-10-14T09:37:37.499 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.495+0000 7ffbdaffd640 1 -- 172.21.15.102:0/1395797105 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc034660 con 0x7ffbdc15aaa0 2023-10-14T09:37:37.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.495+0000 7ffbe1ca9640 1 -- 172.21.15.102:0/1395797105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbdc15aaa0 msgr2=0x7ffbdc15e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:37.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.495+0000 7ffbe1ca9640 1 --2- 172.21.15.102:0/1395797105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbdc15aaa0 0x7ffbdc15e820 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc0c59c0 tx=0x7ffbcc02bec0 comp rx=0 tx=0).stop 2023-10-14T09:37:37.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.495+0000 7ffbe1ca9640 1 -- 172.21.15.102:0/1395797105 shutdown_connections 2023-10-14T09:37:37.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.495+0000 7ffbe1ca9640 1 --2- 172.21.15.102:0/1395797105 >> v2:172.21.15.129:3300/0 conn(0x7ffbdc15ae80 0x7ffbdc0cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:37.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.495+0000 7ffbe1ca9640 1 --2- 172.21.15.102:0/1395797105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbdc15aaa0 0x7ffbdc15e820 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:37.501 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.495+0000 7ffbe1ca9640 1 -- 172.21.15.102:0/1395797105 >> 172.21.15.102:0/1395797105 conn(0x7ffbdc0cb410 msgr2=0x7ffbdc0cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:37.501 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.495+0000 7ffbe1ca9640 1 -- 172.21.15.102:0/1395797105 shutdown_connections 2023-10-14T09:37:37.501 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.495+0000 7ffbe1ca9640 1 -- 172.21.15.102:0/1395797105 wait complete. 2023-10-14T09:37:37.503 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.497+0000 7ffbe1ca9640 1 Processor -- start 2023-10-14T09:37:37.503 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.497+0000 7ffbe1ca9640 1 -- start start 2023-10-14T09:37:37.503 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.498+0000 7ffbe1ca9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbdc0ccaa0 0x7ffbdc14c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:37.504 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.498+0000 7ffbe1ca9640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ffbdc15aaa0 0x7ffbdc0ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:37.504 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.498+0000 7ffbe1ca9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffbdc15ae80 0x7ffbdc0acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:37.504 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.498+0000 7ffbe1ca9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc14cd10 con 0x7ffbdc0ccaa0 2023-10-14T09:37:37.504 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.498+0000 7ffbe1ca9640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc14cf80 con 0x7ffbdc15ae80 2023-10-14T09:37:37.504 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.498+0000 7ffbe1ca9640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc14d260 con 0x7ffbdc15aaa0 2023-10-14T09:37:37.504 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.498+0000 7ffbdb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbdc0ccaa0 0x7ffbdc14c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:37.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.498+0000 7ffbdb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbdc0ccaa0 0x7ffbdc14c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33220/0 (socket says 172.21.15.102:33220) 2023-10-14T09:37:37.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.498+0000 7ffbdb7fe640 1 -- 172.21.15.102:0/3717742977 learned_addr learned my addr 172.21.15.102:0/3717742977 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:37.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.499+0000 7ffbdb7fe640 1 -- 172.21.15.102:0/3717742977 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ffbdc15aaa0 msgr2=0x7ffbdc0ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:37.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.499+0000 7ffbdbfff640 1 --2- 172.21.15.102:0/3717742977 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffbdc15ae80 0x7ffbdc0acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:37.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.499+0000 7ffbd2ffd640 1 --2- 172.21.15.102:0/3717742977 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ffbdc15aaa0 0x7ffbdc0ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:37.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.499+0000 7ffbdb7fe640 1 --2- 172.21.15.102:0/3717742977 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ffbdc15aaa0 0x7ffbdc0ac890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:37.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.499+0000 7ffbdb7fe640 1 -- 172.21.15.102:0/3717742977 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffbdc15ae80 msgr2=0x7ffbdc0acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:37.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.499+0000 7ffbdb7fe640 1 --2- 172.21.15.102:0/3717742977 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffbdc15ae80 0x7ffbdc0acdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:37.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.499+0000 7ffbdb7fe640 1 -- 172.21.15.102:0/3717742977 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbcc009a70 con 0x7ffbdc0ccaa0 2023-10-14T09:37:37.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.499+0000 7ffbdb7fe640 1 --2- 172.21.15.102:0/3717742977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbdc0ccaa0 0x7ffbdc14c4b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc037040 tx=0x7ffbcc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:37.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.499+0000 7ffbd8ff9640 1 -- 172.21.15.102:0/3717742977 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc040650 con 0x7ffbdc0ccaa0 2023-10-14T09:37:37.507 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.499+0000 7ffbd8ff9640 1 -- 172.21.15.102:0/3717742977 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbcc0407b0 con 0x7ffbdc0ccaa0 2023-10-14T09:37:37.507 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.499+0000 7ffbe1ca9640 1 -- 172.21.15.102:0/3717742977 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbdc14d540 con 0x7ffbdc0ccaa0 2023-10-14T09:37:37.507 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.499+0000 7ffbd8ff9640 1 -- 172.21.15.102:0/3717742977 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc040b60 con 0x7ffbdc0ccaa0 2023-10-14T09:37:37.507 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.500+0000 7ffbe1ca9640 1 -- 172.21.15.102:0/3717742977 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbdc1f6a70 con 0x7ffbdc0ccaa0 2023-10-14T09:37:37.507 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.501+0000 7ffbe1ca9640 1 -- 172.21.15.102:0/3717742977 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbdc04e160 con 0x7ffbdc0ccaa0 2023-10-14T09:37:37.508 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.502+0000 7ffbd8ff9640 1 -- 172.21.15.102:0/3717742977 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ffbcc040cc0 con 0x7ffbdc0ccaa0 2023-10-14T09:37:37.508 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.502+0000 7ffbd8ff9640 1 --2- 172.21.15.102:0/3717742977 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ffbbc06aea0 0x7ffbbc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:37.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.502+0000 7ffbd8ff9640 1 -- 172.21.15.102:0/3717742977 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffbcc0ac330 con 0x7ffbdc0ccaa0 2023-10-14T09:37:37.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.503+0000 7ffbd2ffd640 1 --2- 172.21.15.102:0/3717742977 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ffbbc06aea0 0x7ffbbc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:37.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.503+0000 7ffbd2ffd640 1 --2- 172.21.15.102:0/3717742977 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ffbbc06aea0 0x7ffbbc06d360 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4006fd0 tx=0x7ffbc4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:37.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.507+0000 7ffbd8ff9640 1 -- 172.21.15.102:0/3717742977 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffbcc077460 con 0x7ffbdc0ccaa0 2023-10-14T09:37:37.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.696+0000 7ffbe1ca9640 1 -- 172.21.15.102:0/3717742977 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffbdc0cdc60 con 0x7ffbdc0ccaa0 2023-10-14T09:37:37.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.699+0000 7ffbd8ff9640 1 -- 172.21.15.102:0/3717742977 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16541 (secure 0 0 0) 0x7ffbcc07aa80 con 0x7ffbdc0ccaa0 2023-10-14T09:37:37.701 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:37:37.701 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":22,"fsid":"8a6cd69d-7f5b-4f2a-806a-0176c10aed50","created":"2023-10-14T09:36:56.745172+0000","modified":"2023-10-14T09:37:22.712469+0000","last_up_change":"2023-10-14T09:37:09.791473+0000","last_in_change":"2023-10-14T09:37:00.547186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:37:09.952407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:37:19.560925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:37:20.363385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e5aef8f3-878f-482b-b522-9a5b958b90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6801","nonce":1727250718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6803","nonce":1727250718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6807","nonce":1727250718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6805","nonce":1727250718}]},"public_addr":"172.21.15.102:6801/1727250718","cluster_addr":"172.21.15.102:6803/1727250718","heartbeat_back_addr":"172.21.15.102:6807/1727250718","heartbeat_front_addr":"172.21.15.102:6805/1727250718","state":["exists","up"]},{"osd":1,"uuid":"4a8cf50e-387b-4d47-9588-bd22e375a9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6809","nonce":1095651107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6811","nonce":1095651107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6815","nonce":1095651107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6813","nonce":1095651107}]},"public_addr":"172.21.15.102:6809/1095651107","cluster_addr":"172.21.15.102:6811/1095651107","heartbeat_back_addr":"172.21.15.102:6815/1095651107","heartbeat_front_addr":"172.21.15.102:6813/1095651107","state":["exists","up"]},{"osd":2,"uuid":"009ef55f-8a63-4219-bacd-d7c7b4500867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6820","nonce":2198222556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6825","nonce":2198222556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6831","nonce":2198222556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6829","nonce":2198222556}]},"public_addr":"172.21.15.102:6820/2198222556","cluster_addr":"172.21.15.102:6825/2198222556","heartbeat_back_addr":"172.21.15.102:6831/2198222556","heartbeat_front_addr":"172.21.15.102:6829/2198222556","state":["exists","up"]},{"osd":3,"uuid":"f2110eae-2ff9-4ed9-93d6-bd2361618211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6818","nonce":654726740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6821","nonce":654726740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6827","nonce":654726740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6823","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6824","nonce":654726740}]},"public_addr":"172.21.15.102:6818/654726740","cluster_addr":"172.21.15.102:6821/654726740","heartbeat_back_addr":"172.21.15.102:6827/654726740","heartbeat_front_addr":"172.21.15.102:6824/654726740","state":["exists","up"]},{"osd":4,"uuid":"33f1ae34-3100-40f7-9cb8-0eca2b358693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6817","nonce":507586170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6819","nonce":507586170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6823","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6825","nonce":507586170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6821","nonce":507586170}]},"public_addr":"172.21.15.129:6817/507586170","cluster_addr":"172.21.15.129:6819/507586170","heartbeat_back_addr":"172.21.15.129:6825/507586170","heartbeat_front_addr":"172.21.15.129:6821/507586170","state":["exists","up"]},{"osd":5,"uuid":"fab2fc62-3f3e-450d-93e0-770f39e80710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6801","nonce":1913451073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6803","nonce":1913451073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6807","nonce":1913451073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6805","nonce":1913451073}]},"public_addr":"172.21.15.129:6801/1913451073","cluster_addr":"172.21.15.129:6803/1913451073","heartbeat_back_addr":"172.21.15.129:6807/1913451073","heartbeat_front_addr":"172.21.15.129:6805/1913451073","state":["exists","up"]},{"osd":6,"uuid":"d7cc1d69-92e7-4253-a127-cfc0444a4809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6809","nonce":2853291511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6811","nonce":2853291511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6815","nonce":2853291511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6813","nonce":2853291511}]},"public_addr":"172.21.15.129:6809/2853291511","cluster_addr":"172.21.15.129:6811/2853291511","heartbeat_back_addr":"172.21.15.129:6815/2853291511","heartbeat_front_addr":"172.21.15.129:6813/2853291511","state":["exists","up"]},{"osd":7,"uuid":"1e403de1-09e2-4370-b9a7-e790ac44bbee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6824","nonce":2933886914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6827","nonce":2933886914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6831","nonce":2933886914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6829","nonce":2933886914}]},"public_addr":"172.21.15.129:6824/2933886914","cluster_addr":"172.21.15.129:6827/2933886914","heartbeat_back_addr":"172.21.15.129:6831/2933886914","heartbeat_front_addr":"172.21.15.129:6829/2933886914","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.849661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.868113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.933488+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.891794+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.901861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.858750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.911712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.996765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:37:37.703 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.701+0000 7ffbe1ca9640 1 -- 172.21.15.102:0/3717742977 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ffbbc06aea0 msgr2=0x7ffbbc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:37.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.701+0000 7ffbe1ca9640 1 --2- 172.21.15.102:0/3717742977 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ffbbc06aea0 0x7ffbbc06d360 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4006fd0 tx=0x7ffbc4008040 comp rx=0 tx=0).stop 2023-10-14T09:37:37.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.701+0000 7ffbe1ca9640 1 -- 172.21.15.102:0/3717742977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbdc0ccaa0 msgr2=0x7ffbdc14c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:37.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.701+0000 7ffbe1ca9640 1 --2- 172.21.15.102:0/3717742977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbdc0ccaa0 0x7ffbdc14c4b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc037040 tx=0x7ffbcc004a40 comp rx=0 tx=0).stop 2023-10-14T09:37:37.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.702+0000 7ffbe1ca9640 1 -- 172.21.15.102:0/3717742977 shutdown_connections 2023-10-14T09:37:37.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.702+0000 7ffbe1ca9640 1 --2- 172.21.15.102:0/3717742977 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ffbbc06aea0 0x7ffbbc06d360 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:37.705 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.702+0000 7ffbe1ca9640 1 --2- 172.21.15.102:0/3717742977 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffbdc15ae80 0x7ffbdc0acdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:37.705 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.702+0000 7ffbe1ca9640 1 --2- 172.21.15.102:0/3717742977 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ffbdc15aaa0 0x7ffbdc0ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:37.705 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.702+0000 7ffbe1ca9640 1 --2- 172.21.15.102:0/3717742977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbdc0ccaa0 0x7ffbdc14c4b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:37.705 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.702+0000 7ffbe1ca9640 1 -- 172.21.15.102:0/3717742977 >> 172.21.15.102:0/3717742977 conn(0x7ffbdc0cb410 msgr2=0x7ffbdc06cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:37.705 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.702+0000 7ffbe1ca9640 1 -- 172.21.15.102:0/3717742977 shutdown_connections 2023-10-14T09:37:37.706 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.702+0000 7ffbe1ca9640 1 -- 172.21.15.102:0/3717742977 wait complete. 2023-10-14T09:37:37.720 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:37:37.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.926+0000 7f04d694e640 1 Processor -- start 2023-10-14T09:37:37.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.926+0000 7f04d694e640 1 -- start start 2023-10-14T09:37:37.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.928+0000 7f04d694e640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f04d00b3070 0x7f04d00cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:37.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.928+0000 7f04d694e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f04d00d1b10 0x7f04d00cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:37.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.928+0000 7f04d694e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d00b3940 con 0x7f04d00b3e70 2023-10-14T09:37:37.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.928+0000 7f04d694e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d00b45e0 con 0x7f04d00d1b10 2023-10-14T09:37:37.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.928+0000 7f04d694e640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d00b3b90 con 0x7f04d00b3070 2023-10-14T09:37:37.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.928+0000 7f04d4eeb640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f04d00d1b10 0x7f04d00cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:37.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.928+0000 7f04d4eeb640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f04d00d1b10 0x7f04d00cfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33228/0 (socket says 172.21.15.102:33228) 2023-10-14T09:37:37.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.928+0000 7f04d4eeb640 1 -- 172.21.15.102:0/1780861021 learned_addr learned my addr 172.21.15.102:0/1780861021 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:37.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.928+0000 7f04c7fff640 1 --1- 172.21.15.102:0/1780861021 >> v1:172.21.15.102:6789/0 conn(0x7f04d00b3e70 0x7f04d00c6870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:50402/0 (socket says 172.21.15.102:50402) 2023-10-14T09:37:37.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.928+0000 7f04cffff640 1 --2- 172.21.15.102:0/1780861021 >> v2:172.21.15.129:3300/0 conn(0x7f04d00b3070 0x7f04d00cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:37.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.929+0000 7f04d4eeb640 1 -- 172.21.15.102:0/1780861021 >> v2:172.21.15.129:3300/0 conn(0x7f04d00b3070 msgr2=0x7f04d00cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:37.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.929+0000 7f04d4eeb640 1 --2- 172.21.15.102:0/1780861021 >> v2:172.21.15.129:3300/0 conn(0x7f04d00b3070 0x7f04d00cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:37.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.929+0000 7f04d4eeb640 1 -- 172.21.15.102:0/1780861021 >> v1:172.21.15.102:6789/0 conn(0x7f04d00b3e70 legacy=0x7f04d00c6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:37.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.929+0000 7f04d4eeb640 1 -- 172.21.15.102:0/1780861021 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d00d3840 con 0x7f04d00d1b10 2023-10-14T09:37:37.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.930+0000 7f04d4eeb640 1 --2- 172.21.15.102:0/1780861021 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04d00d1b10 0x7f04d00cfa40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f04d008ba60 tx=0x7f04c802bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a316b79fc62911 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:37.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.930+0000 7f04cf7fe640 1 -- 172.21.15.102:0/1780861021 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c802cb10 con 0x7f04d00d1b10 2023-10-14T09:37:37.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.930+0000 7f04cf7fe640 1 -- 172.21.15.102:0/1780861021 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c802cc70 con 0x7f04d00d1b10 2023-10-14T09:37:37.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.930+0000 7f04cf7fe640 1 -- 172.21.15.102:0/1780861021 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c80343f0 con 0x7f04d00d1b10 2023-10-14T09:37:37.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.931+0000 7f04d694e640 1 -- 172.21.15.102:0/1780861021 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04d00d1b10 msgr2=0x7f04d00cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:37.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.931+0000 7f04d694e640 1 --2- 172.21.15.102:0/1780861021 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04d00d1b10 0x7f04d00cfa40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f04d008ba60 tx=0x7f04c802bf70 comp rx=0 tx=0).stop 2023-10-14T09:37:37.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.931+0000 7f04d694e640 1 -- 172.21.15.102:0/1780861021 shutdown_connections 2023-10-14T09:37:37.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.931+0000 7f04d694e640 1 --2- 172.21.15.102:0/1780861021 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04d00d1b10 0x7f04d00cfa40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:37.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.931+0000 7f04d694e640 1 --2- 172.21.15.102:0/1780861021 >> v2:172.21.15.129:3300/0 conn(0x7f04d00b3070 0x7f04d00cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:37.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.931+0000 7f04d694e640 1 -- 172.21.15.102:0/1780861021 >> 172.21.15.102:0/1780861021 conn(0x7f04d00d2d20 msgr2=0x7f04d00d3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:37.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.931+0000 7f04d694e640 1 -- 172.21.15.102:0/1780861021 shutdown_connections 2023-10-14T09:37:37.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.931+0000 7f04d694e640 1 -- 172.21.15.102:0/1780861021 wait complete. 2023-10-14T09:37:37.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.932+0000 7f04d694e640 1 Processor -- start 2023-10-14T09:37:37.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.933+0000 7f04d694e640 1 -- start start 2023-10-14T09:37:37.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.933+0000 7f04d694e640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f04d00b3070 0x7f04d00b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:37.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.933+0000 7f04d694e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04d00b3e70 0x7f04d015c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:37.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.934+0000 7f04d694e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f04d00d1b10 0x7f04d00ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:37.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.934+0000 7f04d694e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d00b2950 con 0x7f04d00b3e70 2023-10-14T09:37:37.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.934+0000 7f04d694e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d015c720 con 0x7f04d00d1b10 2023-10-14T09:37:37.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.934+0000 7f04d694e640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d00b2390 con 0x7f04d00b3070 2023-10-14T09:37:37.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.934+0000 7f04c7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04d00b3e70 0x7f04d015c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:37.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.934+0000 7f04c7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04d00b3e70 0x7f04d015c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33240/0 (socket says 172.21.15.102:33240) 2023-10-14T09:37:37.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.934+0000 7f04c7fff640 1 -- 172.21.15.102:0/98934988 learned_addr learned my addr 172.21.15.102:0/98934988 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:37.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.934+0000 7f04c7fff640 1 -- 172.21.15.102:0/98934988 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f04d00b3070 msgr2=0x7f04d00b1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:37.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.934+0000 7f04c7fff640 1 --2- 172.21.15.102:0/98934988 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f04d00b3070 0x7f04d00b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:37.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.934+0000 7f04c7fff640 1 -- 172.21.15.102:0/98934988 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f04d00d1b10 msgr2=0x7f04d00ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:37.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.934+0000 7f04c7fff640 1 --2- 172.21.15.102:0/98934988 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f04d00d1b10 0x7f04d00ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:37.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.934+0000 7f04c7fff640 1 -- 172.21.15.102:0/98934988 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c8009b30 con 0x7f04d00b3e70 2023-10-14T09:37:37.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.934+0000 7f04c7fff640 1 --2- 172.21.15.102:0/98934988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04d00b3e70 0x7f04d015c1e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f04b800c4d0 tx=0x7f04b800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:37.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.935+0000 7f04cd7fa640 1 -- 172.21.15.102:0/98934988 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b8007480 con 0x7f04d00b3e70 2023-10-14T09:37:37.941 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.935+0000 7f04cd7fa640 1 -- 172.21.15.102:0/98934988 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b80075e0 con 0x7f04d00b3e70 2023-10-14T09:37:37.941 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.935+0000 7f04cd7fa640 1 -- 172.21.15.102:0/98934988 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b80049e0 con 0x7f04d00b3e70 2023-10-14T09:37:37.941 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.935+0000 7f04d694e640 1 -- 172.21.15.102:0/98934988 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d00b2670 con 0x7f04d00b3e70 2023-10-14T09:37:37.941 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.935+0000 7f04d694e640 1 -- 172.21.15.102:0/98934988 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d01f3c00 con 0x7f04d00b3e70 2023-10-14T09:37:37.941 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.936+0000 7f04d694e640 1 -- 172.21.15.102:0/98934988 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04d01f3e20 con 0x7f04d00b3e70 2023-10-14T09:37:37.942 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.936+0000 7f04cd7fa640 1 -- 172.21.15.102:0/98934988 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f04b8004b40 con 0x7f04d00b3e70 2023-10-14T09:37:37.942 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.937+0000 7f04cd7fa640 1 --2- 172.21.15.102:0/98934988 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f04b006ae70 0x7f04b006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:37.942 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.937+0000 7f04cd7fa640 1 -- 172.21.15.102:0/98934988 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04b8088730 con 0x7f04d00b3e70 2023-10-14T09:37:37.943 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.938+0000 7f04cffff640 1 --2- 172.21.15.102:0/98934988 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f04b006ae70 0x7f04b006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:37.943 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.938+0000 7f04cffff640 1 --2- 172.21.15.102:0/98934988 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f04b006ae70 0x7f04b006d330 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f04c0006e20 tx=0x7f04c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:37.943 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:37.942+0000 7f04cd7fa640 1 -- 172.21.15.102:0/98934988 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f04b80537f0 con 0x7f04d00b3e70 2023-10-14T09:37:38.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.157+0000 7f04d694e640 1 -- 172.21.15.102:0/98934988 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04d004e160 con 0x7f04d00b3e70 2023-10-14T09:37:38.160 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.158+0000 7f04cd7fa640 1 -- 172.21.15.102:0/98934988 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4916 (secure 0 0 0) 0x7f04b8056e10 con 0x7f04d00b3e70 2023-10-14T09:37:38.160 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:37:38.161 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6835/3867702876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6833","nonce":3867702876},{"type":"v1","addr":"172.21.15.129:6835","nonce":3867702876}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6834/1559210030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":1559210030},{"type":"v1","addr":"172.21.15.129:6834","nonce":1559210030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1277026451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1277026451},{"type":"v1","addr":"172.21.15.102:6835","nonce":1277026451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T09:37:21.362625+0000","modified":"2023-10-14T09:37:24.408132+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6837/527707922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":527707922},{"type":"v1","addr":"172.21.15.102:6837","nonce":527707922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T09:37:38.161 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 8 2023-10-14T09:37:38.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.161+0000 7f04d694e640 1 -- 172.21.15.102:0/98934988 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f04b006ae70 msgr2=0x7f04b006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:38.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.161+0000 7f04d694e640 1 --2- 172.21.15.102:0/98934988 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f04b006ae70 0x7f04b006d330 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f04c0006e20 tx=0x7f04c0008040 comp rx=0 tx=0).stop 2023-10-14T09:37:38.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.161+0000 7f04d694e640 1 -- 172.21.15.102:0/98934988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04d00b3e70 msgr2=0x7f04d015c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:38.164 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.161+0000 7f04d694e640 1 --2- 172.21.15.102:0/98934988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04d00b3e70 0x7f04d015c1e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f04b800c4d0 tx=0x7f04b800c990 comp rx=0 tx=0).stop 2023-10-14T09:37:38.164 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.161+0000 7f04d694e640 1 -- 172.21.15.102:0/98934988 shutdown_connections 2023-10-14T09:37:38.164 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.161+0000 7f04d694e640 1 --2- 172.21.15.102:0/98934988 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f04b006ae70 0x7f04b006d330 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:38.164 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.161+0000 7f04d694e640 1 --2- 172.21.15.102:0/98934988 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f04d00d1b10 0x7f04d00ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:38.164 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.161+0000 7f04d694e640 1 --2- 172.21.15.102:0/98934988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04d00b3e70 0x7f04d015c1e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:38.165 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.161+0000 7f04d694e640 1 --2- 172.21.15.102:0/98934988 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f04d00b3070 0x7f04d00b1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:38.165 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.161+0000 7f04d694e640 1 -- 172.21.15.102:0/98934988 >> 172.21.15.102:0/98934988 conn(0x7f04d00d2d20 msgr2=0x7f04d006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:38.165 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.161+0000 7f04d694e640 1 -- 172.21.15.102:0/98934988 shutdown_connections 2023-10-14T09:37:38.165 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.162+0000 7f04d694e640 1 -- 172.21.15.102:0/98934988 wait complete. 2023-10-14T09:37:38.582 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T09:37:21.362625+0000', 'modified': '2023-10-14T09:37:24.408132+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4287}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4287': {'gid': 4287, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.102:6837/527707922', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6836', 'nonce': 527707922}, {'type': 'v1', 'addr': '172.21.15.102:6837', 'nonce': 527707922}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-14T09:37:38.583 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T09:37:38.583 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-14T09:37:38.804 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.802+0000 7f2c7e57c640 1 Processor -- start 2023-10-14T09:37:38.804 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.803+0000 7f2c7e57c640 1 -- start start 2023-10-14T09:37:38.806 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.804+0000 7f2c7e57c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2c781618b0 0x7f2c78065ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:38.806 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.804+0000 7f2c7e57c640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f2c78065ff0 0x7f2c780ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:38.807 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.804+0000 7f2c7e57c640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c7806cee0 con 0x7f2c7815d330 2023-10-14T09:37:38.807 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.804+0000 7f2c7e57c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c7806b1e0 con 0x7f2c781618b0 2023-10-14T09:37:38.807 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.804+0000 7f2c7e57c640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c780663d0 con 0x7f2c78065ff0 2023-10-14T09:37:38.807 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.804+0000 7f2c777fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2c781618b0 0x7f2c78065ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:38.807 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.804+0000 7f2c777fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2c781618b0 0x7f2c78065ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33250/0 (socket says 172.21.15.102:33250) 2023-10-14T09:37:38.808 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.804+0000 7f2c777fe640 1 -- 172.21.15.102:0/3789780891 learned_addr learned my addr 172.21.15.102:0/3789780891 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:38.808 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.804+0000 7f2c7cb19640 1 --2- 172.21.15.102:0/3789780891 >> v2:172.21.15.129:3300/0 conn(0x7f2c78065ff0 0x7f2c780ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:38.808 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.805+0000 7f2c777fe640 1 -- 172.21.15.102:0/3789780891 >> v2:172.21.15.129:3300/0 conn(0x7f2c78065ff0 msgr2=0x7f2c780ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:38.808 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.805+0000 7f2c777fe640 1 --2- 172.21.15.102:0/3789780891 >> v2:172.21.15.129:3300/0 conn(0x7f2c78065ff0 0x7f2c780ce9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:38.808 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.805+0000 7f2c777fe640 1 -- 172.21.15.102:0/3789780891 >> v1:172.21.15.129:6789/0 conn(0x7f2c7815d330 legacy=0x7f2c7806c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:38.808 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.805+0000 7f2c777fe640 1 -- 172.21.15.102:0/3789780891 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c780d0890 con 0x7f2c781618b0 2023-10-14T09:37:38.809 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.806+0000 7f2c777fe640 1 --2- 172.21.15.102:0/3789780891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c781618b0 0x7f2c78065ab0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2c7806f340 tx=0x7f2c6002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6ce5cca11258cce server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:38.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.806+0000 7f2c76ffd640 1 -- 172.21.15.102:0/3789780891 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c600317e0 con 0x7f2c781618b0 2023-10-14T09:37:38.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.806+0000 7f2c76ffd640 1 -- 172.21.15.102:0/3789780891 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c60031940 con 0x7f2c781618b0 2023-10-14T09:37:38.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.806+0000 7f2c76ffd640 1 -- 172.21.15.102:0/3789780891 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c60031cd0 con 0x7f2c781618b0 2023-10-14T09:37:38.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.807+0000 7f2c7e57c640 1 -- 172.21.15.102:0/3789780891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c781618b0 msgr2=0x7f2c78065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:38.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.807+0000 7f2c7e57c640 1 --2- 172.21.15.102:0/3789780891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c781618b0 0x7f2c78065ab0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2c7806f340 tx=0x7f2c6002b880 comp rx=0 tx=0).stop 2023-10-14T09:37:38.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.807+0000 7f2c7e57c640 1 -- 172.21.15.102:0/3789780891 shutdown_connections 2023-10-14T09:37:38.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.807+0000 7f2c7e57c640 1 --2- 172.21.15.102:0/3789780891 >> v2:172.21.15.129:3300/0 conn(0x7f2c78065ff0 0x7f2c780ce9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:38.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.807+0000 7f2c7e57c640 1 --2- 172.21.15.102:0/3789780891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c781618b0 0x7f2c78065ab0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:38.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.807+0000 7f2c7e57c640 1 -- 172.21.15.102:0/3789780891 >> 172.21.15.102:0/3789780891 conn(0x7f2c780d0ab0 msgr2=0x7f2c780d0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:38.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.807+0000 7f2c7e57c640 1 -- 172.21.15.102:0/3789780891 shutdown_connections 2023-10-14T09:37:38.812 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.807+0000 7f2c7e57c640 1 -- 172.21.15.102:0/3789780891 wait complete. 2023-10-14T09:37:38.813 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.809+0000 7f2c7e57c640 1 Processor -- start 2023-10-14T09:37:38.813 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.809+0000 7f2c7e57c640 1 -- start start 2023-10-14T09:37:38.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.810+0000 7f2c7e57c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c78065ff0 0x7f2c780b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:38.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.810+0000 7f2c7e57c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2c7815d330 0x7f2c780ad2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:38.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.810+0000 7f2c7e57c640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2c781618b0 0x7f2c781f5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:38.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.810+0000 7f2c7e57c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c780b0b10 con 0x7f2c78065ff0 2023-10-14T09:37:38.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.810+0000 7f2c7e57c640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c780ad7e0 con 0x7f2c7815d330 2023-10-14T09:37:38.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.810+0000 7f2c7e57c640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c780add60 con 0x7f2c781618b0 2023-10-14T09:37:38.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.810+0000 7f2c77fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c78065ff0 0x7f2c780b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:38.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.810+0000 7f2c77fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c78065ff0 0x7f2c780b2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33264/0 (socket says 172.21.15.102:33264) 2023-10-14T09:37:38.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.810+0000 7f2c77fff640 1 -- 172.21.15.102:0/1463347875 learned_addr learned my addr 172.21.15.102:0/1463347875 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:38.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.810+0000 7f2c77fff640 1 -- 172.21.15.102:0/1463347875 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2c781618b0 msgr2=0x7f2c781f5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:38.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.810+0000 7f2c77fff640 1 --2- 172.21.15.102:0/1463347875 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2c781618b0 0x7f2c781f5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:38.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.810+0000 7f2c77fff640 1 -- 172.21.15.102:0/1463347875 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2c7815d330 msgr2=0x7f2c780ad2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:38.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.810+0000 7f2c77fff640 1 --2- 172.21.15.102:0/1463347875 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2c7815d330 0x7f2c780ad2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:38.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.810+0000 7f2c77fff640 1 -- 172.21.15.102:0/1463347875 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c600094d0 con 0x7f2c78065ff0 2023-10-14T09:37:38.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.811+0000 7f2c77fff640 1 --2- 172.21.15.102:0/1463347875 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c78065ff0 0x7f2c780b2e70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2c6800ba50 tx=0x7f2c6800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:38.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.811+0000 7f2c74ff9640 1 -- 172.21.15.102:0/1463347875 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6800cbe0 con 0x7f2c78065ff0 2023-10-14T09:37:38.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.811+0000 7f2c74ff9640 1 -- 172.21.15.102:0/1463347875 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6800cd80 con 0x7f2c78065ff0 2023-10-14T09:37:38.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.811+0000 7f2c74ff9640 1 -- 172.21.15.102:0/1463347875 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c68014680 con 0x7f2c78065ff0 2023-10-14T09:37:38.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.811+0000 7f2c7e57c640 1 -- 172.21.15.102:0/1463347875 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c780ada80 con 0x7f2c78065ff0 2023-10-14T09:37:38.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.811+0000 7f2c7e57c640 1 -- 172.21.15.102:0/1463347875 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c780b0730 con 0x7f2c78065ff0 2023-10-14T09:37:38.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.813+0000 7f2c74ff9640 1 -- 172.21.15.102:0/1463347875 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2c680147e0 con 0x7f2c78065ff0 2023-10-14T09:37:38.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.814+0000 7f2c74ff9640 1 --2- 172.21.15.102:0/1463347875 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2c5806ae70 0x7f2c5806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:38.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.814+0000 7f2c74ff9640 1 -- 172.21.15.102:0/1463347875 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c680893f0 con 0x7f2c78065ff0 2023-10-14T09:37:38.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.814+0000 7f2c777fe640 1 --2- 172.21.15.102:0/1463347875 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2c5806ae70 0x7f2c5806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:38.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.815+0000 7f2c777fe640 1 --2- 172.21.15.102:0/1463347875 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2c5806ae70 0x7f2c5806d330 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2c60036000 tx=0x7f2c60030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:38.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.815+0000 7f2c811e7740 1 Processor -- start 2023-10-14T09:37:38.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.815+0000 7f2c811e7740 1 -- start start 2023-10-14T09:37:38.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.816+0000 7f2c811e7740 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c80f40ff80 0x55c80f3e2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:38.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.816+0000 7f2c811e7740 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x55c80f410360 0x55c80f412d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:38.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.816+0000 7f2c811e7740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c80f3e33c0 0x55c80f413250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:38.822 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.816+0000 7f2c811e7740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c80f3037a0 con 0x55c80f3e33c0 2023-10-14T09:37:38.822 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.816+0000 7f2c811e7740 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c80f355740 con 0x55c80f40ff80 2023-10-14T09:37:38.822 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.816+0000 7f2c811e7740 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c80f352e30 con 0x55c80f410360 2023-10-14T09:37:38.822 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.816+0000 7f2c7cb19640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c80f3e33c0 0x55c80f413250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:38.822 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.816+0000 7f2c7cb19640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c80f3e33c0 0x55c80f413250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33276/0 (socket says 172.21.15.102:33276) 2023-10-14T09:37:38.823 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.816+0000 7f2c7cb19640 1 -- 172.21.15.102:0/86085671 learned_addr learned my addr 172.21.15.102:0/86085671 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:38.823 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.816+0000 7f2c77fff640 1 --2- 172.21.15.102:0/86085671 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c80f40ff80 0x55c80f3e2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:38.823 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.817+0000 7f2c777fe640 1 --2- 172.21.15.102:0/86085671 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x55c80f410360 0x55c80f412d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:38.823 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.817+0000 7f2c7cb19640 1 -- 172.21.15.102:0/86085671 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x55c80f410360 msgr2=0x55c80f412d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:38.823 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.817+0000 7f2c7cb19640 1 --2- 172.21.15.102:0/86085671 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x55c80f410360 0x55c80f412d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:38.824 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.817+0000 7f2c7cb19640 1 -- 172.21.15.102:0/86085671 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c80f40ff80 msgr2=0x55c80f3e2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:38.824 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.817+0000 7f2c7cb19640 1 --2- 172.21.15.102:0/86085671 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c80f40ff80 0x55c80f3e2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:38.824 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.817+0000 7f2c7cb19640 1 -- 172.21.15.102:0/86085671 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c80f312910 con 0x55c80f3e33c0 2023-10-14T09:37:38.824 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.817+0000 7f2c777fe640 1 --2- 172.21.15.102:0/86085671 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x55c80f410360 0x55c80f412d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:38.824 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.817+0000 7f2c77fff640 1 --2- 172.21.15.102:0/86085671 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c80f40ff80 0x55c80f3e2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:38.824 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.817+0000 7f2c7cb19640 1 --2- 172.21.15.102:0/86085671 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c80f3e33c0 0x55c80f413250 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2c700076d0 tx=0x7f2c70007b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c6a3cd273d9738 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:38.825 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.817+0000 7f2c6dffb640 1 -- 172.21.15.102:0/86085671 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7000d740 con 0x55c80f3e33c0 2023-10-14T09:37:38.825 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.817+0000 7f2c6dffb640 1 -- 172.21.15.102:0/86085671 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7000d8a0 con 0x55c80f3e33c0 2023-10-14T09:37:38.825 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.817+0000 7f2c6dffb640 1 -- 172.21.15.102:0/86085671 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7000dc30 con 0x55c80f3e33c0 2023-10-14T09:37:38.825 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.818+0000 7f2c811e7740 1 -- 172.21.15.102:0/86085671 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c80f3e33c0 msgr2=0x55c80f413250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:38.825 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.818+0000 7f2c811e7740 1 --2- 172.21.15.102:0/86085671 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c80f3e33c0 0x55c80f413250 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2c700076d0 tx=0x7f2c70007b90 comp rx=0 tx=0).stop 2023-10-14T09:37:38.826 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.818+0000 7f2c811e7740 1 -- 172.21.15.102:0/86085671 shutdown_connections 2023-10-14T09:37:38.826 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.818+0000 7f2c811e7740 1 --2- 172.21.15.102:0/86085671 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c80f3e33c0 0x55c80f413250 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:38.826 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.818+0000 7f2c811e7740 1 --2- 172.21.15.102:0/86085671 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x55c80f410360 0x55c80f412d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:38.826 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.818+0000 7f2c811e7740 1 --2- 172.21.15.102:0/86085671 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c80f40ff80 0x55c80f3e2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:38.826 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.818+0000 7f2c811e7740 1 -- 172.21.15.102:0/86085671 >> 172.21.15.102:0/86085671 conn(0x55c80f3e5190 msgr2=0x55c80f42dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:38.826 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.818+0000 7f2c811e7740 1 -- 172.21.15.102:0/86085671 shutdown_connections 2023-10-14T09:37:38.827 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.818+0000 7f2c811e7740 1 -- 172.21.15.102:0/86085671 wait complete. 2023-10-14T09:37:38.830 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.819+0000 7f2c811e7740 1 -- start start 2023-10-14T09:37:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.819+0000 7f2c811e7740 1 Processor -- start 2023-10-14T09:37:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.820+0000 7f2c811e7740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c80f40ff80 0x55c80f40db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.820+0000 7f2c811e7740 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x55c80f410360 0x55c80f43da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.820+0000 7f2c811e7740 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c80f416520 0x55c80f415110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.820+0000 7f2c811e7740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c80f34e720 con 0x55c80f40ff80 2023-10-14T09:37:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.820+0000 7f2c811e7740 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c80f2ec970 con 0x55c80f416520 2023-10-14T09:37:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.820+0000 7f2c811e7740 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c80f2ec610 con 0x55c80f410360 2023-10-14T09:37:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.820+0000 7f2c811e7740 10 client.0 _ll_register_callbacks cb 0x55c80f30e9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:37:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.820+0000 7f2c77fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c80f40ff80 0x55c80f40db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.820+0000 7f2c77fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c80f40ff80 0x55c80f40db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33292/0 (socket says 172.21.15.102:33292) 2023-10-14T09:37:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.820+0000 7f2c77fff640 1 -- 172.21.15.102:0/3519078657 learned_addr learned my addr 172.21.15.102:0/3519078657 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:38.833 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.820+0000 7f2c777fe640 1 --2- 172.21.15.102:0/3519078657 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x55c80f410360 0x55c80f43da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:38.833 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.820+0000 7f2c77fff640 1 -- 172.21.15.102:0/3519078657 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x55c80f410360 msgr2=0x55c80f43da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:38.833 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.820+0000 7f2c7cb19640 1 --2- 172.21.15.102:0/3519078657 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c80f416520 0x55c80f415110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:38.833 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.820+0000 7f2c77fff640 1 --2- 172.21.15.102:0/3519078657 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x55c80f410360 0x55c80f43da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:38.833 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.820+0000 7f2c77fff640 1 -- 172.21.15.102:0/3519078657 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c80f416520 msgr2=0x55c80f415110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:38.833 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.820+0000 7f2c77fff640 1 --2- 172.21.15.102:0/3519078657 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c80f416520 0x55c80f415110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:38.834 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.820+0000 7f2c77fff640 1 -- 172.21.15.102:0/3519078657 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c7000e040 con 0x55c80f40ff80 2023-10-14T09:37:38.834 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.821+0000 7f2c777fe640 1 --2- 172.21.15.102:0/3519078657 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x55c80f410360 0x55c80f43da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:38.834 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.821+0000 7f2c77fff640 1 --2- 172.21.15.102:0/3519078657 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c80f40ff80 0x55c80f40db70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2c68087920 tx=0x7f2c6805c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc04733dc0452a09 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:38.834 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.821+0000 7f2c56ffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2023-10-14T09:37:38.834 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.821+0000 7f2c56ffd640 1 -- 172.21.15.102:0/3519078657 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c68057990 con 0x55c80f40ff80 2023-10-14T09:37:38.835 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.821+0000 7f2c56ffd640 1 -- 172.21.15.102:0/3519078657 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c68056700 con 0x55c80f40ff80 2023-10-14T09:37:38.835 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.821+0000 7f2c811e7740 1 -- 172.21.15.102:0/3519078657 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c80f375160 con 0x55c80f40ff80 2023-10-14T09:37:38.835 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.821+0000 7f2c56ffd640 1 -- 172.21.15.102:0/3519078657 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c68089280 con 0x55c80f40ff80 2023-10-14T09:37:38.835 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.821+0000 7f2c811e7740 10 client.4695 fetch_fsmap learned FSMap version 8 2023-10-14T09:37:38.835 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.821+0000 7f2c811e7740 1 -- 172.21.15.102:0/3519078657 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55c80f34cda0 con 0x55c80f40ff80 2023-10-14T09:37:38.836 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.821+0000 7f2c56ffd640 1 -- 172.21.15.102:0/3519078657 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c80f375160 con 0x55c80f40ff80 2023-10-14T09:37:38.836 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.821+0000 7f2c56ffd640 1 -- 172.21.15.102:0/3519078657 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2c68060060 con 0x55c80f40ff80 2023-10-14T09:37:38.836 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.821+0000 7f2c811e7740 10 client.4695 fetch_fsmap finished waiting for FSMap version 8 2023-10-14T09:37:38.836 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.822+0000 7f2c811e7740 10 client.4695 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T09:37:38.836 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.822+0000 7f2c811e7740 20 client.4695 populate_metadata read hostname 'smithi102' 2023-10-14T09:37:38.837 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.822+0000 7f2c811e7740 1 --2- 172.21.15.102:0/3519078657 >> [v2:172.21.15.102:6836/527707922,v1:172.21.15.102:6837/527707922] conn(0x55c80f415650 0x55c80f424c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:38.837 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.822+0000 7f2c811e7740 4 client.4695 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:37:38.837 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.822+0000 7f2c811e7740 1 -- 172.21.15.102:0/3519078657 --> [v2:172.21.15.102:6836/527707922,v1:172.21.15.102:6837/527707922] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c80f320cc0 con 0x55c80f415650 2023-10-14T09:37:38.837 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.822+0000 7f2c777fe640 1 --2- 172.21.15.102:0/3519078657 >> [v2:172.21.15.102:6836/527707922,v1:172.21.15.102:6837/527707922] conn(0x55c80f415650 0x55c80f424c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:38.837 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.822+0000 7f2c777fe640 1 --2- 172.21.15.102:0/3519078657 >> [v2:172.21.15.102:6836/527707922,v1:172.21.15.102:6837/527707922] conn(0x55c80f415650 0x55c80f424c50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3978cc90ed9a132a server_cookie=f4ab97fb08632ca9 in_seq=0 out_seq=0 2023-10-14T09:37:38.838 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.822+0000 7f2c56ffd640 10 client.4695 ms_handle_connect on v2:172.21.15.102:6836/527707922 2023-10-14T09:37:38.838 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.823+0000 7f2c56ffd640 1 -- 172.21.15.102:0/3519078657 <== mds.0 v2:172.21.15.102:6836/527707922 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c80f320cc0 con 0x55c80f415650 2023-10-14T09:37:38.838 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.823+0000 7f2c56ffd640 10 client.4695 handle_command_reply: tid=0 2023-10-14T09:37:38.838 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.823+0000 7f2c811e7740 1 client.4695 shutdown 2023-10-14T09:37:38.838 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.823+0000 7f2c811e7740 1 -- 172.21.15.102:0/3519078657 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c80f40ff80 msgr2=0x55c80f40db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:38.839 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.823+0000 7f2c811e7740 1 --2- 172.21.15.102:0/3519078657 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c80f40ff80 0x55c80f40db70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2c68087920 tx=0x7f2c6805c340 comp rx=0 tx=0).stop 2023-10-14T09:37:38.839 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.823+0000 7f2c811e7740 1 -- 172.21.15.102:0/3519078657 shutdown_connections 2023-10-14T09:37:38.839 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.823+0000 7f2c811e7740 1 --2- 172.21.15.102:0/3519078657 >> [v2:172.21.15.102:6836/527707922,v1:172.21.15.102:6837/527707922] conn(0x55c80f415650 0x55c80f424c50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:38.839 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.823+0000 7f2c811e7740 1 --2- 172.21.15.102:0/3519078657 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c80f416520 0x55c80f415110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:38.839 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.823+0000 7f2c811e7740 1 --2- 172.21.15.102:0/3519078657 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x55c80f410360 0x55c80f43da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:38.839 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.823+0000 7f2c811e7740 1 --2- 172.21.15.102:0/3519078657 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c80f40ff80 0x55c80f40db70 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:38.840 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.823+0000 7f2c811e7740 1 -- 172.21.15.102:0/3519078657 >> 172.21.15.102:0/3519078657 conn(0x55c80f3e33c0 msgr2=0x55c80f412d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:38.840 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.823+0000 7f2c56ffd640 0 client.4695 ms_handle_reset on v2:172.21.15.102:6836/527707922 2023-10-14T09:37:38.840 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.824+0000 7f2c811e7740 1 -- 172.21.15.102:0/3519078657 shutdown_connections 2023-10-14T09:37:38.840 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.824+0000 7f2c811e7740 1 -- 172.21.15.102:0/3519078657 wait complete. 2023-10-14T09:37:38.840 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.824+0000 7f2c811e7740 20 client.4695 trim_cache size 0 max 16384 2023-10-14T09:37:38.841 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.840+0000 7f2c811e7740 1 Processor -- start 2023-10-14T09:37:38.841 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.840+0000 7f2c811e7740 1 -- start start 2023-10-14T09:37:38.843 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.840+0000 7f2c811e7740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c80f40ff80 0x55c80f415b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:38.843 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.841+0000 7f2c811e7740 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x55c80f410360 0x55c80f48c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:38.843 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.841+0000 7f2c811e7740 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c80f416520 0x55c80f430840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:38.843 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.841+0000 7f2c811e7740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c80f0b2f20 con 0x55c80f40ff80 2023-10-14T09:37:38.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.841+0000 7f2c811e7740 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c80f430670 con 0x55c80f416520 2023-10-14T09:37:38.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.841+0000 7f2c811e7740 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c80f440ba0 con 0x55c80f410360 2023-10-14T09:37:38.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.841+0000 7f2c77fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c80f40ff80 0x55c80f415b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:38.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.841+0000 7f2c77fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c80f40ff80 0x55c80f415b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33296/0 (socket says 172.21.15.102:33296) 2023-10-14T09:37:38.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.841+0000 7f2c77fff640 1 -- 172.21.15.102:0/349852081 learned_addr learned my addr 172.21.15.102:0/349852081 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:38.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.841+0000 7f2c77fff640 1 -- 172.21.15.102:0/349852081 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x55c80f410360 msgr2=0x55c80f48c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:38.845 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.841+0000 7f2c77fff640 1 --2- 172.21.15.102:0/349852081 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x55c80f410360 0x55c80f48c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:38.845 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.841+0000 7f2c77fff640 1 -- 172.21.15.102:0/349852081 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c80f416520 msgr2=0x55c80f430840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:38.845 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.841+0000 7f2c77fff640 1 --2- 172.21.15.102:0/349852081 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c80f416520 0x55c80f430840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:38.845 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.841+0000 7f2c77fff640 1 -- 172.21.15.102:0/349852081 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c80f2ebb80 con 0x55c80f40ff80 2023-10-14T09:37:38.845 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.841+0000 7f2c77fff640 1 --2- 172.21.15.102:0/349852081 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c80f40ff80 0x55c80f415b20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2c680606b0 tx=0x7f2c68020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3db931019bd1c6d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:38.849 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.842+0000 7f2c6e7fc640 1 -- 172.21.15.102:0/349852081 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c68089280 con 0x55c80f40ff80 2023-10-14T09:37:38.850 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.842+0000 7f2c6e7fc640 1 -- 172.21.15.102:0/349852081 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6805c170 con 0x55c80f40ff80 2023-10-14T09:37:38.850 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.842+0000 7f2c6e7fc640 1 -- 172.21.15.102:0/349852081 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c68009930 con 0x55c80f40ff80 2023-10-14T09:37:38.850 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.842+0000 7f2c811e7740 1 -- 172.21.15.102:0/349852081 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c80f40ff80 msgr2=0x55c80f415b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:38.850 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.842+0000 7f2c811e7740 1 --2- 172.21.15.102:0/349852081 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c80f40ff80 0x55c80f415b20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2c680606b0 tx=0x7f2c68020000 comp rx=0 tx=0).stop 2023-10-14T09:37:38.850 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.842+0000 7f2c811e7740 1 -- 172.21.15.102:0/349852081 shutdown_connections 2023-10-14T09:37:38.851 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.842+0000 7f2c811e7740 1 --2- 172.21.15.102:0/349852081 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c80f416520 0x55c80f430840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:38.851 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.842+0000 7f2c811e7740 1 --2- 172.21.15.102:0/349852081 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x55c80f410360 0x55c80f48c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:38.851 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.842+0000 7f2c811e7740 1 --2- 172.21.15.102:0/349852081 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c80f40ff80 0x55c80f415b20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:38.851 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.842+0000 7f2c811e7740 1 -- 172.21.15.102:0/349852081 >> 172.21.15.102:0/349852081 conn(0x55c80f3e33c0 msgr2=0x55c80f431670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:38.851 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.842+0000 7f2c811e7740 1 -- 172.21.15.102:0/349852081 shutdown_connections 2023-10-14T09:37:38.851 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.842+0000 7f2c811e7740 1 -- 172.21.15.102:0/349852081 wait complete. 2023-10-14T09:37:38.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.843+0000 7f2c811e7740 1 -- start start 2023-10-14T09:37:38.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.843+0000 7f2c811e7740 1 Processor -- start 2023-10-14T09:37:38.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.844+0000 7f2c811e7740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c80f40ff80 0x55c80f425e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:38.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.844+0000 7f2c811e7740 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x55c80f410360 0x55c80f3e6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:38.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.844+0000 7f2c811e7740 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c80f416520 0x55c80f485b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:38.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.844+0000 7f2c811e7740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c80f4901d0 con 0x55c80f40ff80 2023-10-14T09:37:38.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.844+0000 7f2c811e7740 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c80f499970 con 0x55c80f416520 2023-10-14T09:37:38.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.844+0000 7f2c811e7740 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c80f426450 con 0x55c80f410360 2023-10-14T09:37:38.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.844+0000 7f2c811e7740 10 client.0 _ll_register_callbacks cb 0x55c80f3e92e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:37:38.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.844+0000 7f2c77fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c80f40ff80 0x55c80f425e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:38.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.844+0000 7f2c77fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c80f40ff80 0x55c80f425e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33300/0 (socket says 172.21.15.102:33300) 2023-10-14T09:37:38.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.844+0000 7f2c77fff640 1 -- 172.21.15.102:0/3926791195 learned_addr learned my addr 172.21.15.102:0/3926791195 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:38.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.845+0000 7f2c77fff640 1 -- 172.21.15.102:0/3926791195 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x55c80f410360 msgr2=0x55c80f3e6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:38.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.845+0000 7f2c77fff640 1 --2- 172.21.15.102:0/3926791195 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x55c80f410360 0x55c80f3e6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:38.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.845+0000 7f2c77fff640 1 -- 172.21.15.102:0/3926791195 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c80f416520 msgr2=0x55c80f485b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:38.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.845+0000 7f2c77fff640 1 --2- 172.21.15.102:0/3926791195 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c80f416520 0x55c80f485b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:38.855 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.845+0000 7f2c77fff640 1 -- 172.21.15.102:0/3926791195 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c80f34cda0 con 0x55c80f40ff80 2023-10-14T09:37:38.855 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.845+0000 7f2c77fff640 1 --2- 172.21.15.102:0/3926791195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c80f40ff80 0x55c80f425e50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2c68054cc0 tx=0x7f2c68087880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4979a5da7d32d8c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:38.855 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.845+0000 7f2c56ffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2023-10-14T09:37:38.855 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.845+0000 7f2c56ffd640 1 -- 172.21.15.102:0/3926791195 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c68089280 con 0x55c80f40ff80 2023-10-14T09:37:38.855 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.845+0000 7f2c56ffd640 1 -- 172.21.15.102:0/3926791195 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c68056700 con 0x55c80f40ff80 2023-10-14T09:37:38.855 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.845+0000 7f2c811e7740 1 -- 172.21.15.102:0/3926791195 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2c7000d8a0 con 0x55c80f40ff80 2023-10-14T09:37:38.856 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.845+0000 7f2c56ffd640 1 -- 172.21.15.102:0/3926791195 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c68009930 con 0x55c80f40ff80 2023-10-14T09:37:38.856 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.845+0000 7f2c811e7740 10 client.4701 fetch_fsmap learned FSMap version 8 2023-10-14T09:37:38.856 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.845+0000 7f2c811e7740 1 -- 172.21.15.102:0/3926791195 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55c80f311170 con 0x55c80f40ff80 2023-10-14T09:37:38.856 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.845+0000 7f2c56ffd640 1 -- 172.21.15.102:0/3926791195 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7000d8a0 con 0x55c80f40ff80 2023-10-14T09:37:38.856 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.845+0000 7f2c56ffd640 1 -- 172.21.15.102:0/3926791195 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2c6805e0e0 con 0x55c80f40ff80 2023-10-14T09:37:38.856 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.845+0000 7f2c811e7740 10 client.4701 fetch_fsmap finished waiting for FSMap version 8 2023-10-14T09:37:38.857 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.846+0000 7f2c811e7740 10 client.4701 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T09:37:38.857 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.846+0000 7f2c811e7740 20 client.4701 populate_metadata read hostname 'smithi102' 2023-10-14T09:37:38.857 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.846+0000 7f2c811e7740 1 --2- 172.21.15.102:0/3926791195 >> [v2:172.21.15.102:6836/527707922,v1:172.21.15.102:6837/527707922] conn(0x55c80f486210 0x55c80f3e7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:38.857 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.846+0000 7f2c811e7740 4 client.4701 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T09:37:38.857 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.846+0000 7f2c811e7740 1 -- 172.21.15.102:0/3926791195 --> [v2:172.21.15.102:6836/527707922,v1:172.21.15.102:6837/527707922] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c80f347700 con 0x55c80f486210 2023-10-14T09:37:38.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.846+0000 7f2c777fe640 1 --2- 172.21.15.102:0/3926791195 >> [v2:172.21.15.102:6836/527707922,v1:172.21.15.102:6837/527707922] conn(0x55c80f486210 0x55c80f3e7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:38.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.846+0000 7f2c56ffd640 10 client.4701 ms_handle_connect on v2:172.21.15.102:6836/527707922 2023-10-14T09:37:38.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.846+0000 7f2c777fe640 1 --2- 172.21.15.102:0/3926791195 >> [v2:172.21.15.102:6836/527707922,v1:172.21.15.102:6837/527707922] conn(0x55c80f486210 0x55c80f3e7fe0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88a2917baf7297e5 server_cookie=c0cf7820e674b128 in_seq=0 out_seq=0 2023-10-14T09:37:38.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.846+0000 7f2c56ffd640 1 -- 172.21.15.102:0/3926791195 <== mds.0 v2:172.21.15.102:6836/527707922 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55c80f347700 con 0x55c80f486210 2023-10-14T09:37:38.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.846+0000 7f2c56ffd640 10 client.4701 handle_command_reply: tid=0 2023-10-14T09:37:38.859 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.846+0000 7f2c811e7740 1 client.4701 shutdown 2023-10-14T09:37:38.859 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.847+0000 7f2c811e7740 1 -- 172.21.15.102:0/3926791195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c80f40ff80 msgr2=0x55c80f425e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:38.859 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.847+0000 7f2c811e7740 1 --2- 172.21.15.102:0/3926791195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c80f40ff80 0x55c80f425e50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2c68054cc0 tx=0x7f2c68087880 comp rx=0 tx=0).stop 2023-10-14T09:37:38.859 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.847+0000 7f2c811e7740 1 -- 172.21.15.102:0/3926791195 shutdown_connections 2023-10-14T09:37:38.859 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.847+0000 7f2c811e7740 1 --2- 172.21.15.102:0/3926791195 >> [v2:172.21.15.102:6836/527707922,v1:172.21.15.102:6837/527707922] conn(0x55c80f486210 0x55c80f3e7fe0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:38.859 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.847+0000 7f2c811e7740 1 --2- 172.21.15.102:0/3926791195 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c80f416520 0x55c80f485b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:38.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.847+0000 7f2c811e7740 1 --2- 172.21.15.102:0/3926791195 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x55c80f410360 0x55c80f3e6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:38.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.847+0000 7f2c811e7740 1 --2- 172.21.15.102:0/3926791195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c80f40ff80 0x55c80f425e50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:38.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.847+0000 7f2c56ffd640 0 client.4701 ms_handle_reset on v2:172.21.15.102:6836/527707922 2023-10-14T09:37:38.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.847+0000 7f2c811e7740 1 -- 172.21.15.102:0/3926791195 >> 172.21.15.102:0/3926791195 conn(0x55c80f3e33c0 msgr2=0x55c80f440570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:38.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.847+0000 7f2c811e7740 1 -- 172.21.15.102:0/3926791195 shutdown_connections 2023-10-14T09:37:38.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.847+0000 7f2c811e7740 1 -- 172.21.15.102:0/3926791195 wait complete. 2023-10-14T09:37:38.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.847+0000 7f2c811e7740 20 client.4701 trim_cache size 0 max 16384 2023-10-14T09:37:38.861 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-10-14T09:37:38.861 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_fsid": "8a6cd69d-7f5b-4f2a-806a-0176c10aed50", 2023-10-14T09:37:38.861 INFO:teuthology.orchestra.run.smithi102.stdout: "whoami": 0, 2023-10-14T09:37:38.862 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 4287, 2023-10-14T09:37:38.862 INFO:teuthology.orchestra.run.smithi102.stdout: "want_state": "up:active", 2023-10-14T09:37:38.862 INFO:teuthology.orchestra.run.smithi102.stdout: "state": "up:active", 2023-10-14T09:37:38.862 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs", 2023-10-14T09:37:38.862 INFO:teuthology.orchestra.run.smithi102.stdout: "rank_uptime": 16.943653449999999, 2023-10-14T09:37:38.863 INFO:teuthology.orchestra.run.smithi102.stdout: "mdsmap_epoch": 8, 2023-10-14T09:37:38.863 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch": 22, 2023-10-14T09:37:38.863 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch_barrier": 22, 2023-10-14T09:37:38.863 INFO:teuthology.orchestra.run.smithi102.stdout: "uptime": 22.265227044 2023-10-14T09:37:38.863 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-10-14T09:37:38.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.847+0000 7f2c7e57c640 1 -- 172.21.15.102:0/1463347875 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2c5806ae70 msgr2=0x7f2c5806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:38.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.847+0000 7f2c7e57c640 1 --2- 172.21.15.102:0/1463347875 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2c5806ae70 0x7f2c5806d330 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2c60036000 tx=0x7f2c60030000 comp rx=0 tx=0).stop 2023-10-14T09:37:38.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.847+0000 7f2c7e57c640 1 -- 172.21.15.102:0/1463347875 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c78065ff0 msgr2=0x7f2c780b2e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:38.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.847+0000 7f2c7e57c640 1 --2- 172.21.15.102:0/1463347875 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c78065ff0 0x7f2c780b2e70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2c6800ba50 tx=0x7f2c6800bf10 comp rx=0 tx=0).stop 2023-10-14T09:37:38.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.848+0000 7f2c7e57c640 1 -- 172.21.15.102:0/1463347875 shutdown_connections 2023-10-14T09:37:38.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.848+0000 7f2c7e57c640 1 --2- 172.21.15.102:0/1463347875 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2c5806ae70 0x7f2c5806d330 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:38.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.848+0000 7f2c7e57c640 1 --2- 172.21.15.102:0/1463347875 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2c781618b0 0x7f2c781f5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:38.866 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.848+0000 7f2c7e57c640 1 --2- 172.21.15.102:0/1463347875 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2c7815d330 0x7f2c780ad2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:38.866 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.848+0000 7f2c7e57c640 1 --2- 172.21.15.102:0/1463347875 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c78065ff0 0x7f2c780b2e70 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:38.866 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.848+0000 7f2c7e57c640 1 -- 172.21.15.102:0/1463347875 >> 172.21.15.102:0/1463347875 conn(0x7f2c780d0ab0 msgr2=0x7f2c7815b340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:38.866 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.848+0000 7f2c7e57c640 1 -- 172.21.15.102:0/1463347875 shutdown_connections 2023-10-14T09:37:38.866 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:38.848+0000 7f2c7e57c640 1 -- 172.21.15.102:0/1463347875 wait complete. 2023-10-14T09:37:38.868 INFO:teuthology.run_tasks:Running task kclient... 2023-10-14T09:37:38.890 INFO:tasks.kclient:Mounting kernel clients... 2023-10-14T09:37:38.891 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-14T09:37:38.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:38.891 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2023-10-14T09:37:38.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:38.942 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link delete ceph-brx 2023-10-14T09:37:39.032 INFO:teuthology.orchestra.run.smithi102.stderr:Cannot find device "ceph-brx" 2023-10-14T09:37:39.035 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:37:39.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:39.036 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2023-10-14T09:37:39.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:39.090 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link delete ceph-brx 2023-10-14T09:37:39.181 INFO:teuthology.orchestra.run.smithi102.stderr:Cannot find device "ceph-brx" 2023-10-14T09:37:39.184 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:37:39.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:39.185 DEBUG:teuthology.orchestra.run.smithi129:> ip netns list 2023-10-14T09:37:39.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:39.246 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link delete ceph-brx 2023-10-14T09:37:39.355 INFO:teuthology.orchestra.run.smithi129.stderr:Cannot find device "ceph-brx" 2023-10-14T09:37:39.360 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:37:39.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:39.361 DEBUG:teuthology.orchestra.run.smithi129:> ip netns list 2023-10-14T09:37:39.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:39.413 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link delete ceph-brx 2023-10-14T09:37:39.516 INFO:teuthology.orchestra.run.smithi129.stderr:Cannot find device "ceph-brx" 2023-10-14T09:37:39.519 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:37:39.520 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-10-14T09:37:39.520 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-14T09:37:39.521 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T09:37:39.521 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T09:37:39.740 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.738+0000 7f8a7e2b0640 1 Processor -- start 2023-10-14T09:37:39.740 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.738+0000 7f8a7e2b0640 1 -- start start 2023-10-14T09:37:39.741 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.739+0000 7f8a7e2b0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8a78159f00 0x7f8a780b0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:39.742 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.739+0000 7f8a7e2b0640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f8a7815d880 0x7f8a780b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:39.742 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.739+0000 7f8a7e2b0640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a7806f7f0 con 0x7f8a78159b20 2023-10-14T09:37:39.742 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.739+0000 7f8a7e2b0640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a7806c5e0 con 0x7f8a78159f00 2023-10-14T09:37:39.742 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.739+0000 7f8a7e2b0640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a7806c8c0 con 0x7f8a7815d880 2023-10-14T09:37:39.743 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.740+0000 7f8a777fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8a78159f00 0x7f8a780b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:39.743 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.740+0000 7f8a777fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8a78159f00 0x7f8a780b0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33304/0 (socket says 172.21.15.102:33304) 2023-10-14T09:37:39.743 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.740+0000 7f8a777fe640 1 -- 172.21.15.102:0/2617824467 learned_addr learned my addr 172.21.15.102:0/2617824467 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:39.743 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.740+0000 7f8a7c84d640 1 --2- 172.21.15.102:0/2617824467 >> v2:172.21.15.129:3300/0 conn(0x7f8a7815d880 0x7f8a780b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:39.743 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.740+0000 7f8a777fe640 1 -- 172.21.15.102:0/2617824467 >> v2:172.21.15.129:3300/0 conn(0x7f8a7815d880 msgr2=0x7f8a780b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:39.744 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.740+0000 7f8a777fe640 1 --2- 172.21.15.102:0/2617824467 >> v2:172.21.15.129:3300/0 conn(0x7f8a7815d880 0x7f8a780b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:39.744 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.740+0000 7f8a777fe640 1 -- 172.21.15.102:0/2617824467 >> v1:172.21.15.129:6789/0 conn(0x7f8a78159b20 legacy=0x7f8a7806bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:39.744 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.740+0000 7f8a777fe640 1 -- 172.21.15.102:0/2617824467 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a7806cba0 con 0x7f8a78159f00 2023-10-14T09:37:39.745 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.741+0000 7f8a777fe640 1 --2- 172.21.15.102:0/2617824467 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a78159f00 0x7f8a780b0410 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8a780c8bb0 tx=0x7f8a6c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8111d4386ec2501f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:39.745 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.741+0000 7f8a76ffd640 1 -- 172.21.15.102:0/2617824467 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c031870 con 0x7f8a78159f00 2023-10-14T09:37:39.746 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.741+0000 7f8a76ffd640 1 -- 172.21.15.102:0/2617824467 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6c0319d0 con 0x7f8a78159f00 2023-10-14T09:37:39.746 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.741+0000 7f8a76ffd640 1 -- 172.21.15.102:0/2617824467 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c031d60 con 0x7f8a78159f00 2023-10-14T09:37:39.746 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.742+0000 7f8a7e2b0640 1 -- 172.21.15.102:0/2617824467 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a78159f00 msgr2=0x7f8a780b0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:39.746 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.742+0000 7f8a7e2b0640 1 --2- 172.21.15.102:0/2617824467 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a78159f00 0x7f8a780b0410 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8a780c8bb0 tx=0x7f8a6c02b910 comp rx=0 tx=0).stop 2023-10-14T09:37:39.746 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.742+0000 7f8a7e2b0640 1 -- 172.21.15.102:0/2617824467 shutdown_connections 2023-10-14T09:37:39.747 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.742+0000 7f8a7e2b0640 1 --2- 172.21.15.102:0/2617824467 >> v2:172.21.15.129:3300/0 conn(0x7f8a7815d880 0x7f8a780b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:39.747 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.742+0000 7f8a7e2b0640 1 --2- 172.21.15.102:0/2617824467 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a78159f00 0x7f8a780b0410 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:39.747 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.742+0000 7f8a7e2b0640 1 -- 172.21.15.102:0/2617824467 >> 172.21.15.102:0/2617824467 conn(0x7f8a780cb410 msgr2=0x7f8a780cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:39.747 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.742+0000 7f8a7e2b0640 1 -- 172.21.15.102:0/2617824467 shutdown_connections 2023-10-14T09:37:39.747 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.742+0000 7f8a7e2b0640 1 -- 172.21.15.102:0/2617824467 wait complete. 2023-10-14T09:37:39.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.744+0000 7f8a7e2b0640 1 Processor -- start 2023-10-14T09:37:39.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.744+0000 7f8a7e2b0640 1 -- start start 2023-10-14T09:37:39.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.745+0000 7f8a7e2b0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a78159b20 0x7f8a7815bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:39.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.745+0000 7f8a7e2b0640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8a78159f00 0x7f8a78151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:39.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.745+0000 7f8a7e2b0640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8a7815d880 0x7f8a780ca070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:39.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.745+0000 7f8a7e2b0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a781f7450 con 0x7f8a78159b20 2023-10-14T09:37:39.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.745+0000 7f8a7e2b0640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7815c2c0 con 0x7f8a78159f00 2023-10-14T09:37:39.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.745+0000 7f8a7e2b0640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a781f66d0 con 0x7f8a7815d880 2023-10-14T09:37:39.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.745+0000 7f8a77fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a78159b20 0x7f8a7815bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:39.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.745+0000 7f8a77fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a78159b20 0x7f8a7815bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33318/0 (socket says 172.21.15.102:33318) 2023-10-14T09:37:39.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.745+0000 7f8a77fff640 1 -- 172.21.15.102:0/3898015341 learned_addr learned my addr 172.21.15.102:0/3898015341 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:39.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.746+0000 7f8a777fe640 1 --2- 172.21.15.102:0/3898015341 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8a78159f00 0x7f8a78151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:39.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.746+0000 7f8a77fff640 1 -- 172.21.15.102:0/3898015341 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8a7815d880 msgr2=0x7f8a780ca070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:39.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.746+0000 7f8a7c84d640 1 --2- 172.21.15.102:0/3898015341 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8a7815d880 0x7f8a780ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:39.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.746+0000 7f8a77fff640 1 --2- 172.21.15.102:0/3898015341 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8a7815d880 0x7f8a780ca070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:39.753 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.746+0000 7f8a77fff640 1 -- 172.21.15.102:0/3898015341 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8a78159f00 msgr2=0x7f8a78151aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:39.753 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.746+0000 7f8a77fff640 1 --2- 172.21.15.102:0/3898015341 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8a78159f00 0x7f8a78151aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:39.753 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.746+0000 7f8a77fff640 1 -- 172.21.15.102:0/3898015341 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6c0094d0 con 0x7f8a78159b20 2023-10-14T09:37:39.753 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.746+0000 7f8a77fff640 1 --2- 172.21.15.102:0/3898015341 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a78159b20 0x7f8a7815bae0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8a6800b3e0 tx=0x7f8a6800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:39.753 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.746+0000 7f8a74ff9640 1 -- 172.21.15.102:0/3898015341 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a68011830 con 0x7f8a78159b20 2023-10-14T09:37:39.754 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.746+0000 7f8a74ff9640 1 -- 172.21.15.102:0/3898015341 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a680119b0 con 0x7f8a78159b20 2023-10-14T09:37:39.754 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.746+0000 7f8a74ff9640 1 -- 172.21.15.102:0/3898015341 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a68011d60 con 0x7f8a78159b20 2023-10-14T09:37:39.754 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.746+0000 7f8a7e2b0640 1 -- 172.21.15.102:0/3898015341 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a7815c020 con 0x7f8a78159b20 2023-10-14T09:37:39.754 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.746+0000 7f8a7e2b0640 1 -- 172.21.15.102:0/3898015341 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a781f6c50 con 0x7f8a78159b20 2023-10-14T09:37:39.754 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.747+0000 7f8a7e2b0640 1 -- 172.21.15.102:0/3898015341 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a7804e160 con 0x7f8a78159b20 2023-10-14T09:37:39.755 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.748+0000 7f8a74ff9640 1 -- 172.21.15.102:0/3898015341 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8a6801a400 con 0x7f8a78159b20 2023-10-14T09:37:39.755 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.749+0000 7f8a74ff9640 1 --2- 172.21.15.102:0/3898015341 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f8a6406ae70 0x7f8a6406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:39.756 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.749+0000 7f8a74ff9640 1 -- 172.21.15.102:0/3898015341 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a68089870 con 0x7f8a78159b20 2023-10-14T09:37:39.756 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.749+0000 7f8a777fe640 1 --2- 172.21.15.102:0/3898015341 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f8a6406ae70 0x7f8a6406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:39.756 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.750+0000 7f8a777fe640 1 --2- 172.21.15.102:0/3898015341 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f8a6406ae70 0x7f8a6406d330 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c036000 tx=0x7f8a6c03c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:39.756 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.754+0000 7f8a74ff9640 1 -- 172.21.15.102:0/3898015341 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8a68054880 con 0x7f8a78159b20 2023-10-14T09:37:39.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.983+0000 7f8a7e2b0640 1 -- 172.21.15.102:0/3898015341 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8a780c2260 con 0x7f8a78159b20 2023-10-14T09:37:39.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.984+0000 7f8a74ff9640 1 -- 172.21.15.102:0/3898015341 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8a68015070 con 0x7f8a78159b20 2023-10-14T09:37:39.986 INFO:teuthology.orchestra.run.smithi102.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T09:37:39.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.986+0000 7f8a7e2b0640 1 -- 172.21.15.102:0/3898015341 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f8a6406ae70 msgr2=0x7f8a6406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:39.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.986+0000 7f8a7e2b0640 1 --2- 172.21.15.102:0/3898015341 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f8a6406ae70 0x7f8a6406d330 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c036000 tx=0x7f8a6c03c040 comp rx=0 tx=0).stop 2023-10-14T09:37:39.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.986+0000 7f8a7e2b0640 1 -- 172.21.15.102:0/3898015341 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a78159b20 msgr2=0x7f8a7815bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:39.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.986+0000 7f8a7e2b0640 1 --2- 172.21.15.102:0/3898015341 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a78159b20 0x7f8a7815bae0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8a6800b3e0 tx=0x7f8a6800b8a0 comp rx=0 tx=0).stop 2023-10-14T09:37:39.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.987+0000 7f8a7e2b0640 1 -- 172.21.15.102:0/3898015341 shutdown_connections 2023-10-14T09:37:39.990 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.987+0000 7f8a7e2b0640 1 --2- 172.21.15.102:0/3898015341 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f8a6406ae70 0x7f8a6406d330 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:39.990 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.987+0000 7f8a7e2b0640 1 --2- 172.21.15.102:0/3898015341 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8a7815d880 0x7f8a780ca070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:39.990 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.987+0000 7f8a7e2b0640 1 --2- 172.21.15.102:0/3898015341 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8a78159f00 0x7f8a78151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:39.990 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.987+0000 7f8a7e2b0640 1 --2- 172.21.15.102:0/3898015341 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a78159b20 0x7f8a7815bae0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:39.990 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.987+0000 7f8a7e2b0640 1 -- 172.21.15.102:0/3898015341 >> 172.21.15.102:0/3898015341 conn(0x7f8a780cb410 msgr2=0x7f8a7806bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:39.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.987+0000 7f8a7e2b0640 1 -- 172.21.15.102:0/3898015341 shutdown_connections 2023-10-14T09:37:39.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:39.987+0000 7f8a7e2b0640 1 -- 172.21.15.102:0/3898015341 wait complete. 2023-10-14T09:37:40.008 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T09:37:40.008 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T09:37:40.008 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi102.front.sepia.ceph.com 2023-10-14T09:37:40.008 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T09:37:40.009 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T09:37:40.009 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T09:37:40.009 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T09:37:40.009 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T09:37:40.010 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T09:37:40.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:40.010 DEBUG:teuthology.orchestra.run.smithi102:> ip addr 2023-10-14T09:37:40.061 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T09:37:40.062 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T09:37:40.062 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T09:37:40.062 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:37:40.062 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2023-10-14T09:37:40.062 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:37:40.063 INFO:teuthology.orchestra.run.smithi102.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T09:37:40.063 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dc brd ff:ff:ff:ff:ff:ff 2023-10-14T09:37:40.063 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f0 2023-10-14T09:37:40.063 INFO:teuthology.orchestra.run.smithi102.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T09:37:40.063 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dd brd ff:ff:ff:ff:ff:ff 2023-10-14T09:37:40.064 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f1 2023-10-14T09:37:40.064 INFO:teuthology.orchestra.run.smithi102.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T09:37:40.064 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:68 brd ff:ff:ff:ff:ff:ff 2023-10-14T09:37:40.064 INFO:teuthology.orchestra.run.smithi102.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T09:37:40.064 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:69 brd ff:ff:ff:ff:ff:ff 2023-10-14T09:37:40.064 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.21.15.102/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T09:37:40.065 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft 42366sec preferred_lft 42366sec 2023-10-14T09:37:40.065 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::ec4:7aff:fe8f:d769/64 scope link 2023-10-14T09:37:40.065 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:37:40.066 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-14T09:37:40.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:40.067 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2023-10-14T09:37:40.067 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2023-10-14T09:37:40.067 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link add name ceph-brx type bridge 2023-10-14T09:37:40.068 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip addr flush dev ceph-brx 2023-10-14T09:37:40.068 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set ceph-brx up 2023-10-14T09:37:40.068 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-14T09:37:40.068 DEBUG:teuthology.orchestra.run.smithi102:> ') 2023-10-14T09:37:40.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:40.538 DEBUG:teuthology.orchestra.run.smithi102:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T09:37:40.614 INFO:teuthology.orchestra.run.smithi102.stdout:1 2023-10-14T09:37:40.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:40.617 DEBUG:teuthology.orchestra.run.smithi102:> route 2023-10-14T09:37:40.680 INFO:teuthology.orchestra.run.smithi102.stdout:Kernel IP routing table 2023-10-14T09:37:40.680 INFO:teuthology.orchestra.run.smithi102.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T09:37:40.681 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T09:37:40.681 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T09:37:40.681 INFO:teuthology.orchestra.run.smithi102.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T09:37:40.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:40.682 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2023-10-14T09:37:40.682 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2023-10-14T09:37:40.682 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T09:37:40.683 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T09:37:40.683 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T09:37:40.683 DEBUG:teuthology.orchestra.run.smithi102:> ') 2023-10-14T09:37:41.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:41.373 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2023-10-14T09:37:41.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:41.422 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list-id 2023-10-14T09:37:41.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:41.510 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2023-10-14T09:37:41.511 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2023-10-14T09:37:41.511 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T09:37:41.511 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-14T09:37:41.511 DEBUG:teuthology.orchestra.run.smithi102:> ') 2023-10-14T09:37:41.637 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-14T09:37:41.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:41.638 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2023-10-14T09:37:41.638 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2023-10-14T09:37:41.638 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-14T09:37:41.639 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-14T09:37:41.639 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-14T09:37:41.639 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-14T09:37:41.640 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-14T09:37:41.640 DEBUG:teuthology.orchestra.run.smithi102:> ') 2023-10-14T09:37:41.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:41.916 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2023-10-14T09:37:41.917 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2023-10-14T09:37:41.917 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set brx.0 up 2023-10-14T09:37:41.917 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set dev brx.0 master ceph-brx 2023-10-14T09:37:41.918 DEBUG:teuthology.orchestra.run.smithi102:> ') 2023-10-14T09:37:42.066 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T09:37:42.067 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T09:37:42.115 INFO:teuthology.orchestra.run.smithi102.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T09:37:42.115 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T09:37:42.116 DEBUG:teuthology.orchestra.run.smithi102:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T09:37:42.208 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-14T09:37:42.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:42.209 DEBUG:teuthology.orchestra.run.smithi102:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T09:37:42.346 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T09:37:42.346 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T09:37:42.829 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T09:37:42.830 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T09:37:42.830 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.102:3300,172.21.15.129:3300,172.21.15.129:3301" 2023-10-14T09:37:42.830 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: trying mount with new device syntax: 0@8a6cd69d-7f5b-4f2a-806a-0176c10aed50.cephfs=/ 2023-10-14T09:37:42.830 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.102:3300/172.21.15.129:3300/172.21.15.129:3301" will pass to kernel 2023-10-14T09:37:42.834 INFO:teuthology.orchestra.run.smithi102.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-10-14T09:37:42.834 INFO:teuthology.orchestra.run.smithi102.stdout: You just mounted a file system that supports labels which does not 2023-10-14T09:37:42.835 INFO:teuthology.orchestra.run.smithi102.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-10-14T09:37:42.835 INFO:teuthology.orchestra.run.smithi102.stdout: applications will generate AVC messages and not be allowed access to 2023-10-14T09:37:42.835 INFO:teuthology.orchestra.run.smithi102.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-10-14T09:37:42.839 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T09:37:42.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:42.839 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T09:37:42.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:42.933 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T09:37:42.996 INFO:teuthology.orchestra.run.smithi102.stdout:client4385 2023-10-14T09:37:42.996 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-10-14T09:37:42.997 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T09:37:43.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:43.048 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T09:37:43.116 INFO:teuthology.orchestra.run.smithi102.stdout:client4385 2023-10-14T09:37:43.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:43.117 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T09:37:43.181 INFO:teuthology.orchestra.run.smithi102.stdout:client4385 2023-10-14T09:37:43.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:43.182 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/8a6cd69d-7f5b-4f2a-806a-0176c10aed50.client4385/status') 2023-10-14T09:37:43.279 INFO:teuthology.orchestra.run.smithi102.stdout:instance: client.4385 (3)172.21.15.102:0/1830274262 2023-10-14T09:37:43.279 INFO:teuthology.orchestra.run.smithi102.stdout:blocklisted: false 2023-10-14T09:37:43.280 INFO:teuthology.orchestra.run.smithi102.stderr:0+1 records in 2023-10-14T09:37:43.280 INFO:teuthology.orchestra.run.smithi102.stderr:0+1 records out 2023-10-14T09:37:43.280 INFO:teuthology.orchestra.run.smithi102.stderr:71 bytes copied, 6.3702e-05 s, 1.1 MB/s 2023-10-14T09:37:43.283 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-10-14T09:37:43.284 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-14T09:37:43.284 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-14T09:37:43.284 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T09:37:43.488 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.486+0000 7fe90a9d0640 1 Processor -- start 2023-10-14T09:37:43.488 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.486+0000 7fe90a9d0640 1 -- start start 2023-10-14T09:37:43.489 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.488+0000 7fe90a9d0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe90415aaa0 0x7fe90415e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:43.490 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.488+0000 7fe90a9d0640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe90415ed60 con 0x7fe90415ae80 2023-10-14T09:37:43.490 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.488+0000 7fe90a9d0640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9040707e0 con 0x7fe9040ce390 2023-10-14T09:37:43.490 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.488+0000 7fe90a9d0640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe90406b810 con 0x7fe90415aaa0 2023-10-14T09:37:43.491 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.488+0000 7fe903fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe90415aaa0 0x7fe90415e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:43.491 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.488+0000 7fe8fbfff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fe90415ae80 0x7fe9040cc560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:47910/0 (socket says 172.21.15.102:47910) 2023-10-14T09:37:43.491 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.488+0000 7fe8fbfff640 1 -- 172.21.15.102:0/2711012481 learned_addr learned my addr 172.21.15.102:0/2711012481 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:43.491 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.489+0000 7fe9037fe640 1 -- 172.21.15.102:0/2711012481 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2773863053 0 0) 0x7fe90415ed60 con 0x7fe90415ae80 2023-10-14T09:37:43.492 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.489+0000 7fe903fff640 1 -- 172.21.15.102:0/2711012481 >> v1:172.21.15.129:6789/0 conn(0x7fe9040ce390 legacy=0x7fe904070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:43.492 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.489+0000 7fe903fff640 1 -- 172.21.15.102:0/2711012481 >> v1:172.21.15.102:6789/0 conn(0x7fe90415ae80 legacy=0x7fe9040cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:43.492 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.489+0000 7fe903fff640 1 -- 172.21.15.102:0/2711012481 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe90415ef90 con 0x7fe90415aaa0 2023-10-14T09:37:43.493 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.490+0000 7fe903fff640 1 --2- 172.21.15.102:0/2711012481 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe90415aaa0 0x7fe90415e820 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe8f40097a0 tx=0x7fe8f402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bfef2db4dfa4d62 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:43.493 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.491+0000 7fe9037fe640 1 -- 172.21.15.102:0/2711012481 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f4030610 con 0x7fe90415aaa0 2023-10-14T09:37:43.493 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.491+0000 7fe9037fe640 1 -- 172.21.15.102:0/2711012481 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f4030770 con 0x7fe90415aaa0 2023-10-14T09:37:43.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.491+0000 7fe9037fe640 1 -- 172.21.15.102:0/2711012481 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f4030b00 con 0x7fe90415aaa0 2023-10-14T09:37:43.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.491+0000 7fe90a9d0640 1 -- 172.21.15.102:0/2711012481 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe90415aaa0 msgr2=0x7fe90415e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:43.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.491+0000 7fe90a9d0640 1 --2- 172.21.15.102:0/2711012481 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe90415aaa0 0x7fe90415e820 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe8f40097a0 tx=0x7fe8f402b960 comp rx=0 tx=0).stop 2023-10-14T09:37:43.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.491+0000 7fe90a9d0640 1 -- 172.21.15.102:0/2711012481 shutdown_connections 2023-10-14T09:37:43.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.491+0000 7fe90a9d0640 1 --2- 172.21.15.102:0/2711012481 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe90415aaa0 0x7fe90415e820 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:43.495 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.491+0000 7fe90a9d0640 1 -- 172.21.15.102:0/2711012481 >> 172.21.15.102:0/2711012481 conn(0x7fe9040cb410 msgr2=0x7fe9040cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:43.495 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.492+0000 7fe90a9d0640 1 -- 172.21.15.102:0/2711012481 shutdown_connections 2023-10-14T09:37:43.495 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.492+0000 7fe90a9d0640 1 -- 172.21.15.102:0/2711012481 wait complete. 2023-10-14T09:37:43.496 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.493+0000 7fe90a9d0640 1 Processor -- start 2023-10-14T09:37:43.496 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.494+0000 7fe90a9d0640 1 -- start start 2023-10-14T09:37:43.497 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.494+0000 7fe90a9d0640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe9040ce390 0x7fe90414fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:43.498 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.494+0000 7fe90a9d0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe90415aaa0 0x7fe9040c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:43.498 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.494+0000 7fe90a9d0640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe90415ae80 0x7fe90406fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:43.498 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.494+0000 7fe90a9d0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90415e040 con 0x7fe90415aaa0 2023-10-14T09:37:43.498 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.494+0000 7fe90a9d0640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90415b3c0 con 0x7fe90415ae80 2023-10-14T09:37:43.498 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.494+0000 7fe90a9d0640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe90415c3f0 con 0x7fe9040ce390 2023-10-14T09:37:43.499 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.495+0000 7fe8fbfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe90415aaa0 0x7fe9040c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:43.499 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.495+0000 7fe8fbfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe90415aaa0 0x7fe9040c46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43282/0 (socket says 172.21.15.102:43282) 2023-10-14T09:37:43.499 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.495+0000 7fe8fbfff640 1 -- 172.21.15.102:0/2363890600 learned_addr learned my addr 172.21.15.102:0/2363890600 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:43.499 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.495+0000 7fe8fbfff640 1 -- 172.21.15.102:0/2363890600 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe9040ce390 msgr2=0x7fe90414fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:43.499 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.495+0000 7fe908f6d640 1 --2- 172.21.15.102:0/2363890600 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe90415ae80 0x7fe90406fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:43.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.495+0000 7fe8fbfff640 1 --2- 172.21.15.102:0/2363890600 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe9040ce390 0x7fe90414fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:43.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.495+0000 7fe8fbfff640 1 -- 172.21.15.102:0/2363890600 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe90415ae80 msgr2=0x7fe90406fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:43.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.495+0000 7fe8fbfff640 1 --2- 172.21.15.102:0/2363890600 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe90415ae80 0x7fe90406fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:43.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.495+0000 7fe8fbfff640 1 -- 172.21.15.102:0/2363890600 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f4009400 con 0x7fe90415aaa0 2023-10-14T09:37:43.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.496+0000 7fe8fbfff640 1 --2- 172.21.15.102:0/2363890600 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe90415aaa0 0x7fe9040c46a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec00c3f0 tx=0x7fe8ec00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:43.501 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.496+0000 7fe9017fa640 1 -- 172.21.15.102:0/2363890600 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec0074e0 con 0x7fe90415aaa0 2023-10-14T09:37:43.501 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.496+0000 7fe9017fa640 1 -- 172.21.15.102:0/2363890600 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8ec007660 con 0x7fe90415aaa0 2023-10-14T09:37:43.501 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.496+0000 7fe90a9d0640 1 -- 172.21.15.102:0/2363890600 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe90415b630 con 0x7fe90415aaa0 2023-10-14T09:37:43.501 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.496+0000 7fe9017fa640 1 -- 172.21.15.102:0/2363890600 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec004a20 con 0x7fe90415aaa0 2023-10-14T09:37:43.501 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.496+0000 7fe90a9d0640 1 -- 172.21.15.102:0/2363890600 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe90415b9c0 con 0x7fe90415aaa0 2023-10-14T09:37:43.502 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.497+0000 7fe90a9d0640 1 -- 172.21.15.102:0/2363890600 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe90404e160 con 0x7fe90415aaa0 2023-10-14T09:37:43.502 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.498+0000 7fe9017fa640 1 -- 172.21.15.102:0/2363890600 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe8ec004b80 con 0x7fe90415aaa0 2023-10-14T09:37:43.503 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.499+0000 7fe9017fa640 1 --2- 172.21.15.102:0/2363890600 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe8e406ae70 0x7fe8e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:43.503 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.499+0000 7fe9017fa640 1 -- 172.21.15.102:0/2363890600 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8ec0893e0 con 0x7fe90415aaa0 2023-10-14T09:37:43.503 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.499+0000 7fe903fff640 1 --2- 172.21.15.102:0/2363890600 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe8e406ae70 0x7fe8e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:43.503 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.500+0000 7fe903fff640 1 --2- 172.21.15.102:0/2363890600 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe8e406ae70 0x7fe8e406d330 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4036000 tx=0x7fe8f4030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:43.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.504+0000 7fe9017fa640 1 -- 172.21.15.102:0/2363890600 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe8ec054480 con 0x7fe90415aaa0 2023-10-14T09:37:43.735 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.733+0000 7fe90a9d0640 1 -- 172.21.15.102:0/2363890600 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe9040cdc60 con 0x7fe90415aaa0 2023-10-14T09:37:43.736 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.734+0000 7fe9017fa640 1 -- 172.21.15.102:0/2363890600 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe8ec057aa0 con 0x7fe90415aaa0 2023-10-14T09:37:43.736 INFO:teuthology.orchestra.run.smithi102.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T09:37:43.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.737+0000 7fe90a9d0640 1 -- 172.21.15.102:0/2363890600 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe8e406ae70 msgr2=0x7fe8e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:43.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.737+0000 7fe90a9d0640 1 --2- 172.21.15.102:0/2363890600 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe8e406ae70 0x7fe8e406d330 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4036000 tx=0x7fe8f4030000 comp rx=0 tx=0).stop 2023-10-14T09:37:43.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.737+0000 7fe90a9d0640 1 -- 172.21.15.102:0/2363890600 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe90415aaa0 msgr2=0x7fe9040c46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:43.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.737+0000 7fe90a9d0640 1 --2- 172.21.15.102:0/2363890600 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe90415aaa0 0x7fe9040c46a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec00c3f0 tx=0x7fe8ec00c8b0 comp rx=0 tx=0).stop 2023-10-14T09:37:43.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.737+0000 7fe90a9d0640 1 -- 172.21.15.102:0/2363890600 shutdown_connections 2023-10-14T09:37:43.740 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.737+0000 7fe90a9d0640 1 --2- 172.21.15.102:0/2363890600 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe8e406ae70 0x7fe8e406d330 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:43.740 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.737+0000 7fe90a9d0640 1 --2- 172.21.15.102:0/2363890600 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe90415ae80 0x7fe90406fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:43.740 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.737+0000 7fe90a9d0640 1 --2- 172.21.15.102:0/2363890600 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe90415aaa0 0x7fe9040c46a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:43.740 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.737+0000 7fe90a9d0640 1 --2- 172.21.15.102:0/2363890600 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe9040ce390 0x7fe90414fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:43.740 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.737+0000 7fe90a9d0640 1 -- 172.21.15.102:0/2363890600 >> 172.21.15.102:0/2363890600 conn(0x7fe9040cb410 msgr2=0x7fe9040b0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:43.741 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.737+0000 7fe90a9d0640 1 -- 172.21.15.102:0/2363890600 shutdown_connections 2023-10-14T09:37:43.741 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:43.737+0000 7fe90a9d0640 1 -- 172.21.15.102:0/2363890600 wait complete. 2023-10-14T09:37:43.758 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T09:37:43.758 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T09:37:43.758 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi102.front.sepia.ceph.com 2023-10-14T09:37:43.759 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-14T09:37:43.759 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-14T09:37:43.759 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T09:37:43.759 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T09:37:43.760 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T09:37:43.760 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-14T09:37:43.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:43.760 DEBUG:teuthology.orchestra.run.smithi102:> ip addr 2023-10-14T09:37:43.809 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T09:37:43.809 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T09:37:43.810 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T09:37:43.810 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:37:43.810 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2023-10-14T09:37:43.810 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:37:43.810 INFO:teuthology.orchestra.run.smithi102.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T09:37:43.811 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dc brd ff:ff:ff:ff:ff:ff 2023-10-14T09:37:43.811 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f0 2023-10-14T09:37:43.811 INFO:teuthology.orchestra.run.smithi102.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T09:37:43.811 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dd brd ff:ff:ff:ff:ff:ff 2023-10-14T09:37:43.811 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f1 2023-10-14T09:37:43.812 INFO:teuthology.orchestra.run.smithi102.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T09:37:43.812 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:68 brd ff:ff:ff:ff:ff:ff 2023-10-14T09:37:43.812 INFO:teuthology.orchestra.run.smithi102.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T09:37:43.812 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:69 brd ff:ff:ff:ff:ff:ff 2023-10-14T09:37:43.812 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.21.15.102/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T09:37:43.813 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft 42362sec preferred_lft 42362sec 2023-10-14T09:37:43.813 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::ec4:7aff:fe8f:d769/64 scope link 2023-10-14T09:37:43.813 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:37:43.813 INFO:teuthology.orchestra.run.smithi102.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T09:37:43.813 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 16:ec:bb:57:4c:b9 brd ff:ff:ff:ff:ff:ff 2023-10-14T09:37:43.813 INFO:teuthology.orchestra.run.smithi102.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T09:37:43.814 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:37:43.814 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::4865:1ff:fe3f:e5e7/64 scope link 2023-10-14T09:37:43.814 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:37:43.814 INFO:teuthology.orchestra.run.smithi102.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T09:37:43.814 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 16:ec:bb:57:4c:b9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T09:37:43.815 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::14ec:bbff:fe57:4cb9/64 scope link 2023-10-14T09:37:43.815 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:37:43.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:43.816 DEBUG:teuthology.orchestra.run.smithi102:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T09:37:43.905 INFO:teuthology.orchestra.run.smithi102.stdout:1 2023-10-14T09:37:43.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:43.909 DEBUG:teuthology.orchestra.run.smithi102:> route 2023-10-14T09:37:43.962 INFO:teuthology.orchestra.run.smithi102.stdout:Kernel IP routing table 2023-10-14T09:37:43.962 INFO:teuthology.orchestra.run.smithi102.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T09:37:43.963 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T09:37:43.963 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T09:37:43.963 INFO:teuthology.orchestra.run.smithi102.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T09:37:43.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:43.964 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2023-10-14T09:37:43.964 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2023-10-14T09:37:43.964 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T09:37:43.965 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T09:37:43.965 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T09:37:43.965 DEBUG:teuthology.orchestra.run.smithi102:> ') 2023-10-14T09:37:44.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:44.142 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2023-10-14T09:37:44.192 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T09:37:44.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:44.194 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list-id 2023-10-14T09:37:44.245 INFO:teuthology.orchestra.run.smithi102.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-14T09:37:44.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:44.247 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2023-10-14T09:37:44.247 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2023-10-14T09:37:44.247 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T09:37:44.248 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-14T09:37:44.248 DEBUG:teuthology.orchestra.run.smithi102:> ') 2023-10-14T09:37:44.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:44.391 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-14T09:37:44.485 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T09:37:44.485 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T09:37:44.485 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T09:37:44.486 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:37:44.486 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2023-10-14T09:37:44.486 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:37:44.486 INFO:teuthology.orchestra.run.smithi102.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T09:37:44.486 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 3a:ed:90:74:5d:d5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-14T09:37:44.487 INFO:teuthology.orchestra.run.smithi102.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-14T09:37:44.487 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:37:44.487 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::38ed:90ff:fe74:5dd5/64 scope link 2023-10-14T09:37:44.487 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:37:44.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:44.489 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-14T09:37:44.590 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T09:37:44.590 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T09:37:44.590 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T09:37:44.590 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:37:44.591 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2023-10-14T09:37:44.591 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:37:44.591 INFO:teuthology.orchestra.run.smithi102.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T09:37:44.591 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 3a:ed:90:74:5d:d5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-14T09:37:44.592 INFO:teuthology.orchestra.run.smithi102.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-14T09:37:44.592 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:37:44.592 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::38ed:90ff:fe74:5dd5/64 scope link 2023-10-14T09:37:44.592 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:37:44.594 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-14T09:37:44.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:44.595 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2023-10-14T09:37:44.595 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2023-10-14T09:37:44.596 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-14T09:37:44.596 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-14T09:37:44.596 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-14T09:37:44.596 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-14T09:37:44.597 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-14T09:37:44.597 DEBUG:teuthology.orchestra.run.smithi102:> ') 2023-10-14T09:37:44.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:44.866 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2023-10-14T09:37:44.866 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2023-10-14T09:37:44.867 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set brx.1 up 2023-10-14T09:37:44.867 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set dev brx.1 master ceph-brx 2023-10-14T09:37:44.867 DEBUG:teuthology.orchestra.run.smithi102:> ') 2023-10-14T09:37:45.043 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T09:37:45.043 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-14T09:37:45.093 INFO:teuthology.orchestra.run.smithi102.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-14T09:37:45.093 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T09:37:45.093 DEBUG:teuthology.orchestra.run.smithi102:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-14T09:37:45.143 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-10-14T09:37:45.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:45.144 DEBUG:teuthology.orchestra.run.smithi102:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T09:37:45.282 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T09:37:45.282 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T09:37:45.316 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T09:37:45.317 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T09:37:45.317 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.102:3300,172.21.15.129:3300,172.21.15.129:3301" 2023-10-14T09:37:45.317 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: trying mount with new device syntax: 2@8a6cd69d-7f5b-4f2a-806a-0176c10aed50.cephfs=/ 2023-10-14T09:37:45.317 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.102:3300/172.21.15.129:3300/172.21.15.129:3301" will pass to kernel 2023-10-14T09:37:45.321 INFO:teuthology.orchestra.run.smithi102.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2023-10-14T09:37:45.321 INFO:teuthology.orchestra.run.smithi102.stdout: You just mounted a file system that supports labels which does not 2023-10-14T09:37:45.321 INFO:teuthology.orchestra.run.smithi102.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-10-14T09:37:45.321 INFO:teuthology.orchestra.run.smithi102.stdout: applications will generate AVC messages and not be allowed access to 2023-10-14T09:37:45.321 INFO:teuthology.orchestra.run.smithi102.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-10-14T09:37:45.326 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T09:37:45.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:45.326 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-14T09:37:45.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:45.417 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T09:37:45.475 INFO:teuthology.orchestra.run.smithi102.stdout:client4492 2023-10-14T09:37:45.476 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-10-14T09:37:45.476 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T09:37:45.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:45.527 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T09:37:45.631 INFO:teuthology.orchestra.run.smithi102.stdout:client4492 2023-10-14T09:37:45.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:45.632 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T09:37:45.688 INFO:teuthology.orchestra.run.smithi102.stdout:client4492 2023-10-14T09:37:45.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:45.689 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/8a6cd69d-7f5b-4f2a-806a-0176c10aed50.client4492/status') 2023-10-14T09:37:45.781 INFO:teuthology.orchestra.run.smithi102.stdout:instance: client.4492 (3)172.21.15.102:0/3730665304 2023-10-14T09:37:45.781 INFO:teuthology.orchestra.run.smithi102.stdout:blocklisted: false 2023-10-14T09:37:45.781 INFO:teuthology.orchestra.run.smithi102.stderr:0+1 records in 2023-10-14T09:37:45.781 INFO:teuthology.orchestra.run.smithi102.stderr:0+1 records out 2023-10-14T09:37:45.782 INFO:teuthology.orchestra.run.smithi102.stderr:71 bytes copied, 6.4919e-05 s, 1.1 MB/s 2023-10-14T09:37:45.784 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-10-14T09:37:45.785 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-14T09:37:45.785 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T09:37:45.785 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T09:37:45.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:45.995+0000 7f327a7b6640 1 Processor -- start 2023-10-14T09:37:45.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:45.996+0000 7f327a7b6640 1 -- start start 2023-10-14T09:37:45.998 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:45.997+0000 7f327a7b6640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f32740adb50 0x7f327406f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:45.998 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:45.997+0000 7f327a7b6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3274070fd0 0x7f32740b0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:45.998 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:45.997+0000 7f327a7b6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3274071450 con 0x7f32740adf30 2023-10-14T09:37:45.998 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:45.997+0000 7f327a7b6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32740cc600 con 0x7f3274070fd0 2023-10-14T09:37:45.999 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:45.997+0000 7f327a7b6640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32740cc8e0 con 0x7f32740adb50 2023-10-14T09:37:46.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:45.997+0000 7f326bfff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3274070fd0 0x7f32740b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:46.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:45.997+0000 7f3278d53640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f32740adf30 0x7f3274164f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:47924/0 (socket says 172.21.15.102:47924) 2023-10-14T09:37:46.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:45.998+0000 7f3278d53640 1 -- 172.21.15.102:0/298207473 learned_addr learned my addr 172.21.15.102:0/298207473 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:46.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:45.998+0000 7f326bfff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3274070fd0 0x7f32740b0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43286/0 (socket says 172.21.15.102:43286) 2023-10-14T09:37:46.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:45.998+0000 7f3273fff640 1 --2- 172.21.15.102:0/298207473 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f32740adb50 0x7f327406f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:46.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:45.998+0000 7f326bfff640 1 -- 172.21.15.102:0/298207473 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f32740adb50 msgr2=0x7f327406f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:46.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:45.998+0000 7f326bfff640 1 --2- 172.21.15.102:0/298207473 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f32740adb50 0x7f327406f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:46.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:45.998+0000 7f326bfff640 1 -- 172.21.15.102:0/298207473 >> v1:172.21.15.102:6789/0 conn(0x7f32740adf30 legacy=0x7f3274164f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:46.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:45.998+0000 7f326bfff640 1 -- 172.21.15.102:0/298207473 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32740ccbc0 con 0x7f3274070fd0 2023-10-14T09:37:46.003 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:45.999+0000 7f326bfff640 1 --2- 172.21.15.102:0/298207473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3274070fd0 0x7f32740b0410 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f325c0097a0 tx=0x7f325c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab563f1aa973b32 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:46.003 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.000+0000 7f32737fe640 1 -- 172.21.15.102:0/298207473 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325c031830 con 0x7f3274070fd0 2023-10-14T09:37:46.003 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.000+0000 7f32737fe640 1 -- 172.21.15.102:0/298207473 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325c031990 con 0x7f3274070fd0 2023-10-14T09:37:46.003 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.000+0000 7f32737fe640 1 -- 172.21.15.102:0/298207473 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325c031d20 con 0x7f3274070fd0 2023-10-14T09:37:46.004 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.000+0000 7f327a7b6640 1 -- 172.21.15.102:0/298207473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3274070fd0 msgr2=0x7f32740b0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:46.004 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.000+0000 7f327a7b6640 1 --2- 172.21.15.102:0/298207473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3274070fd0 0x7f32740b0410 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f325c0097a0 tx=0x7f325c02b8d0 comp rx=0 tx=0).stop 2023-10-14T09:37:46.004 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.000+0000 7f327a7b6640 1 -- 172.21.15.102:0/298207473 shutdown_connections 2023-10-14T09:37:46.004 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.000+0000 7f327a7b6640 1 --2- 172.21.15.102:0/298207473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3274070fd0 0x7f32740b0410 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:46.004 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.000+0000 7f327a7b6640 1 --2- 172.21.15.102:0/298207473 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f32740adb50 0x7f327406f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:46.005 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.000+0000 7f327a7b6640 1 -- 172.21.15.102:0/298207473 >> 172.21.15.102:0/298207473 conn(0x7f32740cb410 msgr2=0x7f32740cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:46.005 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.000+0000 7f327a7b6640 1 -- 172.21.15.102:0/298207473 shutdown_connections 2023-10-14T09:37:46.005 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.000+0000 7f327a7b6640 1 -- 172.21.15.102:0/298207473 wait complete. 2023-10-14T09:37:46.005 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.002+0000 7f327a7b6640 1 Processor -- start 2023-10-14T09:37:46.005 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.002+0000 7f327a7b6640 1 -- start start 2023-10-14T09:37:46.007 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.003+0000 7f327a7b6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3274070fd0 0x7f32741fb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:46.008 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.003+0000 7f327a7b6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32740adb50 0x7f32740b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:46.008 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.003+0000 7f327a7b6640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f32740adf30 0x7f32741515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:46.008 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.003+0000 7f327a7b6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3274155900 con 0x7f32740adb50 2023-10-14T09:37:46.008 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.003+0000 7f327a7b6640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32741fb130 con 0x7f3274070fd0 2023-10-14T09:37:46.008 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.003+0000 7f327a7b6640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32741524a0 con 0x7f32740adf30 2023-10-14T09:37:46.009 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.004+0000 7f326bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32740adb50 0x7f32740b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:46.009 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.004+0000 7f326bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32740adb50 0x7f32740b3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43302/0 (socket says 172.21.15.102:43302) 2023-10-14T09:37:46.009 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.004+0000 7f326bfff640 1 -- 172.21.15.102:0/2377549424 learned_addr learned my addr 172.21.15.102:0/2377549424 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:46.009 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.004+0000 7f3278d53640 1 --2- 172.21.15.102:0/2377549424 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f32740adf30 0x7f32741515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:46.009 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.004+0000 7f3273fff640 1 --2- 172.21.15.102:0/2377549424 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3274070fd0 0x7f32741fb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:46.010 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.004+0000 7f326bfff640 1 -- 172.21.15.102:0/2377549424 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f32740adf30 msgr2=0x7f32741515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:46.010 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.004+0000 7f326bfff640 1 --2- 172.21.15.102:0/2377549424 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f32740adf30 0x7f32741515e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:46.010 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.004+0000 7f326bfff640 1 -- 172.21.15.102:0/2377549424 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3274070fd0 msgr2=0x7f32741fb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:46.010 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.004+0000 7f326bfff640 1 --2- 172.21.15.102:0/2377549424 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3274070fd0 0x7f32741fb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:46.010 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.004+0000 7f326bfff640 1 -- 172.21.15.102:0/2377549424 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f325c009400 con 0x7f32740adb50 2023-10-14T09:37:46.011 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.004+0000 7f326bfff640 1 --2- 172.21.15.102:0/2377549424 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32740adb50 0x7f32740b3df0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f325c034040 tx=0x7f325c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:46.011 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.005+0000 7f32717fa640 1 -- 172.21.15.102:0/2377549424 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325c03aa60 con 0x7f32740adb50 2023-10-14T09:37:46.011 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.005+0000 7f32717fa640 1 -- 172.21.15.102:0/2377549424 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325c03abe0 con 0x7f32740adb50 2023-10-14T09:37:46.011 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.005+0000 7f32717fa640 1 -- 172.21.15.102:0/2377549424 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325c044400 con 0x7f32740adb50 2023-10-14T09:37:46.011 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.005+0000 7f327a7b6640 1 -- 172.21.15.102:0/2377549424 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32741521c0 con 0x7f32740adb50 2023-10-14T09:37:46.012 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.005+0000 7f327a7b6640 1 -- 172.21.15.102:0/2377549424 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32741fadc0 con 0x7f32740adb50 2023-10-14T09:37:46.012 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.006+0000 7f327a7b6640 1 -- 172.21.15.102:0/2377549424 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32741faf50 con 0x7f32740adb50 2023-10-14T09:37:46.012 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.007+0000 7f32717fa640 1 -- 172.21.15.102:0/2377549424 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f325c04d440 con 0x7f32740adb50 2023-10-14T09:37:46.013 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.008+0000 7f32717fa640 1 --2- 172.21.15.102:0/2377549424 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f325806ae70 0x7f325806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:46.013 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.008+0000 7f32717fa640 1 -- 172.21.15.102:0/2377549424 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f325c0ab820 con 0x7f32740adb50 2023-10-14T09:37:46.013 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.008+0000 7f3273fff640 1 --2- 172.21.15.102:0/2377549424 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f325806ae70 0x7f325806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:46.014 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.009+0000 7f3273fff640 1 --2- 172.21.15.102:0/2377549424 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f325806ae70 0x7f325806d330 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3264006fd0 tx=0x7f3264008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:46.014 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.012+0000 7f32717fa640 1 -- 172.21.15.102:0/2377549424 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f325c0768c0 con 0x7f32740adb50 2023-10-14T09:37:46.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.244+0000 7f327a7b6640 1 -- 172.21.15.102:0/2377549424 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f327404e160 con 0x7f32740adb50 2023-10-14T09:37:46.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.245+0000 7f32717fa640 1 -- 172.21.15.102:0/2377549424 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f325c035070 con 0x7f32740adb50 2023-10-14T09:37:46.246 INFO:teuthology.orchestra.run.smithi102.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T09:37:46.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.247+0000 7f327a7b6640 1 -- 172.21.15.102:0/2377549424 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f325806ae70 msgr2=0x7f325806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:46.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.247+0000 7f327a7b6640 1 --2- 172.21.15.102:0/2377549424 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f325806ae70 0x7f325806d330 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3264006fd0 tx=0x7f3264008040 comp rx=0 tx=0).stop 2023-10-14T09:37:46.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.247+0000 7f327a7b6640 1 -- 172.21.15.102:0/2377549424 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32740adb50 msgr2=0x7f32740b3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:46.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.247+0000 7f327a7b6640 1 --2- 172.21.15.102:0/2377549424 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32740adb50 0x7f32740b3df0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f325c034040 tx=0x7f325c0046c0 comp rx=0 tx=0).stop 2023-10-14T09:37:46.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.247+0000 7f327a7b6640 1 -- 172.21.15.102:0/2377549424 shutdown_connections 2023-10-14T09:37:46.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.247+0000 7f327a7b6640 1 --2- 172.21.15.102:0/2377549424 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f325806ae70 0x7f325806d330 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:46.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.248+0000 7f327a7b6640 1 --2- 172.21.15.102:0/2377549424 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f32740adf30 0x7f32741515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:46.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.248+0000 7f327a7b6640 1 --2- 172.21.15.102:0/2377549424 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32740adb50 0x7f32740b3df0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:46.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.248+0000 7f327a7b6640 1 --2- 172.21.15.102:0/2377549424 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3274070fd0 0x7f32741fb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:46.251 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.248+0000 7f327a7b6640 1 -- 172.21.15.102:0/2377549424 >> 172.21.15.102:0/2377549424 conn(0x7f32740cb410 msgr2=0x7f327415eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:46.251 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.248+0000 7f327a7b6640 1 -- 172.21.15.102:0/2377549424 shutdown_connections 2023-10-14T09:37:46.251 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:46.248+0000 7f327a7b6640 1 -- 172.21.15.102:0/2377549424 wait complete. 2023-10-14T09:37:46.267 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T09:37:46.268 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T09:37:46.268 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi129.front.sepia.ceph.com 2023-10-14T09:37:46.268 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-14T09:37:46.268 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T09:37:46.269 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T09:37:46.269 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T09:37:46.269 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T09:37:46.269 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T09:37:46.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:46.270 DEBUG:teuthology.orchestra.run.smithi129:> ip addr 2023-10-14T09:37:46.328 INFO:teuthology.orchestra.run.smithi129.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T09:37:46.329 INFO:teuthology.orchestra.run.smithi129.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T09:37:46.329 INFO:teuthology.orchestra.run.smithi129.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T09:37:46.329 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:37:46.329 INFO:teuthology.orchestra.run.smithi129.stdout: inet6 ::1/128 scope host 2023-10-14T09:37:46.330 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:37:46.330 INFO:teuthology.orchestra.run.smithi129.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T09:37:46.330 INFO:teuthology.orchestra.run.smithi129.stdout: link/ether 0c:c4:7a:d9:19:38 brd ff:ff:ff:ff:ff:ff 2023-10-14T09:37:46.330 INFO:teuthology.orchestra.run.smithi129.stdout: altname enp7s0f0 2023-10-14T09:37:46.330 INFO:teuthology.orchestra.run.smithi129.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T09:37:46.331 INFO:teuthology.orchestra.run.smithi129.stdout: link/ether 0c:c4:7a:d9:19:39 brd ff:ff:ff:ff:ff:ff 2023-10-14T09:37:46.331 INFO:teuthology.orchestra.run.smithi129.stdout: altname enp7s0f1 2023-10-14T09:37:46.331 INFO:teuthology.orchestra.run.smithi129.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T09:37:46.331 INFO:teuthology.orchestra.run.smithi129.stdout: link/ether 0c:c4:7a:88:72:60 brd ff:ff:ff:ff:ff:ff 2023-10-14T09:37:46.331 INFO:teuthology.orchestra.run.smithi129.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T09:37:46.332 INFO:teuthology.orchestra.run.smithi129.stdout: link/ether 0c:c4:7a:88:72:61 brd ff:ff:ff:ff:ff:ff 2023-10-14T09:37:46.332 INFO:teuthology.orchestra.run.smithi129.stdout: inet 172.21.15.129/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T09:37:46.332 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft 42347sec preferred_lft 42347sec 2023-10-14T09:37:46.332 INFO:teuthology.orchestra.run.smithi129.stdout: inet6 fe80::ec4:7aff:fe88:7261/64 scope link 2023-10-14T09:37:46.332 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:37:46.333 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-14T09:37:46.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:46.333 DEBUG:teuthology.orchestra.run.smithi129:> (cd / && exec bash -c ' 2023-10-14T09:37:46.334 DEBUG:teuthology.orchestra.run.smithi129:> set -e 2023-10-14T09:37:46.334 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link add name ceph-brx type bridge 2023-10-14T09:37:46.334 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip addr flush dev ceph-brx 2023-10-14T09:37:46.335 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link set ceph-brx up 2023-10-14T09:37:46.335 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-14T09:37:46.335 DEBUG:teuthology.orchestra.run.smithi129:> ') 2023-10-14T09:37:46.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:46.808 DEBUG:teuthology.orchestra.run.smithi129:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T09:37:46.887 INFO:teuthology.orchestra.run.smithi129.stdout:1 2023-10-14T09:37:46.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:46.891 DEBUG:teuthology.orchestra.run.smithi129:> route 2023-10-14T09:37:46.949 INFO:teuthology.orchestra.run.smithi129.stdout:Kernel IP routing table 2023-10-14T09:37:46.950 INFO:teuthology.orchestra.run.smithi129.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T09:37:46.950 INFO:teuthology.orchestra.run.smithi129.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T09:37:46.950 INFO:teuthology.orchestra.run.smithi129.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T09:37:46.951 INFO:teuthology.orchestra.run.smithi129.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T09:37:46.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:46.951 DEBUG:teuthology.orchestra.run.smithi129:> (cd / && exec bash -c ' 2023-10-14T09:37:46.952 DEBUG:teuthology.orchestra.run.smithi129:> set -e 2023-10-14T09:37:46.952 DEBUG:teuthology.orchestra.run.smithi129:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T09:37:46.952 DEBUG:teuthology.orchestra.run.smithi129:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T09:37:46.953 DEBUG:teuthology.orchestra.run.smithi129:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T09:37:46.953 DEBUG:teuthology.orchestra.run.smithi129:> ') 2023-10-14T09:37:47.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:47.691 DEBUG:teuthology.orchestra.run.smithi129:> ip netns list 2023-10-14T09:37:47.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:47.748 DEBUG:teuthology.orchestra.run.smithi129:> ip netns list-id 2023-10-14T09:37:47.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:47.802 DEBUG:teuthology.orchestra.run.smithi129:> (cd / && exec bash -c ' 2023-10-14T09:37:47.802 DEBUG:teuthology.orchestra.run.smithi129:> set -e 2023-10-14T09:37:47.802 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T09:37:47.803 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-14T09:37:47.803 DEBUG:teuthology.orchestra.run.smithi129:> ') 2023-10-14T09:37:47.944 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-14T09:37:47.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:47.945 DEBUG:teuthology.orchestra.run.smithi129:> (cd / && exec bash -c ' 2023-10-14T09:37:47.945 DEBUG:teuthology.orchestra.run.smithi129:> set -e 2023-10-14T09:37:47.945 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-14T09:37:47.946 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-14T09:37:47.946 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-14T09:37:47.946 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-14T09:37:47.947 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-14T09:37:47.947 DEBUG:teuthology.orchestra.run.smithi129:> ') 2023-10-14T09:37:48.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:48.220 DEBUG:teuthology.orchestra.run.smithi129:> (cd / && exec bash -c ' 2023-10-14T09:37:48.221 DEBUG:teuthology.orchestra.run.smithi129:> set -e 2023-10-14T09:37:48.221 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link set brx.0 up 2023-10-14T09:37:48.221 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link set dev brx.0 master ceph-brx 2023-10-14T09:37:48.222 DEBUG:teuthology.orchestra.run.smithi129:> ') 2023-10-14T09:37:48.379 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T09:37:48.380 DEBUG:teuthology.orchestra.run.smithi129:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-14T09:37:48.427 INFO:teuthology.orchestra.run.smithi129.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-14T09:37:48.427 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T09:37:48.428 DEBUG:teuthology.orchestra.run.smithi129:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-14T09:37:48.524 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-14T09:37:48.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:48.525 DEBUG:teuthology.orchestra.run.smithi129:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T09:37:48.674 INFO:teuthology.orchestra.run.smithi129.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T09:37:48.675 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T09:37:49.114 INFO:teuthology.orchestra.run.smithi129.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T09:37:49.114 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T09:37:49.114 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: resolved to: "172.21.15.102:3300,172.21.15.129:3300,172.21.15.129:3301" 2023-10-14T09:37:49.114 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: trying mount with new device syntax: 1@8a6cd69d-7f5b-4f2a-806a-0176c10aed50.cephfs=/ 2023-10-14T09:37:49.115 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.102:3300/172.21.15.129:3300/172.21.15.129:3301" will pass to kernel 2023-10-14T09:37:49.119 INFO:teuthology.orchestra.run.smithi129.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-10-14T09:37:49.119 INFO:teuthology.orchestra.run.smithi129.stdout: You just mounted a file system that supports labels which does not 2023-10-14T09:37:49.120 INFO:teuthology.orchestra.run.smithi129.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-10-14T09:37:49.120 INFO:teuthology.orchestra.run.smithi129.stdout: applications will generate AVC messages and not be allowed access to 2023-10-14T09:37:49.120 INFO:teuthology.orchestra.run.smithi129.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-10-14T09:37:49.125 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T09:37:49.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:49.125 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-14T09:37:49.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:49.214 DEBUG:teuthology.orchestra.run.smithi129:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T09:37:49.269 INFO:teuthology.orchestra.run.smithi129.stdout:client4498 2023-10-14T09:37:49.270 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2023-10-14T09:37:49.270 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T09:37:49.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:49.319 DEBUG:teuthology.orchestra.run.smithi129:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T09:37:49.422 INFO:teuthology.orchestra.run.smithi129.stdout:client4498 2023-10-14T09:37:49.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:49.423 DEBUG:teuthology.orchestra.run.smithi129:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T09:37:49.478 INFO:teuthology.orchestra.run.smithi129.stdout:client4498 2023-10-14T09:37:49.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:49.479 DEBUG:teuthology.orchestra.run.smithi129:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/8a6cd69d-7f5b-4f2a-806a-0176c10aed50.client4498/status') 2023-10-14T09:37:49.574 INFO:teuthology.orchestra.run.smithi129.stdout:instance: client.4498 (3)192.168.0.1:0/1591349443 2023-10-14T09:37:49.574 INFO:teuthology.orchestra.run.smithi129.stdout:blocklisted: false 2023-10-14T09:37:49.574 INFO:teuthology.orchestra.run.smithi129.stderr:0+1 records in 2023-10-14T09:37:49.575 INFO:teuthology.orchestra.run.smithi129.stderr:0+1 records out 2023-10-14T09:37:49.575 INFO:teuthology.orchestra.run.smithi129.stderr:69 bytes copied, 7.0228e-05 s, 983 kB/s 2023-10-14T09:37:49.578 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-10-14T09:37:49.578 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-14T09:37:49.578 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-14T09:37:49.578 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T09:37:49.798 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.796+0000 7f646d56c640 1 Processor -- start 2023-10-14T09:37:49.798 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.796+0000 7f646d56c640 1 -- start start 2023-10-14T09:37:49.800 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.798+0000 7f646d56c640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6468159f00 0x7f64680b0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:49.800 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.798+0000 7f646d56c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f646815d880 0x7f64680b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:49.800 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.798+0000 7f646d56c640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f646806f7f0 con 0x7f6468159b20 2023-10-14T09:37:49.800 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.798+0000 7f646d56c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f646806c5e0 con 0x7f646815d880 2023-10-14T09:37:49.800 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.798+0000 7f646d56c640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646806c8c0 con 0x7f6468159f00 2023-10-14T09:37:49.801 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.798+0000 7f64677fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f646815d880 0x7f64680b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:49.801 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.798+0000 7f64677fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f646815d880 0x7f64680b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43308/0 (socket says 172.21.15.102:43308) 2023-10-14T09:37:49.802 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.798+0000 7f64677fe640 1 -- 172.21.15.102:0/3112668979 learned_addr learned my addr 172.21.15.102:0/3112668979 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:49.802 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.799+0000 7f645e7fc640 1 --2- 172.21.15.102:0/3112668979 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6468159f00 0x7f64680b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:49.802 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.799+0000 7f64677fe640 1 -- 172.21.15.102:0/3112668979 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6468159f00 msgr2=0x7f64680b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:49.802 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.799+0000 7f64677fe640 1 --2- 172.21.15.102:0/3112668979 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6468159f00 0x7f64680b0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:49.803 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.799+0000 7f64677fe640 1 -- 172.21.15.102:0/3112668979 >> v1:172.21.15.129:6789/0 conn(0x7f6468159b20 legacy=0x7f646806bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:49.803 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.799+0000 7f64677fe640 1 -- 172.21.15.102:0/3112668979 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646806cba0 con 0x7f646815d880 2023-10-14T09:37:49.804 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.800+0000 7f64677fe640 1 --2- 172.21.15.102:0/3112668979 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f646815d880 0x7f64680b0950 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6460009870 tx=0x7f646002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=439c2efcf7325815 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:49.804 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.801+0000 7f64667fc640 1 -- 172.21.15.102:0/3112668979 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6460030840 con 0x7f646815d880 2023-10-14T09:37:49.804 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.801+0000 7f64667fc640 1 -- 172.21.15.102:0/3112668979 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64600309a0 con 0x7f646815d880 2023-10-14T09:37:49.805 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.801+0000 7f64667fc640 1 -- 172.21.15.102:0/3112668979 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6460030d30 con 0x7f646815d880 2023-10-14T09:37:49.805 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.801+0000 7f646d56c640 1 -- 172.21.15.102:0/3112668979 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f646815d880 msgr2=0x7f64680b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:49.805 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.801+0000 7f646d56c640 1 --2- 172.21.15.102:0/3112668979 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f646815d880 0x7f64680b0950 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6460009870 tx=0x7f646002b980 comp rx=0 tx=0).stop 2023-10-14T09:37:49.805 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.801+0000 7f646d56c640 1 -- 172.21.15.102:0/3112668979 shutdown_connections 2023-10-14T09:37:49.805 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.801+0000 7f646d56c640 1 --2- 172.21.15.102:0/3112668979 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f646815d880 0x7f64680b0950 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:49.805 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.801+0000 7f646d56c640 1 --2- 172.21.15.102:0/3112668979 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6468159f00 0x7f64680b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:49.806 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.801+0000 7f646d56c640 1 -- 172.21.15.102:0/3112668979 >> 172.21.15.102:0/3112668979 conn(0x7f64680cb410 msgr2=0x7f64680cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:49.806 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.801+0000 7f646d56c640 1 -- 172.21.15.102:0/3112668979 shutdown_connections 2023-10-14T09:37:49.806 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.801+0000 7f646d56c640 1 -- 172.21.15.102:0/3112668979 wait complete. 2023-10-14T09:37:49.808 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.803+0000 7f646d56c640 1 Processor -- start 2023-10-14T09:37:49.808 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.803+0000 7f646d56c640 1 -- start start 2023-10-14T09:37:49.808 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.804+0000 7f646d56c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6468159b20 0x7f6468154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:49.809 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.804+0000 7f646d56c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6468159f00 0x7f64680af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:49.809 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.804+0000 7f646d56c640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f646815d880 0x7f64680afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:49.809 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.804+0000 7f646d56c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64681552a0 con 0x7f6468159f00 2023-10-14T09:37:49.809 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.804+0000 7f646d56c640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646815d0d0 con 0x7f6468159b20 2023-10-14T09:37:49.809 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.804+0000 7f646d56c640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64680b1470 con 0x7f646815d880 2023-10-14T09:37:49.809 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.804+0000 7f645e7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6468159f00 0x7f64680af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:49.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.804+0000 7f645e7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6468159f00 0x7f64680af8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43312/0 (socket says 172.21.15.102:43312) 2023-10-14T09:37:49.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.804+0000 7f645e7fc640 1 -- 172.21.15.102:0/1067222395 learned_addr learned my addr 172.21.15.102:0/1067222395 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:49.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.805+0000 7f6466ffd640 1 --2- 172.21.15.102:0/1067222395 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6468159b20 0x7f6468154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:49.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.805+0000 7f64677fe640 1 --2- 172.21.15.102:0/1067222395 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f646815d880 0x7f64680afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:49.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.805+0000 7f645e7fc640 1 -- 172.21.15.102:0/1067222395 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f646815d880 msgr2=0x7f64680afdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:49.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.805+0000 7f645e7fc640 1 --2- 172.21.15.102:0/1067222395 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f646815d880 0x7f64680afdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:49.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.805+0000 7f645e7fc640 1 -- 172.21.15.102:0/1067222395 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6468159b20 msgr2=0x7f6468154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:49.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.805+0000 7f645e7fc640 1 --2- 172.21.15.102:0/1067222395 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6468159b20 0x7f6468154d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:49.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.805+0000 7f645e7fc640 1 -- 172.21.15.102:0/1067222395 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64600094d0 con 0x7f6468159f00 2023-10-14T09:37:49.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.805+0000 7f64677fe640 1 --2- 172.21.15.102:0/1067222395 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f646815d880 0x7f64680afdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:49.812 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.805+0000 7f645e7fc640 1 --2- 172.21.15.102:0/1067222395 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6468159f00 0x7f64680af8b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6450007e70 tx=0x7f645000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:49.812 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.805+0000 7f645ffff640 1 -- 172.21.15.102:0/1067222395 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6450014620 con 0x7f6468159f00 2023-10-14T09:37:49.812 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.805+0000 7f645ffff640 1 -- 172.21.15.102:0/1067222395 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645000ee90 con 0x7f6468159f00 2023-10-14T09:37:49.812 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.805+0000 7f646d56c640 1 -- 172.21.15.102:0/1067222395 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64680b1750 con 0x7f6468159f00 2023-10-14T09:37:49.812 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.805+0000 7f645ffff640 1 -- 172.21.15.102:0/1067222395 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64500149c0 con 0x7f6468159f00 2023-10-14T09:37:49.813 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.806+0000 7f646d56c640 1 -- 172.21.15.102:0/1067222395 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64680b1d10 con 0x7f6468159f00 2023-10-14T09:37:49.813 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.807+0000 7f646d56c640 1 -- 172.21.15.102:0/1067222395 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f646804e160 con 0x7f6468159f00 2023-10-14T09:37:49.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.808+0000 7f645ffff640 1 -- 172.21.15.102:0/1067222395 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6450014b20 con 0x7f6468159f00 2023-10-14T09:37:49.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.808+0000 7f645ffff640 1 --2- 172.21.15.102:0/1067222395 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f644806ae70 0x7f644806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:49.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.809+0000 7f645ffff640 1 -- 172.21.15.102:0/1067222395 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f645008a100 con 0x7f6468159f00 2023-10-14T09:37:49.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.809+0000 7f6466ffd640 1 --2- 172.21.15.102:0/1067222395 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f644806ae70 0x7f644806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:49.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.809+0000 7f6466ffd640 1 --2- 172.21.15.102:0/1067222395 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f644806ae70 0x7f644806d330 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6458000f60 tx=0x7f6458009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:49.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:49.813+0000 7f645ffff640 1 -- 172.21.15.102:0/1067222395 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6450055110 con 0x7f6468159f00 2023-10-14T09:37:50.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:50.043+0000 7f646d56c640 1 -- 172.21.15.102:0/1067222395 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f64680cb900 con 0x7f6468159f00 2023-10-14T09:37:50.046 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:50.044+0000 7f645ffff640 1 -- 172.21.15.102:0/1067222395 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6450058730 con 0x7f6468159f00 2023-10-14T09:37:50.047 INFO:teuthology.orchestra.run.smithi102.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T09:37:50.048 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:50.046+0000 7f646d56c640 1 -- 172.21.15.102:0/1067222395 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f644806ae70 msgr2=0x7f644806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:50.048 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:50.046+0000 7f646d56c640 1 --2- 172.21.15.102:0/1067222395 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f644806ae70 0x7f644806d330 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6458000f60 tx=0x7f6458009040 comp rx=0 tx=0).stop 2023-10-14T09:37:50.049 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:50.046+0000 7f646d56c640 1 -- 172.21.15.102:0/1067222395 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6468159f00 msgr2=0x7f64680af8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:50.049 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:50.046+0000 7f646d56c640 1 --2- 172.21.15.102:0/1067222395 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6468159f00 0x7f64680af8b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6450007e70 tx=0x7f645000e4b0 comp rx=0 tx=0).stop 2023-10-14T09:37:50.049 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:50.047+0000 7f646d56c640 1 -- 172.21.15.102:0/1067222395 shutdown_connections 2023-10-14T09:37:50.050 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:50.047+0000 7f646d56c640 1 --2- 172.21.15.102:0/1067222395 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f644806ae70 0x7f644806d330 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:50.050 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:50.047+0000 7f646d56c640 1 --2- 172.21.15.102:0/1067222395 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f646815d880 0x7f64680afdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:50.050 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:50.047+0000 7f646d56c640 1 --2- 172.21.15.102:0/1067222395 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6468159f00 0x7f64680af8b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:50.050 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:50.047+0000 7f646d56c640 1 --2- 172.21.15.102:0/1067222395 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6468159b20 0x7f6468154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:50.051 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:50.047+0000 7f646d56c640 1 -- 172.21.15.102:0/1067222395 >> 172.21.15.102:0/1067222395 conn(0x7f64680cb410 msgr2=0x7f64680ce870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:50.051 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:50.047+0000 7f646d56c640 1 -- 172.21.15.102:0/1067222395 shutdown_connections 2023-10-14T09:37:50.051 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:50.047+0000 7f646d56c640 1 -- 172.21.15.102:0/1067222395 wait complete. 2023-10-14T09:37:50.066 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T09:37:50.066 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T09:37:50.066 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi129.front.sepia.ceph.com 2023-10-14T09:37:50.067 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-14T09:37:50.067 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-14T09:37:50.067 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T09:37:50.067 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T09:37:50.068 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T09:37:50.068 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-14T09:37:50.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:50.069 DEBUG:teuthology.orchestra.run.smithi129:> ip addr 2023-10-14T09:37:50.130 INFO:teuthology.orchestra.run.smithi129.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T09:37:50.130 INFO:teuthology.orchestra.run.smithi129.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T09:37:50.130 INFO:teuthology.orchestra.run.smithi129.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T09:37:50.130 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:37:50.131 INFO:teuthology.orchestra.run.smithi129.stdout: inet6 ::1/128 scope host 2023-10-14T09:37:50.131 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:37:50.131 INFO:teuthology.orchestra.run.smithi129.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T09:37:50.131 INFO:teuthology.orchestra.run.smithi129.stdout: link/ether 0c:c4:7a:d9:19:38 brd ff:ff:ff:ff:ff:ff 2023-10-14T09:37:50.131 INFO:teuthology.orchestra.run.smithi129.stdout: altname enp7s0f0 2023-10-14T09:37:50.132 INFO:teuthology.orchestra.run.smithi129.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T09:37:50.132 INFO:teuthology.orchestra.run.smithi129.stdout: link/ether 0c:c4:7a:d9:19:39 brd ff:ff:ff:ff:ff:ff 2023-10-14T09:37:50.132 INFO:teuthology.orchestra.run.smithi129.stdout: altname enp7s0f1 2023-10-14T09:37:50.132 INFO:teuthology.orchestra.run.smithi129.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T09:37:50.132 INFO:teuthology.orchestra.run.smithi129.stdout: link/ether 0c:c4:7a:88:72:60 brd ff:ff:ff:ff:ff:ff 2023-10-14T09:37:50.132 INFO:teuthology.orchestra.run.smithi129.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T09:37:50.133 INFO:teuthology.orchestra.run.smithi129.stdout: link/ether 0c:c4:7a:88:72:61 brd ff:ff:ff:ff:ff:ff 2023-10-14T09:37:50.133 INFO:teuthology.orchestra.run.smithi129.stdout: inet 172.21.15.129/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T09:37:50.133 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft 42343sec preferred_lft 42343sec 2023-10-14T09:37:50.133 INFO:teuthology.orchestra.run.smithi129.stdout: inet6 fe80::ec4:7aff:fe88:7261/64 scope link 2023-10-14T09:37:50.133 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:37:50.133 INFO:teuthology.orchestra.run.smithi129.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T09:37:50.134 INFO:teuthology.orchestra.run.smithi129.stdout: link/ether 66:a0:68:66:03:68 brd ff:ff:ff:ff:ff:ff 2023-10-14T09:37:50.134 INFO:teuthology.orchestra.run.smithi129.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T09:37:50.134 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:37:50.134 INFO:teuthology.orchestra.run.smithi129.stdout: inet6 fe80::2842:5bff:fee8:298e/64 scope link 2023-10-14T09:37:50.134 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:37:50.135 INFO:teuthology.orchestra.run.smithi129.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T09:37:50.135 INFO:teuthology.orchestra.run.smithi129.stdout: link/ether 66:a0:68:66:03:68 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T09:37:50.135 INFO:teuthology.orchestra.run.smithi129.stdout: inet6 fe80::64a0:68ff:fe66:368/64 scope link 2023-10-14T09:37:50.135 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:37:50.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:50.137 DEBUG:teuthology.orchestra.run.smithi129:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T09:37:50.235 INFO:teuthology.orchestra.run.smithi129.stdout:1 2023-10-14T09:37:50.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:50.239 DEBUG:teuthology.orchestra.run.smithi129:> route 2023-10-14T09:37:50.295 INFO:teuthology.orchestra.run.smithi129.stdout:Kernel IP routing table 2023-10-14T09:37:50.295 INFO:teuthology.orchestra.run.smithi129.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T09:37:50.296 INFO:teuthology.orchestra.run.smithi129.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T09:37:50.296 INFO:teuthology.orchestra.run.smithi129.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T09:37:50.296 INFO:teuthology.orchestra.run.smithi129.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T09:37:50.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:50.297 DEBUG:teuthology.orchestra.run.smithi129:> (cd / && exec bash -c ' 2023-10-14T09:37:50.297 DEBUG:teuthology.orchestra.run.smithi129:> set -e 2023-10-14T09:37:50.298 DEBUG:teuthology.orchestra.run.smithi129:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T09:37:50.298 DEBUG:teuthology.orchestra.run.smithi129:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T09:37:50.298 DEBUG:teuthology.orchestra.run.smithi129:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T09:37:50.299 DEBUG:teuthology.orchestra.run.smithi129:> ') 2023-10-14T09:37:50.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:50.477 DEBUG:teuthology.orchestra.run.smithi129:> ip netns list 2023-10-14T09:37:50.525 INFO:teuthology.orchestra.run.smithi129.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T09:37:50.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:50.526 DEBUG:teuthology.orchestra.run.smithi129:> ip netns list-id 2023-10-14T09:37:50.575 INFO:teuthology.orchestra.run.smithi129.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-14T09:37:50.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:50.577 DEBUG:teuthology.orchestra.run.smithi129:> (cd / && exec bash -c ' 2023-10-14T09:37:50.577 DEBUG:teuthology.orchestra.run.smithi129:> set -e 2023-10-14T09:37:50.578 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T09:37:50.578 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-14T09:37:50.579 DEBUG:teuthology.orchestra.run.smithi129:> ') 2023-10-14T09:37:50.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:50.717 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-14T09:37:50.811 INFO:teuthology.orchestra.run.smithi129.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T09:37:50.811 INFO:teuthology.orchestra.run.smithi129.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T09:37:50.811 INFO:teuthology.orchestra.run.smithi129.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T09:37:50.811 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:37:50.812 INFO:teuthology.orchestra.run.smithi129.stdout: inet6 ::1/128 scope host 2023-10-14T09:37:50.812 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:37:50.812 INFO:teuthology.orchestra.run.smithi129.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T09:37:50.812 INFO:teuthology.orchestra.run.smithi129.stdout: link/ether 1a:2c:98:3e:4a:fc brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-14T09:37:50.812 INFO:teuthology.orchestra.run.smithi129.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-14T09:37:50.812 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:37:50.813 INFO:teuthology.orchestra.run.smithi129.stdout: inet6 fe80::182c:98ff:fe3e:4afc/64 scope link 2023-10-14T09:37:50.813 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:37:50.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:50.815 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-14T09:37:50.907 INFO:teuthology.orchestra.run.smithi129.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T09:37:50.908 INFO:teuthology.orchestra.run.smithi129.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T09:37:50.908 INFO:teuthology.orchestra.run.smithi129.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T09:37:50.908 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:37:50.908 INFO:teuthology.orchestra.run.smithi129.stdout: inet6 ::1/128 scope host 2023-10-14T09:37:50.909 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:37:50.909 INFO:teuthology.orchestra.run.smithi129.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T09:37:50.909 INFO:teuthology.orchestra.run.smithi129.stdout: link/ether 1a:2c:98:3e:4a:fc brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-14T09:37:50.909 INFO:teuthology.orchestra.run.smithi129.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-14T09:37:50.909 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:37:50.909 INFO:teuthology.orchestra.run.smithi129.stdout: inet6 fe80::182c:98ff:fe3e:4afc/64 scope link 2023-10-14T09:37:50.910 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:37:50.911 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-14T09:37:50.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:50.911 DEBUG:teuthology.orchestra.run.smithi129:> (cd / && exec bash -c ' 2023-10-14T09:37:50.912 DEBUG:teuthology.orchestra.run.smithi129:> set -e 2023-10-14T09:37:50.912 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-14T09:37:50.912 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-14T09:37:50.912 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-14T09:37:50.913 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-14T09:37:50.913 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-14T09:37:50.913 DEBUG:teuthology.orchestra.run.smithi129:> ') 2023-10-14T09:37:51.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:51.186 DEBUG:teuthology.orchestra.run.smithi129:> (cd / && exec bash -c ' 2023-10-14T09:37:51.186 DEBUG:teuthology.orchestra.run.smithi129:> set -e 2023-10-14T09:37:51.186 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link set brx.1 up 2023-10-14T09:37:51.186 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link set dev brx.1 master ceph-brx 2023-10-14T09:37:51.187 DEBUG:teuthology.orchestra.run.smithi129:> ') 2023-10-14T09:37:51.355 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T09:37:51.355 DEBUG:teuthology.orchestra.run.smithi129:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-14T09:37:51.404 INFO:teuthology.orchestra.run.smithi129.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-14T09:37:51.405 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T09:37:51.405 DEBUG:teuthology.orchestra.run.smithi129:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-14T09:37:51.457 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-10-14T09:37:51.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:51.457 DEBUG:teuthology.orchestra.run.smithi129:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T09:37:51.592 INFO:teuthology.orchestra.run.smithi129.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T09:37:51.592 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T09:37:51.629 INFO:teuthology.orchestra.run.smithi129.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T09:37:51.629 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T09:37:51.629 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: resolved to: "172.21.15.102:3300,172.21.15.129:3300,172.21.15.129:3301" 2023-10-14T09:37:51.629 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: trying mount with new device syntax: 3@8a6cd69d-7f5b-4f2a-806a-0176c10aed50.cephfs=/ 2023-10-14T09:37:51.630 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.102:3300/172.21.15.129:3300/172.21.15.129:3301" will pass to kernel 2023-10-14T09:37:51.631 INFO:teuthology.orchestra.run.smithi129.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2023-10-14T09:37:51.631 INFO:teuthology.orchestra.run.smithi129.stdout: You just mounted a file system that supports labels which does not 2023-10-14T09:37:51.631 INFO:teuthology.orchestra.run.smithi129.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-10-14T09:37:51.632 INFO:teuthology.orchestra.run.smithi129.stdout: applications will generate AVC messages and not be allowed access to 2023-10-14T09:37:51.632 INFO:teuthology.orchestra.run.smithi129.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-10-14T09:37:51.635 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T09:37:51.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:51.636 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-14T09:37:51.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:51.725 DEBUG:teuthology.orchestra.run.smithi129:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T09:37:51.779 INFO:teuthology.orchestra.run.smithi129.stdout:client4734 2023-10-14T09:37:51.779 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2023-10-14T09:37:51.780 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T09:37:51.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:51.829 DEBUG:teuthology.orchestra.run.smithi129:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T09:37:51.933 INFO:teuthology.orchestra.run.smithi129.stdout:client4734 2023-10-14T09:37:51.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:51.934 DEBUG:teuthology.orchestra.run.smithi129:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T09:37:51.993 INFO:teuthology.orchestra.run.smithi129.stdout:client4734 2023-10-14T09:37:51.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:37:51.995 DEBUG:teuthology.orchestra.run.smithi129:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/8a6cd69d-7f5b-4f2a-806a-0176c10aed50.client4734/status') 2023-10-14T09:37:52.087 INFO:teuthology.orchestra.run.smithi129.stdout:instance: client.4734 (3)172.21.15.129:0/542577401 2023-10-14T09:37:52.087 INFO:teuthology.orchestra.run.smithi129.stdout:blocklisted: false 2023-10-14T09:37:52.087 INFO:teuthology.orchestra.run.smithi129.stderr:0+1 records in 2023-10-14T09:37:52.088 INFO:teuthology.orchestra.run.smithi129.stderr:0+1 records out 2023-10-14T09:37:52.088 INFO:teuthology.orchestra.run.smithi129.stderr:70 bytes copied, 0.000104388 s, 671 kB/s 2023-10-14T09:37:52.091 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-14T09:37:52.168 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:37:52.389 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.387+0000 7f4f35e90640 1 Processor -- start 2023-10-14T09:37:52.389 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.387+0000 7f4f35e90640 1 -- start start 2023-10-14T09:37:52.391 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.388+0000 7f4f35e90640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4f300adb50 0x7f4f3006f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:52.391 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.389+0000 7f4f35e90640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4f300b0b20 0x7f4f30164f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:52.391 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.389+0000 7f4f35e90640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f30071450 con 0x7f4f30070fd0 2023-10-14T09:37:52.391 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.389+0000 7f4f35e90640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f300cc600 con 0x7f4f300b0b20 2023-10-14T09:37:52.391 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.389+0000 7f4f35e90640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f300cc8e0 con 0x7f4f300adb50 2023-10-14T09:37:52.392 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.389+0000 7f4f27fff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f4f30070fd0 0x7f4f300b0410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:59764/0 (socket says 172.21.15.102:59764) 2023-10-14T09:37:52.392 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.389+0000 7f4f27fff640 1 -- 172.21.15.102:0/3787353392 learned_addr learned my addr 172.21.15.102:0/3787353392 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:52.392 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.389+0000 7f4f2ffff640 1 --2- 172.21.15.102:0/3787353392 >> v2:172.21.15.102:3300/0 conn(0x7f4f300b0b20 0x7f4f30164f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:52.393 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.389+0000 7f4f2f7fe640 1 --2- 172.21.15.102:0/3787353392 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4f300adb50 0x7f4f3006f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:52.394 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.389+0000 7f4f2effd640 1 -- 172.21.15.102:0/3787353392 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3315744949 0 0) 0x7f4f30071450 con 0x7f4f30070fd0 2023-10-14T09:37:52.394 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.390+0000 7f4f2effd640 1 -- 172.21.15.102:0/3787353392 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f1c003520 con 0x7f4f30070fd0 2023-10-14T09:37:52.394 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.390+0000 7f4f2ffff640 1 -- 172.21.15.102:0/3787353392 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4f300adb50 msgr2=0x7f4f3006f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:52.394 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.390+0000 7f4f2ffff640 1 --2- 172.21.15.102:0/3787353392 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4f300adb50 0x7f4f3006f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:52.395 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.390+0000 7f4f2ffff640 1 -- 172.21.15.102:0/3787353392 >> v1:172.21.15.102:6789/0 conn(0x7f4f30070fd0 legacy=0x7f4f300b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:52.395 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.390+0000 7f4f2ffff640 1 -- 172.21.15.102:0/3787353392 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f300ccbc0 con 0x7f4f300b0b20 2023-10-14T09:37:52.395 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.390+0000 7f4f2f7fe640 1 --2- 172.21.15.102:0/3787353392 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4f300adb50 0x7f4f3006f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:37:52.395 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.391+0000 7f4f2ffff640 1 --2- 172.21.15.102:0/3787353392 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f300b0b20 0x7f4f30164f60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4f28009d90 tx=0x7f4f2802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390e2422ba97263 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:52.395 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.391+0000 7f4f2effd640 1 -- 172.21.15.102:0/3787353392 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2802cc60 con 0x7f4f300b0b20 2023-10-14T09:37:52.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.391+0000 7f4f2effd640 1 -- 172.21.15.102:0/3787353392 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2802cdc0 con 0x7f4f300b0b20 2023-10-14T09:37:52.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.391+0000 7f4f2effd640 1 -- 172.21.15.102:0/3787353392 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f28034640 con 0x7f4f300b0b20 2023-10-14T09:37:52.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.392+0000 7f4f35e90640 1 -- 172.21.15.102:0/3787353392 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f300b0b20 msgr2=0x7f4f30164f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:52.398 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.392+0000 7f4f35e90640 1 --2- 172.21.15.102:0/3787353392 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f300b0b20 0x7f4f30164f60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4f28009d90 tx=0x7f4f2802beb0 comp rx=0 tx=0).stop 2023-10-14T09:37:52.398 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.392+0000 7f4f35e90640 1 -- 172.21.15.102:0/3787353392 shutdown_connections 2023-10-14T09:37:52.398 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.392+0000 7f4f35e90640 1 --2- 172.21.15.102:0/3787353392 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f300b0b20 0x7f4f30164f60 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:52.398 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.392+0000 7f4f35e90640 1 --2- 172.21.15.102:0/3787353392 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4f300adb50 0x7f4f3006f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:52.398 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.392+0000 7f4f35e90640 1 -- 172.21.15.102:0/3787353392 >> 172.21.15.102:0/3787353392 conn(0x7f4f300cb410 msgr2=0x7f4f300cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:52.399 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.392+0000 7f4f35e90640 1 -- 172.21.15.102:0/3787353392 shutdown_connections 2023-10-14T09:37:52.399 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.393+0000 7f4f35e90640 1 -- 172.21.15.102:0/3787353392 wait complete. 2023-10-14T09:37:52.399 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.394+0000 7f4f35e90640 1 Processor -- start 2023-10-14T09:37:52.399 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.394+0000 7f4f35e90640 1 -- start start 2023-10-14T09:37:52.399 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.395+0000 7f4f35e90640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4f30070fd0 0x7f4f301f7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:52.400 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.395+0000 7f4f35e90640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4f300adb50 0x7f4f301f9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:52.400 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.395+0000 7f4f35e90640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f300b0b20 0x7f4f3015f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:52.400 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.395+0000 7f4f35e90640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f300b2be0 con 0x7f4f300b0b20 2023-10-14T09:37:52.400 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.395+0000 7f4f35e90640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f300c3900 con 0x7f4f300adb50 2023-10-14T09:37:52.400 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.395+0000 7f4f35e90640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f300c3be0 con 0x7f4f30070fd0 2023-10-14T09:37:52.400 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.396+0000 7f4f2ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f300b0b20 0x7f4f3015f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:52.401 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.396+0000 7f4f2ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f300b0b20 0x7f4f3015f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39830/0 (socket says 172.21.15.102:39830) 2023-10-14T09:37:52.401 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.396+0000 7f4f2ffff640 1 -- 172.21.15.102:0/4163813657 learned_addr learned my addr 172.21.15.102:0/4163813657 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:52.403 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.396+0000 7f4f2f7fe640 1 --2- 172.21.15.102:0/4163813657 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4f30070fd0 0x7f4f301f7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:52.403 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.396+0000 7f4f2ffff640 1 -- 172.21.15.102:0/4163813657 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4f30070fd0 msgr2=0x7f4f301f7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:52.404 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.396+0000 7f4f2ffff640 1 --2- 172.21.15.102:0/4163813657 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4f30070fd0 0x7f4f301f7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:52.404 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.396+0000 7f4f2ffff640 1 -- 172.21.15.102:0/4163813657 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4f300adb50 msgr2=0x7f4f301f9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:52.404 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.396+0000 7f4f27fff640 1 --2- 172.21.15.102:0/4163813657 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4f300adb50 0x7f4f301f9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:52.404 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.396+0000 7f4f2ffff640 1 --2- 172.21.15.102:0/4163813657 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4f300adb50 0x7f4f301f9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:52.404 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.396+0000 7f4f2ffff640 1 -- 172.21.15.102:0/4163813657 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f28009a70 con 0x7f4f300b0b20 2023-10-14T09:37:52.404 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.396+0000 7f4f27fff640 1 --2- 172.21.15.102:0/4163813657 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4f300adb50 0x7f4f301f9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:52.405 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.396+0000 7f4f2ffff640 1 --2- 172.21.15.102:0/4163813657 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f300b0b20 0x7f4f3015f8b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4f28009eb0 tx=0x7f4f28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:52.405 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.397+0000 7f4f2cff9640 1 -- 172.21.15.102:0/4163813657 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2803e610 con 0x7f4f300b0b20 2023-10-14T09:37:52.405 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.397+0000 7f4f2cff9640 1 -- 172.21.15.102:0/4163813657 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2803e770 con 0x7f4f300b0b20 2023-10-14T09:37:52.405 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.397+0000 7f4f35e90640 1 -- 172.21.15.102:0/4163813657 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f300c3ec0 con 0x7f4f300b0b20 2023-10-14T09:37:52.406 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.397+0000 7f4f2cff9640 1 -- 172.21.15.102:0/4163813657 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2803eb60 con 0x7f4f300b0b20 2023-10-14T09:37:52.406 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.397+0000 7f4f35e90640 1 -- 172.21.15.102:0/4163813657 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f3015fdf0 con 0x7f4f300b0b20 2023-10-14T09:37:52.406 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.398+0000 7f4f35e90640 1 -- 172.21.15.102:0/4163813657 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f300c40d0 con 0x7f4f300b0b20 2023-10-14T09:37:52.406 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.399+0000 7f4f2cff9640 1 -- 172.21.15.102:0/4163813657 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4f2803b050 con 0x7f4f300b0b20 2023-10-14T09:37:52.406 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.400+0000 7f4f2cff9640 1 --2- 172.21.15.102:0/4163813657 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4f1006aea0 0x7f4f1006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:52.407 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.400+0000 7f4f2cff9640 1 -- 172.21.15.102:0/4163813657 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f280ab850 con 0x7f4f300b0b20 2023-10-14T09:37:52.407 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.400+0000 7f4f2f7fe640 1 --2- 172.21.15.102:0/4163813657 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4f1006aea0 0x7f4f1006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:52.407 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.401+0000 7f4f2f7fe640 1 --2- 172.21.15.102:0/4163813657 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4f1006aea0 0x7f4f1006d360 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4f20006fd0 tx=0x7f4f20008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:52.409 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.408+0000 7f4f2cff9640 1 -- 172.21.15.102:0/4163813657 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4f28076900 con 0x7f4f300b0b20 2023-10-14T09:37:52.615 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.613+0000 7f4f35e90640 1 -- 172.21.15.102:0/4163813657 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f3004e160 con 0x7f4f300b0b20 2023-10-14T09:37:52.618 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.616+0000 7f4f2cff9640 1 -- 172.21.15.102:0/4163813657 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f4f28039090 con 0x7f4f300b0b20 2023-10-14T09:37:52.618 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:37:52.618 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":22,"fsid":"8a6cd69d-7f5b-4f2a-806a-0176c10aed50","created":"2023-10-14T09:36:56.745172+0000","modified":"2023-10-14T09:37:22.712469+0000","last_up_change":"2023-10-14T09:37:09.791473+0000","last_in_change":"2023-10-14T09:37:00.547186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:37:09.952407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:37:19.560925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:37:20.363385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e5aef8f3-878f-482b-b522-9a5b958b90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6801","nonce":1727250718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6803","nonce":1727250718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6807","nonce":1727250718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6805","nonce":1727250718}]},"public_addr":"172.21.15.102:6801/1727250718","cluster_addr":"172.21.15.102:6803/1727250718","heartbeat_back_addr":"172.21.15.102:6807/1727250718","heartbeat_front_addr":"172.21.15.102:6805/1727250718","state":["exists","up"]},{"osd":1,"uuid":"4a8cf50e-387b-4d47-9588-bd22e375a9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6809","nonce":1095651107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6811","nonce":1095651107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6815","nonce":1095651107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6813","nonce":1095651107}]},"public_addr":"172.21.15.102:6809/1095651107","cluster_addr":"172.21.15.102:6811/1095651107","heartbeat_back_addr":"172.21.15.102:6815/1095651107","heartbeat_front_addr":"172.21.15.102:6813/1095651107","state":["exists","up"]},{"osd":2,"uuid":"009ef55f-8a63-4219-bacd-d7c7b4500867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6820","nonce":2198222556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6825","nonce":2198222556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6831","nonce":2198222556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6829","nonce":2198222556}]},"public_addr":"172.21.15.102:6820/2198222556","cluster_addr":"172.21.15.102:6825/2198222556","heartbeat_back_addr":"172.21.15.102:6831/2198222556","heartbeat_front_addr":"172.21.15.102:6829/2198222556","state":["exists","up"]},{"osd":3,"uuid":"f2110eae-2ff9-4ed9-93d6-bd2361618211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6818","nonce":654726740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6821","nonce":654726740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6827","nonce":654726740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6823","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6824","nonce":654726740}]},"public_addr":"172.21.15.102:6818/654726740","cluster_addr":"172.21.15.102:6821/654726740","heartbeat_back_addr":"172.21.15.102:6827/654726740","heartbeat_front_addr":"172.21.15.102:6824/654726740","state":["exists","up"]},{"osd":4,"uuid":"33f1ae34-3100-40f7-9cb8-0eca2b358693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6817","nonce":507586170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6819","nonce":507586170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6823","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6825","nonce":507586170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6821","nonce":507586170}]},"public_addr":"172.21.15.129:6817/507586170","cluster_addr":"172.21.15.129:6819/507586170","heartbeat_back_addr":"172.21.15.129:6825/507586170","heartbeat_front_addr":"172.21.15.129:6821/507586170","state":["exists","up"]},{"osd":5,"uuid":"fab2fc62-3f3e-450d-93e0-770f39e80710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6801","nonce":1913451073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6803","nonce":1913451073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6807","nonce":1913451073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6805","nonce":1913451073}]},"public_addr":"172.21.15.129:6801/1913451073","cluster_addr":"172.21.15.129:6803/1913451073","heartbeat_back_addr":"172.21.15.129:6807/1913451073","heartbeat_front_addr":"172.21.15.129:6805/1913451073","state":["exists","up"]},{"osd":6,"uuid":"d7cc1d69-92e7-4253-a127-cfc0444a4809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6809","nonce":2853291511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6811","nonce":2853291511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6815","nonce":2853291511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6813","nonce":2853291511}]},"public_addr":"172.21.15.129:6809/2853291511","cluster_addr":"172.21.15.129:6811/2853291511","heartbeat_back_addr":"172.21.15.129:6815/2853291511","heartbeat_front_addr":"172.21.15.129:6813/2853291511","state":["exists","up"]},{"osd":7,"uuid":"1e403de1-09e2-4370-b9a7-e790ac44bbee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6824","nonce":2933886914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6827","nonce":2933886914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6831","nonce":2933886914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6829","nonce":2933886914}]},"public_addr":"172.21.15.129:6824/2933886914","cluster_addr":"172.21.15.129:6827/2933886914","heartbeat_back_addr":"172.21.15.129:6831/2933886914","heartbeat_front_addr":"172.21.15.129:6829/2933886914","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.849661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.868113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.933488+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.891794+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.901861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.858750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.911712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.996765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:37:52.621 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.618+0000 7f4f35e90640 1 -- 172.21.15.102:0/4163813657 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4f1006aea0 msgr2=0x7f4f1006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:52.621 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.618+0000 7f4f35e90640 1 --2- 172.21.15.102:0/4163813657 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4f1006aea0 0x7f4f1006d360 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4f20006fd0 tx=0x7f4f20008040 comp rx=0 tx=0).stop 2023-10-14T09:37:52.621 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.618+0000 7f4f35e90640 1 -- 172.21.15.102:0/4163813657 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f300b0b20 msgr2=0x7f4f3015f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:52.621 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.618+0000 7f4f35e90640 1 --2- 172.21.15.102:0/4163813657 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f300b0b20 0x7f4f3015f8b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4f28009eb0 tx=0x7f4f28004a40 comp rx=0 tx=0).stop 2023-10-14T09:37:52.621 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.619+0000 7f4f35e90640 1 -- 172.21.15.102:0/4163813657 shutdown_connections 2023-10-14T09:37:52.622 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.619+0000 7f4f35e90640 1 --2- 172.21.15.102:0/4163813657 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4f1006aea0 0x7f4f1006d360 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:52.622 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.619+0000 7f4f35e90640 1 --2- 172.21.15.102:0/4163813657 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f300b0b20 0x7f4f3015f8b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:52.622 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.619+0000 7f4f35e90640 1 --2- 172.21.15.102:0/4163813657 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4f300adb50 0x7f4f301f9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:52.622 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.619+0000 7f4f35e90640 1 --2- 172.21.15.102:0/4163813657 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4f30070fd0 0x7f4f301f7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:52.622 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.619+0000 7f4f35e90640 1 -- 172.21.15.102:0/4163813657 >> 172.21.15.102:0/4163813657 conn(0x7f4f300cb410 msgr2=0x7f4f3006bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:52.623 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.619+0000 7f4f35e90640 1 -- 172.21.15.102:0/4163813657 shutdown_connections 2023-10-14T09:37:52.623 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.619+0000 7f4f35e90640 1 -- 172.21.15.102:0/4163813657 wait complete. 2023-10-14T09:37:52.641 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T09:37:09.952407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T09:37:19.560925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T09:37:20.363385+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T09:37:52.642 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T09:37:52.845 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.843+0000 7fb0b1a56640 1 Processor -- start 2023-10-14T09:37:52.845 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.843+0000 7fb0b1a56640 1 -- start start 2023-10-14T09:37:52.847 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.845+0000 7fb0b1a56640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb0ac0ad350 0x7fb0ac069da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:52.847 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.845+0000 7fb0b1a56640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0ac06a6f0 con 0x7fb0ac06a2e0 2023-10-14T09:37:52.847 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.845+0000 7fb0b1a56640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0ac0ac890 con 0x7fb0ac15d150 2023-10-14T09:37:52.848 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.845+0000 7fb0b1a56640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac15d530 con 0x7fb0ac0ad350 2023-10-14T09:37:52.848 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.845+0000 7fb0ab7fe640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fb0ac06a2e0 0x7fb0ac0c9000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:59774/0 (socket says 172.21.15.102:59774) 2023-10-14T09:37:52.848 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.845+0000 7fb0ab7fe640 1 -- 172.21.15.102:0/3214905882 learned_addr learned my addr 172.21.15.102:0/3214905882 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:52.850 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.846+0000 7fb0a3fff640 1 --2- 172.21.15.102:0/3214905882 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb0ac0ad350 0x7fb0ac069da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:52.850 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.846+0000 7fb0aa7fc640 1 -- 172.21.15.102:0/3214905882 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 88781867 0 0) 0x7fb0ac06a6f0 con 0x7fb0ac06a2e0 2023-10-14T09:37:52.851 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.846+0000 7fb0aa7fc640 1 -- 172.21.15.102:0/3214905882 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb098003520 con 0x7fb0ac06a2e0 2023-10-14T09:37:52.851 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.846+0000 7fb0aa7fc640 1 -- 172.21.15.102:0/3214905882 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3226723103 0 0) 0x7fb098003520 con 0x7fb0ac06a2e0 2023-10-14T09:37:52.851 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.846+0000 7fb0aa7fc640 1 -- 172.21.15.102:0/3214905882 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb0ac0ad350 msgr2=0x7fb0ac069da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:52.851 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.846+0000 7fb0aa7fc640 1 --2- 172.21.15.102:0/3214905882 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb0ac0ad350 0x7fb0ac069da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:52.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.846+0000 7fb0aa7fc640 1 -- 172.21.15.102:0/3214905882 >> v1:172.21.15.129:6789/0 conn(0x7fb0ac15d150 legacy=0x7fb0ac160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:52.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.846+0000 7fb0aa7fc640 1 -- 172.21.15.102:0/3214905882 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ac161650 con 0x7fb0ac06a2e0 2023-10-14T09:37:52.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.846+0000 7fb0aa7fc640 1 -- 172.21.15.102:0/3214905882 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4030661168 0 0) 0x7fb0a40019f0 con 0x7fb0ac06a2e0 2023-10-14T09:37:52.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.846+0000 7fb0aa7fc640 1 -- 172.21.15.102:0/3214905882 >> v1:172.21.15.102:6789/0 conn(0x7fb0ac06a2e0 legacy=0x7fb0ac0c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:52.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.846+0000 7fb0aa7fc640 1 --2- 172.21.15.102:0/3214905882 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb0980039a0 0x7fb098003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:52.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.847+0000 7fb0aa7fc640 1 --2- 172.21.15.102:0/3214905882 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0980047c0 0x7fb098004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:52.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.847+0000 7fb0aa7fc640 1 --2- 172.21.15.102:0/3214905882 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb0ac0ad350 0x7fb098005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:52.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.847+0000 7fb0aa7fc640 1 -- 172.21.15.102:0/3214905882 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac15d530 con 0x7fb0980047c0 2023-10-14T09:37:52.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.847+0000 7fb0aa7fc640 1 -- 172.21.15.102:0/3214905882 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09800ba30 con 0x7fb0980039a0 2023-10-14T09:37:52.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.847+0000 7fb0aa7fc640 1 -- 172.21.15.102:0/3214905882 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb09800bbf0 con 0x7fb0ac0ad350 2023-10-14T09:37:52.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.847+0000 7fb0a3fff640 1 --2- 172.21.15.102:0/3214905882 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0980047c0 0x7fb098004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:52.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.847+0000 7fb0aaffd640 1 --2- 172.21.15.102:0/3214905882 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb0980039a0 0x7fb098003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:52.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.847+0000 7fb0ab7fe640 1 --2- 172.21.15.102:0/3214905882 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb0ac0ad350 0x7fb098005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:52.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.847+0000 7fb0a3fff640 1 -- 172.21.15.102:0/3214905882 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb0ac0ad350 msgr2=0x7fb098005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:52.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.847+0000 7fb0a3fff640 1 --2- 172.21.15.102:0/3214905882 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb0ac0ad350 0x7fb098005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:52.855 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.847+0000 7fb0a3fff640 1 -- 172.21.15.102:0/3214905882 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb0980039a0 msgr2=0x7fb098003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:52.855 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.847+0000 7fb0a3fff640 1 --2- 172.21.15.102:0/3214905882 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb0980039a0 0x7fb098003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:52.855 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.847+0000 7fb0a3fff640 1 -- 172.21.15.102:0/3214905882 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb098003520 con 0x7fb0980047c0 2023-10-14T09:37:52.855 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.847+0000 7fb0aaffd640 1 --2- 172.21.15.102:0/3214905882 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb0980039a0 0x7fb098003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:52.855 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.848+0000 7fb0a3fff640 1 --2- 172.21.15.102:0/3214905882 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0980047c0 0x7fb098004c40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb094009a90 tx=0x7fb0980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feb61799ceba77ec server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:52.856 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.849+0000 7fb0aa7fc640 1 -- 172.21.15.102:0/3214905882 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09402c660 con 0x7fb0980047c0 2023-10-14T09:37:52.856 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.849+0000 7fb0aa7fc640 1 -- 172.21.15.102:0/3214905882 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09402c7c0 con 0x7fb0980047c0 2023-10-14T09:37:52.856 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.849+0000 7fb0aa7fc640 1 -- 172.21.15.102:0/3214905882 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09402cb50 con 0x7fb0980047c0 2023-10-14T09:37:52.859 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.849+0000 7fb0b1a56640 1 -- 172.21.15.102:0/3214905882 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0980047c0 msgr2=0x7fb098004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:52.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.849+0000 7fb0b1a56640 1 --2- 172.21.15.102:0/3214905882 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0980047c0 0x7fb098004c40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb094009a90 tx=0x7fb0980057f0 comp rx=0 tx=0).stop 2023-10-14T09:37:52.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.849+0000 7fb0ab7fe640 1 -- 172.21.15.102:0/3214905882 reap_dead start 2023-10-14T09:37:52.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.849+0000 7fb0b1a56640 1 -- 172.21.15.102:0/3214905882 shutdown_connections 2023-10-14T09:37:52.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.849+0000 7fb0b1a56640 1 -- 172.21.15.102:0/3214905882 >> 172.21.15.102:0/3214905882 conn(0x7fb0ac0ce9b0 msgr2=0x7fb0ac0cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:52.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.849+0000 7fb0b1a56640 1 -- 172.21.15.102:0/3214905882 shutdown_connections 2023-10-14T09:37:52.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.849+0000 7fb0b1a56640 1 -- 172.21.15.102:0/3214905882 wait complete. 2023-10-14T09:37:52.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.851+0000 7fb0b1a56640 1 Processor -- start 2023-10-14T09:37:52.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.851+0000 7fb0b1a56640 1 -- start start 2023-10-14T09:37:52.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.852+0000 7fb0b1a56640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb0980047c0 0x7fb0ac1e7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:52.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.852+0000 7fb0b1a56640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0ac0c2e40 0x7fb0ac1e8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:52.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.852+0000 7fb0b1a56640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb0ac0c32c0 0x7fb0ac1e9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:52.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.852+0000 7fb0b1a56640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac1e96a0 con 0x7fb0ac0c2e40 2023-10-14T09:37:52.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.852+0000 7fb0b1a56640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac0c3820 con 0x7fb0980047c0 2023-10-14T09:37:52.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.852+0000 7fb0b1a56640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac0c3b00 con 0x7fb0ac0c32c0 2023-10-14T09:37:52.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.853+0000 7fb0a3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0ac0c2e40 0x7fb0ac1e8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:52.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.853+0000 7fb0a3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0ac0c2e40 0x7fb0ac1e8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39846/0 (socket says 172.21.15.102:39846) 2023-10-14T09:37:52.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.853+0000 7fb0a3fff640 1 -- 172.21.15.102:0/1086799006 learned_addr learned my addr 172.21.15.102:0/1086799006 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:52.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.853+0000 7fb0ab7fe640 1 --2- 172.21.15.102:0/1086799006 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb0ac0c32c0 0x7fb0ac1e9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:52.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.853+0000 7fb0aaffd640 1 --2- 172.21.15.102:0/1086799006 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb0980047c0 0x7fb0ac1e7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:52.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.853+0000 7fb0a3fff640 1 -- 172.21.15.102:0/1086799006 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb0ac0c32c0 msgr2=0x7fb0ac1e9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:52.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.853+0000 7fb0a3fff640 1 --2- 172.21.15.102:0/1086799006 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb0ac0c32c0 0x7fb0ac1e9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:52.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.853+0000 7fb0a3fff640 1 -- 172.21.15.102:0/1086799006 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb0980047c0 msgr2=0x7fb0ac1e7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:52.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.853+0000 7fb0a3fff640 1 --2- 172.21.15.102:0/1086799006 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb0980047c0 0x7fb0ac1e7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:52.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.853+0000 7fb0a3fff640 1 -- 172.21.15.102:0/1086799006 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ac0c3de0 con 0x7fb0ac0c2e40 2023-10-14T09:37:52.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.853+0000 7fb0a3fff640 1 --2- 172.21.15.102:0/1086799006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0ac0c2e40 0x7fb0ac1e8c20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb094009a90 tx=0x7fb094004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:52.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.854+0000 7fb0a8ff9640 1 -- 172.21.15.102:0/1086799006 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb094003810 con 0x7fb0ac0c2e40 2023-10-14T09:37:52.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.854+0000 7fb0a8ff9640 1 -- 172.21.15.102:0/1086799006 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb094003970 con 0x7fb0ac0c2e40 2023-10-14T09:37:52.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.854+0000 7fb0b1a56640 1 -- 172.21.15.102:0/1086799006 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0ac0c40c0 con 0x7fb0ac0c2e40 2023-10-14T09:37:52.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.854+0000 7fb0a8ff9640 1 -- 172.21.15.102:0/1086799006 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb094003d00 con 0x7fb0ac0c2e40 2023-10-14T09:37:52.866 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.854+0000 7fb0b1a56640 1 -- 172.21.15.102:0/1086799006 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0ac0c50d0 con 0x7fb0ac0c2e40 2023-10-14T09:37:52.866 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.855+0000 7fb0b1a56640 1 -- 172.21.15.102:0/1086799006 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0ac0c3c40 con 0x7fb0ac0c2e40 2023-10-14T09:37:52.866 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.856+0000 7fb0a8ff9640 1 -- 172.21.15.102:0/1086799006 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb094040450 con 0x7fb0ac0c2e40 2023-10-14T09:37:52.866 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.857+0000 7fb0a8ff9640 1 --2- 172.21.15.102:0/1086799006 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fb08c06aea0 0x7fb08c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:52.866 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.857+0000 7fb0a8ff9640 1 -- 172.21.15.102:0/1086799006 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0940ab520 con 0x7fb0ac0c2e40 2023-10-14T09:37:52.867 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.857+0000 7fb0aaffd640 1 --2- 172.21.15.102:0/1086799006 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fb08c06aea0 0x7fb08c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:52.867 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.858+0000 7fb0aaffd640 1 --2- 172.21.15.102:0/1086799006 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fb08c06aea0 0x7fb08c06d360 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb09c001750 tx=0x7fb09c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:52.867 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:52.861+0000 7fb0a8ff9640 1 -- 172.21.15.102:0/1086799006 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb0ac0c3c40 con 0x7fb0ac0c2e40 2023-10-14T09:37:53.055 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.053+0000 7fb0b1a56640 1 -- 172.21.15.102:0/1086799006 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb0ac0c3c40 con 0x7fb0ac0c2e40 2023-10-14T09:37:53.056 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.054+0000 7fb0a8ff9640 1 -- 172.21.15.102:0/1086799006 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb0ac0c3c40 con 0x7fb0ac0c2e40 2023-10-14T09:37:53.057 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2023-10-14T09:37:53.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.057+0000 7fb0b1a56640 1 -- 172.21.15.102:0/1086799006 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fb08c06aea0 msgr2=0x7fb08c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:53.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.057+0000 7fb0b1a56640 1 --2- 172.21.15.102:0/1086799006 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fb08c06aea0 0x7fb08c06d360 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb09c001750 tx=0x7fb09c009040 comp rx=0 tx=0).stop 2023-10-14T09:37:53.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.057+0000 7fb0b1a56640 1 -- 172.21.15.102:0/1086799006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0ac0c2e40 msgr2=0x7fb0ac1e8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:53.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.057+0000 7fb0b1a56640 1 --2- 172.21.15.102:0/1086799006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0ac0c2e40 0x7fb0ac1e8c20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb094009a90 tx=0x7fb094004730 comp rx=0 tx=0).stop 2023-10-14T09:37:53.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.058+0000 7fb0b1a56640 1 -- 172.21.15.102:0/1086799006 shutdown_connections 2023-10-14T09:37:53.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.058+0000 7fb0b1a56640 1 --2- 172.21.15.102:0/1086799006 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fb08c06aea0 0x7fb08c06d360 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:53.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.058+0000 7fb0b1a56640 1 --2- 172.21.15.102:0/1086799006 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb0ac0c32c0 0x7fb0ac1e9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:53.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.058+0000 7fb0b1a56640 1 --2- 172.21.15.102:0/1086799006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0ac0c2e40 0x7fb0ac1e8c20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:53.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.058+0000 7fb0b1a56640 1 --2- 172.21.15.102:0/1086799006 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb0980047c0 0x7fb0ac1e7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:53.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.058+0000 7fb0b1a56640 1 -- 172.21.15.102:0/1086799006 >> 172.21.15.102:0/1086799006 conn(0x7fb0ac0ce9b0 msgr2=0x7fb0ac06c390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:53.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.058+0000 7fb0b1a56640 1 -- 172.21.15.102:0/1086799006 shutdown_connections 2023-10-14T09:37:53.062 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.058+0000 7fb0b1a56640 1 -- 172.21.15.102:0/1086799006 wait complete. 2023-10-14T09:37:53.077 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T09:37:53.294 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.292+0000 7f90e721f640 1 Processor -- start 2023-10-14T09:37:53.294 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.292+0000 7f90e721f640 1 -- start start 2023-10-14T09:37:53.297 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.294+0000 7f90e721f640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f90e0159e90 0x7f90e00ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:53.298 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.294+0000 7f90e721f640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90e006c140 0x7f90e006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:53.298 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.294+0000 7f90e721f640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90e0070360 con 0x7f90e0159ab0 2023-10-14T09:37:53.298 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.294+0000 7f90e721f640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90e006cb10 con 0x7f90e0159e90 2023-10-14T09:37:53.298 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.294+0000 7f90e721f640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e015d890 con 0x7f90e006c140 2023-10-14T09:37:53.298 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.294+0000 7f90e4fbb640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f90e0159ab0 0x7f90e006fc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:59784/0 (socket says 172.21.15.102:59784) 2023-10-14T09:37:53.299 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.294+0000 7f90e4fbb640 1 -- 172.21.15.102:0/1598136354 learned_addr learned my addr 172.21.15.102:0/1598136354 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:53.299 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.294+0000 7f90e57bc640 1 --2- 172.21.15.102:0/1598136354 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90e006c140 0x7f90e006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:53.299 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.294+0000 7f90dffff640 1 --2- 172.21.15.102:0/1598136354 >> v2:172.21.15.129:3300/0 conn(0x7f90e0159e90 0x7f90e00ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:53.299 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.295+0000 7f90df7fe640 1 -- 172.21.15.102:0/1598136354 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2418312749 0 0) 0x7f90e0070360 con 0x7f90e0159ab0 2023-10-14T09:37:53.299 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.295+0000 7f90df7fe640 1 -- 172.21.15.102:0/1598136354 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90d0003520 con 0x7f90e0159ab0 2023-10-14T09:37:53.300 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.295+0000 7f90df7fe640 1 -- 172.21.15.102:0/1598136354 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3412040585 0 0) 0x7f90d0003520 con 0x7f90e0159ab0 2023-10-14T09:37:53.300 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.295+0000 7f90df7fe640 1 -- 172.21.15.102:0/1598136354 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90e006c140 msgr2=0x7f90e006c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:53.300 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.295+0000 7f90df7fe640 1 --2- 172.21.15.102:0/1598136354 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90e006c140 0x7f90e006c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:53.300 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.295+0000 7f90df7fe640 1 -- 172.21.15.102:0/1598136354 >> v2:172.21.15.129:3300/0 conn(0x7f90e0159e90 msgr2=0x7f90e00ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:53.300 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.295+0000 7f90df7fe640 1 --2- 172.21.15.102:0/1598136354 >> v2:172.21.15.129:3300/0 conn(0x7f90e0159e90 0x7f90e00ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:53.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.295+0000 7f90df7fe640 1 -- 172.21.15.102:0/1598136354 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e00cd1f0 con 0x7f90e0159ab0 2023-10-14T09:37:53.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.295+0000 7f90df7fe640 1 -- 172.21.15.102:0/1598136354 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4030661168 0 0) 0x7f90d4001670 con 0x7f90e0159ab0 2023-10-14T09:37:53.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.295+0000 7f90df7fe640 1 -- 172.21.15.102:0/1598136354 >> v1:172.21.15.102:6789/0 conn(0x7f90e0159ab0 legacy=0x7f90e006fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:53.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.295+0000 7f90df7fe640 1 --2- 172.21.15.102:0/1598136354 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90d0003970 0x7f90d0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:53.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.295+0000 7f90df7fe640 1 --2- 172.21.15.102:0/1598136354 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90d00047c0 0x7f90d0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:53.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.295+0000 7f90df7fe640 1 --2- 172.21.15.102:0/1598136354 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90e006c140 0x7f90d0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:53.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.295+0000 7f90df7fe640 1 -- 172.21.15.102:0/1598136354 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e006cb10 con 0x7f90d0003970 2023-10-14T09:37:53.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.295+0000 7f90df7fe640 1 -- 172.21.15.102:0/1598136354 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e015d890 con 0x7f90d00047c0 2023-10-14T09:37:53.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.295+0000 7f90df7fe640 1 -- 172.21.15.102:0/1598136354 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d000ba60 con 0x7f90e006c140 2023-10-14T09:37:53.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.295+0000 7f90e4fbb640 1 --2- 172.21.15.102:0/1598136354 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90d0003970 0x7f90d0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:53.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.296+0000 7f90dffff640 1 --2- 172.21.15.102:0/1598136354 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90d00047c0 0x7f90d0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:53.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.296+0000 7f90e4fbb640 1 -- 172.21.15.102:0/1598136354 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90e006c140 msgr2=0x7f90d0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:53.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.296+0000 7f90e4fbb640 1 --2- 172.21.15.102:0/1598136354 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90e006c140 0x7f90d0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:53.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.296+0000 7f90e4fbb640 1 -- 172.21.15.102:0/1598136354 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90d00047c0 msgr2=0x7f90d0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:53.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.296+0000 7f90e4fbb640 1 --2- 172.21.15.102:0/1598136354 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90d00047c0 0x7f90d0004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:53.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.296+0000 7f90e4fbb640 1 -- 172.21.15.102:0/1598136354 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d0003520 con 0x7f90d0003970 2023-10-14T09:37:53.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.297+0000 7f90e4fbb640 1 --2- 172.21.15.102:0/1598136354 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90d0003970 0x7f90d0003d90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f90d400c160 tx=0x7f90d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9674fe2b5be420f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:53.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.297+0000 7f90df7fe640 1 -- 172.21.15.102:0/1598136354 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d4005ad0 con 0x7f90d0003970 2023-10-14T09:37:53.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.297+0000 7f90df7fe640 1 -- 172.21.15.102:0/1598136354 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d4005c50 con 0x7f90d0003970 2023-10-14T09:37:53.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.297+0000 7f90df7fe640 1 -- 172.21.15.102:0/1598136354 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d402c7c0 con 0x7f90d0003970 2023-10-14T09:37:53.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.298+0000 7f90e721f640 1 -- 172.21.15.102:0/1598136354 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90d0003970 msgr2=0x7f90d0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:53.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.298+0000 7f90e721f640 1 --2- 172.21.15.102:0/1598136354 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90d0003970 0x7f90d0003d90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f90d400c160 tx=0x7f90d00057f0 comp rx=0 tx=0).stop 2023-10-14T09:37:53.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.298+0000 7f90e57bc640 1 -- 172.21.15.102:0/1598136354 reap_dead start 2023-10-14T09:37:53.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.298+0000 7f90e721f640 1 -- 172.21.15.102:0/1598136354 shutdown_connections 2023-10-14T09:37:53.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.298+0000 7f90e721f640 1 -- 172.21.15.102:0/1598136354 >> 172.21.15.102:0/1598136354 conn(0x7f90e00ce9b0 msgr2=0x7f90e00cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:53.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.298+0000 7f90e721f640 1 -- 172.21.15.102:0/1598136354 shutdown_connections 2023-10-14T09:37:53.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.298+0000 7f90e721f640 1 -- 172.21.15.102:0/1598136354 wait complete. 2023-10-14T09:37:53.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.300+0000 7f90e721f640 1 Processor -- start 2023-10-14T09:37:53.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.300+0000 7f90e721f640 1 -- start start 2023-10-14T09:37:53.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.301+0000 7f90e721f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90d0003970 0x7f90e014f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:53.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.301+0000 7f90e721f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90e0151190 0x7f90e01653b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:53.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.301+0000 7f90e721f640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90e0149a20 0x7f90e00b0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:53.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.301+0000 7f90e721f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e014d7d0 con 0x7f90d0003970 2023-10-14T09:37:53.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.301+0000 7f90e721f640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e0151f60 con 0x7f90e0151190 2023-10-14T09:37:53.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.301+0000 7f90e721f640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e01516c0 con 0x7f90e0149a20 2023-10-14T09:37:53.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.301+0000 7f90e4fbb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90d0003970 0x7f90e014f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:53.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.301+0000 7f90e4fbb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90d0003970 0x7f90e014f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39854/0 (socket says 172.21.15.102:39854) 2023-10-14T09:37:53.311 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.301+0000 7f90e4fbb640 1 -- 172.21.15.102:0/2452713556 learned_addr learned my addr 172.21.15.102:0/2452713556 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:53.311 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.301+0000 7f90e57bc640 1 --2- 172.21.15.102:0/2452713556 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90e0149a20 0x7f90e00b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:53.311 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.302+0000 7f90dffff640 1 --2- 172.21.15.102:0/2452713556 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90e0151190 0x7f90e01653b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:53.311 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.302+0000 7f90e4fbb640 1 -- 172.21.15.102:0/2452713556 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90e0149a20 msgr2=0x7f90e00b0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:53.311 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.302+0000 7f90e4fbb640 1 --2- 172.21.15.102:0/2452713556 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90e0149a20 0x7f90e00b0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:53.312 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.302+0000 7f90e4fbb640 1 -- 172.21.15.102:0/2452713556 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90e0151190 msgr2=0x7f90e01653b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:53.312 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.302+0000 7f90e4fbb640 1 --2- 172.21.15.102:0/2452713556 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90e0151190 0x7f90e01653b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:53.312 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.302+0000 7f90e4fbb640 1 -- 172.21.15.102:0/2452713556 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e01519a0 con 0x7f90d0003970 2023-10-14T09:37:53.312 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.302+0000 7f90e4fbb640 1 --2- 172.21.15.102:0/2452713556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90d0003970 0x7f90e014f6e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f90d402c360 tx=0x7f90e00cdd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:53.312 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.302+0000 7f90dd7fa640 1 -- 172.21.15.102:0/2452713556 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d4039070 con 0x7f90d0003970 2023-10-14T09:37:53.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.302+0000 7f90dd7fa640 1 -- 172.21.15.102:0/2452713556 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d402cbd0 con 0x7f90d0003970 2023-10-14T09:37:53.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.302+0000 7f90dd7fa640 1 -- 172.21.15.102:0/2452713556 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d403c040 con 0x7f90d0003970 2023-10-14T09:37:53.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.302+0000 7f90e721f640 1 -- 172.21.15.102:0/2452713556 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90e0151c80 con 0x7f90d0003970 2023-10-14T09:37:53.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.302+0000 7f90e721f640 1 -- 172.21.15.102:0/2452713556 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90e01658f0 con 0x7f90d0003970 2023-10-14T09:37:53.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.303+0000 7f90e721f640 1 -- 172.21.15.102:0/2452713556 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90e004e160 con 0x7f90d0003970 2023-10-14T09:37:53.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.304+0000 7f90dd7fa640 1 -- 172.21.15.102:0/2452713556 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f90d4032070 con 0x7f90d0003970 2023-10-14T09:37:53.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.305+0000 7f90dd7fa640 1 --2- 172.21.15.102:0/2452713556 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f90c406ae70 0x7f90c406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:53.315 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.305+0000 7f90dd7fa640 1 -- 172.21.15.102:0/2452713556 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90d40aa860 con 0x7f90d0003970 2023-10-14T09:37:53.315 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.305+0000 7f90dffff640 1 --2- 172.21.15.102:0/2452713556 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f90c406ae70 0x7f90c406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:53.315 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.306+0000 7f90dffff640 1 --2- 172.21.15.102:0/2452713556 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f90c406ae70 0x7f90c406d330 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f90e00c2480 tx=0x7f90cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:53.315 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.309+0000 7f90dd7fa640 1 -- 172.21.15.102:0/2452713556 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f90d4075870 con 0x7f90d0003970 2023-10-14T09:37:53.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.498+0000 7f90e721f640 1 -- 172.21.15.102:0/2452713556 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f90e00ccb60 con 0x7f90d0003970 2023-10-14T09:37:53.501 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.499+0000 7f90dd7fa640 1 -- 172.21.15.102:0/2452713556 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f90d4078e90 con 0x7f90d0003970 2023-10-14T09:37:53.501 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2023-10-14T09:37:53.504 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.502+0000 7f90e721f640 1 -- 172.21.15.102:0/2452713556 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f90c406ae70 msgr2=0x7f90c406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:53.504 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.502+0000 7f90e721f640 1 --2- 172.21.15.102:0/2452713556 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f90c406ae70 0x7f90c406d330 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f90e00c2480 tx=0x7f90cc008040 comp rx=0 tx=0).stop 2023-10-14T09:37:53.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.502+0000 7f90e721f640 1 -- 172.21.15.102:0/2452713556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90d0003970 msgr2=0x7f90e014f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:53.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.502+0000 7f90e721f640 1 --2- 172.21.15.102:0/2452713556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90d0003970 0x7f90e014f6e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f90d402c360 tx=0x7f90e00cdd70 comp rx=0 tx=0).stop 2023-10-14T09:37:53.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.502+0000 7f90e721f640 1 -- 172.21.15.102:0/2452713556 shutdown_connections 2023-10-14T09:37:53.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.502+0000 7f90e721f640 1 --2- 172.21.15.102:0/2452713556 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f90c406ae70 0x7f90c406d330 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:53.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.502+0000 7f90e721f640 1 --2- 172.21.15.102:0/2452713556 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90e0149a20 0x7f90e00b0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:53.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.502+0000 7f90e721f640 1 --2- 172.21.15.102:0/2452713556 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90e0151190 0x7f90e01653b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:53.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.502+0000 7f90e721f640 1 --2- 172.21.15.102:0/2452713556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90d0003970 0x7f90e014f6e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:53.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.502+0000 7f90e721f640 1 -- 172.21.15.102:0/2452713556 >> 172.21.15.102:0/2452713556 conn(0x7f90e00ce9b0 msgr2=0x7f90e00ae310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:53.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.502+0000 7f90e721f640 1 -- 172.21.15.102:0/2452713556 shutdown_connections 2023-10-14T09:37:53.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.502+0000 7f90e721f640 1 -- 172.21.15.102:0/2452713556 wait complete. 2023-10-14T09:37:53.522 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T09:37:53.736 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.734+0000 7f1204db6640 1 Processor -- start 2023-10-14T09:37:53.736 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.734+0000 7f1204db6640 1 -- start start 2023-10-14T09:37:53.738 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.736+0000 7f1204db6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f12000cf710 0x7f12000b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:53.738 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.736+0000 7f1204db6640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f12000cfaf0 0x7f12000b3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:53.738 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.736+0000 7f1204db6640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f12000b38e0 0x7f12000d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:53.738 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.736+0000 7f1204db6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12000d3c60 con 0x7f12000cf710 2023-10-14T09:37:53.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.736+0000 7f1204db6640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12000d3980 con 0x7f12000cfaf0 2023-10-14T09:37:53.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.736+0000 7f1204db6640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12000ce630 con 0x7f12000b38e0 2023-10-14T09:37:53.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.736+0000 7f11fe59c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f12000cf710 0x7f12000b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:53.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.736+0000 7f11fe59c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f12000cf710 0x7f12000b2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39860/0 (socket says 172.21.15.102:39860) 2023-10-14T09:37:53.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.736+0000 7f11fe59c640 1 -- 172.21.15.102:0/3436855930 learned_addr learned my addr 172.21.15.102:0/3436855930 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:53.741 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.737+0000 7f11fe59c640 1 -- 172.21.15.102:0/3436855930 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f12000b38e0 msgr2=0x7f12000d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:53.741 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.737+0000 7f11fdd9b640 1 --2- 172.21.15.102:0/3436855930 >> v2:172.21.15.129:3300/0 conn(0x7f12000cfaf0 0x7f12000b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:53.742 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.737+0000 7f11fed9d640 1 --2- 172.21.15.102:0/3436855930 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f12000b38e0 0x7f12000d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:53.742 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.737+0000 7f11fe59c640 1 --2- 172.21.15.102:0/3436855930 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f12000b38e0 0x7f12000d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:53.742 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.737+0000 7f11fe59c640 1 -- 172.21.15.102:0/3436855930 >> v2:172.21.15.129:3300/0 conn(0x7f12000cfaf0 msgr2=0x7f12000b3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:53.742 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.737+0000 7f11fe59c640 1 --2- 172.21.15.102:0/3436855930 >> v2:172.21.15.129:3300/0 conn(0x7f12000cfaf0 0x7f12000b3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:53.742 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.737+0000 7f11fe59c640 1 -- 172.21.15.102:0/3436855930 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12000ce910 con 0x7f12000cf710 2023-10-14T09:37:53.743 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.737+0000 7f11fdd9b640 1 --2- 172.21.15.102:0/3436855930 >> v2:172.21.15.129:3300/0 conn(0x7f12000cfaf0 0x7f12000b3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:53.743 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.737+0000 7f11fed9d640 1 --2- 172.21.15.102:0/3436855930 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f12000b38e0 0x7f12000d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:53.743 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.738+0000 7f11fe59c640 1 --2- 172.21.15.102:0/3436855930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f12000cf710 0x7f12000b2d10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f120008d210 tx=0x7f11f002b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a17ff3402878c359 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:53.743 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.738+0000 7f11fd59a640 1 -- 172.21.15.102:0/3436855930 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f0004230 con 0x7f12000cf710 2023-10-14T09:37:53.743 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.738+0000 7f11fd59a640 1 -- 172.21.15.102:0/3436855930 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f002e070 con 0x7f12000cf710 2023-10-14T09:37:53.744 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.738+0000 7f11fd59a640 1 -- 172.21.15.102:0/3436855930 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f0003610 con 0x7f12000cf710 2023-10-14T09:37:53.744 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.739+0000 7f1204db6640 1 -- 172.21.15.102:0/3436855930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f12000cf710 msgr2=0x7f12000b2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:53.744 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.739+0000 7f1204db6640 1 --2- 172.21.15.102:0/3436855930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f12000cf710 0x7f12000b2d10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f120008d210 tx=0x7f11f002b850 comp rx=0 tx=0).stop 2023-10-14T09:37:53.744 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.739+0000 7f1204db6640 1 -- 172.21.15.102:0/3436855930 shutdown_connections 2023-10-14T09:37:53.744 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.739+0000 7f1204db6640 1 --2- 172.21.15.102:0/3436855930 >> v2:172.21.15.129:3300/0 conn(0x7f12000cfaf0 0x7f12000b3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:53.745 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.739+0000 7f1204db6640 1 --2- 172.21.15.102:0/3436855930 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f12000b38e0 0x7f12000d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:53.745 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.739+0000 7f1204db6640 1 --2- 172.21.15.102:0/3436855930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f12000cf710 0x7f12000b2d10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:53.745 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.739+0000 7f1204db6640 1 -- 172.21.15.102:0/3436855930 >> 172.21.15.102:0/3436855930 conn(0x7f12000d2cc0 msgr2=0x7f12000d30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:53.745 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.739+0000 7f1204db6640 1 -- 172.21.15.102:0/3436855930 shutdown_connections 2023-10-14T09:37:53.745 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.739+0000 7f1204db6640 1 -- 172.21.15.102:0/3436855930 wait complete. 2023-10-14T09:37:53.747 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.741+0000 7f1204db6640 1 Processor -- start 2023-10-14T09:37:53.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.742+0000 7f1204db6640 1 -- start start 2023-10-14T09:37:53.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.743+0000 7f1204db6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f12000b38e0 0x7f1200155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:53.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.743+0000 7f1204db6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f12000cf710 0x7f12000cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:53.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.743+0000 7f1204db6640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f12000cfaf0 0x7f12001582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:53.749 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.743+0000 7f1204db6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1200156110 con 0x7f12000cf710 2023-10-14T09:37:53.749 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.743+0000 7f1204db6640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12000ccdf0 con 0x7f12000b38e0 2023-10-14T09:37:53.749 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.743+0000 7f1204db6640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1200156360 con 0x7f12000cfaf0 2023-10-14T09:37:53.749 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.743+0000 7f11fdd9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f12000cf710 0x7f12000cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:53.749 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.743+0000 7f11fdd9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f12000cf710 0x7f12000cc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39872/0 (socket says 172.21.15.102:39872) 2023-10-14T09:37:53.749 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.743+0000 7f11fdd9b640 1 -- 172.21.15.102:0/750098924 learned_addr learned my addr 172.21.15.102:0/750098924 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:53.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.743+0000 7f11fe59c640 1 --2- 172.21.15.102:0/750098924 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f12000b38e0 0x7f1200155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:53.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.743+0000 7f11fed9d640 1 --2- 172.21.15.102:0/750098924 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f12000cfaf0 0x7f12001582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:53.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.743+0000 7f11fdd9b640 1 -- 172.21.15.102:0/750098924 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f12000cfaf0 msgr2=0x7f12001582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:53.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.743+0000 7f11fdd9b640 1 --2- 172.21.15.102:0/750098924 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f12000cfaf0 0x7f12001582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:53.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.743+0000 7f11fdd9b640 1 -- 172.21.15.102:0/750098924 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f12000b38e0 msgr2=0x7f1200155ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:53.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.743+0000 7f11fdd9b640 1 --2- 172.21.15.102:0/750098924 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f12000b38e0 0x7f1200155ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:53.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.743+0000 7f11fdd9b640 1 -- 172.21.15.102:0/750098924 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f0009460 con 0x7f12000cf710 2023-10-14T09:37:53.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.743+0000 7f11fed9d640 1 --2- 172.21.15.102:0/750098924 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f12000cfaf0 0x7f12001582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:53.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.744+0000 7f11fdd9b640 1 --2- 172.21.15.102:0/750098924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f12000cf710 0x7f12000cc8b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f11f400c7f0 tx=0x7f11f400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:53.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.744+0000 7f11eeffd640 1 -- 172.21.15.102:0/750098924 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f4007820 con 0x7f12000cf710 2023-10-14T09:37:53.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.744+0000 7f11eeffd640 1 -- 172.21.15.102:0/750098924 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f4007980 con 0x7f12000cf710 2023-10-14T09:37:53.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.744+0000 7f11eeffd640 1 -- 172.21.15.102:0/750098924 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f4007cf0 con 0x7f12000cf710 2023-10-14T09:37:53.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.744+0000 7f1204db6640 1 -- 172.21.15.102:0/750098924 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1200156640 con 0x7f12000cf710 2023-10-14T09:37:53.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.744+0000 7f1204db6640 1 -- 172.21.15.102:0/750098924 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12000cb5b0 con 0x7f12000cf710 2023-10-14T09:37:53.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.745+0000 7f1204db6640 1 -- 172.21.15.102:0/750098924 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1200156880 con 0x7f12000cf710 2023-10-14T09:37:53.753 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.747+0000 7f11eeffd640 1 -- 172.21.15.102:0/750098924 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f11f40113f0 con 0x7f12000cf710 2023-10-14T09:37:53.753 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.748+0000 7f11eeffd640 1 --2- 172.21.15.102:0/750098924 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f11e006ae70 0x7f11e006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:53.753 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.748+0000 7f11eeffd640 1 -- 172.21.15.102:0/750098924 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11f40899b0 con 0x7f12000cf710 2023-10-14T09:37:53.753 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.748+0000 7f11fe59c640 1 --2- 172.21.15.102:0/750098924 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f11e006ae70 0x7f11e006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:53.754 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.749+0000 7f11fe59c640 1 --2- 172.21.15.102:0/750098924 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f11e006ae70 0x7f11e006d330 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f11f0034000 tx=0x7f11f0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:53.754 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.753+0000 7f11eeffd640 1 -- 172.21.15.102:0/750098924 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1200156880 con 0x7f12000cf710 2023-10-14T09:37:53.947 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.945+0000 7f1204db6640 1 -- 172.21.15.102:0/750098924 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1200156880 con 0x7f12000cf710 2023-10-14T09:37:53.947 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.945+0000 7f11eeffd640 1 -- 172.21.15.102:0/750098924 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1200156880 con 0x7f12000cf710 2023-10-14T09:37:53.948 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2023-10-14T09:37:53.950 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.948+0000 7f1204db6640 1 -- 172.21.15.102:0/750098924 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f11e006ae70 msgr2=0x7f11e006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:53.950 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.948+0000 7f1204db6640 1 --2- 172.21.15.102:0/750098924 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f11e006ae70 0x7f11e006d330 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f11f0034000 tx=0x7f11f0008030 comp rx=0 tx=0).stop 2023-10-14T09:37:53.950 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.948+0000 7f1204db6640 1 -- 172.21.15.102:0/750098924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f12000cf710 msgr2=0x7f12000cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:53.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.948+0000 7f1204db6640 1 --2- 172.21.15.102:0/750098924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f12000cf710 0x7f12000cc8b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f11f400c7f0 tx=0x7f11f400ccb0 comp rx=0 tx=0).stop 2023-10-14T09:37:53.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.948+0000 7f1204db6640 1 -- 172.21.15.102:0/750098924 shutdown_connections 2023-10-14T09:37:53.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.948+0000 7f1204db6640 1 --2- 172.21.15.102:0/750098924 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f11e006ae70 0x7f11e006d330 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:53.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.948+0000 7f1204db6640 1 --2- 172.21.15.102:0/750098924 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f12000cfaf0 0x7f12001582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:53.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.948+0000 7f1204db6640 1 --2- 172.21.15.102:0/750098924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f12000cf710 0x7f12000cc8b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:53.952 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.948+0000 7f1204db6640 1 --2- 172.21.15.102:0/750098924 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f12000b38e0 0x7f1200155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:53.952 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.948+0000 7f1204db6640 1 -- 172.21.15.102:0/750098924 >> 172.21.15.102:0/750098924 conn(0x7f12000d2cc0 msgr2=0x7f12000b31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:53.952 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.948+0000 7f1204db6640 1 -- 172.21.15.102:0/750098924 shutdown_connections 2023-10-14T09:37:53.952 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:53.948+0000 7f1204db6640 1 -- 172.21.15.102:0/750098924 wait complete. 2023-10-14T09:37:53.969 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:37:54.180 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.178+0000 7f1d52472640 1 Processor -- start 2023-10-14T09:37:54.180 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.178+0000 7f1d52472640 1 -- start start 2023-10-14T09:37:54.181 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.180+0000 7f1d52472640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1d4c070b60 0x7f1d4c15a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:54.182 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.180+0000 7f1d52472640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f1d4c06c100 0x7f1d4c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:54.182 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.180+0000 7f1d52472640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d4c15aef0 con 0x7f1d4c159950 2023-10-14T09:37:54.182 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.180+0000 7f1d52472640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d4c15e490 con 0x7f1d4c070b60 2023-10-14T09:37:54.182 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.180+0000 7f1d52472640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d4c15d910 con 0x7f1d4c06c100 2023-10-14T09:37:54.183 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.180+0000 7f1d50c6f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1d4c070b60 0x7f1d4c15a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:54.183 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.180+0000 7f1d50c6f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1d4c070b60 0x7f1d4c15a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39878/0 (socket says 172.21.15.102:39878) 2023-10-14T09:37:54.184 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.180+0000 7f1d50c6f640 1 -- 172.21.15.102:0/1257470129 learned_addr learned my addr 172.21.15.102:0/1257470129 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:54.184 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.180+0000 7f1d51c71640 1 --2- 172.21.15.102:0/1257470129 >> v2:172.21.15.129:3300/0 conn(0x7f1d4c06c100 0x7f1d4c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:54.184 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.181+0000 7f1d50c6f640 1 -- 172.21.15.102:0/1257470129 >> v2:172.21.15.129:3300/0 conn(0x7f1d4c06c100 msgr2=0x7f1d4c06c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:54.184 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.181+0000 7f1d50c6f640 1 --2- 172.21.15.102:0/1257470129 >> v2:172.21.15.129:3300/0 conn(0x7f1d4c06c100 0x7f1d4c06c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:54.184 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.181+0000 7f1d50c6f640 1 -- 172.21.15.102:0/1257470129 >> v1:172.21.15.129:6789/0 conn(0x7f1d4c159950 legacy=0x7f1d4c070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:54.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.181+0000 7f1d50c6f640 1 -- 172.21.15.102:0/1257470129 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d4c15dbf0 con 0x7f1d4c070b60 2023-10-14T09:37:54.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.182+0000 7f1d50c6f640 1 --2- 172.21.15.102:0/1257470129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d4c070b60 0x7f1d4c15a9b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0ade70 tx=0x7f1d3c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd27cd6c0ba3bcad server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:54.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.182+0000 7f1d43fff640 1 -- 172.21.15.102:0/1257470129 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c031870 con 0x7f1d4c070b60 2023-10-14T09:37:54.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.182+0000 7f1d43fff640 1 -- 172.21.15.102:0/1257470129 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3c0319d0 con 0x7f1d4c070b60 2023-10-14T09:37:54.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.182+0000 7f1d43fff640 1 -- 172.21.15.102:0/1257470129 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c031d60 con 0x7f1d4c070b60 2023-10-14T09:37:54.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.183+0000 7f1d52472640 1 -- 172.21.15.102:0/1257470129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d4c070b60 msgr2=0x7f1d4c15a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:54.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.183+0000 7f1d52472640 1 --2- 172.21.15.102:0/1257470129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d4c070b60 0x7f1d4c15a9b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0ade70 tx=0x7f1d3c02b910 comp rx=0 tx=0).stop 2023-10-14T09:37:54.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.183+0000 7f1d52472640 1 -- 172.21.15.102:0/1257470129 shutdown_connections 2023-10-14T09:37:54.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.183+0000 7f1d52472640 1 --2- 172.21.15.102:0/1257470129 >> v2:172.21.15.129:3300/0 conn(0x7f1d4c06c100 0x7f1d4c06c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:54.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.183+0000 7f1d52472640 1 --2- 172.21.15.102:0/1257470129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d4c070b60 0x7f1d4c15a9b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:54.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.183+0000 7f1d52472640 1 -- 172.21.15.102:0/1257470129 >> 172.21.15.102:0/1257470129 conn(0x7f1d4c0ce6a0 msgr2=0x7f1d4c0ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:54.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.183+0000 7f1d52472640 1 -- 172.21.15.102:0/1257470129 shutdown_connections 2023-10-14T09:37:54.188 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.183+0000 7f1d52472640 1 -- 172.21.15.102:0/1257470129 wait complete. 2023-10-14T09:37:54.189 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.185+0000 7f1d52472640 1 Processor -- start 2023-10-14T09:37:54.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.185+0000 7f1d52472640 1 -- start start 2023-10-14T09:37:54.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.186+0000 7f1d52472640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1d4c06c100 0x7f1d4c1583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:54.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.186+0000 7f1d52472640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d4c070b60 0x7f1d4c154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:54.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.186+0000 7f1d52472640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d4c159950 0x7f1d4c157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:54.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.186+0000 7f1d52472640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c155130 con 0x7f1d4c070b60 2023-10-14T09:37:54.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.186+0000 7f1d52472640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c0c21b0 con 0x7f1d4c159950 2023-10-14T09:37:54.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.186+0000 7f1d52472640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c0c2450 con 0x7f1d4c06c100 2023-10-14T09:37:54.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.186+0000 7f1d50c6f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d4c070b60 0x7f1d4c154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:54.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.186+0000 7f1d50c6f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d4c070b60 0x7f1d4c154bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39894/0 (socket says 172.21.15.102:39894) 2023-10-14T09:37:54.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.186+0000 7f1d50c6f640 1 -- 172.21.15.102:0/3569153165 learned_addr learned my addr 172.21.15.102:0/3569153165 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:54.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.186+0000 7f1d50c6f640 1 -- 172.21.15.102:0/3569153165 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1d4c06c100 msgr2=0x7f1d4c1583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:54.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.186+0000 7f1d50c6f640 1 --2- 172.21.15.102:0/3569153165 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1d4c06c100 0x7f1d4c1583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:54.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.186+0000 7f1d50c6f640 1 -- 172.21.15.102:0/3569153165 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d4c159950 msgr2=0x7f1d4c157440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:54.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.186+0000 7f1d50c6f640 1 --2- 172.21.15.102:0/3569153165 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d4c159950 0x7f1d4c157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:54.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.186+0000 7f1d50c6f640 1 -- 172.21.15.102:0/3569153165 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3c0094d0 con 0x7f1d4c070b60 2023-10-14T09:37:54.193 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.187+0000 7f1d50c6f640 1 --2- 172.21.15.102:0/3569153165 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d4c070b60 0x7f1d4c154bf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c02b950 tx=0x7f1d3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:54.193 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.187+0000 7f1d41ffb640 1 -- 172.21.15.102:0/3569153165 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c03ad30 con 0x7f1d4c070b60 2023-10-14T09:37:54.193 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.187+0000 7f1d41ffb640 1 -- 172.21.15.102:0/3569153165 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3c0443f0 con 0x7f1d4c070b60 2023-10-14T09:37:54.193 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.187+0000 7f1d52472640 1 -- 172.21.15.102:0/3569153165 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d4c0c2730 con 0x7f1d4c070b60 2023-10-14T09:37:54.193 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.187+0000 7f1d41ffb640 1 -- 172.21.15.102:0/3569153165 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c0447a0 con 0x7f1d4c070b60 2023-10-14T09:37:54.193 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.187+0000 7f1d52472640 1 -- 172.21.15.102:0/3569153165 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d4c0c2cf0 con 0x7f1d4c070b60 2023-10-14T09:37:54.194 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.188+0000 7f1d52472640 1 -- 172.21.15.102:0/3569153165 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d4c04e9b0 con 0x7f1d4c070b60 2023-10-14T09:37:54.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.189+0000 7f1d41ffb640 1 -- 172.21.15.102:0/3569153165 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1d3c04d450 con 0x7f1d4c070b60 2023-10-14T09:37:54.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.190+0000 7f1d41ffb640 1 --2- 172.21.15.102:0/3569153165 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1d3006ae70 0x7f1d3006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:54.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.190+0000 7f1d41ffb640 1 -- 172.21.15.102:0/3569153165 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d3c02d040 con 0x7f1d4c070b60 2023-10-14T09:37:54.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.190+0000 7f1d51470640 1 --2- 172.21.15.102:0/3569153165 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1d3006ae70 0x7f1d3006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:54.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.191+0000 7f1d51470640 1 --2- 172.21.15.102:0/3569153165 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1d3006ae70 0x7f1d3006d330 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1d48000f60 tx=0x7f1d480079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:54.196 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.195+0000 7f1d41ffb640 1 -- 172.21.15.102:0/3569153165 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1d3c076cd0 con 0x7f1d4c070b60 2023-10-14T09:37:54.384 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.381+0000 7f1d52472640 1 -- 172.21.15.102:0/3569153165 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d4c06dad0 con 0x7f1d4c070b60 2023-10-14T09:37:54.386 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.385+0000 7f1d41ffb640 1 -- 172.21.15.102:0/3569153165 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f1d3c035070 con 0x7f1d4c070b60 2023-10-14T09:37:54.387 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:37:54.387 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":22,"fsid":"8a6cd69d-7f5b-4f2a-806a-0176c10aed50","created":"2023-10-14T09:36:56.745172+0000","modified":"2023-10-14T09:37:22.712469+0000","last_up_change":"2023-10-14T09:37:09.791473+0000","last_in_change":"2023-10-14T09:37:00.547186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:37:09.952407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:37:19.560925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:37:20.363385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e5aef8f3-878f-482b-b522-9a5b958b90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6801","nonce":1727250718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6803","nonce":1727250718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6807","nonce":1727250718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6805","nonce":1727250718}]},"public_addr":"172.21.15.102:6801/1727250718","cluster_addr":"172.21.15.102:6803/1727250718","heartbeat_back_addr":"172.21.15.102:6807/1727250718","heartbeat_front_addr":"172.21.15.102:6805/1727250718","state":["exists","up"]},{"osd":1,"uuid":"4a8cf50e-387b-4d47-9588-bd22e375a9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6809","nonce":1095651107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6811","nonce":1095651107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6815","nonce":1095651107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6813","nonce":1095651107}]},"public_addr":"172.21.15.102:6809/1095651107","cluster_addr":"172.21.15.102:6811/1095651107","heartbeat_back_addr":"172.21.15.102:6815/1095651107","heartbeat_front_addr":"172.21.15.102:6813/1095651107","state":["exists","up"]},{"osd":2,"uuid":"009ef55f-8a63-4219-bacd-d7c7b4500867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6820","nonce":2198222556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6825","nonce":2198222556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6831","nonce":2198222556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6829","nonce":2198222556}]},"public_addr":"172.21.15.102:6820/2198222556","cluster_addr":"172.21.15.102:6825/2198222556","heartbeat_back_addr":"172.21.15.102:6831/2198222556","heartbeat_front_addr":"172.21.15.102:6829/2198222556","state":["exists","up"]},{"osd":3,"uuid":"f2110eae-2ff9-4ed9-93d6-bd2361618211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6818","nonce":654726740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6821","nonce":654726740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6827","nonce":654726740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6823","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6824","nonce":654726740}]},"public_addr":"172.21.15.102:6818/654726740","cluster_addr":"172.21.15.102:6821/654726740","heartbeat_back_addr":"172.21.15.102:6827/654726740","heartbeat_front_addr":"172.21.15.102:6824/654726740","state":["exists","up"]},{"osd":4,"uuid":"33f1ae34-3100-40f7-9cb8-0eca2b358693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6817","nonce":507586170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6819","nonce":507586170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6823","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6825","nonce":507586170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6821","nonce":507586170}]},"public_addr":"172.21.15.129:6817/507586170","cluster_addr":"172.21.15.129:6819/507586170","heartbeat_back_addr":"172.21.15.129:6825/507586170","heartbeat_front_addr":"172.21.15.129:6821/507586170","state":["exists","up"]},{"osd":5,"uuid":"fab2fc62-3f3e-450d-93e0-770f39e80710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6801","nonce":1913451073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6803","nonce":1913451073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6807","nonce":1913451073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6805","nonce":1913451073}]},"public_addr":"172.21.15.129:6801/1913451073","cluster_addr":"172.21.15.129:6803/1913451073","heartbeat_back_addr":"172.21.15.129:6807/1913451073","heartbeat_front_addr":"172.21.15.129:6805/1913451073","state":["exists","up"]},{"osd":6,"uuid":"d7cc1d69-92e7-4253-a127-cfc0444a4809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6809","nonce":2853291511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6811","nonce":2853291511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6815","nonce":2853291511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6813","nonce":2853291511}]},"public_addr":"172.21.15.129:6809/2853291511","cluster_addr":"172.21.15.129:6811/2853291511","heartbeat_back_addr":"172.21.15.129:6815/2853291511","heartbeat_front_addr":"172.21.15.129:6813/2853291511","state":["exists","up"]},{"osd":7,"uuid":"1e403de1-09e2-4370-b9a7-e790ac44bbee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6824","nonce":2933886914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6827","nonce":2933886914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6831","nonce":2933886914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6829","nonce":2933886914}]},"public_addr":"172.21.15.129:6824/2933886914","cluster_addr":"172.21.15.129:6827/2933886914","heartbeat_back_addr":"172.21.15.129:6831/2933886914","heartbeat_front_addr":"172.21.15.129:6829/2933886914","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.849661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.868113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.933488+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.891794+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.901861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.858750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.911712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.996765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:37:54.389 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.387+0000 7f1d52472640 1 -- 172.21.15.102:0/3569153165 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1d3006ae70 msgr2=0x7f1d3006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:54.389 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.387+0000 7f1d52472640 1 --2- 172.21.15.102:0/3569153165 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1d3006ae70 0x7f1d3006d330 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1d48000f60 tx=0x7f1d480079b0 comp rx=0 tx=0).stop 2023-10-14T09:37:54.389 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.387+0000 7f1d52472640 1 -- 172.21.15.102:0/3569153165 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d4c070b60 msgr2=0x7f1d4c154bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:54.390 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.387+0000 7f1d52472640 1 --2- 172.21.15.102:0/3569153165 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d4c070b60 0x7f1d4c154bf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c02b950 tx=0x7f1d3c0046c0 comp rx=0 tx=0).stop 2023-10-14T09:37:54.390 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.387+0000 7f1d52472640 1 -- 172.21.15.102:0/3569153165 shutdown_connections 2023-10-14T09:37:54.390 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.387+0000 7f1d52472640 1 --2- 172.21.15.102:0/3569153165 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1d3006ae70 0x7f1d3006d330 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:54.390 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.387+0000 7f1d52472640 1 --2- 172.21.15.102:0/3569153165 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d4c159950 0x7f1d4c157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:54.390 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.387+0000 7f1d52472640 1 --2- 172.21.15.102:0/3569153165 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d4c070b60 0x7f1d4c154bf0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:54.391 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.387+0000 7f1d52472640 1 --2- 172.21.15.102:0/3569153165 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1d4c06c100 0x7f1d4c1583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:54.391 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.387+0000 7f1d52472640 1 -- 172.21.15.102:0/3569153165 >> 172.21.15.102:0/3569153165 conn(0x7f1d4c0ce6a0 msgr2=0x7f1d4c0cea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:54.391 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.387+0000 7f1d52472640 1 -- 172.21.15.102:0/3569153165 shutdown_connections 2023-10-14T09:37:54.391 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.388+0000 7f1d52472640 1 -- 172.21.15.102:0/3569153165 wait complete. 2023-10-14T09:37:54.407 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T09:37:09.952407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T09:37:19.560925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T09:37:20.363385+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T09:37:54.408 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T09:37:54.613 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.611+0000 7f64cac90640 1 Processor -- start 2023-10-14T09:37:54.613 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.611+0000 7f64cac90640 1 -- start start 2023-10-14T09:37:54.614 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.612+0000 7f64cac90640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f64c4159ab0 0x7f64c40ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:54.615 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.612+0000 7f64cac90640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f64c406c140 0x7f64c406c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:54.615 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.612+0000 7f64cac90640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64c406cad0 con 0x7f64c4159e90 2023-10-14T09:37:54.615 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.613+0000 7f64cac90640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64c415d890 con 0x7f64c4159ab0 2023-10-14T09:37:54.615 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.613+0000 7f64cac90640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64c4070360 con 0x7f64c406c140 2023-10-14T09:37:54.615 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.613+0000 7f64c8a2c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f64c4159ab0 0x7f64c40ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:54.615 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.613+0000 7f64c3fff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f64c4159e90 0x7f64c406fc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:59794/0 (socket says 172.21.15.102:59794) 2023-10-14T09:37:54.616 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.613+0000 7f64c3fff640 1 -- 172.21.15.102:0/3983368281 learned_addr learned my addr 172.21.15.102:0/3983368281 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:54.617 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.613+0000 7f64c8a2c640 1 -- 172.21.15.102:0/3983368281 >> v2:172.21.15.129:3300/0 conn(0x7f64c406c140 msgr2=0x7f64c406c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:54.618 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.613+0000 7f64c8a2c640 1 --2- 172.21.15.102:0/3983368281 >> v2:172.21.15.129:3300/0 conn(0x7f64c406c140 0x7f64c406c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:54.618 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.613+0000 7f64c8a2c640 1 -- 172.21.15.102:0/3983368281 >> v1:172.21.15.102:6789/0 conn(0x7f64c4159e90 legacy=0x7f64c406fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:54.618 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.613+0000 7f64c8a2c640 1 -- 172.21.15.102:0/3983368281 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c40cd1f0 con 0x7f64c4159ab0 2023-10-14T09:37:54.618 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.614+0000 7f64c8a2c640 1 --2- 172.21.15.102:0/3983368281 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64c4159ab0 0x7f64c40ce370 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f64c40adcd0 tx=0x7f64b802d9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0aca4616a0931b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:54.618 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.615+0000 7f64c37fe640 1 -- 172.21.15.102:0/3983368281 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b8032880 con 0x7f64c4159ab0 2023-10-14T09:37:54.619 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.615+0000 7f64c37fe640 1 -- 172.21.15.102:0/3983368281 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b80329e0 con 0x7f64c4159ab0 2023-10-14T09:37:54.619 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.615+0000 7f64c37fe640 1 -- 172.21.15.102:0/3983368281 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b8032d70 con 0x7f64c4159ab0 2023-10-14T09:37:54.619 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.615+0000 7f64cac90640 1 -- 172.21.15.102:0/3983368281 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64c4159ab0 msgr2=0x7f64c40ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:54.619 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.615+0000 7f64cac90640 1 --2- 172.21.15.102:0/3983368281 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64c4159ab0 0x7f64c40ce370 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f64c40adcd0 tx=0x7f64b802d9c0 comp rx=0 tx=0).stop 2023-10-14T09:37:54.619 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.615+0000 7f64cac90640 1 -- 172.21.15.102:0/3983368281 shutdown_connections 2023-10-14T09:37:54.620 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.615+0000 7f64cac90640 1 --2- 172.21.15.102:0/3983368281 >> v2:172.21.15.129:3300/0 conn(0x7f64c406c140 0x7f64c406c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:54.620 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.615+0000 7f64cac90640 1 --2- 172.21.15.102:0/3983368281 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64c4159ab0 0x7f64c40ce370 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:54.620 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.615+0000 7f64cac90640 1 -- 172.21.15.102:0/3983368281 >> 172.21.15.102:0/3983368281 conn(0x7f64c40ce9b0 msgr2=0x7f64c40cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:54.620 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.615+0000 7f64cac90640 1 -- 172.21.15.102:0/3983368281 shutdown_connections 2023-10-14T09:37:54.620 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.615+0000 7f64cac90640 1 -- 172.21.15.102:0/3983368281 wait complete. 2023-10-14T09:37:54.622 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.617+0000 7f64cac90640 1 Processor -- start 2023-10-14T09:37:54.622 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.617+0000 7f64cac90640 1 -- start start 2023-10-14T09:37:54.623 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.618+0000 7f64cac90640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64c406c140 0x7f64c41e4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:54.623 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.618+0000 7f64cac90640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f64c4159ab0 0x7f64c4156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:54.623 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.618+0000 7f64cac90640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f64c4159e90 0x7f64c41e6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:54.623 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.618+0000 7f64cac90640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c41e55e0 con 0x7f64c406c140 2023-10-14T09:37:54.624 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.618+0000 7f64cac90640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c41e58c0 con 0x7f64c4159ab0 2023-10-14T09:37:54.624 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.618+0000 7f64cac90640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c41e5ba0 con 0x7f64c4159e90 2023-10-14T09:37:54.624 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.619+0000 7f64c8a2c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64c406c140 0x7f64c41e4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:54.624 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.619+0000 7f64c8a2c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64c406c140 0x7f64c41e4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39906/0 (socket says 172.21.15.102:39906) 2023-10-14T09:37:54.624 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.619+0000 7f64c8a2c640 1 -- 172.21.15.102:0/2832996491 learned_addr learned my addr 172.21.15.102:0/2832996491 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:54.625 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.619+0000 7f64c8a2c640 1 -- 172.21.15.102:0/2832996491 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f64c4159e90 msgr2=0x7f64c41e6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:54.625 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.619+0000 7f64c8a2c640 1 --2- 172.21.15.102:0/2832996491 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f64c4159e90 0x7f64c41e6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:54.625 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.619+0000 7f64c8a2c640 1 -- 172.21.15.102:0/2832996491 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f64c4159ab0 msgr2=0x7f64c4156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:54.625 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.619+0000 7f64c8a2c640 1 --2- 172.21.15.102:0/2832996491 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f64c4159ab0 0x7f64c4156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:54.625 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.619+0000 7f64c8a2c640 1 -- 172.21.15.102:0/2832996491 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b8009400 con 0x7f64c406c140 2023-10-14T09:37:54.626 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.619+0000 7f64c8a2c640 1 --2- 172.21.15.102:0/2832996491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64c406c140 0x7f64c41e4d90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f64b8009890 tx=0x7f64b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:54.626 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.620+0000 7f64c17fa640 1 -- 172.21.15.102:0/2832996491 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b803cd70 con 0x7f64c406c140 2023-10-14T09:37:54.626 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.620+0000 7f64c17fa640 1 -- 172.21.15.102:0/2832996491 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b80463f0 con 0x7f64c406c140 2023-10-14T09:37:54.626 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.620+0000 7f64c17fa640 1 -- 172.21.15.102:0/2832996491 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b80467a0 con 0x7f64c406c140 2023-10-14T09:37:54.626 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.620+0000 7f64cac90640 1 -- 172.21.15.102:0/2832996491 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64c41e5e80 con 0x7f64c406c140 2023-10-14T09:37:54.627 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.620+0000 7f64cac90640 1 -- 172.21.15.102:0/2832996491 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c41e52d0 con 0x7f64c406c140 2023-10-14T09:37:54.627 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.621+0000 7f64cac90640 1 -- 172.21.15.102:0/2832996491 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64c404e160 con 0x7f64c406c140 2023-10-14T09:37:54.628 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.622+0000 7f64c17fa640 1 -- 172.21.15.102:0/2832996491 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f64b8046900 con 0x7f64c406c140 2023-10-14T09:37:54.628 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.623+0000 7f64c17fa640 1 --2- 172.21.15.102:0/2832996491 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f64a806ae70 0x7f64a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:54.628 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.623+0000 7f64c17fa640 1 -- 172.21.15.102:0/2832996491 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64b80ac1c0 con 0x7f64c406c140 2023-10-14T09:37:54.628 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.623+0000 7f64c3fff640 1 --2- 172.21.15.102:0/2832996491 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f64a806ae70 0x7f64a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:54.629 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.624+0000 7f64c3fff640 1 --2- 172.21.15.102:0/2832996491 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f64a806ae70 0x7f64a806d330 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f64b00015f0 tx=0x7f64b0007a40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:54.629 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.627+0000 7f64c17fa640 1 -- 172.21.15.102:0/2832996491 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f64b8077390 con 0x7f64c406c140 2023-10-14T09:37:54.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.819+0000 7f64cac90640 1 -- 172.21.15.102:0/2832996491 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f64c40ccb60 con 0x7f64c406c140 2023-10-14T09:37:54.822 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.820+0000 7f64c17fa640 1 -- 172.21.15.102:0/2832996491 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f64b807a9b0 con 0x7f64c406c140 2023-10-14T09:37:54.823 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2023-10-14T09:37:54.826 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.824+0000 7f64cac90640 1 -- 172.21.15.102:0/2832996491 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f64a806ae70 msgr2=0x7f64a806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:54.826 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.824+0000 7f64cac90640 1 --2- 172.21.15.102:0/2832996491 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f64a806ae70 0x7f64a806d330 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f64b00015f0 tx=0x7f64b0007a40 comp rx=0 tx=0).stop 2023-10-14T09:37:54.826 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.824+0000 7f64cac90640 1 -- 172.21.15.102:0/2832996491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64c406c140 msgr2=0x7f64c41e4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:54.826 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.824+0000 7f64cac90640 1 --2- 172.21.15.102:0/2832996491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64c406c140 0x7f64c41e4d90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f64b8009890 tx=0x7f64b80046c0 comp rx=0 tx=0).stop 2023-10-14T09:37:54.827 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.824+0000 7f64cac90640 1 -- 172.21.15.102:0/2832996491 shutdown_connections 2023-10-14T09:37:54.827 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.824+0000 7f64cac90640 1 --2- 172.21.15.102:0/2832996491 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f64a806ae70 0x7f64a806d330 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:54.827 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.824+0000 7f64cac90640 1 --2- 172.21.15.102:0/2832996491 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f64c4159e90 0x7f64c41e6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:54.827 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.824+0000 7f64cac90640 1 --2- 172.21.15.102:0/2832996491 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f64c4159ab0 0x7f64c4156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:54.827 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.824+0000 7f64cac90640 1 --2- 172.21.15.102:0/2832996491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64c406c140 0x7f64c41e4d90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:54.828 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.824+0000 7f64cac90640 1 -- 172.21.15.102:0/2832996491 >> 172.21.15.102:0/2832996491 conn(0x7f64c40ce9b0 msgr2=0x7f64c4070500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:54.828 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.824+0000 7f64cac90640 1 -- 172.21.15.102:0/2832996491 shutdown_connections 2023-10-14T09:37:54.828 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:54.824+0000 7f64cac90640 1 -- 172.21.15.102:0/2832996491 wait complete. 2023-10-14T09:37:54.843 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T09:37:55.052 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.050+0000 7fb559505640 1 Processor -- start 2023-10-14T09:37:55.052 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.050+0000 7fb559505640 1 -- start start 2023-10-14T09:37:55.054 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.051+0000 7fb559505640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fb5540ad350 0x7fb554069da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:55.054 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.051+0000 7fb559505640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb55406a2e0 0x7fb5540c9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:55.054 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.052+0000 7fb559505640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb55406a730 con 0x7fb55415d150 2023-10-14T09:37:55.054 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.052+0000 7fb559505640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb55415d530 con 0x7fb55406a2e0 2023-10-14T09:37:55.054 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.052+0000 7fb559505640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5540ac890 con 0x7fb5540ad350 2023-10-14T09:37:55.055 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.052+0000 7fb5537fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb55406a2e0 0x7fb5540c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:55.055 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.052+0000 7fb5537fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb55406a2e0 0x7fb5540c9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39912/0 (socket says 172.21.15.102:39912) 2023-10-14T09:37:55.055 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.052+0000 7fb5537fe640 1 -- 172.21.15.102:0/1492364929 learned_addr learned my addr 172.21.15.102:0/1492364929 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:55.055 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.052+0000 7fb5527fc640 1 --2- 172.21.15.102:0/1492364929 >> v2:172.21.15.129:3300/0 conn(0x7fb5540ad350 0x7fb554069da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:55.057 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.052+0000 7fb5537fe640 1 -- 172.21.15.102:0/1492364929 >> v2:172.21.15.129:3300/0 conn(0x7fb5540ad350 msgr2=0x7fb554069da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:55.057 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.052+0000 7fb5537fe640 1 --2- 172.21.15.102:0/1492364929 >> v2:172.21.15.129:3300/0 conn(0x7fb5540ad350 0x7fb554069da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:55.057 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.052+0000 7fb5537fe640 1 -- 172.21.15.102:0/1492364929 >> v1:172.21.15.129:6789/0 conn(0x7fb55415d150 legacy=0x7fb554160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:55.057 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.052+0000 7fb5537fe640 1 -- 172.21.15.102:0/1492364929 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5540ad7a0 con 0x7fb55406a2e0 2023-10-14T09:37:55.057 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.053+0000 7fb5537fe640 1 --2- 172.21.15.102:0/1492364929 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb55406a2e0 0x7fb5540c9000 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb5540cf990 tx=0x7fb54c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93c45a2f30ea81b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:55.058 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.054+0000 7fb551ffb640 1 -- 172.21.15.102:0/1492364929 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c02ca80 con 0x7fb55406a2e0 2023-10-14T09:37:55.058 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.054+0000 7fb551ffb640 1 -- 172.21.15.102:0/1492364929 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54c02cbe0 con 0x7fb55406a2e0 2023-10-14T09:37:55.058 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.054+0000 7fb551ffb640 1 -- 172.21.15.102:0/1492364929 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c0343f0 con 0x7fb55406a2e0 2023-10-14T09:37:55.058 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.054+0000 7fb559505640 1 -- 172.21.15.102:0/1492364929 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb55406a2e0 msgr2=0x7fb5540c9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:55.058 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.054+0000 7fb559505640 1 --2- 172.21.15.102:0/1492364929 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb55406a2e0 0x7fb5540c9000 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb5540cf990 tx=0x7fb54c02bee0 comp rx=0 tx=0).stop 2023-10-14T09:37:55.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.055+0000 7fb559505640 1 -- 172.21.15.102:0/1492364929 shutdown_connections 2023-10-14T09:37:55.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.055+0000 7fb559505640 1 --2- 172.21.15.102:0/1492364929 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb55406a2e0 0x7fb5540c9000 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:55.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.055+0000 7fb559505640 1 --2- 172.21.15.102:0/1492364929 >> v2:172.21.15.129:3300/0 conn(0x7fb5540ad350 0x7fb554069da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:55.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.055+0000 7fb559505640 1 -- 172.21.15.102:0/1492364929 >> 172.21.15.102:0/1492364929 conn(0x7fb5540ce9b0 msgr2=0x7fb5540cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:55.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.055+0000 7fb559505640 1 -- 172.21.15.102:0/1492364929 shutdown_connections 2023-10-14T09:37:55.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.055+0000 7fb559505640 1 -- 172.21.15.102:0/1492364929 wait complete. 2023-10-14T09:37:55.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.057+0000 7fb559505640 1 Processor -- start 2023-10-14T09:37:55.062 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.057+0000 7fb559505640 1 -- start start 2023-10-14T09:37:55.062 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.058+0000 7fb559505640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb55406a2e0 0x7fb5540c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:55.062 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.058+0000 7fb559505640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5540ad350 0x7fb5540b36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:55.062 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.058+0000 7fb559505640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb55415d150 0x7fb5540c6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:55.062 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.058+0000 7fb559505640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5541561f0 con 0x7fb5540ad350 2023-10-14T09:37:55.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.058+0000 7fb559505640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5540c83b0 con 0x7fb55415d150 2023-10-14T09:37:55.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.058+0000 7fb559505640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5540ae590 con 0x7fb55406a2e0 2023-10-14T09:37:55.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.058+0000 7fb5527fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5540ad350 0x7fb5540b36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:55.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.058+0000 7fb5527fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5540ad350 0x7fb5540b36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39914/0 (socket says 172.21.15.102:39914) 2023-10-14T09:37:55.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.058+0000 7fb5527fc640 1 -- 172.21.15.102:0/3598179844 learned_addr learned my addr 172.21.15.102:0/3598179844 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:55.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.059+0000 7fb552ffd640 1 --2- 172.21.15.102:0/3598179844 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb55406a2e0 0x7fb5540c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:55.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.059+0000 7fb5537fe640 1 --2- 172.21.15.102:0/3598179844 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb55415d150 0x7fb5540c6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:55.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.059+0000 7fb5527fc640 1 -- 172.21.15.102:0/3598179844 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb55406a2e0 msgr2=0x7fb5540c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:55.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.059+0000 7fb5527fc640 1 --2- 172.21.15.102:0/3598179844 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb55406a2e0 0x7fb5540c7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:55.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.059+0000 7fb5527fc640 1 -- 172.21.15.102:0/3598179844 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb55415d150 msgr2=0x7fb5540c6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:55.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.059+0000 7fb5527fc640 1 --2- 172.21.15.102:0/3598179844 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb55415d150 0x7fb5540c6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:55.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.059+0000 7fb5527fc640 1 -- 172.21.15.102:0/3598179844 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54c009b30 con 0x7fb5540ad350 2023-10-14T09:37:55.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.059+0000 7fb5537fe640 1 --2- 172.21.15.102:0/3598179844 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb55415d150 0x7fb5540c6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:55.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.059+0000 7fb5527fc640 1 --2- 172.21.15.102:0/3598179844 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5540ad350 0x7fb5540b36c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb54800d800 tx=0x7fb54800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:55.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.059+0000 7fb53b7fe640 1 -- 172.21.15.102:0/3598179844 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54800b6c0 con 0x7fb5540ad350 2023-10-14T09:37:55.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.060+0000 7fb53b7fe640 1 -- 172.21.15.102:0/3598179844 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54800b820 con 0x7fb5540ad350 2023-10-14T09:37:55.066 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.060+0000 7fb53b7fe640 1 -- 172.21.15.102:0/3598179844 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54800bbb0 con 0x7fb5540ad350 2023-10-14T09:37:55.066 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.060+0000 7fb559505640 1 -- 172.21.15.102:0/3598179844 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5540ae870 con 0x7fb5540ad350 2023-10-14T09:37:55.066 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.060+0000 7fb559505640 1 -- 172.21.15.102:0/3598179844 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5540aee30 con 0x7fb5540ad350 2023-10-14T09:37:55.067 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.061+0000 7fb559505640 1 -- 172.21.15.102:0/3598179844 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb55404e160 con 0x7fb5540ad350 2023-10-14T09:37:55.067 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.062+0000 7fb53b7fe640 1 -- 172.21.15.102:0/3598179844 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb54800bd10 con 0x7fb5540ad350 2023-10-14T09:37:55.067 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.063+0000 7fb53b7fe640 1 --2- 172.21.15.102:0/3598179844 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fb54006ae70 0x7fb54006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:55.068 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.063+0000 7fb53b7fe640 1 -- 172.21.15.102:0/3598179844 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb548089ca0 con 0x7fb5540ad350 2023-10-14T09:37:55.068 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.063+0000 7fb552ffd640 1 --2- 172.21.15.102:0/3598179844 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fb54006ae70 0x7fb54006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:55.068 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.064+0000 7fb552ffd640 1 --2- 172.21.15.102:0/3598179844 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fb54006ae70 0x7fb54006d330 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb544007fd0 tx=0x7fb544009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:55.068 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.067+0000 7fb53b7fe640 1 -- 172.21.15.102:0/3598179844 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb548054c20 con 0x7fb5540ad350 2023-10-14T09:37:55.256 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.254+0000 7fb559505640 1 -- 172.21.15.102:0/3598179844 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb5540ade10 con 0x7fb5540ad350 2023-10-14T09:37:55.257 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.255+0000 7fb53b7fe640 1 -- 172.21.15.102:0/3598179844 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb548058240 con 0x7fb5540ad350 2023-10-14T09:37:55.258 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2023-10-14T09:37:55.262 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.258+0000 7fb559505640 1 -- 172.21.15.102:0/3598179844 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fb54006ae70 msgr2=0x7fb54006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:55.262 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.258+0000 7fb559505640 1 --2- 172.21.15.102:0/3598179844 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fb54006ae70 0x7fb54006d330 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb544007fd0 tx=0x7fb544009040 comp rx=0 tx=0).stop 2023-10-14T09:37:55.262 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.258+0000 7fb559505640 1 -- 172.21.15.102:0/3598179844 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5540ad350 msgr2=0x7fb5540b36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:55.262 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.258+0000 7fb559505640 1 --2- 172.21.15.102:0/3598179844 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5540ad350 0x7fb5540b36c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb54800d800 tx=0x7fb54800dcc0 comp rx=0 tx=0).stop 2023-10-14T09:37:55.262 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.258+0000 7fb559505640 1 -- 172.21.15.102:0/3598179844 shutdown_connections 2023-10-14T09:37:55.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.258+0000 7fb559505640 1 --2- 172.21.15.102:0/3598179844 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fb54006ae70 0x7fb54006d330 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:55.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.258+0000 7fb559505640 1 --2- 172.21.15.102:0/3598179844 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb55415d150 0x7fb5540c6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:55.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.258+0000 7fb559505640 1 --2- 172.21.15.102:0/3598179844 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5540ad350 0x7fb5540b36c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:55.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.258+0000 7fb559505640 1 --2- 172.21.15.102:0/3598179844 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb55406a2e0 0x7fb5540c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:55.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.258+0000 7fb559505640 1 -- 172.21.15.102:0/3598179844 >> 172.21.15.102:0/3598179844 conn(0x7fb5540ce9b0 msgr2=0x7fb5540ca290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:55.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.258+0000 7fb559505640 1 -- 172.21.15.102:0/3598179844 shutdown_connections 2023-10-14T09:37:55.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.258+0000 7fb559505640 1 -- 172.21.15.102:0/3598179844 wait complete. 2023-10-14T09:37:55.279 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T09:37:55.492 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.490+0000 7f4b8c9d0640 1 Processor -- start 2023-10-14T09:37:55.492 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.490+0000 7f4b8c9d0640 1 -- start start 2023-10-14T09:37:55.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.492+0000 7f4b8c9d0640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4b8815ad70 0x7f4b88069da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:55.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.492+0000 7f4b8c9d0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4b880c9ca0 0x7f4b8806a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:55.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.492+0000 7f4b8c9d0640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f4b880ca3b0 0x7f4b880ca840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:55.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.492+0000 7f4b8c9d0640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b880cad80 con 0x7f4b880c9ca0 2023-10-14T09:37:55.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.492+0000 7f4b8c9d0640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b880cb030 con 0x7f4b880ca3b0 2023-10-14T09:37:55.495 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.492+0000 7f4b8c9d0640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b880c91c0 con 0x7f4b8815ad70 2023-10-14T09:37:55.495 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.492+0000 7f4b7ffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4b880c9ca0 0x7f4b8806a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:55.495 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.492+0000 7f4b7ffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4b880c9ca0 0x7f4b8806a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39924/0 (socket says 172.21.15.102:39924) 2023-10-14T09:37:55.495 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.492+0000 7f4b7ffff640 1 -- 172.21.15.102:0/946918474 learned_addr learned my addr 172.21.15.102:0/946918474 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:55.497 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.492+0000 7f4b86d9d640 1 --2- 172.21.15.102:0/946918474 >> v2:172.21.15.129:3300/0 conn(0x7f4b880ca3b0 0x7f4b880ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:55.497 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.493+0000 7f4b8659c640 1 --2- 172.21.15.102:0/946918474 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4b8815ad70 0x7f4b88069da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:55.497 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.493+0000 7f4b7ffff640 1 -- 172.21.15.102:0/946918474 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4b8815ad70 msgr2=0x7f4b88069da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:55.497 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.493+0000 7f4b7ffff640 1 --2- 172.21.15.102:0/946918474 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4b8815ad70 0x7f4b88069da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:55.498 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.493+0000 7f4b7ffff640 1 -- 172.21.15.102:0/946918474 >> v2:172.21.15.129:3300/0 conn(0x7f4b880ca3b0 msgr2=0x7f4b880ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:55.498 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.493+0000 7f4b7ffff640 1 --2- 172.21.15.102:0/946918474 >> v2:172.21.15.129:3300/0 conn(0x7f4b880ca3b0 0x7f4b880ca840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:55.498 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.493+0000 7f4b7ffff640 1 -- 172.21.15.102:0/946918474 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b880c94a0 con 0x7f4b880c9ca0 2023-10-14T09:37:55.498 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.493+0000 7f4b8659c640 1 --2- 172.21.15.102:0/946918474 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4b8815ad70 0x7f4b88069da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:55.498 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.494+0000 7f4b7ffff640 1 --2- 172.21.15.102:0/946918474 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b880c9ca0 0x7f4b8806a2e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4b880cf820 tx=0x7f4b7002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0275a6f6ea9a28d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:55.499 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.494+0000 7f4b85d9b640 1 -- 172.21.15.102:0/946918474 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b70031860 con 0x7f4b880c9ca0 2023-10-14T09:37:55.499 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.494+0000 7f4b85d9b640 1 -- 172.21.15.102:0/946918474 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b700319c0 con 0x7f4b880c9ca0 2023-10-14T09:37:55.499 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.494+0000 7f4b85d9b640 1 -- 172.21.15.102:0/946918474 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b70031d50 con 0x7f4b880c9ca0 2023-10-14T09:37:55.499 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.495+0000 7f4b8c9d0640 1 -- 172.21.15.102:0/946918474 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b880c9ca0 msgr2=0x7f4b8806a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:55.499 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.495+0000 7f4b8c9d0640 1 --2- 172.21.15.102:0/946918474 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b880c9ca0 0x7f4b8806a2e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4b880cf820 tx=0x7f4b7002b900 comp rx=0 tx=0).stop 2023-10-14T09:37:55.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.495+0000 7f4b8c9d0640 1 -- 172.21.15.102:0/946918474 shutdown_connections 2023-10-14T09:37:55.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.495+0000 7f4b8c9d0640 1 --2- 172.21.15.102:0/946918474 >> v2:172.21.15.129:3300/0 conn(0x7f4b880ca3b0 0x7f4b880ca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:55.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.495+0000 7f4b8c9d0640 1 --2- 172.21.15.102:0/946918474 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b880c9ca0 0x7f4b8806a2e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:55.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.495+0000 7f4b8c9d0640 1 --2- 172.21.15.102:0/946918474 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4b8815ad70 0x7f4b88069da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:55.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.495+0000 7f4b8c9d0640 1 -- 172.21.15.102:0/946918474 >> 172.21.15.102:0/946918474 conn(0x7f4b880ce9b0 msgr2=0x7f4b880cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:55.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.495+0000 7f4b8c9d0640 1 -- 172.21.15.102:0/946918474 shutdown_connections 2023-10-14T09:37:55.501 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.495+0000 7f4b8c9d0640 1 -- 172.21.15.102:0/946918474 wait complete. 2023-10-14T09:37:55.503 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.497+0000 7f4b8c9d0640 1 Processor -- start 2023-10-14T09:37:55.503 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.497+0000 7f4b8c9d0640 1 -- start start 2023-10-14T09:37:55.503 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.498+0000 7f4b8c9d0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b880c9ca0 0x7f4b881f1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:55.503 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.498+0000 7f4b8c9d0640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4b880ca3b0 0x7f4b880ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:55.503 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.498+0000 7f4b8c9d0640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4b8815ad70 0x7f4b880acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:55.503 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.498+0000 7f4b8c9d0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b880cc8f0 con 0x7f4b880c9ca0 2023-10-14T09:37:55.504 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.498+0000 7f4b8c9d0640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b880ce030 con 0x7f4b8815ad70 2023-10-14T09:37:55.504 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.498+0000 7f4b8c9d0640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b880aed20 con 0x7f4b880ca3b0 2023-10-14T09:37:55.504 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.498+0000 7f4b8659c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b880c9ca0 0x7f4b881f1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:55.504 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.498+0000 7f4b8659c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b880c9ca0 0x7f4b881f1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39930/0 (socket says 172.21.15.102:39930) 2023-10-14T09:37:55.504 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.498+0000 7f4b8659c640 1 -- 172.21.15.102:0/226703971 learned_addr learned my addr 172.21.15.102:0/226703971 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:55.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.499+0000 7f4b8659c640 1 -- 172.21.15.102:0/226703971 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4b880ca3b0 msgr2=0x7f4b880ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:55.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.499+0000 7f4b8659c640 1 --2- 172.21.15.102:0/226703971 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4b880ca3b0 0x7f4b880ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:55.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.499+0000 7f4b8659c640 1 -- 172.21.15.102:0/226703971 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4b8815ad70 msgr2=0x7f4b880acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:55.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.499+0000 7f4b8659c640 1 --2- 172.21.15.102:0/226703971 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4b8815ad70 0x7f4b880acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:55.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.499+0000 7f4b8659c640 1 -- 172.21.15.102:0/226703971 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b700094d0 con 0x7f4b880c9ca0 2023-10-14T09:37:55.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.499+0000 7f4b8659c640 1 --2- 172.21.15.102:0/226703971 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b880c9ca0 0x7f4b881f1ab0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800c7f0 tx=0x7f4b7800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:55.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.499+0000 7f4b7effd640 1 -- 172.21.15.102:0/226703971 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b78007820 con 0x7f4b880c9ca0 2023-10-14T09:37:55.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.499+0000 7f4b7effd640 1 -- 172.21.15.102:0/226703971 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b78007980 con 0x7f4b880c9ca0 2023-10-14T09:37:55.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.499+0000 7f4b7effd640 1 -- 172.21.15.102:0/226703971 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b78007cf0 con 0x7f4b880c9ca0 2023-10-14T09:37:55.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.499+0000 7f4b8c9d0640 1 -- 172.21.15.102:0/226703971 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b880af000 con 0x7f4b880c9ca0 2023-10-14T09:37:55.507 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.499+0000 7f4b8c9d0640 1 -- 172.21.15.102:0/226703971 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b880cc580 con 0x7f4b880c9ca0 2023-10-14T09:37:55.507 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.500+0000 7f4b8c9d0640 1 -- 172.21.15.102:0/226703971 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b8804e160 con 0x7f4b880c9ca0 2023-10-14T09:37:55.508 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.501+0000 7f4b7effd640 1 -- 172.21.15.102:0/226703971 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4b780113f0 con 0x7f4b880c9ca0 2023-10-14T09:37:55.508 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.502+0000 7f4b7effd640 1 --2- 172.21.15.102:0/226703971 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4b6806ae70 0x7f4b6806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:55.508 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.502+0000 7f4b7effd640 1 -- 172.21.15.102:0/226703971 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b780899c0 con 0x7f4b880c9ca0 2023-10-14T09:37:55.508 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.503+0000 7f4b7ffff640 1 --2- 172.21.15.102:0/226703971 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4b6806ae70 0x7f4b6806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:55.508 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.503+0000 7f4b7ffff640 1 --2- 172.21.15.102:0/226703971 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4b6806ae70 0x7f4b6806d330 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4b70036000 tx=0x7f4b70030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:55.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.507+0000 7f4b7effd640 1 -- 172.21.15.102:0/226703971 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4b780549d0 con 0x7f4b880c9ca0 2023-10-14T09:37:55.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.689+0000 7f4b8c9d0640 1 -- 172.21.15.102:0/226703971 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4b880ced90 con 0x7f4b880c9ca0 2023-10-14T09:37:55.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.690+0000 7f4b7effd640 1 -- 172.21.15.102:0/226703971 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4b7801f0a0 con 0x7f4b880c9ca0 2023-10-14T09:37:55.692 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2023-10-14T09:37:55.695 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.693+0000 7f4b8c9d0640 1 -- 172.21.15.102:0/226703971 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4b6806ae70 msgr2=0x7f4b6806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:55.695 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.693+0000 7f4b8c9d0640 1 --2- 172.21.15.102:0/226703971 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4b6806ae70 0x7f4b6806d330 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4b70036000 tx=0x7f4b70030000 comp rx=0 tx=0).stop 2023-10-14T09:37:55.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.693+0000 7f4b8c9d0640 1 -- 172.21.15.102:0/226703971 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b880c9ca0 msgr2=0x7f4b881f1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:55.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.693+0000 7f4b8c9d0640 1 --2- 172.21.15.102:0/226703971 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b880c9ca0 0x7f4b881f1ab0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800c7f0 tx=0x7f4b7800ccb0 comp rx=0 tx=0).stop 2023-10-14T09:37:55.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.693+0000 7f4b8c9d0640 1 -- 172.21.15.102:0/226703971 shutdown_connections 2023-10-14T09:37:55.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.693+0000 7f4b8c9d0640 1 --2- 172.21.15.102:0/226703971 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4b6806ae70 0x7f4b6806d330 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:55.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.693+0000 7f4b8c9d0640 1 --2- 172.21.15.102:0/226703971 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4b8815ad70 0x7f4b880acdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:55.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.693+0000 7f4b8c9d0640 1 --2- 172.21.15.102:0/226703971 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4b880ca3b0 0x7f4b880ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:55.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.693+0000 7f4b8c9d0640 1 --2- 172.21.15.102:0/226703971 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b880c9ca0 0x7f4b881f1ab0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:55.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.693+0000 7f4b8c9d0640 1 -- 172.21.15.102:0/226703971 >> 172.21.15.102:0/226703971 conn(0x7f4b880ce9b0 msgr2=0x7f4b88069fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:55.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.693+0000 7f4b8c9d0640 1 -- 172.21.15.102:0/226703971 shutdown_connections 2023-10-14T09:37:55.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.693+0000 7f4b8c9d0640 1 -- 172.21.15.102:0/226703971 wait complete. 2023-10-14T09:37:55.714 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:37:55.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.923+0000 7f90789a8640 1 Processor -- start 2023-10-14T09:37:55.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.923+0000 7f90789a8640 1 -- start start 2023-10-14T09:37:55.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.924+0000 7f90789a8640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f90740ad970 0x7f90740cca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:55.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.924+0000 7f90789a8640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90740ccfb0 0x7f90740cd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:55.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.924+0000 7f90789a8640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f907415b9d0 con 0x7f907406c040 2023-10-14T09:37:55.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.924+0000 7f90789a8640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f907415bcb0 con 0x7f90740ad970 2023-10-14T09:37:55.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.924+0000 7f90789a8640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f907415bf90 con 0x7f90740ccfb0 2023-10-14T09:37:55.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.925+0000 7f907259c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f90740ad970 0x7f90740cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:55.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.925+0000 7f907259c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f90740ad970 0x7f90740cca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39932/0 (socket says 172.21.15.102:39932) 2023-10-14T09:37:55.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.925+0000 7f907259c640 1 -- 172.21.15.102:0/3417434858 learned_addr learned my addr 172.21.15.102:0/3417434858 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:55.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.925+0000 7f9072d9d640 1 --1- 172.21.15.102:0/3417434858 >> v1:172.21.15.102:6789/0 conn(0x7f907406c040 0x7f907406c420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:59802/0 (socket says 172.21.15.102:59802) 2023-10-14T09:37:55.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.925+0000 7f907359e640 1 --2- 172.21.15.102:0/3417434858 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90740ccfb0 0x7f90740cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:55.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.925+0000 7f907259c640 1 -- 172.21.15.102:0/3417434858 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90740ccfb0 msgr2=0x7f90740cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:55.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.925+0000 7f907259c640 1 --2- 172.21.15.102:0/3417434858 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90740ccfb0 0x7f90740cd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:55.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.925+0000 7f907259c640 1 -- 172.21.15.102:0/3417434858 >> v1:172.21.15.102:6789/0 conn(0x7f907406c040 legacy=0x7f907406c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:55.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.925+0000 7f907259c640 1 -- 172.21.15.102:0/3417434858 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90740cc270 con 0x7f90740ad970 2023-10-14T09:37:55.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.925+0000 7f9071d9b640 1 -- 172.21.15.102:0/3417434858 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2415826802 0 0) 0x7f907415b9d0 con 0x7f907406c040 2023-10-14T09:37:55.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.927+0000 7f907259c640 1 --2- 172.21.15.102:0/3417434858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90740ad970 0x7f90740cca70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9068009870 tx=0x7f906802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a900fb0c5ac27003 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:55.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.927+0000 7f9071d9b640 1 -- 172.21.15.102:0/3417434858 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9068030840 con 0x7f90740ad970 2023-10-14T09:37:55.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.927+0000 7f9071d9b640 1 -- 172.21.15.102:0/3417434858 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90680309a0 con 0x7f90740ad970 2023-10-14T09:37:55.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.927+0000 7f9071d9b640 1 -- 172.21.15.102:0/3417434858 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9068030d30 con 0x7f90740ad970 2023-10-14T09:37:55.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.927+0000 7f90789a8640 1 -- 172.21.15.102:0/3417434858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90740ad970 msgr2=0x7f90740cca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:55.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.927+0000 7f90789a8640 1 --2- 172.21.15.102:0/3417434858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90740ad970 0x7f90740cca70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9068009870 tx=0x7f906802b980 comp rx=0 tx=0).stop 2023-10-14T09:37:55.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.927+0000 7f90789a8640 1 -- 172.21.15.102:0/3417434858 shutdown_connections 2023-10-14T09:37:55.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.928+0000 7f90789a8640 1 --2- 172.21.15.102:0/3417434858 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90740ccfb0 0x7f90740cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:55.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.928+0000 7f90789a8640 1 --2- 172.21.15.102:0/3417434858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90740ad970 0x7f90740cca70 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:55.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.928+0000 7f90789a8640 1 -- 172.21.15.102:0/3417434858 >> 172.21.15.102:0/3417434858 conn(0x7f90740ce6a0 msgr2=0x7f90740ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:55.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.928+0000 7f90789a8640 1 -- 172.21.15.102:0/3417434858 shutdown_connections 2023-10-14T09:37:55.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.928+0000 7f90789a8640 1 -- 172.21.15.102:0/3417434858 wait complete. 2023-10-14T09:37:55.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.929+0000 7f90789a8640 1 Processor -- start 2023-10-14T09:37:55.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.929+0000 7f90789a8640 1 -- start start 2023-10-14T09:37:55.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.930+0000 7f90789a8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f907406c040 0x7f907414c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:55.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.930+0000 7f90789a8640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90740ad970 0x7f90740c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:55.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.930+0000 7f90789a8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90740ccfb0 0x7f90740ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:55.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.930+0000 7f90789a8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90740c3640 con 0x7f907406c040 2023-10-14T09:37:55.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.930+0000 7f90789a8640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907414cf10 con 0x7f90740ccfb0 2023-10-14T09:37:55.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.930+0000 7f90789a8640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90740c6f90 con 0x7f90740ad970 2023-10-14T09:37:55.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.931+0000 7f9072d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f907406c040 0x7f907414c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:55.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.931+0000 7f9072d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f907406c040 0x7f907414c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39948/0 (socket says 172.21.15.102:39948) 2023-10-14T09:37:55.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.931+0000 7f9072d9d640 1 -- 172.21.15.102:0/2017565107 learned_addr learned my addr 172.21.15.102:0/2017565107 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:55.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.931+0000 7f907359e640 1 --2- 172.21.15.102:0/2017565107 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90740ccfb0 0x7f90740ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:55.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.931+0000 7f9072d9d640 1 -- 172.21.15.102:0/2017565107 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90740ad970 msgr2=0x7f90740c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:55.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.931+0000 7f907259c640 1 --2- 172.21.15.102:0/2017565107 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90740ad970 0x7f90740c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:55.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.931+0000 7f9072d9d640 1 --2- 172.21.15.102:0/2017565107 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90740ad970 0x7f90740c7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:55.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.931+0000 7f9072d9d640 1 -- 172.21.15.102:0/2017565107 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90740ccfb0 msgr2=0x7f90740ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:55.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.931+0000 7f9072d9d640 1 --2- 172.21.15.102:0/2017565107 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90740ccfb0 0x7f90740ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:55.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.931+0000 7f9072d9d640 1 -- 172.21.15.102:0/2017565107 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90680094d0 con 0x7f907406c040 2023-10-14T09:37:55.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.932+0000 7f9072d9d640 1 --2- 172.21.15.102:0/2017565107 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f907406c040 0x7f907414c9d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f906400c4d0 tx=0x7f906400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:55.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.932+0000 7f905b7fe640 1 -- 172.21.15.102:0/2017565107 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90640074e0 con 0x7f907406c040 2023-10-14T09:37:55.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.932+0000 7f905b7fe640 1 -- 172.21.15.102:0/2017565107 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9064007660 con 0x7f907406c040 2023-10-14T09:37:55.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.932+0000 7f905b7fe640 1 -- 172.21.15.102:0/2017565107 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9064004a20 con 0x7f907406c040 2023-10-14T09:37:55.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.932+0000 7f90789a8640 1 -- 172.21.15.102:0/2017565107 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90740c66f0 con 0x7f907406c040 2023-10-14T09:37:55.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.932+0000 7f90789a8640 1 -- 172.21.15.102:0/2017565107 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90740c6cb0 con 0x7f907406c040 2023-10-14T09:37:55.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.933+0000 7f90789a8640 1 -- 172.21.15.102:0/2017565107 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f907406b330 con 0x7f907406c040 2023-10-14T09:37:55.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.934+0000 7f905b7fe640 1 -- 172.21.15.102:0/2017565107 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9064004b80 con 0x7f907406c040 2023-10-14T09:37:55.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.935+0000 7f905b7fe640 1 --2- 172.21.15.102:0/2017565107 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f906006aea0 0x7f906006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:55.941 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.935+0000 7f905b7fe640 1 -- 172.21.15.102:0/2017565107 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9064088850 con 0x7f907406c040 2023-10-14T09:37:55.941 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.935+0000 7f907259c640 1 --2- 172.21.15.102:0/2017565107 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f906006aea0 0x7f906006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:55.941 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.936+0000 7f907259c640 1 --2- 172.21.15.102:0/2017565107 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f906006aea0 0x7f906006d360 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9068036000 tx=0x7f906803b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:55.941 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:55.939+0000 7f905b7fe640 1 -- 172.21.15.102:0/2017565107 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9064053870 con 0x7f907406c040 2023-10-14T09:37:56.133 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.132+0000 7f90789a8640 1 -- 172.21.15.102:0/2017565107 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f907404e9b0 con 0x7f907406c040 2023-10-14T09:37:56.136 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.135+0000 7f905b7fe640 1 -- 172.21.15.102:0/2017565107 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f9064018070 con 0x7f907406c040 2023-10-14T09:37:56.137 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:37:56.137 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":22,"fsid":"8a6cd69d-7f5b-4f2a-806a-0176c10aed50","created":"2023-10-14T09:36:56.745172+0000","modified":"2023-10-14T09:37:22.712469+0000","last_up_change":"2023-10-14T09:37:09.791473+0000","last_in_change":"2023-10-14T09:37:00.547186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:37:09.952407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:37:19.560925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:37:20.363385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e5aef8f3-878f-482b-b522-9a5b958b90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6801","nonce":1727250718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6803","nonce":1727250718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6807","nonce":1727250718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6805","nonce":1727250718}]},"public_addr":"172.21.15.102:6801/1727250718","cluster_addr":"172.21.15.102:6803/1727250718","heartbeat_back_addr":"172.21.15.102:6807/1727250718","heartbeat_front_addr":"172.21.15.102:6805/1727250718","state":["exists","up"]},{"osd":1,"uuid":"4a8cf50e-387b-4d47-9588-bd22e375a9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6809","nonce":1095651107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6811","nonce":1095651107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6815","nonce":1095651107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6813","nonce":1095651107}]},"public_addr":"172.21.15.102:6809/1095651107","cluster_addr":"172.21.15.102:6811/1095651107","heartbeat_back_addr":"172.21.15.102:6815/1095651107","heartbeat_front_addr":"172.21.15.102:6813/1095651107","state":["exists","up"]},{"osd":2,"uuid":"009ef55f-8a63-4219-bacd-d7c7b4500867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6820","nonce":2198222556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6825","nonce":2198222556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6831","nonce":2198222556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6829","nonce":2198222556}]},"public_addr":"172.21.15.102:6820/2198222556","cluster_addr":"172.21.15.102:6825/2198222556","heartbeat_back_addr":"172.21.15.102:6831/2198222556","heartbeat_front_addr":"172.21.15.102:6829/2198222556","state":["exists","up"]},{"osd":3,"uuid":"f2110eae-2ff9-4ed9-93d6-bd2361618211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6818","nonce":654726740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6821","nonce":654726740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6827","nonce":654726740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6823","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6824","nonce":654726740}]},"public_addr":"172.21.15.102:6818/654726740","cluster_addr":"172.21.15.102:6821/654726740","heartbeat_back_addr":"172.21.15.102:6827/654726740","heartbeat_front_addr":"172.21.15.102:6824/654726740","state":["exists","up"]},{"osd":4,"uuid":"33f1ae34-3100-40f7-9cb8-0eca2b358693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6817","nonce":507586170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6819","nonce":507586170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6823","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6825","nonce":507586170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6821","nonce":507586170}]},"public_addr":"172.21.15.129:6817/507586170","cluster_addr":"172.21.15.129:6819/507586170","heartbeat_back_addr":"172.21.15.129:6825/507586170","heartbeat_front_addr":"172.21.15.129:6821/507586170","state":["exists","up"]},{"osd":5,"uuid":"fab2fc62-3f3e-450d-93e0-770f39e80710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6801","nonce":1913451073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6803","nonce":1913451073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6807","nonce":1913451073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6805","nonce":1913451073}]},"public_addr":"172.21.15.129:6801/1913451073","cluster_addr":"172.21.15.129:6803/1913451073","heartbeat_back_addr":"172.21.15.129:6807/1913451073","heartbeat_front_addr":"172.21.15.129:6805/1913451073","state":["exists","up"]},{"osd":6,"uuid":"d7cc1d69-92e7-4253-a127-cfc0444a4809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6809","nonce":2853291511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6811","nonce":2853291511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6815","nonce":2853291511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6813","nonce":2853291511}]},"public_addr":"172.21.15.129:6809/2853291511","cluster_addr":"172.21.15.129:6811/2853291511","heartbeat_back_addr":"172.21.15.129:6815/2853291511","heartbeat_front_addr":"172.21.15.129:6813/2853291511","state":["exists","up"]},{"osd":7,"uuid":"1e403de1-09e2-4370-b9a7-e790ac44bbee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6824","nonce":2933886914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6827","nonce":2933886914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6831","nonce":2933886914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6829","nonce":2933886914}]},"public_addr":"172.21.15.129:6824/2933886914","cluster_addr":"172.21.15.129:6827/2933886914","heartbeat_back_addr":"172.21.15.129:6831/2933886914","heartbeat_front_addr":"172.21.15.129:6829/2933886914","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.849661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.868113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.933488+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.891794+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.901861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.858750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.911712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.996765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:37:56.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.137+0000 7f90789a8640 1 -- 172.21.15.102:0/2017565107 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f906006aea0 msgr2=0x7f906006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:56.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.137+0000 7f90789a8640 1 --2- 172.21.15.102:0/2017565107 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f906006aea0 0x7f906006d360 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9068036000 tx=0x7f906803b040 comp rx=0 tx=0).stop 2023-10-14T09:37:56.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.137+0000 7f90789a8640 1 -- 172.21.15.102:0/2017565107 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f907406c040 msgr2=0x7f907414c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:56.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.137+0000 7f90789a8640 1 --2- 172.21.15.102:0/2017565107 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f907406c040 0x7f907414c9d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f906400c4d0 tx=0x7f906400c990 comp rx=0 tx=0).stop 2023-10-14T09:37:56.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.137+0000 7f90789a8640 1 -- 172.21.15.102:0/2017565107 shutdown_connections 2023-10-14T09:37:56.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.137+0000 7f90789a8640 1 --2- 172.21.15.102:0/2017565107 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f906006aea0 0x7f906006d360 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:56.141 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.137+0000 7f90789a8640 1 --2- 172.21.15.102:0/2017565107 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90740ccfb0 0x7f90740ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:56.141 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.137+0000 7f90789a8640 1 --2- 172.21.15.102:0/2017565107 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90740ad970 0x7f90740c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:56.141 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.137+0000 7f90789a8640 1 --2- 172.21.15.102:0/2017565107 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f907406c040 0x7f907414c9d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:56.141 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.137+0000 7f90789a8640 1 -- 172.21.15.102:0/2017565107 >> 172.21.15.102:0/2017565107 conn(0x7f90740ce6a0 msgr2=0x7f90740b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:56.141 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.137+0000 7f90789a8640 1 -- 172.21.15.102:0/2017565107 shutdown_connections 2023-10-14T09:37:56.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.138+0000 7f90789a8640 1 -- 172.21.15.102:0/2017565107 wait complete. 2023-10-14T09:37:56.159 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T09:37:09.952407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T09:37:19.560925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T09:37:20.363385+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T09:37:56.159 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T09:37:56.371 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.369+0000 7f37f54b4640 1 Processor -- start 2023-10-14T09:37:56.371 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.369+0000 7f37f54b4640 1 -- start start 2023-10-14T09:37:56.372 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.370+0000 7f37f54b4640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f37f015d330 0x7f37f01618b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:56.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.370+0000 7f37f54b4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f37f00661c0 0x7f37f00ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:56.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.370+0000 7f37f54b4640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37f00d0890 con 0x7f37f006c7d0 2023-10-14T09:37:56.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.370+0000 7f37f54b4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37f006b1e0 con 0x7f37f00661c0 2023-10-14T09:37:56.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.370+0000 7f37f54b4640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f00d05b0 con 0x7f37f015d330 2023-10-14T09:37:56.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.371+0000 7f37ef7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f37f00661c0 0x7f37f00ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:56.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.371+0000 7f37ef7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f37f00661c0 0x7f37f00ce9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39950/0 (socket says 172.21.15.102:39950) 2023-10-14T09:37:56.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.371+0000 7f37ef7fe640 1 -- 172.21.15.102:0/3302736695 learned_addr learned my addr 172.21.15.102:0/3302736695 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:56.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.371+0000 7f37eeffd640 1 --2- 172.21.15.102:0/3302736695 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f37f015d330 0x7f37f01618b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:56.375 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.371+0000 7f37ef7fe640 1 -- 172.21.15.102:0/3302736695 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f37f015d330 msgr2=0x7f37f01618b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:56.375 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.371+0000 7f37ef7fe640 1 --2- 172.21.15.102:0/3302736695 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f37f015d330 0x7f37f01618b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:56.375 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.371+0000 7f37ef7fe640 1 -- 172.21.15.102:0/3302736695 >> v1:172.21.15.129:6789/0 conn(0x7f37f006c7d0 legacy=0x7f37f0065ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:56.375 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.371+0000 7f37ef7fe640 1 -- 172.21.15.102:0/3302736695 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f0160dd0 con 0x7f37f00661c0 2023-10-14T09:37:56.376 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.371+0000 7f37eeffd640 1 --2- 172.21.15.102:0/3302736695 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f37f015d330 0x7f37f01618b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:37:56.376 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.373+0000 7f37ef7fe640 1 --2- 172.21.15.102:0/3302736695 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37f00661c0 0x7f37f00ce9b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f37e8009870 tx=0x7f37e802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c6e19804ee1e886 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:56.376 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.373+0000 7f37edffb640 1 -- 172.21.15.102:0/3302736695 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e8031640 con 0x7f37f00661c0 2023-10-14T09:37:56.376 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.373+0000 7f37edffb640 1 -- 172.21.15.102:0/3302736695 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e80317a0 con 0x7f37f00661c0 2023-10-14T09:37:56.376 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.373+0000 7f37edffb640 1 -- 172.21.15.102:0/3302736695 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e8031b30 con 0x7f37f00661c0 2023-10-14T09:37:56.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.374+0000 7f37f54b4640 1 -- 172.21.15.102:0/3302736695 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37f00661c0 msgr2=0x7f37f00ce9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:56.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.374+0000 7f37f54b4640 1 --2- 172.21.15.102:0/3302736695 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37f00661c0 0x7f37f00ce9b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f37e8009870 tx=0x7f37e802b8f0 comp rx=0 tx=0).stop 2023-10-14T09:37:56.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.374+0000 7f37f54b4640 1 -- 172.21.15.102:0/3302736695 shutdown_connections 2023-10-14T09:37:56.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.374+0000 7f37f54b4640 1 --2- 172.21.15.102:0/3302736695 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37f00661c0 0x7f37f00ce9b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:56.379 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.374+0000 7f37f54b4640 1 --2- 172.21.15.102:0/3302736695 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f37f015d330 0x7f37f01618b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:56.379 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.374+0000 7f37f54b4640 1 -- 172.21.15.102:0/3302736695 >> 172.21.15.102:0/3302736695 conn(0x7f37f00d0ab0 msgr2=0x7f37f00d0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:56.379 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.374+0000 7f37f54b4640 1 -- 172.21.15.102:0/3302736695 shutdown_connections 2023-10-14T09:37:56.379 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.374+0000 7f37f54b4640 1 -- 172.21.15.102:0/3302736695 wait complete. 2023-10-14T09:37:56.379 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.376+0000 7f37f54b4640 1 Processor -- start 2023-10-14T09:37:56.379 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.376+0000 7f37f54b4640 1 -- start start 2023-10-14T09:37:56.381 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.377+0000 7f37f54b4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37f00661c0 0x7f37f014bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:56.381 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.377+0000 7f37f54b4640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f37f006c7d0 0x7f37f00cb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:56.381 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.377+0000 7f37f54b4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f37f015d330 0x7f37f00cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:56.382 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.377+0000 7f37f54b4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f014c440 con 0x7f37f00661c0 2023-10-14T09:37:56.382 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.377+0000 7f37f54b4640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f014c9b0 con 0x7f37f015d330 2023-10-14T09:37:56.382 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.377+0000 7f37f54b4640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f014cc90 con 0x7f37f006c7d0 2023-10-14T09:37:56.382 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.377+0000 7f37eeffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37f00661c0 0x7f37f014bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:56.382 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.377+0000 7f37eeffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37f00661c0 0x7f37f014bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39960/0 (socket says 172.21.15.102:39960) 2023-10-14T09:37:56.383 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.377+0000 7f37eeffd640 1 -- 172.21.15.102:0/1086608711 learned_addr learned my addr 172.21.15.102:0/1086608711 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:56.383 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.377+0000 7f37eeffd640 1 -- 172.21.15.102:0/1086608711 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f37f006c7d0 msgr2=0x7f37f00cb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:56.383 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.377+0000 7f37eeffd640 1 --2- 172.21.15.102:0/1086608711 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f37f006c7d0 0x7f37f00cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:56.383 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.377+0000 7f37eeffd640 1 -- 172.21.15.102:0/1086608711 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f37f015d330 msgr2=0x7f37f00cbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:56.383 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.377+0000 7f37eeffd640 1 --2- 172.21.15.102:0/1086608711 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f37f015d330 0x7f37f00cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:56.384 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.377+0000 7f37eeffd640 1 -- 172.21.15.102:0/1086608711 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e80094d0 con 0x7f37f00661c0 2023-10-14T09:37:56.384 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.378+0000 7f37eeffd640 1 --2- 172.21.15.102:0/1086608711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37f00661c0 0x7f37f014bf00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f37e0009fc0 tx=0x7f37e000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:56.384 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.378+0000 7f37e77fe640 1 -- 172.21.15.102:0/1086608711 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e0003b90 con 0x7f37f00661c0 2023-10-14T09:37:56.384 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.378+0000 7f37e77fe640 1 -- 172.21.15.102:0/1086608711 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e000f040 con 0x7f37f00661c0 2023-10-14T09:37:56.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.378+0000 7f37e77fe640 1 -- 172.21.15.102:0/1086608711 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e0004030 con 0x7f37f00661c0 2023-10-14T09:37:56.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.378+0000 7f37f54b4640 1 -- 172.21.15.102:0/1086608711 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37f014cf70 con 0x7f37f00661c0 2023-10-14T09:37:56.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.378+0000 7f37f54b4640 1 -- 172.21.15.102:0/1086608711 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37f014d770 con 0x7f37f00661c0 2023-10-14T09:37:56.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.379+0000 7f37f54b4640 1 -- 172.21.15.102:0/1086608711 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37f014d9e0 con 0x7f37f00661c0 2023-10-14T09:37:56.386 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.380+0000 7f37e77fe640 1 -- 172.21.15.102:0/1086608711 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f37e0004190 con 0x7f37f00661c0 2023-10-14T09:37:56.386 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.381+0000 7f37e77fe640 1 --2- 172.21.15.102:0/1086608711 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f37d006ae70 0x7f37d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:56.387 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.381+0000 7f37e77fe640 1 -- 172.21.15.102:0/1086608711 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f37e0089860 con 0x7f37f00661c0 2023-10-14T09:37:56.387 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.381+0000 7f37ee7fc640 1 --2- 172.21.15.102:0/1086608711 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f37d006ae70 0x7f37d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:56.387 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.382+0000 7f37ee7fc640 1 --2- 172.21.15.102:0/1086608711 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f37d006ae70 0x7f37d006d330 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f37d8000f60 tx=0x7f37d80079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:56.388 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.385+0000 7f37e77fe640 1 -- 172.21.15.102:0/1086608711 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f37e0054a50 con 0x7f37f00661c0 2023-10-14T09:37:56.576 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.574+0000 7f37f54b4640 1 -- 172.21.15.102:0/1086608711 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f37f004e160 con 0x7f37f00661c0 2023-10-14T09:37:56.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.575+0000 7f37e77fe640 1 -- 172.21.15.102:0/1086608711 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f37e001a0a0 con 0x7f37f00661c0 2023-10-14T09:37:56.577 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2023-10-14T09:37:56.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.577+0000 7f37f54b4640 1 -- 172.21.15.102:0/1086608711 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f37d006ae70 msgr2=0x7f37d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:56.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.577+0000 7f37f54b4640 1 --2- 172.21.15.102:0/1086608711 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f37d006ae70 0x7f37d006d330 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f37d8000f60 tx=0x7f37d80079b0 comp rx=0 tx=0).stop 2023-10-14T09:37:56.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.577+0000 7f37f54b4640 1 -- 172.21.15.102:0/1086608711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37f00661c0 msgr2=0x7f37f014bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:56.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.577+0000 7f37f54b4640 1 --2- 172.21.15.102:0/1086608711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37f00661c0 0x7f37f014bf00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f37e0009fc0 tx=0x7f37e000d560 comp rx=0 tx=0).stop 2023-10-14T09:37:56.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.578+0000 7f37f54b4640 1 -- 172.21.15.102:0/1086608711 shutdown_connections 2023-10-14T09:37:56.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.578+0000 7f37f54b4640 1 --2- 172.21.15.102:0/1086608711 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f37d006ae70 0x7f37d006d330 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:56.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.578+0000 7f37f54b4640 1 --2- 172.21.15.102:0/1086608711 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f37f015d330 0x7f37f00cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:56.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.578+0000 7f37f54b4640 1 --2- 172.21.15.102:0/1086608711 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f37f006c7d0 0x7f37f00cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:56.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.578+0000 7f37f54b4640 1 --2- 172.21.15.102:0/1086608711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37f00661c0 0x7f37f014bf00 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:56.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.578+0000 7f37f54b4640 1 -- 172.21.15.102:0/1086608711 >> 172.21.15.102:0/1086608711 conn(0x7f37f00d0ab0 msgr2=0x7f37f00cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:56.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.578+0000 7f37f54b4640 1 -- 172.21.15.102:0/1086608711 shutdown_connections 2023-10-14T09:37:56.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.578+0000 7f37f54b4640 1 -- 172.21.15.102:0/1086608711 wait complete. 2023-10-14T09:37:56.599 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T09:37:56.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.814+0000 7f4c23fc9640 1 Processor -- start 2023-10-14T09:37:56.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.814+0000 7f4c23fc9640 1 -- start start 2023-10-14T09:37:56.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.815+0000 7f4c23fc9640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4c1c159ab0 0x7f4c1c0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:56.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.815+0000 7f4c23fc9640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f4c1c159e90 0x7f4c1c06fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:56.818 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.816+0000 7f4c23fc9640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c1c0cd1f0 con 0x7f4c1c06c140 2023-10-14T09:37:56.818 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.816+0000 7f4c23fc9640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c1c15d890 con 0x7f4c1c159e90 2023-10-14T09:37:56.818 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.816+0000 7f4c23fc9640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c0cd4d0 con 0x7f4c1c159ab0 2023-10-14T09:37:56.819 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.816+0000 7f4c21564640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f4c1c159e90 0x7f4c1c06fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:56.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.816+0000 7f4c21d65640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4c1c159ab0 0x7f4c1c0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:56.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.816+0000 7f4c21d65640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4c1c159ab0 0x7f4c1c0ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.102:36918/0 (socket says 172.21.15.102:36918) 2023-10-14T09:37:56.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.816+0000 7f4c21d65640 1 -- 172.21.15.102:0/3196918811 learned_addr learned my addr 172.21.15.102:0/3196918811 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:56.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.816+0000 7f4c21564640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f4c1c159e90 0x7f4c1c06fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.102:52790/0 (socket says 172.21.15.102:52790) 2023-10-14T09:37:56.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.817+0000 7f4c21d65640 1 -- 172.21.15.102:0/3196918811 >> v2:172.21.15.129:3300/0 conn(0x7f4c1c159e90 msgr2=0x7f4c1c06fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:56.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.817+0000 7f4c21d65640 1 --2- 172.21.15.102:0/3196918811 >> v2:172.21.15.129:3300/0 conn(0x7f4c1c159e90 0x7f4c1c06fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:56.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.817+0000 7f4c21d65640 1 -- 172.21.15.102:0/3196918811 >> v1:172.21.15.129:6789/0 conn(0x7f4c1c06c140 legacy=0x7f4c1c15dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:56.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.817+0000 7f4c21d65640 1 -- 172.21.15.102:0/3196918811 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1c0cd7b0 con 0x7f4c1c159ab0 2023-10-14T09:37:56.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.817+0000 7f4c21564640 1 --2- 172.21.15.102:0/3196918811 >> v2:172.21.15.129:3300/0 conn(0x7f4c1c159e90 0x7f4c1c06fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:37:56.826 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.818+0000 7f4c21d65640 1 --2- 172.21.15.102:0/3196918811 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4c1c159ab0 0x7f4c1c0ce370 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4c180098a0 tx=0x7f4c1802da70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e42a66eba6effec0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:56.826 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.819+0000 7f4c20d63640 1 -- 172.21.15.102:0/3196918811 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1802f830 con 0x7f4c1c159ab0 2023-10-14T09:37:56.826 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.819+0000 7f4c20d63640 1 -- 172.21.15.102:0/3196918811 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1802f990 con 0x7f4c1c159ab0 2023-10-14T09:37:56.827 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.819+0000 7f4c20d63640 1 -- 172.21.15.102:0/3196918811 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1802fd20 con 0x7f4c1c159ab0 2023-10-14T09:37:56.827 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.819+0000 7f4c23fc9640 1 -- 172.21.15.102:0/3196918811 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4c1c159ab0 msgr2=0x7f4c1c0ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:56.827 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.819+0000 7f4c23fc9640 1 --2- 172.21.15.102:0/3196918811 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4c1c159ab0 0x7f4c1c0ce370 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4c180098a0 tx=0x7f4c1802da70 comp rx=0 tx=0).stop 2023-10-14T09:37:56.827 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.820+0000 7f4c23fc9640 1 -- 172.21.15.102:0/3196918811 shutdown_connections 2023-10-14T09:37:56.827 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.820+0000 7f4c23fc9640 1 --2- 172.21.15.102:0/3196918811 >> v2:172.21.15.129:3300/0 conn(0x7f4c1c159e90 0x7f4c1c06fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:56.828 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.820+0000 7f4c23fc9640 1 --2- 172.21.15.102:0/3196918811 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4c1c159ab0 0x7f4c1c0ce370 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:56.828 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.820+0000 7f4c23fc9640 1 -- 172.21.15.102:0/3196918811 >> 172.21.15.102:0/3196918811 conn(0x7f4c1c0ce9b0 msgr2=0x7f4c1c0cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:56.828 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.820+0000 7f4c23fc9640 1 -- 172.21.15.102:0/3196918811 shutdown_connections 2023-10-14T09:37:56.828 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.820+0000 7f4c23fc9640 1 -- 172.21.15.102:0/3196918811 wait complete. 2023-10-14T09:37:56.828 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.821+0000 7f4c23fc9640 1 Processor -- start 2023-10-14T09:37:56.829 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.821+0000 7f4c23fc9640 1 -- start start 2023-10-14T09:37:56.829 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.822+0000 7f4c23fc9640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4c1c06c140 0x7f4c1c146980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:56.829 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.822+0000 7f4c23fc9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c1c159ab0 0x7f4c1c069da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:56.829 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.822+0000 7f4c23fc9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4c1c159e90 0x7f4c1c06a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:56.829 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.822+0000 7f4c23fc9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c15d4f0 con 0x7f4c1c159ab0 2023-10-14T09:37:56.830 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.822+0000 7f4c23fc9640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c149350 con 0x7f4c1c159e90 2023-10-14T09:37:56.830 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.822+0000 7f4c23fc9640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c1495d0 con 0x7f4c1c06c140 2023-10-14T09:37:56.830 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.823+0000 7f4c21564640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c1c159ab0 0x7f4c1c069da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:56.830 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.823+0000 7f4c21564640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c1c159ab0 0x7f4c1c069da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39962/0 (socket says 172.21.15.102:39962) 2023-10-14T09:37:56.831 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.823+0000 7f4c21564640 1 -- 172.21.15.102:0/2525350968 learned_addr learned my addr 172.21.15.102:0/2525350968 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:56.831 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.823+0000 7f4c21d65640 1 --2- 172.21.15.102:0/2525350968 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4c1c06c140 0x7f4c1c146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:56.831 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.823+0000 7f4c21564640 1 -- 172.21.15.102:0/2525350968 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4c1c06c140 msgr2=0x7f4c1c146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:56.832 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.823+0000 7f4c21564640 1 --2- 172.21.15.102:0/2525350968 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4c1c06c140 0x7f4c1c146980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:56.832 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.823+0000 7f4c21564640 1 -- 172.21.15.102:0/2525350968 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4c1c159e90 msgr2=0x7f4c1c06a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:56.832 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.823+0000 7f4c22566640 1 --2- 172.21.15.102:0/2525350968 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4c1c159e90 0x7f4c1c06a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:56.832 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.823+0000 7f4c21564640 1 --2- 172.21.15.102:0/2525350968 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4c1c159e90 0x7f4c1c06a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:56.833 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.823+0000 7f4c21564640 1 -- 172.21.15.102:0/2525350968 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0c009400 con 0x7f4c1c159ab0 2023-10-14T09:37:56.833 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.823+0000 7f4c21d65640 1 --2- 172.21.15.102:0/2525350968 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4c1c06c140 0x7f4c1c146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:56.833 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.823+0000 7f4c22566640 1 --2- 172.21.15.102:0/2525350968 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4c1c159e90 0x7f4c1c06a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:56.833 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.824+0000 7f4c21564640 1 --2- 172.21.15.102:0/2525350968 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c1c159ab0 0x7f4c1c069da0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c00ebe0 tx=0x7f4c0c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:56.833 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.824+0000 7f4c127fc640 1 -- 172.21.15.102:0/2525350968 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c009760 con 0x7f4c1c159ab0 2023-10-14T09:37:56.834 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.824+0000 7f4c127fc640 1 -- 172.21.15.102:0/2525350968 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0c00cc30 con 0x7f4c1c159ab0 2023-10-14T09:37:56.834 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.824+0000 7f4c23fc9640 1 -- 172.21.15.102:0/2525350968 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c180094d0 con 0x7f4c1c159ab0 2023-10-14T09:37:56.834 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.824+0000 7f4c127fc640 1 -- 172.21.15.102:0/2525350968 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c00eee0 con 0x7f4c1c159ab0 2023-10-14T09:37:56.834 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.824+0000 7f4c23fc9640 1 -- 172.21.15.102:0/2525350968 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c1c149b90 con 0x7f4c1c159ab0 2023-10-14T09:37:56.836 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.825+0000 7f4c23fc9640 1 -- 172.21.15.102:0/2525350968 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c1c04e160 con 0x7f4c1c159ab0 2023-10-14T09:37:56.836 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.826+0000 7f4c127fc640 1 -- 172.21.15.102:0/2525350968 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4c0c013470 con 0x7f4c1c159ab0 2023-10-14T09:37:56.836 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.827+0000 7f4c127fc640 1 --2- 172.21.15.102:0/2525350968 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4c0006ae70 0x7f4c0006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:56.836 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.827+0000 7f4c127fc640 1 -- 172.21.15.102:0/2525350968 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4c0c0899c0 con 0x7f4c1c159ab0 2023-10-14T09:37:56.836 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.828+0000 7f4c21d65640 1 --2- 172.21.15.102:0/2525350968 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4c0006ae70 0x7f4c0006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:56.837 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.828+0000 7f4c21d65640 1 --2- 172.21.15.102:0/2525350968 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4c0006ae70 0x7f4c0006d330 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4c18038000 tx=0x7f4c18008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:56.837 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:56.832+0000 7f4c127fc640 1 -- 172.21.15.102:0/2525350968 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4c0c0549d0 con 0x7f4c1c159ab0 2023-10-14T09:37:57.023 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.022+0000 7f4c23fc9640 1 -- 172.21.15.102:0/2525350968 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4c1c0cda60 con 0x7f4c1c159ab0 2023-10-14T09:37:57.024 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.023+0000 7f4c127fc640 1 -- 172.21.15.102:0/2525350968 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4c0c057ff0 con 0x7f4c1c159ab0 2023-10-14T09:37:57.025 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2023-10-14T09:37:57.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.025+0000 7f4c23fc9640 1 -- 172.21.15.102:0/2525350968 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4c0006ae70 msgr2=0x7f4c0006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:57.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.025+0000 7f4c23fc9640 1 --2- 172.21.15.102:0/2525350968 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4c0006ae70 0x7f4c0006d330 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4c18038000 tx=0x7f4c18008030 comp rx=0 tx=0).stop 2023-10-14T09:37:57.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.026+0000 7f4c23fc9640 1 -- 172.21.15.102:0/2525350968 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c1c159ab0 msgr2=0x7f4c1c069da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:57.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.026+0000 7f4c23fc9640 1 --2- 172.21.15.102:0/2525350968 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c1c159ab0 0x7f4c1c069da0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c00ebe0 tx=0x7f4c0c00c520 comp rx=0 tx=0).stop 2023-10-14T09:37:57.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.026+0000 7f4c23fc9640 1 -- 172.21.15.102:0/2525350968 shutdown_connections 2023-10-14T09:37:57.029 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.026+0000 7f4c23fc9640 1 --2- 172.21.15.102:0/2525350968 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4c0006ae70 0x7f4c0006d330 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:57.029 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.026+0000 7f4c23fc9640 1 --2- 172.21.15.102:0/2525350968 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4c1c159e90 0x7f4c1c06a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:57.029 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.026+0000 7f4c23fc9640 1 --2- 172.21.15.102:0/2525350968 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c1c159ab0 0x7f4c1c069da0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:57.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.026+0000 7f4c23fc9640 1 --2- 172.21.15.102:0/2525350968 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4c1c06c140 0x7f4c1c146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:57.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.026+0000 7f4c23fc9640 1 -- 172.21.15.102:0/2525350968 >> 172.21.15.102:0/2525350968 conn(0x7f4c1c0ce9b0 msgr2=0x7f4c1c0c1620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:57.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.026+0000 7f4c23fc9640 1 -- 172.21.15.102:0/2525350968 shutdown_connections 2023-10-14T09:37:57.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.026+0000 7f4c23fc9640 1 -- 172.21.15.102:0/2525350968 wait complete. 2023-10-14T09:37:57.047 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T09:37:57.271 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.260+0000 7f0b17fff640 1 Processor -- start 2023-10-14T09:37:57.271 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.260+0000 7f0b17fff640 1 -- start start 2023-10-14T09:37:57.272 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.262+0000 7f0b17fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0b1806c040 0x7f0b1806c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:57.272 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.262+0000 7f0b17fff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f0b180ad970 0x7f0b1815e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:57.272 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.262+0000 7f0b17fff640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b1806c960 con 0x7f0b1815ebc0 2023-10-14T09:37:57.272 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.262+0000 7f0b17fff640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b1815b9d0 con 0x7f0b1806c040 2023-10-14T09:37:57.272 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.262+0000 7f0b17fff640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b1815bcb0 con 0x7f0b180ad970 2023-10-14T09:37:57.272 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.262+0000 7f0b16ffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0b1806c040 0x7f0b1806c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:57.273 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.262+0000 7f0b16ffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0b1806c040 0x7f0b1806c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39968/0 (socket says 172.21.15.102:39968) 2023-10-14T09:37:57.273 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.262+0000 7f0b16ffd640 1 -- 172.21.15.102:0/3142549335 learned_addr learned my addr 172.21.15.102:0/3142549335 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:57.280 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.262+0000 7f0b167fc640 1 --2- 172.21.15.102:0/3142549335 >> v2:172.21.15.129:3300/0 conn(0x7f0b180ad970 0x7f0b1815e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:57.280 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.263+0000 7f0b16ffd640 1 -- 172.21.15.102:0/3142549335 >> v2:172.21.15.129:3300/0 conn(0x7f0b180ad970 msgr2=0x7f0b1815e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:57.280 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.263+0000 7f0b16ffd640 1 --2- 172.21.15.102:0/3142549335 >> v2:172.21.15.129:3300/0 conn(0x7f0b180ad970 0x7f0b1815e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:57.280 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.263+0000 7f0b16ffd640 1 -- 172.21.15.102:0/3142549335 >> v1:172.21.15.129:6789/0 conn(0x7f0b1815ebc0 legacy=0x7f0b180cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:57.281 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.263+0000 7f0b16ffd640 1 -- 172.21.15.102:0/3142549335 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b1815bf90 con 0x7f0b1806c040 2023-10-14T09:37:57.285 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.264+0000 7f0b16ffd640 1 --2- 172.21.15.102:0/3142549335 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b1806c040 0x7f0b1806c420 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0b180cb060 tx=0x7f0b0802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d8f59136607690 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:57.286 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.264+0000 7f0b15ffb640 1 -- 172.21.15.102:0/3142549335 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b08031870 con 0x7f0b1806c040 2023-10-14T09:37:57.286 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.264+0000 7f0b15ffb640 1 -- 172.21.15.102:0/3142549335 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b080319d0 con 0x7f0b1806c040 2023-10-14T09:37:57.286 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.264+0000 7f0b15ffb640 1 -- 172.21.15.102:0/3142549335 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b08031d60 con 0x7f0b1806c040 2023-10-14T09:37:57.286 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.265+0000 7f0b17fff640 1 -- 172.21.15.102:0/3142549335 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b1806c040 msgr2=0x7f0b1806c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:57.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.265+0000 7f0b17fff640 1 --2- 172.21.15.102:0/3142549335 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b1806c040 0x7f0b1806c420 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0b180cb060 tx=0x7f0b0802b910 comp rx=0 tx=0).stop 2023-10-14T09:37:57.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.265+0000 7f0b17fff640 1 -- 172.21.15.102:0/3142549335 shutdown_connections 2023-10-14T09:37:57.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.265+0000 7f0b17fff640 1 --2- 172.21.15.102:0/3142549335 >> v2:172.21.15.129:3300/0 conn(0x7f0b180ad970 0x7f0b1815e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:57.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.265+0000 7f0b17fff640 1 --2- 172.21.15.102:0/3142549335 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b1806c040 0x7f0b1806c420 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:57.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.265+0000 7f0b17fff640 1 -- 172.21.15.102:0/3142549335 >> 172.21.15.102:0/3142549335 conn(0x7f0b180ce6a0 msgr2=0x7f0b180ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:57.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.265+0000 7f0b17fff640 1 -- 172.21.15.102:0/3142549335 shutdown_connections 2023-10-14T09:37:57.288 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.265+0000 7f0b17fff640 1 -- 172.21.15.102:0/3142549335 wait complete. 2023-10-14T09:37:57.288 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.267+0000 7f0b17fff640 1 Processor -- start 2023-10-14T09:37:57.288 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.267+0000 7f0b17fff640 1 -- start start 2023-10-14T09:37:57.288 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.268+0000 7f0b17fff640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0b1806c040 0x7f0b18156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:57.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.268+0000 7f0b17fff640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0b180ad970 0x7f0b180afb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:57.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.268+0000 7f0b17fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b1815ebc0 0x7f0b181581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:57.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.268+0000 7f0b17fff640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b18156c50 con 0x7f0b1815ebc0 2023-10-14T09:37:57.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.268+0000 7f0b17fff640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b181437a0 con 0x7f0b180ad970 2023-10-14T09:37:57.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.268+0000 7f0b17fff640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b18143a80 con 0x7f0b1806c040 2023-10-14T09:37:57.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.268+0000 7f0b177fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b1815ebc0 0x7f0b181581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:57.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.268+0000 7f0b177fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b1815ebc0 0x7f0b181581a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39980/0 (socket says 172.21.15.102:39980) 2023-10-14T09:37:57.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.268+0000 7f0b177fe640 1 -- 172.21.15.102:0/3098381000 learned_addr learned my addr 172.21.15.102:0/3098381000 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:57.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.268+0000 7f0b167fc640 1 --2- 172.21.15.102:0/3098381000 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0b180ad970 0x7f0b180afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:57.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.268+0000 7f0b16ffd640 1 --2- 172.21.15.102:0/3098381000 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0b1806c040 0x7f0b18156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:57.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.269+0000 7f0b177fe640 1 -- 172.21.15.102:0/3098381000 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0b1806c040 msgr2=0x7f0b18156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:57.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.269+0000 7f0b177fe640 1 --2- 172.21.15.102:0/3098381000 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0b1806c040 0x7f0b18156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:57.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.269+0000 7f0b177fe640 1 -- 172.21.15.102:0/3098381000 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0b180ad970 msgr2=0x7f0b180afb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:57.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.269+0000 7f0b177fe640 1 --2- 172.21.15.102:0/3098381000 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0b180ad970 0x7f0b180afb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:57.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.269+0000 7f0b177fe640 1 -- 172.21.15.102:0/3098381000 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b080094d0 con 0x7f0b1815ebc0 2023-10-14T09:37:57.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.269+0000 7f0b16ffd640 1 --2- 172.21.15.102:0/3098381000 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0b1806c040 0x7f0b18156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:57.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.269+0000 7f0b167fc640 1 --2- 172.21.15.102:0/3098381000 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0b180ad970 0x7f0b180afb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:57.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.269+0000 7f0b177fe640 1 --2- 172.21.15.102:0/3098381000 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b1815ebc0 0x7f0b181581a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0b1000c780 tx=0x7f0b1000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:57.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.269+0000 7f0aff7fe640 1 -- 172.21.15.102:0/3098381000 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b10003d80 con 0x7f0b1815ebc0 2023-10-14T09:37:57.293 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.269+0000 7f0aff7fe640 1 -- 172.21.15.102:0/3098381000 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1000ce90 con 0x7f0b1815ebc0 2023-10-14T09:37:57.293 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.269+0000 7f0aff7fe640 1 -- 172.21.15.102:0/3098381000 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b100052b0 con 0x7f0b1815ebc0 2023-10-14T09:37:57.293 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.269+0000 7f0b17fff640 1 -- 172.21.15.102:0/3098381000 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b18143d60 con 0x7f0b1815ebc0 2023-10-14T09:37:57.293 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.269+0000 7f0b17fff640 1 -- 172.21.15.102:0/3098381000 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b18144320 con 0x7f0b1815ebc0 2023-10-14T09:37:57.293 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.271+0000 7f0b17fff640 1 -- 172.21.15.102:0/3098381000 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b1806b330 con 0x7f0b1815ebc0 2023-10-14T09:37:57.294 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.271+0000 7f0aff7fe640 1 -- 172.21.15.102:0/3098381000 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0b10005410 con 0x7f0b1815ebc0 2023-10-14T09:37:57.294 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.273+0000 7f0aff7fe640 1 --2- 172.21.15.102:0/3098381000 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f0b0406ae70 0x7f0b0406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:57.294 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.273+0000 7f0aff7fe640 1 -- 172.21.15.102:0/3098381000 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b10088aa0 con 0x7f0b1815ebc0 2023-10-14T09:37:57.294 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.273+0000 7f0b16ffd640 1 --2- 172.21.15.102:0/3098381000 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f0b0406ae70 0x7f0b0406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:57.295 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.274+0000 7f0b16ffd640 1 --2- 172.21.15.102:0/3098381000 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f0b0406ae70 0x7f0b0406d330 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0b08036000 tx=0x7f0b0803c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:57.295 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.277+0000 7f0aff7fe640 1 -- 172.21.15.102:0/3098381000 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0b10053b50 con 0x7f0b1815ebc0 2023-10-14T09:37:57.469 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.467+0000 7f0b17fff640 1 -- 172.21.15.102:0/3098381000 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0b1804e9b0 con 0x7f0b1815ebc0 2023-10-14T09:37:57.475 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.468+0000 7f0aff7fe640 1 -- 172.21.15.102:0/3098381000 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0b10017020 con 0x7f0b1815ebc0 2023-10-14T09:37:57.476 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2023-10-14T09:37:57.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.470+0000 7f0b17fff640 1 -- 172.21.15.102:0/3098381000 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f0b0406ae70 msgr2=0x7f0b0406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:57.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.470+0000 7f0b17fff640 1 --2- 172.21.15.102:0/3098381000 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f0b0406ae70 0x7f0b0406d330 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0b08036000 tx=0x7f0b0803c040 comp rx=0 tx=0).stop 2023-10-14T09:37:57.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.470+0000 7f0b17fff640 1 -- 172.21.15.102:0/3098381000 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b1815ebc0 msgr2=0x7f0b181581a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:57.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.470+0000 7f0b17fff640 1 --2- 172.21.15.102:0/3098381000 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b1815ebc0 0x7f0b181581a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0b1000c780 tx=0x7f0b1000cc40 comp rx=0 tx=0).stop 2023-10-14T09:37:57.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.471+0000 7f0b17fff640 1 -- 172.21.15.102:0/3098381000 shutdown_connections 2023-10-14T09:37:57.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.471+0000 7f0b17fff640 1 --2- 172.21.15.102:0/3098381000 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f0b0406ae70 0x7f0b0406d330 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:57.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.471+0000 7f0b17fff640 1 --2- 172.21.15.102:0/3098381000 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b1815ebc0 0x7f0b181581a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:57.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.471+0000 7f0b17fff640 1 --2- 172.21.15.102:0/3098381000 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0b180ad970 0x7f0b180afb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:57.479 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.471+0000 7f0b17fff640 1 --2- 172.21.15.102:0/3098381000 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0b1806c040 0x7f0b18156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:57.479 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.471+0000 7f0b17fff640 1 -- 172.21.15.102:0/3098381000 >> 172.21.15.102:0/3098381000 conn(0x7f0b180ce6a0 msgr2=0x7f0b180c5770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:57.479 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.471+0000 7f0b17fff640 1 -- 172.21.15.102:0/3098381000 shutdown_connections 2023-10-14T09:37:57.479 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.471+0000 7f0b17fff640 1 -- 172.21.15.102:0/3098381000 wait complete. 2023-10-14T09:37:57.501 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:37:57.725 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.723+0000 7fc8cd1f5640 1 Processor -- start 2023-10-14T09:37:57.726 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.723+0000 7fc8cd1f5640 1 -- start start 2023-10-14T09:37:57.728 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.724+0000 7fc8cd1f5640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc8c80ce390 0x7fc8c815e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:57.729 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.724+0000 7fc8cd1f5640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8c815ed60 con 0x7fc8c815aaa0 2023-10-14T09:37:57.729 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.725+0000 7fc8cd1f5640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8c80707e0 con 0x7fc8c815ae80 2023-10-14T09:37:57.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.725+0000 7fc8cd1f5640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c806b810 con 0x7fc8c80ce390 2023-10-14T09:37:57.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.725+0000 7fc8c6d9d640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fc8c815aaa0 0x7fc8c80cc560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:59810/0 (socket says 172.21.15.102:59810) 2023-10-14T09:37:57.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.725+0000 7fc8c6d9d640 1 -- 172.21.15.102:0/3663428654 learned_addr learned my addr 172.21.15.102:0/3663428654 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:57.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.725+0000 7fc8c759e640 1 --2- 172.21.15.102:0/3663428654 >> v2:172.21.15.102:3300/0 conn(0x7fc8c80ce390 0x7fc8c815e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:57.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.725+0000 7fc8c5d9b640 1 -- 172.21.15.102:0/3663428654 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 794452762 0 0) 0x7fc8c815ed60 con 0x7fc8c815aaa0 2023-10-14T09:37:57.732 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.725+0000 7fc8c5d9b640 1 -- 172.21.15.102:0/3663428654 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8b4003520 con 0x7fc8c815aaa0 2023-10-14T09:37:57.732 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.725+0000 7fc8c759e640 1 -- 172.21.15.102:0/3663428654 >> v1:172.21.15.129:6789/0 conn(0x7fc8c815ae80 legacy=0x7fc8c8070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:57.732 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.725+0000 7fc8c759e640 1 -- 172.21.15.102:0/3663428654 >> v1:172.21.15.102:6789/0 conn(0x7fc8c815aaa0 legacy=0x7fc8c80cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:57.733 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.725+0000 7fc8c759e640 1 -- 172.21.15.102:0/3663428654 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c815ef90 con 0x7fc8c80ce390 2023-10-14T09:37:57.733 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.727+0000 7fc8c759e640 1 --2- 172.21.15.102:0/3663428654 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8c80ce390 0x7fc8c815e820 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0009d90 tx=0x7fc8c002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=613f5e18097926ef server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:57.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.727+0000 7fc8c5d9b640 1 -- 172.21.15.102:0/3663428654 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c002cc60 con 0x7fc8c80ce390 2023-10-14T09:37:57.740 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.727+0000 7fc8c5d9b640 1 -- 172.21.15.102:0/3663428654 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c002cdc0 con 0x7fc8c80ce390 2023-10-14T09:37:57.740 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.727+0000 7fc8c5d9b640 1 -- 172.21.15.102:0/3663428654 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c0034660 con 0x7fc8c80ce390 2023-10-14T09:37:57.740 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.728+0000 7fc8cd1f5640 1 -- 172.21.15.102:0/3663428654 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8c80ce390 msgr2=0x7fc8c815e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:57.741 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.728+0000 7fc8cd1f5640 1 --2- 172.21.15.102:0/3663428654 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8c80ce390 0x7fc8c815e820 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0009d90 tx=0x7fc8c002beb0 comp rx=0 tx=0).stop 2023-10-14T09:37:57.741 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.728+0000 7fc8cd1f5640 1 -- 172.21.15.102:0/3663428654 shutdown_connections 2023-10-14T09:37:57.742 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.728+0000 7fc8cd1f5640 1 --2- 172.21.15.102:0/3663428654 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8c80ce390 0x7fc8c815e820 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:57.742 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.728+0000 7fc8cd1f5640 1 -- 172.21.15.102:0/3663428654 >> 172.21.15.102:0/3663428654 conn(0x7fc8c80cb410 msgr2=0x7fc8c80cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:57.742 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.728+0000 7fc8cd1f5640 1 -- 172.21.15.102:0/3663428654 shutdown_connections 2023-10-14T09:37:57.743 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.728+0000 7fc8cd1f5640 1 -- 172.21.15.102:0/3663428654 wait complete. 2023-10-14T09:37:57.743 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.730+0000 7fc8cd1f5640 1 Processor -- start 2023-10-14T09:37:57.744 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.730+0000 7fc8cd1f5640 1 -- start start 2023-10-14T09:37:57.744 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.731+0000 7fc8cd1f5640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc8c80ce390 0x7fc8c80c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:57.744 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.731+0000 7fc8cd1f5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8c815aaa0 0x7fc8c806f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:57.745 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.731+0000 7fc8cd1f5640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc8c815ae80 0x7fc8c814d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:57.745 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.731+0000 7fc8cd1f5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c80c6f70 con 0x7fc8c815aaa0 2023-10-14T09:37:57.745 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.731+0000 7fc8cd1f5640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c80c6360 con 0x7fc8c815ae80 2023-10-14T09:37:57.746 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.731+0000 7fc8cd1f5640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c80c6640 con 0x7fc8c80ce390 2023-10-14T09:37:57.746 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.731+0000 7fc8c659c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8c815aaa0 0x7fc8c806f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:57.747 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.731+0000 7fc8c659c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8c815aaa0 0x7fc8c806f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39996/0 (socket says 172.21.15.102:39996) 2023-10-14T09:37:57.747 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.731+0000 7fc8c659c640 1 -- 172.21.15.102:0/2528384839 learned_addr learned my addr 172.21.15.102:0/2528384839 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:57.747 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.731+0000 7fc8c659c640 1 -- 172.21.15.102:0/2528384839 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc8c80ce390 msgr2=0x7fc8c80c5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:57.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.731+0000 7fc8c659c640 1 --2- 172.21.15.102:0/2528384839 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc8c80ce390 0x7fc8c80c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:57.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.731+0000 7fc8c659c640 1 -- 172.21.15.102:0/2528384839 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc8c815ae80 msgr2=0x7fc8c814d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:57.749 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.731+0000 7fc8c659c640 1 --2- 172.21.15.102:0/2528384839 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc8c815ae80 0x7fc8c814d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:57.749 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.731+0000 7fc8c659c640 1 -- 172.21.15.102:0/2528384839 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c0009a70 con 0x7fc8c815aaa0 2023-10-14T09:37:57.749 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.732+0000 7fc8c659c640 1 --2- 172.21.15.102:0/2528384839 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8c815aaa0 0x7fc8c806f6c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800b3c0 tx=0x7fc8b800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:57.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.732+0000 7fc8bf7fe640 1 -- 172.21.15.102:0/2528384839 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8011830 con 0x7fc8c815aaa0 2023-10-14T09:37:57.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.732+0000 7fc8bf7fe640 1 -- 172.21.15.102:0/2528384839 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b8011990 con 0x7fc8c815aaa0 2023-10-14T09:37:57.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.732+0000 7fc8bf7fe640 1 -- 172.21.15.102:0/2528384839 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8011d80 con 0x7fc8c815aaa0 2023-10-14T09:37:57.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.732+0000 7fc8cd1f5640 1 -- 172.21.15.102:0/2528384839 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8c80c6920 con 0x7fc8c815aaa0 2023-10-14T09:37:57.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.732+0000 7fc8cd1f5640 1 -- 172.21.15.102:0/2528384839 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c80c6050 con 0x7fc8c815aaa0 2023-10-14T09:37:57.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.733+0000 7fc8cd1f5640 1 -- 172.21.15.102:0/2528384839 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8c804e160 con 0x7fc8c815aaa0 2023-10-14T09:37:57.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.734+0000 7fc8bf7fe640 1 -- 172.21.15.102:0/2528384839 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc8b801b460 con 0x7fc8c815aaa0 2023-10-14T09:37:57.753 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.735+0000 7fc8bf7fe640 1 --2- 172.21.15.102:0/2528384839 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc8a806ae70 0x7fc8a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:57.753 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.735+0000 7fc8bf7fe640 1 -- 172.21.15.102:0/2528384839 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc8b80891a0 con 0x7fc8c815aaa0 2023-10-14T09:37:57.753 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.736+0000 7fc8c6d9d640 1 --2- 172.21.15.102:0/2528384839 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc8a806ae70 0x7fc8a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:57.754 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.736+0000 7fc8c6d9d640 1 --2- 172.21.15.102:0/2528384839 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc8a806ae70 0x7fc8a806d330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8157c50 tx=0x7fc8b0007930 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:57.755 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.740+0000 7fc8bf7fe640 1 -- 172.21.15.102:0/2528384839 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc8b8054250 con 0x7fc8c815aaa0 2023-10-14T09:37:57.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.930+0000 7fc8cd1f5640 1 -- 172.21.15.102:0/2528384839 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8c80c70b0 con 0x7fc8c815aaa0 2023-10-14T09:37:57.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.932+0000 7fc8bf7fe640 1 -- 172.21.15.102:0/2528384839 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16541 (secure 0 0 0) 0x7fc8b8057870 con 0x7fc8c815aaa0 2023-10-14T09:37:57.935 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:37:57.935 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":22,"fsid":"8a6cd69d-7f5b-4f2a-806a-0176c10aed50","created":"2023-10-14T09:36:56.745172+0000","modified":"2023-10-14T09:37:22.712469+0000","last_up_change":"2023-10-14T09:37:09.791473+0000","last_in_change":"2023-10-14T09:37:00.547186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:37:09.952407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:37:19.560925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:37:20.363385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e5aef8f3-878f-482b-b522-9a5b958b90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6801","nonce":1727250718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6803","nonce":1727250718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6807","nonce":1727250718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6805","nonce":1727250718}]},"public_addr":"172.21.15.102:6801/1727250718","cluster_addr":"172.21.15.102:6803/1727250718","heartbeat_back_addr":"172.21.15.102:6807/1727250718","heartbeat_front_addr":"172.21.15.102:6805/1727250718","state":["exists","up"]},{"osd":1,"uuid":"4a8cf50e-387b-4d47-9588-bd22e375a9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6809","nonce":1095651107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6811","nonce":1095651107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6815","nonce":1095651107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6813","nonce":1095651107}]},"public_addr":"172.21.15.102:6809/1095651107","cluster_addr":"172.21.15.102:6811/1095651107","heartbeat_back_addr":"172.21.15.102:6815/1095651107","heartbeat_front_addr":"172.21.15.102:6813/1095651107","state":["exists","up"]},{"osd":2,"uuid":"009ef55f-8a63-4219-bacd-d7c7b4500867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6820","nonce":2198222556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6825","nonce":2198222556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6831","nonce":2198222556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6829","nonce":2198222556}]},"public_addr":"172.21.15.102:6820/2198222556","cluster_addr":"172.21.15.102:6825/2198222556","heartbeat_back_addr":"172.21.15.102:6831/2198222556","heartbeat_front_addr":"172.21.15.102:6829/2198222556","state":["exists","up"]},{"osd":3,"uuid":"f2110eae-2ff9-4ed9-93d6-bd2361618211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6818","nonce":654726740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6821","nonce":654726740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6827","nonce":654726740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6823","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6824","nonce":654726740}]},"public_addr":"172.21.15.102:6818/654726740","cluster_addr":"172.21.15.102:6821/654726740","heartbeat_back_addr":"172.21.15.102:6827/654726740","heartbeat_front_addr":"172.21.15.102:6824/654726740","state":["exists","up"]},{"osd":4,"uuid":"33f1ae34-3100-40f7-9cb8-0eca2b358693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6817","nonce":507586170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6819","nonce":507586170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6823","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6825","nonce":507586170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6821","nonce":507586170}]},"public_addr":"172.21.15.129:6817/507586170","cluster_addr":"172.21.15.129:6819/507586170","heartbeat_back_addr":"172.21.15.129:6825/507586170","heartbeat_front_addr":"172.21.15.129:6821/507586170","state":["exists","up"]},{"osd":5,"uuid":"fab2fc62-3f3e-450d-93e0-770f39e80710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6801","nonce":1913451073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6803","nonce":1913451073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6807","nonce":1913451073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6805","nonce":1913451073}]},"public_addr":"172.21.15.129:6801/1913451073","cluster_addr":"172.21.15.129:6803/1913451073","heartbeat_back_addr":"172.21.15.129:6807/1913451073","heartbeat_front_addr":"172.21.15.129:6805/1913451073","state":["exists","up"]},{"osd":6,"uuid":"d7cc1d69-92e7-4253-a127-cfc0444a4809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6809","nonce":2853291511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6811","nonce":2853291511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6815","nonce":2853291511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6813","nonce":2853291511}]},"public_addr":"172.21.15.129:6809/2853291511","cluster_addr":"172.21.15.129:6811/2853291511","heartbeat_back_addr":"172.21.15.129:6815/2853291511","heartbeat_front_addr":"172.21.15.129:6813/2853291511","state":["exists","up"]},{"osd":7,"uuid":"1e403de1-09e2-4370-b9a7-e790ac44bbee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6824","nonce":2933886914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6827","nonce":2933886914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6831","nonce":2933886914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6829","nonce":2933886914}]},"public_addr":"172.21.15.129:6824/2933886914","cluster_addr":"172.21.15.129:6827/2933886914","heartbeat_back_addr":"172.21.15.129:6831/2933886914","heartbeat_front_addr":"172.21.15.129:6829/2933886914","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.849661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.868113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.933488+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.891794+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.901861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.858750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.911712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.996765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:37:57.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.934+0000 7fc8cd1f5640 1 -- 172.21.15.102:0/2528384839 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc8a806ae70 msgr2=0x7fc8a806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:57.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.934+0000 7fc8cd1f5640 1 --2- 172.21.15.102:0/2528384839 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc8a806ae70 0x7fc8a806d330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8157c50 tx=0x7fc8b0007930 comp rx=0 tx=0).stop 2023-10-14T09:37:57.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.934+0000 7fc8cd1f5640 1 -- 172.21.15.102:0/2528384839 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8c815aaa0 msgr2=0x7fc8c806f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:57.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.934+0000 7fc8cd1f5640 1 --2- 172.21.15.102:0/2528384839 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8c815aaa0 0x7fc8c806f6c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800b3c0 tx=0x7fc8b800b880 comp rx=0 tx=0).stop 2023-10-14T09:37:57.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.934+0000 7fc8cd1f5640 1 -- 172.21.15.102:0/2528384839 shutdown_connections 2023-10-14T09:37:57.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.934+0000 7fc8cd1f5640 1 --2- 172.21.15.102:0/2528384839 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc8a806ae70 0x7fc8a806d330 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:57.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.934+0000 7fc8cd1f5640 1 --2- 172.21.15.102:0/2528384839 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc8c815ae80 0x7fc8c814d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:57.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.934+0000 7fc8cd1f5640 1 --2- 172.21.15.102:0/2528384839 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8c815aaa0 0x7fc8c806f6c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:57.941 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.934+0000 7fc8cd1f5640 1 --2- 172.21.15.102:0/2528384839 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc8c80ce390 0x7fc8c80c5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:57.941 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.934+0000 7fc8cd1f5640 1 -- 172.21.15.102:0/2528384839 >> 172.21.15.102:0/2528384839 conn(0x7fc8c80cb410 msgr2=0x7fc8c815a090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:57.941 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.935+0000 7fc8cd1f5640 1 -- 172.21.15.102:0/2528384839 shutdown_connections 2023-10-14T09:37:57.942 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:57.935+0000 7fc8cd1f5640 1 -- 172.21.15.102:0/2528384839 wait complete. 2023-10-14T09:37:57.955 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T09:37:09.952407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T09:37:19.560925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T09:37:20.363385+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T09:37:57.957 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T09:37:58.170 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.168+0000 7fac52ac9640 1 Processor -- start 2023-10-14T09:37:58.170 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.168+0000 7fac52ac9640 1 -- start start 2023-10-14T09:37:58.172 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.170+0000 7fac52ac9640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fac4c15ad70 0x7fac4c069da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:58.172 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.170+0000 7fac52ac9640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fac4c0c9ca0 0x7fac4c06a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:58.172 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.170+0000 7fac52ac9640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fac4c0ca3b0 0x7fac4c0ca840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:58.172 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.170+0000 7fac52ac9640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac4c0cad80 con 0x7fac4c0ca3b0 2023-10-14T09:37:58.173 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.170+0000 7fac52ac9640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac4c0cb030 con 0x7fac4c15ad70 2023-10-14T09:37:58.173 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.170+0000 7fac52ac9640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c0c91c0 con 0x7fac4c0c9ca0 2023-10-14T09:37:58.173 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.170+0000 7fac51066640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fac4c0ca3b0 0x7fac4c0ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:58.173 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.170+0000 7fac51066640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fac4c0ca3b0 0x7fac4c0ca840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40012/0 (socket says 172.21.15.102:40012) 2023-10-14T09:37:58.173 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.170+0000 7fac51066640 1 -- 172.21.15.102:0/1115843668 learned_addr learned my addr 172.21.15.102:0/1115843668 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:58.175 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.171+0000 7fac51066640 1 -- 172.21.15.102:0/1115843668 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fac4c0c9ca0 msgr2=0x7fac4c06a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:58.175 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.171+0000 7fac50865640 1 --2- 172.21.15.102:0/1115843668 >> v2:172.21.15.129:3300/0 conn(0x7fac4c15ad70 0x7fac4c069da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:58.175 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.171+0000 7fac4bfff640 1 --2- 172.21.15.102:0/1115843668 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fac4c0c9ca0 0x7fac4c06a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:58.176 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.171+0000 7fac51066640 1 --2- 172.21.15.102:0/1115843668 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fac4c0c9ca0 0x7fac4c06a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:58.176 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.171+0000 7fac51066640 1 -- 172.21.15.102:0/1115843668 >> v2:172.21.15.129:3300/0 conn(0x7fac4c15ad70 msgr2=0x7fac4c069da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:58.176 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.171+0000 7fac51066640 1 --2- 172.21.15.102:0/1115843668 >> v2:172.21.15.129:3300/0 conn(0x7fac4c15ad70 0x7fac4c069da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:58.176 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.171+0000 7fac51066640 1 -- 172.21.15.102:0/1115843668 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac4c0c94a0 con 0x7fac4c0ca3b0 2023-10-14T09:37:58.176 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.172+0000 7fac51066640 1 --2- 172.21.15.102:0/1115843668 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac4c0ca3b0 0x7fac4c0ca840 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fac4c0cf780 tx=0x7fac4402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e98c098c2b6babc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:58.177 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.172+0000 7fac4b7fe640 1 -- 172.21.15.102:0/1115843668 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4402ca70 con 0x7fac4c0ca3b0 2023-10-14T09:37:58.177 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.172+0000 7fac4b7fe640 1 -- 172.21.15.102:0/1115843668 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4402cbd0 con 0x7fac4c0ca3b0 2023-10-14T09:37:58.177 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.172+0000 7fac4b7fe640 1 -- 172.21.15.102:0/1115843668 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac440343f0 con 0x7fac4c0ca3b0 2023-10-14T09:37:58.177 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.173+0000 7fac52ac9640 1 -- 172.21.15.102:0/1115843668 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac4c0ca3b0 msgr2=0x7fac4c0ca840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:58.177 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.173+0000 7fac52ac9640 1 --2- 172.21.15.102:0/1115843668 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac4c0ca3b0 0x7fac4c0ca840 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fac4c0cf780 tx=0x7fac4402bed0 comp rx=0 tx=0).stop 2023-10-14T09:37:58.178 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.173+0000 7fac52ac9640 1 -- 172.21.15.102:0/1115843668 shutdown_connections 2023-10-14T09:37:58.178 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.173+0000 7fac52ac9640 1 --2- 172.21.15.102:0/1115843668 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac4c0ca3b0 0x7fac4c0ca840 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:58.178 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.173+0000 7fac52ac9640 1 --2- 172.21.15.102:0/1115843668 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fac4c0c9ca0 0x7fac4c06a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:58.178 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.173+0000 7fac52ac9640 1 --2- 172.21.15.102:0/1115843668 >> v2:172.21.15.129:3300/0 conn(0x7fac4c15ad70 0x7fac4c069da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:58.178 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.173+0000 7fac52ac9640 1 -- 172.21.15.102:0/1115843668 >> 172.21.15.102:0/1115843668 conn(0x7fac4c0ce9b0 msgr2=0x7fac4c0cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:58.179 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.173+0000 7fac52ac9640 1 -- 172.21.15.102:0/1115843668 shutdown_connections 2023-10-14T09:37:58.179 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.173+0000 7fac52ac9640 1 -- 172.21.15.102:0/1115843668 wait complete. 2023-10-14T09:37:58.181 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.175+0000 7fac52ac9640 1 Processor -- start 2023-10-14T09:37:58.181 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.175+0000 7fac52ac9640 1 -- start start 2023-10-14T09:37:58.181 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.176+0000 7fac52ac9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac4c0c9ca0 0x7fac4c0b3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:58.182 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.176+0000 7fac52ac9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fac4c0ca3b0 0x7fac4c0cd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:58.182 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.176+0000 7fac52ac9640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fac4c15ad70 0x7fac4c1f5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:58.182 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.176+0000 7fac52ac9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c151650 con 0x7fac4c0c9ca0 2023-10-14T09:37:58.182 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.176+0000 7fac52ac9640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c153c10 con 0x7fac4c0ca3b0 2023-10-14T09:37:58.182 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.176+0000 7fac52ac9640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c151000 con 0x7fac4c15ad70 2023-10-14T09:37:58.183 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.176+0000 7fac50865640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac4c0c9ca0 0x7fac4c0b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:58.183 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.176+0000 7fac50865640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac4c0c9ca0 0x7fac4c0b3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40026/0 (socket says 172.21.15.102:40026) 2023-10-14T09:37:58.183 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.176+0000 7fac50865640 1 -- 172.21.15.102:0/1551287366 learned_addr learned my addr 172.21.15.102:0/1551287366 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:58.183 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.176+0000 7fac50865640 1 -- 172.21.15.102:0/1551287366 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fac4c15ad70 msgr2=0x7fac4c1f5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:58.183 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.176+0000 7fac50865640 1 --2- 172.21.15.102:0/1551287366 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fac4c15ad70 0x7fac4c1f5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:58.184 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.176+0000 7fac50865640 1 -- 172.21.15.102:0/1551287366 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fac4c0ca3b0 msgr2=0x7fac4c0cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:58.184 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.176+0000 7fac4bfff640 1 --2- 172.21.15.102:0/1551287366 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fac4c0ca3b0 0x7fac4c0cd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:58.184 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.176+0000 7fac50865640 1 --2- 172.21.15.102:0/1551287366 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fac4c0ca3b0 0x7fac4c0cd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:58.184 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.176+0000 7fac50865640 1 -- 172.21.15.102:0/1551287366 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac44009b30 con 0x7fac4c0c9ca0 2023-10-14T09:37:58.184 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.177+0000 7fac50865640 1 --2- 172.21.15.102:0/1551287366 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac4c0c9ca0 0x7fac4c0b3850 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fac4000c7f0 tx=0x7fac4000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:58.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.177+0000 7fac497fa640 1 -- 172.21.15.102:0/1551287366 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac40004220 con 0x7fac4c0c9ca0 2023-10-14T09:37:58.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.177+0000 7fac497fa640 1 -- 172.21.15.102:0/1551287366 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac40004380 con 0x7fac4c0c9ca0 2023-10-14T09:37:58.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.177+0000 7fac497fa640 1 -- 172.21.15.102:0/1551287366 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac40007840 con 0x7fac4c0c9ca0 2023-10-14T09:37:58.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.177+0000 7fac52ac9640 1 -- 172.21.15.102:0/1551287366 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac4c1512e0 con 0x7fac4c0c9ca0 2023-10-14T09:37:58.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.177+0000 7fac52ac9640 1 -- 172.21.15.102:0/1551287366 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac4c0cdc10 con 0x7fac4c0c9ca0 2023-10-14T09:37:58.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.178+0000 7fac52ac9640 1 -- 172.21.15.102:0/1551287366 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac4c150e60 con 0x7fac4c0c9ca0 2023-10-14T09:37:58.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.179+0000 7fac497fa640 1 -- 172.21.15.102:0/1551287366 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fac40007bb0 con 0x7fac4c0c9ca0 2023-10-14T09:37:58.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.180+0000 7fac497fa640 1 --2- 172.21.15.102:0/1551287366 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fac3006ae70 0x7fac3006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:58.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.180+0000 7fac497fa640 1 -- 172.21.15.102:0/1551287366 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac40089570 con 0x7fac4c0c9ca0 2023-10-14T09:37:58.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.180+0000 7fac4bfff640 1 --2- 172.21.15.102:0/1551287366 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fac3006ae70 0x7fac3006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:58.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.181+0000 7fac4bfff640 1 --2- 172.21.15.102:0/1551287366 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fac3006ae70 0x7fac3006d330 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fac4c0b4430 tx=0x7fac38008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:58.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.185+0000 7fac497fa640 1 -- 172.21.15.102:0/1551287366 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fac4c150e60 con 0x7fac4c0c9ca0 2023-10-14T09:37:58.372 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.370+0000 7fac52ac9640 1 -- 172.21.15.102:0/1551287366 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fac4c150e60 con 0x7fac4c0c9ca0 2023-10-14T09:37:58.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.371+0000 7fac497fa640 1 -- 172.21.15.102:0/1551287366 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fac4c150e60 con 0x7fac4c0c9ca0 2023-10-14T09:37:58.373 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2023-10-14T09:37:58.376 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.374+0000 7fac52ac9640 1 -- 172.21.15.102:0/1551287366 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fac3006ae70 msgr2=0x7fac3006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:58.376 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.374+0000 7fac52ac9640 1 --2- 172.21.15.102:0/1551287366 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fac3006ae70 0x7fac3006d330 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fac4c0b4430 tx=0x7fac38008040 comp rx=0 tx=0).stop 2023-10-14T09:37:58.377 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.374+0000 7fac52ac9640 1 -- 172.21.15.102:0/1551287366 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac4c0c9ca0 msgr2=0x7fac4c0b3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:58.377 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.374+0000 7fac52ac9640 1 --2- 172.21.15.102:0/1551287366 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac4c0c9ca0 0x7fac4c0b3850 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fac4000c7f0 tx=0x7fac4000ccb0 comp rx=0 tx=0).stop 2023-10-14T09:37:58.377 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.374+0000 7fac52ac9640 1 -- 172.21.15.102:0/1551287366 shutdown_connections 2023-10-14T09:37:58.377 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.374+0000 7fac52ac9640 1 --2- 172.21.15.102:0/1551287366 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fac3006ae70 0x7fac3006d330 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:58.377 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.374+0000 7fac52ac9640 1 --2- 172.21.15.102:0/1551287366 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fac4c15ad70 0x7fac4c1f5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:58.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.374+0000 7fac52ac9640 1 --2- 172.21.15.102:0/1551287366 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fac4c0ca3b0 0x7fac4c0cd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:58.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.374+0000 7fac52ac9640 1 --2- 172.21.15.102:0/1551287366 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac4c0c9ca0 0x7fac4c0b3850 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:58.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.374+0000 7fac52ac9640 1 -- 172.21.15.102:0/1551287366 >> 172.21.15.102:0/1551287366 conn(0x7fac4c0ce9b0 msgr2=0x7fac4c0cc540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:58.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.374+0000 7fac52ac9640 1 -- 172.21.15.102:0/1551287366 shutdown_connections 2023-10-14T09:37:58.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.374+0000 7fac52ac9640 1 -- 172.21.15.102:0/1551287366 wait complete. 2023-10-14T09:37:58.393 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T09:37:58.602 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.600+0000 7f4031bf5640 1 Processor -- start 2023-10-14T09:37:58.602 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.600+0000 7f4031bf5640 1 -- start start 2023-10-14T09:37:58.604 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.602+0000 7f4031bf5640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f402c070830 0x7f402c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:58.604 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.602+0000 7f4031bf5640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f402c0cf5f0 0x7f402c06c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:58.604 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.602+0000 7f4031bf5640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f402c070c10 0x7f402c0cd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:58.604 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.602+0000 7f4031bf5640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f402c161740 con 0x7f402c070c10 2023-10-14T09:37:58.605 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.602+0000 7f4031bf5640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f402c06c680 con 0x7f402c070830 2023-10-14T09:37:58.605 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.602+0000 7f4031bf5640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f402c0cdbd0 con 0x7f402c0cf5f0 2023-10-14T09:37:58.605 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.602+0000 7f402bfff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f402c070c10 0x7f402c0cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:58.605 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.602+0000 7f402bfff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f402c070c10 0x7f402c0cd690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40038/0 (socket says 172.21.15.102:40038) 2023-10-14T09:37:58.605 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.602+0000 7f402bfff640 1 -- 172.21.15.102:0/4259732126 learned_addr learned my addr 172.21.15.102:0/4259732126 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:58.607 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.603+0000 7f4023fff640 1 --2- 172.21.15.102:0/4259732126 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f402c0cf5f0 0x7f402c06c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:58.608 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.603+0000 7f402b7fe640 1 --2- 172.21.15.102:0/4259732126 >> v2:172.21.15.129:3300/0 conn(0x7f402c070830 0x7f402c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:58.608 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.603+0000 7f402bfff640 1 -- 172.21.15.102:0/4259732126 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f402c0cf5f0 msgr2=0x7f402c06c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:58.608 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.603+0000 7f402bfff640 1 --2- 172.21.15.102:0/4259732126 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f402c0cf5f0 0x7f402c06c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:58.608 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.603+0000 7f402bfff640 1 -- 172.21.15.102:0/4259732126 >> v2:172.21.15.129:3300/0 conn(0x7f402c070830 msgr2=0x7f402c06d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:58.608 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.603+0000 7f402bfff640 1 --2- 172.21.15.102:0/4259732126 >> v2:172.21.15.129:3300/0 conn(0x7f402c070830 0x7f402c06d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:58.609 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.603+0000 7f402bfff640 1 -- 172.21.15.102:0/4259732126 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f402c06b0f0 con 0x7f402c070c10 2023-10-14T09:37:58.609 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.603+0000 7f402b7fe640 1 --2- 172.21.15.102:0/4259732126 >> v2:172.21.15.129:3300/0 conn(0x7f402c070830 0x7f402c06d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:58.609 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.603+0000 7f4023fff640 1 --2- 172.21.15.102:0/4259732126 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f402c0cf5f0 0x7f402c06c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:58.609 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.604+0000 7f402bfff640 1 --2- 172.21.15.102:0/4259732126 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f402c070c10 0x7f402c0cd690 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f402c06c010 tx=0x7f402402bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b250db06ebb4b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:58.609 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.604+0000 7f402affd640 1 -- 172.21.15.102:0/4259732126 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402402c960 con 0x7f402c070c10 2023-10-14T09:37:58.609 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.604+0000 7f402affd640 1 -- 172.21.15.102:0/4259732126 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f402402cac0 con 0x7f402c070c10 2023-10-14T09:37:58.610 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.604+0000 7f402affd640 1 -- 172.21.15.102:0/4259732126 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402402ce50 con 0x7f402c070c10 2023-10-14T09:37:58.610 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.605+0000 7f4031bf5640 1 -- 172.21.15.102:0/4259732126 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f402c070c10 msgr2=0x7f402c0cd690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:58.610 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.605+0000 7f4031bf5640 1 --2- 172.21.15.102:0/4259732126 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f402c070c10 0x7f402c0cd690 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f402c06c010 tx=0x7f402402bdc0 comp rx=0 tx=0).stop 2023-10-14T09:37:58.610 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.605+0000 7f4031bf5640 1 -- 172.21.15.102:0/4259732126 shutdown_connections 2023-10-14T09:37:58.610 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.605+0000 7f4031bf5640 1 --2- 172.21.15.102:0/4259732126 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f402c070c10 0x7f402c0cd690 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:58.611 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.605+0000 7f4031bf5640 1 --2- 172.21.15.102:0/4259732126 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f402c0cf5f0 0x7f402c06c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:58.611 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.605+0000 7f4031bf5640 1 --2- 172.21.15.102:0/4259732126 >> v2:172.21.15.129:3300/0 conn(0x7f402c070830 0x7f402c06d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:58.611 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.605+0000 7f4031bf5640 1 -- 172.21.15.102:0/4259732126 >> 172.21.15.102:0/4259732126 conn(0x7f402c0cfac0 msgr2=0x7f402c0cfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:58.611 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.605+0000 7f4031bf5640 1 -- 172.21.15.102:0/4259732126 shutdown_connections 2023-10-14T09:37:58.611 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.605+0000 7f4031bf5640 1 -- 172.21.15.102:0/4259732126 wait complete. 2023-10-14T09:37:58.614 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.607+0000 7f4031bf5640 1 Processor -- start 2023-10-14T09:37:58.614 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.607+0000 7f4031bf5640 1 -- start start 2023-10-14T09:37:58.614 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.608+0000 7f4031bf5640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f402c070830 0x7f402c15f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:58.615 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.608+0000 7f4031bf5640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f402c070c10 0x7f402c0c4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:58.615 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.608+0000 7f4031bf5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f402c0cf5f0 0x7f402c0af520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:58.615 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.608+0000 7f4031bf5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402c0c42b0 con 0x7f402c0cf5f0 2023-10-14T09:37:58.615 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.608+0000 7f4031bf5640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402c0c4800 con 0x7f402c070830 2023-10-14T09:37:58.615 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.608+0000 7f4031bf5640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f402c0affc0 con 0x7f402c070c10 2023-10-14T09:37:58.616 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.608+0000 7f402bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f402c0cf5f0 0x7f402c0af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:58.616 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.608+0000 7f402bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f402c0cf5f0 0x7f402c0af520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40054/0 (socket says 172.21.15.102:40054) 2023-10-14T09:37:58.616 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.608+0000 7f402bfff640 1 -- 172.21.15.102:0/3190991695 learned_addr learned my addr 172.21.15.102:0/3190991695 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:58.616 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.609+0000 7f402b7fe640 1 --2- 172.21.15.102:0/3190991695 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f402c070830 0x7f402c15f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:58.616 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.609+0000 7f4023fff640 1 --2- 172.21.15.102:0/3190991695 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f402c070c10 0x7f402c0c4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:58.617 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.609+0000 7f402bfff640 1 -- 172.21.15.102:0/3190991695 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f402c070c10 msgr2=0x7f402c0c4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:58.617 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.609+0000 7f402bfff640 1 --2- 172.21.15.102:0/3190991695 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f402c070c10 0x7f402c0c4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:58.617 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.609+0000 7f402bfff640 1 -- 172.21.15.102:0/3190991695 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f402c070830 msgr2=0x7f402c15f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:58.617 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.609+0000 7f402bfff640 1 --2- 172.21.15.102:0/3190991695 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f402c070830 0x7f402c15f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:58.617 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.609+0000 7f402bfff640 1 -- 172.21.15.102:0/3190991695 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4024009b30 con 0x7f402c0cf5f0 2023-10-14T09:37:58.618 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.609+0000 7f402bfff640 1 --2- 172.21.15.102:0/3190991695 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f402c0cf5f0 0x7f402c0af520 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4024036040 tx=0x7f4024004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:58.618 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.609+0000 7f4028ff9640 1 -- 172.21.15.102:0/3190991695 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4024009510 con 0x7f402c0cf5f0 2023-10-14T09:37:58.618 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.609+0000 7f4028ff9640 1 -- 172.21.15.102:0/3190991695 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f402403e450 con 0x7f402c0cf5f0 2023-10-14T09:37:58.618 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.609+0000 7f4028ff9640 1 -- 172.21.15.102:0/3190991695 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402403e800 con 0x7f402c0cf5f0 2023-10-14T09:37:58.618 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.609+0000 7f4031bf5640 1 -- 172.21.15.102:0/3190991695 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f402c0b02a0 con 0x7f402c0cf5f0 2023-10-14T09:37:58.619 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.610+0000 7f4031bf5640 1 -- 172.21.15.102:0/3190991695 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f402c0c58a0 con 0x7f402c0cf5f0 2023-10-14T09:37:58.619 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.611+0000 7f4031bf5640 1 -- 172.21.15.102:0/3190991695 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f402c0b04c0 con 0x7f402c0cf5f0 2023-10-14T09:37:58.619 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.611+0000 7f4028ff9640 1 -- 172.21.15.102:0/3190991695 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f402403e960 con 0x7f402c0cf5f0 2023-10-14T09:37:58.619 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.612+0000 7f4028ff9640 1 --2- 172.21.15.102:0/3190991695 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f400c06aea0 0x7f400c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:58.619 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.612+0000 7f4028ff9640 1 -- 172.21.15.102:0/3190991695 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40240ac3f0 con 0x7f402c0cf5f0 2023-10-14T09:37:58.620 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.613+0000 7f402b7fe640 1 --2- 172.21.15.102:0/3190991695 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f400c06aea0 0x7f400c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:58.620 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.613+0000 7f402b7fe640 1 --2- 172.21.15.102:0/3190991695 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f400c06aea0 0x7f400c06d360 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f402c0718d0 tx=0x7f401c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:58.620 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.617+0000 7f4028ff9640 1 -- 172.21.15.102:0/3190991695 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f40240775e0 con 0x7f402c0cf5f0 2023-10-14T09:37:58.807 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.805+0000 7f4031bf5640 1 -- 172.21.15.102:0/3190991695 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f402c04e160 con 0x7f402c0cf5f0 2023-10-14T09:37:58.808 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.806+0000 7f4028ff9640 1 -- 172.21.15.102:0/3190991695 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f402407ac00 con 0x7f402c0cf5f0 2023-10-14T09:37:58.808 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2023-10-14T09:37:58.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.809+0000 7f4031bf5640 1 -- 172.21.15.102:0/3190991695 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f400c06aea0 msgr2=0x7f400c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:58.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.809+0000 7f4031bf5640 1 --2- 172.21.15.102:0/3190991695 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f400c06aea0 0x7f400c06d360 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f402c0718d0 tx=0x7f401c008040 comp rx=0 tx=0).stop 2023-10-14T09:37:58.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.809+0000 7f4031bf5640 1 -- 172.21.15.102:0/3190991695 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f402c0cf5f0 msgr2=0x7f402c0af520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:58.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.809+0000 7f4031bf5640 1 --2- 172.21.15.102:0/3190991695 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f402c0cf5f0 0x7f402c0af520 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4024036040 tx=0x7f4024004a40 comp rx=0 tx=0).stop 2023-10-14T09:37:58.812 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.809+0000 7f4031bf5640 1 -- 172.21.15.102:0/3190991695 shutdown_connections 2023-10-14T09:37:58.812 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.809+0000 7f4031bf5640 1 --2- 172.21.15.102:0/3190991695 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f400c06aea0 0x7f400c06d360 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:58.812 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.809+0000 7f4031bf5640 1 --2- 172.21.15.102:0/3190991695 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f402c0cf5f0 0x7f402c0af520 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:58.812 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.809+0000 7f4031bf5640 1 --2- 172.21.15.102:0/3190991695 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f402c070c10 0x7f402c0c4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:58.812 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.809+0000 7f4031bf5640 1 --2- 172.21.15.102:0/3190991695 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f402c070830 0x7f402c15f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:58.813 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.809+0000 7f4031bf5640 1 -- 172.21.15.102:0/3190991695 >> 172.21.15.102:0/3190991695 conn(0x7f402c0cfac0 msgr2=0x7f402c0ae450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:58.813 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.809+0000 7f4031bf5640 1 -- 172.21.15.102:0/3190991695 shutdown_connections 2023-10-14T09:37:58.813 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:58.809+0000 7f4031bf5640 1 -- 172.21.15.102:0/3190991695 wait complete. 2023-10-14T09:37:58.829 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T09:37:59.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.038+0000 7f62c2fc9640 1 Processor -- start 2023-10-14T09:37:59.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.038+0000 7f62c2fc9640 1 -- start start 2023-10-14T09:37:59.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.039+0000 7f62c2fc9640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f62bc06c040 0x7f62bc06c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:59.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.039+0000 7f62c2fc9640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f62bc0ad970 0x7f62bc15e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:59.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.039+0000 7f62c2fc9640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62bc06c960 con 0x7f62bc15ebc0 2023-10-14T09:37:59.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.039+0000 7f62c2fc9640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62bc15b9d0 con 0x7f62bc0ad970 2023-10-14T09:37:59.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.039+0000 7f62c2fc9640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62bc15bcb0 con 0x7f62bc06c040 2023-10-14T09:37:59.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.040+0000 7f62c17c6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f62bc0ad970 0x7f62bc15e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:59.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.040+0000 7f62c17c6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f62bc0ad970 0x7f62bc15e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40064/0 (socket says 172.21.15.102:40064) 2023-10-14T09:37:59.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.040+0000 7f62c17c6640 1 -- 172.21.15.102:0/3461344710 learned_addr learned my addr 172.21.15.102:0/3461344710 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:59.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.040+0000 7f62c1fc7640 1 --2- 172.21.15.102:0/3461344710 >> v2:172.21.15.129:3300/0 conn(0x7f62bc06c040 0x7f62bc06c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:59.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.040+0000 7f62c17c6640 1 -- 172.21.15.102:0/3461344710 >> v2:172.21.15.129:3300/0 conn(0x7f62bc06c040 msgr2=0x7f62bc06c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:59.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.040+0000 7f62c17c6640 1 --2- 172.21.15.102:0/3461344710 >> v2:172.21.15.129:3300/0 conn(0x7f62bc06c040 0x7f62bc06c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:59.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.040+0000 7f62c17c6640 1 -- 172.21.15.102:0/3461344710 >> v1:172.21.15.129:6789/0 conn(0x7f62bc15ebc0 legacy=0x7f62bc0cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:59.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.040+0000 7f62c17c6640 1 -- 172.21.15.102:0/3461344710 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc15bf90 con 0x7f62bc0ad970 2023-10-14T09:37:59.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.042+0000 7f62c17c6640 1 --2- 172.21.15.102:0/3461344710 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62bc0ad970 0x7f62bc15e680 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f62bc0cf350 tx=0x7f62ac02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f0a73b8724855a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:59.046 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.042+0000 7f62c0fc5640 1 -- 172.21.15.102:0/3461344710 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac031870 con 0x7f62bc0ad970 2023-10-14T09:37:59.047 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.042+0000 7f62c0fc5640 1 -- 172.21.15.102:0/3461344710 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ac0319d0 con 0x7f62bc0ad970 2023-10-14T09:37:59.047 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.042+0000 7f62c0fc5640 1 -- 172.21.15.102:0/3461344710 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac031d60 con 0x7f62bc0ad970 2023-10-14T09:37:59.047 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.043+0000 7f62c2fc9640 1 -- 172.21.15.102:0/3461344710 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62bc0ad970 msgr2=0x7f62bc15e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:59.047 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.043+0000 7f62c2fc9640 1 --2- 172.21.15.102:0/3461344710 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62bc0ad970 0x7f62bc15e680 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f62bc0cf350 tx=0x7f62ac02b910 comp rx=0 tx=0).stop 2023-10-14T09:37:59.048 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.043+0000 7f62c2fc9640 1 -- 172.21.15.102:0/3461344710 shutdown_connections 2023-10-14T09:37:59.048 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.043+0000 7f62c2fc9640 1 --2- 172.21.15.102:0/3461344710 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62bc0ad970 0x7f62bc15e680 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:59.048 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.043+0000 7f62c2fc9640 1 --2- 172.21.15.102:0/3461344710 >> v2:172.21.15.129:3300/0 conn(0x7f62bc06c040 0x7f62bc06c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:59.049 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.043+0000 7f62c2fc9640 1 -- 172.21.15.102:0/3461344710 >> 172.21.15.102:0/3461344710 conn(0x7f62bc0ce6a0 msgr2=0x7f62bc0ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:59.049 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.043+0000 7f62c2fc9640 1 -- 172.21.15.102:0/3461344710 shutdown_connections 2023-10-14T09:37:59.049 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.043+0000 7f62c2fc9640 1 -- 172.21.15.102:0/3461344710 wait complete. 2023-10-14T09:37:59.052 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.045+0000 7f62c2fc9640 1 Processor -- start 2023-10-14T09:37:59.053 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.045+0000 7f62c2fc9640 1 -- start start 2023-10-14T09:37:59.053 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.047+0000 7f62c2fc9640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f62bc06c040 0x7f62bc0b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:59.053 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.047+0000 7f62c2fc9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f62bc0ad970 0x7f62bc0afd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:59.053 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.047+0000 7f62c2fc9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62bc15ebc0 0x7f62bc0b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:59.054 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.047+0000 7f62c2fc9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc0b3d70 con 0x7f62bc15ebc0 2023-10-14T09:37:59.054 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.047+0000 7f62c2fc9640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc0b31f0 con 0x7f62bc0ad970 2023-10-14T09:37:59.054 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.047+0000 7f62c2fc9640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc0b34d0 con 0x7f62bc06c040 2023-10-14T09:37:59.054 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.047+0000 7f62c27c8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62bc15ebc0 0x7f62bc0b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:59.055 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.047+0000 7f62c27c8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62bc15ebc0 0x7f62bc0b02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40068/0 (socket says 172.21.15.102:40068) 2023-10-14T09:37:59.055 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.047+0000 7f62c27c8640 1 -- 172.21.15.102:0/3255510713 learned_addr learned my addr 172.21.15.102:0/3255510713 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:59.055 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.047+0000 7f62c1fc7640 1 --2- 172.21.15.102:0/3255510713 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f62bc06c040 0x7f62bc0b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:59.055 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.047+0000 7f62c17c6640 1 --2- 172.21.15.102:0/3255510713 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f62bc0ad970 0x7f62bc0afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:59.056 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.047+0000 7f62c27c8640 1 -- 172.21.15.102:0/3255510713 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f62bc06c040 msgr2=0x7f62bc0b0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:59.056 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.047+0000 7f62c27c8640 1 --2- 172.21.15.102:0/3255510713 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f62bc06c040 0x7f62bc0b0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:59.056 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.047+0000 7f62c27c8640 1 -- 172.21.15.102:0/3255510713 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f62bc0ad970 msgr2=0x7f62bc0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:59.056 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.047+0000 7f62c27c8640 1 --2- 172.21.15.102:0/3255510713 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f62bc0ad970 0x7f62bc0afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:59.057 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.047+0000 7f62c27c8640 1 -- 172.21.15.102:0/3255510713 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ac0094d0 con 0x7f62bc15ebc0 2023-10-14T09:37:59.057 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.048+0000 7f62c27c8640 1 --2- 172.21.15.102:0/3255510713 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62bc15ebc0 0x7f62bc0b02c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f62b400c780 tx=0x7f62b400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:59.057 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.048+0000 7f62b27fc640 1 -- 172.21.15.102:0/3255510713 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b4004b60 con 0x7f62bc15ebc0 2023-10-14T09:37:59.058 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.048+0000 7f62b27fc640 1 -- 172.21.15.102:0/3255510713 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b400ce90 con 0x7f62bc15ebc0 2023-10-14T09:37:59.058 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.048+0000 7f62b27fc640 1 -- 172.21.15.102:0/3255510713 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b400a850 con 0x7f62bc15ebc0 2023-10-14T09:37:59.058 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.048+0000 7f62c2fc9640 1 -- 172.21.15.102:0/3255510713 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62bc0b37b0 con 0x7f62bc15ebc0 2023-10-14T09:37:59.058 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.048+0000 7f62c2fc9640 1 -- 172.21.15.102:0/3255510713 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62bc0b0f40 con 0x7f62bc15ebc0 2023-10-14T09:37:59.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.049+0000 7f62c2fc9640 1 -- 172.21.15.102:0/3255510713 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62bc06b330 con 0x7f62bc15ebc0 2023-10-14T09:37:59.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.050+0000 7f62b27fc640 1 -- 172.21.15.102:0/3255510713 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f62b400a9b0 con 0x7f62bc15ebc0 2023-10-14T09:37:59.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.051+0000 7f62b27fc640 1 --2- 172.21.15.102:0/3255510713 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f62a006aea0 0x7f62a006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:59.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.051+0000 7f62b27fc640 1 -- 172.21.15.102:0/3255510713 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f62b40897d0 con 0x7f62bc15ebc0 2023-10-14T09:37:59.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.052+0000 7f62c1fc7640 1 --2- 172.21.15.102:0/3255510713 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f62a006aea0 0x7f62a006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:59.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.052+0000 7f62c1fc7640 1 --2- 172.21.15.102:0/3255510713 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f62a006aea0 0x7f62a006d360 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f62b8006fd0 tx=0x7f62b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:59.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.056+0000 7f62b27fc640 1 -- 172.21.15.102:0/3255510713 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f62b40547e0 con 0x7f62bc15ebc0 2023-10-14T09:37:59.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.243+0000 7f62c2fc9640 1 -- 172.21.15.102:0/3255510713 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f62bc0cc270 con 0x7f62bc15ebc0 2023-10-14T09:37:59.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.244+0000 7f62b27fc640 1 -- 172.21.15.102:0/3255510713 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f62b4057e00 con 0x7f62bc15ebc0 2023-10-14T09:37:59.246 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2023-10-14T09:37:59.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.247+0000 7f62c2fc9640 1 -- 172.21.15.102:0/3255510713 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f62a006aea0 msgr2=0x7f62a006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:59.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.247+0000 7f62c2fc9640 1 --2- 172.21.15.102:0/3255510713 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f62a006aea0 0x7f62a006d360 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f62b8006fd0 tx=0x7f62b8008040 comp rx=0 tx=0).stop 2023-10-14T09:37:59.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.247+0000 7f62c2fc9640 1 -- 172.21.15.102:0/3255510713 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62bc15ebc0 msgr2=0x7f62bc0b02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:59.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.247+0000 7f62c2fc9640 1 --2- 172.21.15.102:0/3255510713 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62bc15ebc0 0x7f62bc0b02c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f62b400c780 tx=0x7f62b400cc40 comp rx=0 tx=0).stop 2023-10-14T09:37:59.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.247+0000 7f62c2fc9640 1 -- 172.21.15.102:0/3255510713 shutdown_connections 2023-10-14T09:37:59.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.247+0000 7f62c2fc9640 1 --2- 172.21.15.102:0/3255510713 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f62a006aea0 0x7f62a006d360 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:59.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.247+0000 7f62c2fc9640 1 --2- 172.21.15.102:0/3255510713 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62bc15ebc0 0x7f62bc0b02c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:59.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.247+0000 7f62c2fc9640 1 --2- 172.21.15.102:0/3255510713 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f62bc0ad970 0x7f62bc0afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:59.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.247+0000 7f62c2fc9640 1 --2- 172.21.15.102:0/3255510713 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f62bc06c040 0x7f62bc0b0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:59.251 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.247+0000 7f62c2fc9640 1 -- 172.21.15.102:0/3255510713 >> 172.21.15.102:0/3255510713 conn(0x7f62bc0ce6a0 msgr2=0x7f62bc0c5770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:59.251 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.247+0000 7f62c2fc9640 1 -- 172.21.15.102:0/3255510713 shutdown_connections 2023-10-14T09:37:59.251 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.247+0000 7f62c2fc9640 1 -- 172.21.15.102:0/3255510713 wait complete. 2023-10-14T09:37:59.324 INFO:tasks.cephfs_test_runner:Starting test: test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) Validate binary .meta file on legacy subvol root doesn't break the system 2023-10-14T09:37:59.325 INFO:tasks.cephfs_test_runner:test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2023-10-14T09:37:59.325 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:37:59.547 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.545+0000 7ff73e9e7640 1 Processor -- start 2023-10-14T09:37:59.547 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.545+0000 7ff73e9e7640 1 -- start start 2023-10-14T09:37:59.549 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.547+0000 7ff73e9e7640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7ff7380adb50 0x7ff73806f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:59.549 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.547+0000 7ff73e9e7640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff738070fd0 0x7ff7380b0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:59.550 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.547+0000 7ff73e9e7640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff738071450 con 0x7ff7380adf30 2023-10-14T09:37:59.550 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.547+0000 7ff73e9e7640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7380cc600 con 0x7ff7380adb50 2023-10-14T09:37:59.550 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.547+0000 7ff73e9e7640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7380cc8e0 con 0x7ff738070fd0 2023-10-14T09:37:59.550 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.547+0000 7ff73cf84640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7ff7380adf30 0x7ff738164f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:59820/0 (socket says 172.21.15.102:59820) 2023-10-14T09:37:59.550 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.547+0000 7ff73cf84640 1 -- 172.21.15.102:0/3409823104 learned_addr learned my addr 172.21.15.102:0/3409823104 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:59.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.548+0000 7ff737fff640 1 --2- 172.21.15.102:0/3409823104 >> v2:172.21.15.129:3300/0 conn(0x7ff7380adb50 0x7ff73806f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:59.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.548+0000 7ff7377fe640 1 --2- 172.21.15.102:0/3409823104 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff738070fd0 0x7ff7380b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:59.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.548+0000 7ff736ffd640 1 -- 172.21.15.102:0/3409823104 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3804450440 0 0) 0x7ff738071450 con 0x7ff7380adf30 2023-10-14T09:37:59.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.548+0000 7ff736ffd640 1 -- 172.21.15.102:0/3409823104 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff720003520 con 0x7ff7380adf30 2023-10-14T09:37:59.553 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.548+0000 7ff736ffd640 1 -- 172.21.15.102:0/3409823104 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2977648066 0 0) 0x7ff720003520 con 0x7ff7380adf30 2023-10-14T09:37:59.554 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.548+0000 7ff736ffd640 1 -- 172.21.15.102:0/3409823104 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff738070fd0 msgr2=0x7ff7380b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:59.554 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.548+0000 7ff736ffd640 1 --2- 172.21.15.102:0/3409823104 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff738070fd0 0x7ff7380b0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:59.554 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.548+0000 7ff736ffd640 1 -- 172.21.15.102:0/3409823104 >> v2:172.21.15.129:3300/0 conn(0x7ff7380adb50 msgr2=0x7ff73806f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:59.554 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.548+0000 7ff736ffd640 1 --2- 172.21.15.102:0/3409823104 >> v2:172.21.15.129:3300/0 conn(0x7ff7380adb50 0x7ff73806f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:59.554 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.548+0000 7ff736ffd640 1 -- 172.21.15.102:0/3409823104 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7380ccbc0 con 0x7ff7380adf30 2023-10-14T09:37:59.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.548+0000 7ff736ffd640 1 -- 172.21.15.102:0/3409823104 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4030661168 0 0) 0x7ff7300019f0 con 0x7ff7380adf30 2023-10-14T09:37:59.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.548+0000 7ff736ffd640 1 -- 172.21.15.102:0/3409823104 >> v1:172.21.15.102:6789/0 conn(0x7ff7380adf30 legacy=0x7ff738164f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:59.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.548+0000 7ff736ffd640 1 --2- 172.21.15.102:0/3409823104 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff738070fd0 0x7ff720003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:59.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.548+0000 7ff736ffd640 1 --2- 172.21.15.102:0/3409823104 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff720003ef0 0x7ff7200047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:59.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.548+0000 7ff736ffd640 1 --2- 172.21.15.102:0/3409823104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff720004d00 0x7ff720005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:59.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.548+0000 7ff736ffd640 1 -- 172.21.15.102:0/3409823104 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7380cc600 con 0x7ff720004d00 2023-10-14T09:37:59.556 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.548+0000 7ff736ffd640 1 -- 172.21.15.102:0/3409823104 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7380cc8e0 con 0x7ff720003ef0 2023-10-14T09:37:59.556 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.548+0000 7ff736ffd640 1 -- 172.21.15.102:0/3409823104 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff72000b980 con 0x7ff738070fd0 2023-10-14T09:37:59.556 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.549+0000 7ff73cf84640 1 --2- 172.21.15.102:0/3409823104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff720004d00 0x7ff720005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:59.556 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.549+0000 7ff737fff640 1 --2- 172.21.15.102:0/3409823104 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff738070fd0 0x7ff720003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:59.556 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.549+0000 7ff7377fe640 1 --2- 172.21.15.102:0/3409823104 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff720003ef0 0x7ff7200047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:59.557 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.549+0000 7ff73cf84640 1 -- 172.21.15.102:0/3409823104 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff738070fd0 msgr2=0x7ff720003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:59.557 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.549+0000 7ff73cf84640 1 --2- 172.21.15.102:0/3409823104 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff738070fd0 0x7ff720003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:59.557 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.549+0000 7ff73cf84640 1 -- 172.21.15.102:0/3409823104 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff720003ef0 msgr2=0x7ff7200047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:59.557 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.549+0000 7ff73cf84640 1 --2- 172.21.15.102:0/3409823104 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff720003ef0 0x7ff7200047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:59.557 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.549+0000 7ff73cf84640 1 -- 172.21.15.102:0/3409823104 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff720003520 con 0x7ff720004d00 2023-10-14T09:37:59.558 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.549+0000 7ff7377fe640 1 --2- 172.21.15.102:0/3409823104 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff720003ef0 0x7ff7200047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:37:59.558 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.550+0000 7ff73cf84640 1 --2- 172.21.15.102:0/3409823104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff720004d00 0x7ff720005180 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff73000a860 tx=0x7ff7200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e07315adc7eba4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:59.558 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.550+0000 7ff736ffd640 1 -- 172.21.15.102:0/3409823104 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff730034630 con 0x7ff720004d00 2023-10-14T09:37:59.558 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.550+0000 7ff736ffd640 1 -- 172.21.15.102:0/3409823104 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73002f070 con 0x7ff720004d00 2023-10-14T09:37:59.558 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.550+0000 7ff736ffd640 1 -- 172.21.15.102:0/3409823104 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff730034a30 con 0x7ff720004d00 2023-10-14T09:37:59.559 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.551+0000 7ff73e9e7640 1 -- 172.21.15.102:0/3409823104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff720004d00 msgr2=0x7ff720005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:59.559 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.551+0000 7ff73e9e7640 1 --2- 172.21.15.102:0/3409823104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff720004d00 0x7ff720005180 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff73000a860 tx=0x7ff7200057f0 comp rx=0 tx=0).stop 2023-10-14T09:37:59.559 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.551+0000 7ff73cf84640 1 -- 172.21.15.102:0/3409823104 reap_dead start 2023-10-14T09:37:59.559 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.551+0000 7ff73e9e7640 1 -- 172.21.15.102:0/3409823104 shutdown_connections 2023-10-14T09:37:59.559 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.551+0000 7ff73e9e7640 1 -- 172.21.15.102:0/3409823104 >> 172.21.15.102:0/3409823104 conn(0x7ff7380cb410 msgr2=0x7ff7380cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:59.560 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.551+0000 7ff73e9e7640 1 -- 172.21.15.102:0/3409823104 shutdown_connections 2023-10-14T09:37:59.560 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.551+0000 7ff73e9e7640 1 -- 172.21.15.102:0/3409823104 wait complete. 2023-10-14T09:37:59.562 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.553+0000 7ff73e9e7640 1 Processor -- start 2023-10-14T09:37:59.562 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.553+0000 7ff73e9e7640 1 -- start start 2023-10-14T09:37:59.562 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.554+0000 7ff73e9e7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff720004d00 0x7ff7380bd550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:59.562 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.554+0000 7ff73e9e7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff7380bda90 0x7ff7380bf770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:59.563 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.554+0000 7ff73e9e7640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7380bfcb0 0x7ff7380c3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:59.563 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.554+0000 7ff73e9e7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7380bdf10 con 0x7ff720004d00 2023-10-14T09:37:59.563 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.554+0000 7ff73e9e7640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7380c38c0 con 0x7ff7380bda90 2023-10-14T09:37:59.563 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.554+0000 7ff73e9e7640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7381fa3e0 con 0x7ff7380bfcb0 2023-10-14T09:37:59.563 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.554+0000 7ff737fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff720004d00 0x7ff7380bd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:59.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.554+0000 7ff737fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff720004d00 0x7ff7380bd550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40072/0 (socket says 172.21.15.102:40072) 2023-10-14T09:37:59.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.554+0000 7ff737fff640 1 -- 172.21.15.102:0/2273593401 learned_addr learned my addr 172.21.15.102:0/2273593401 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:59.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.555+0000 7ff73cf84640 1 --2- 172.21.15.102:0/2273593401 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7380bfcb0 0x7ff7380c3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:59.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.555+0000 7ff7377fe640 1 --2- 172.21.15.102:0/2273593401 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff7380bda90 0x7ff7380bf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:59.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.555+0000 7ff737fff640 1 -- 172.21.15.102:0/2273593401 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7380bfcb0 msgr2=0x7ff7380c3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:59.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.555+0000 7ff737fff640 1 --2- 172.21.15.102:0/2273593401 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7380bfcb0 0x7ff7380c3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:59.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.555+0000 7ff737fff640 1 -- 172.21.15.102:0/2273593401 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff7380bda90 msgr2=0x7ff7380bf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:59.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.555+0000 7ff737fff640 1 --2- 172.21.15.102:0/2273593401 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff7380bda90 0x7ff7380bf770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:59.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.555+0000 7ff737fff640 1 -- 172.21.15.102:0/2273593401 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7380c0430 con 0x7ff720004d00 2023-10-14T09:37:59.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.555+0000 7ff737fff640 1 --2- 172.21.15.102:0/2273593401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff720004d00 0x7ff7380bd550 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff728011700 tx=0x7ff728011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:59.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.555+0000 7ff734ff9640 1 -- 172.21.15.102:0/2273593401 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72800f9c0 con 0x7ff720004d00 2023-10-14T09:37:59.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.555+0000 7ff734ff9640 1 -- 172.21.15.102:0/2273593401 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff72800fb20 con 0x7ff720004d00 2023-10-14T09:37:59.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.555+0000 7ff734ff9640 1 -- 172.21.15.102:0/2273593401 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72800fe90 con 0x7ff720004d00 2023-10-14T09:37:59.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.555+0000 7ff73e9e7640 1 -- 172.21.15.102:0/2273593401 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7380c0710 con 0x7ff720004d00 2023-10-14T09:37:59.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.555+0000 7ff73e9e7640 1 -- 172.21.15.102:0/2273593401 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7380c0cd0 con 0x7ff720004d00 2023-10-14T09:37:59.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.557+0000 7ff73e9e7640 1 -- 172.21.15.102:0/2273593401 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff73804e160 con 0x7ff720004d00 2023-10-14T09:37:59.567 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.557+0000 7ff734ff9640 1 -- 172.21.15.102:0/2273593401 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff728015460 con 0x7ff720004d00 2023-10-14T09:37:59.567 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.559+0000 7ff734ff9640 1 --2- 172.21.15.102:0/2273593401 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff72406aea0 0x7ff72406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:59.567 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.559+0000 7ff734ff9640 1 -- 172.21.15.102:0/2273593401 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff728089ab0 con 0x7ff720004d00 2023-10-14T09:37:59.567 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.559+0000 7ff7377fe640 1 --2- 172.21.15.102:0/2273593401 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff72406aea0 0x7ff72406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:59.567 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.560+0000 7ff7377fe640 1 --2- 172.21.15.102:0/2273593401 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff72406aea0 0x7ff72406d360 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff7380b48e0 tx=0x7ff72c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:59.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.563+0000 7ff734ff9640 1 -- 172.21.15.102:0/2273593401 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff728054bf0 con 0x7ff720004d00 2023-10-14T09:37:59.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.748+0000 7ff73e9e7640 1 -- 172.21.15.102:0/2273593401 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7380b4910 con 0x7ff720004d00 2023-10-14T09:37:59.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.750+0000 7ff734ff9640 1 -- 172.21.15.102:0/2273593401 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16541 (secure 0 0 0) 0x7ff728022090 con 0x7ff720004d00 2023-10-14T09:37:59.752 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:37:59.752 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":22,"fsid":"8a6cd69d-7f5b-4f2a-806a-0176c10aed50","created":"2023-10-14T09:36:56.745172+0000","modified":"2023-10-14T09:37:22.712469+0000","last_up_change":"2023-10-14T09:37:09.791473+0000","last_in_change":"2023-10-14T09:37:00.547186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:37:09.952407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:37:19.560925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:37:20.363385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e5aef8f3-878f-482b-b522-9a5b958b90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6801","nonce":1727250718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6803","nonce":1727250718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6807","nonce":1727250718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6805","nonce":1727250718}]},"public_addr":"172.21.15.102:6801/1727250718","cluster_addr":"172.21.15.102:6803/1727250718","heartbeat_back_addr":"172.21.15.102:6807/1727250718","heartbeat_front_addr":"172.21.15.102:6805/1727250718","state":["exists","up"]},{"osd":1,"uuid":"4a8cf50e-387b-4d47-9588-bd22e375a9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6809","nonce":1095651107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6811","nonce":1095651107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6815","nonce":1095651107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6813","nonce":1095651107}]},"public_addr":"172.21.15.102:6809/1095651107","cluster_addr":"172.21.15.102:6811/1095651107","heartbeat_back_addr":"172.21.15.102:6815/1095651107","heartbeat_front_addr":"172.21.15.102:6813/1095651107","state":["exists","up"]},{"osd":2,"uuid":"009ef55f-8a63-4219-bacd-d7c7b4500867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6820","nonce":2198222556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6825","nonce":2198222556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6831","nonce":2198222556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6829","nonce":2198222556}]},"public_addr":"172.21.15.102:6820/2198222556","cluster_addr":"172.21.15.102:6825/2198222556","heartbeat_back_addr":"172.21.15.102:6831/2198222556","heartbeat_front_addr":"172.21.15.102:6829/2198222556","state":["exists","up"]},{"osd":3,"uuid":"f2110eae-2ff9-4ed9-93d6-bd2361618211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6818","nonce":654726740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6821","nonce":654726740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6827","nonce":654726740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6823","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6824","nonce":654726740}]},"public_addr":"172.21.15.102:6818/654726740","cluster_addr":"172.21.15.102:6821/654726740","heartbeat_back_addr":"172.21.15.102:6827/654726740","heartbeat_front_addr":"172.21.15.102:6824/654726740","state":["exists","up"]},{"osd":4,"uuid":"33f1ae34-3100-40f7-9cb8-0eca2b358693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6817","nonce":507586170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6819","nonce":507586170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6823","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6825","nonce":507586170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6821","nonce":507586170}]},"public_addr":"172.21.15.129:6817/507586170","cluster_addr":"172.21.15.129:6819/507586170","heartbeat_back_addr":"172.21.15.129:6825/507586170","heartbeat_front_addr":"172.21.15.129:6821/507586170","state":["exists","up"]},{"osd":5,"uuid":"fab2fc62-3f3e-450d-93e0-770f39e80710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6801","nonce":1913451073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6803","nonce":1913451073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6807","nonce":1913451073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6805","nonce":1913451073}]},"public_addr":"172.21.15.129:6801/1913451073","cluster_addr":"172.21.15.129:6803/1913451073","heartbeat_back_addr":"172.21.15.129:6807/1913451073","heartbeat_front_addr":"172.21.15.129:6805/1913451073","state":["exists","up"]},{"osd":6,"uuid":"d7cc1d69-92e7-4253-a127-cfc0444a4809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6809","nonce":2853291511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6811","nonce":2853291511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6815","nonce":2853291511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6813","nonce":2853291511}]},"public_addr":"172.21.15.129:6809/2853291511","cluster_addr":"172.21.15.129:6811/2853291511","heartbeat_back_addr":"172.21.15.129:6815/2853291511","heartbeat_front_addr":"172.21.15.129:6813/2853291511","state":["exists","up"]},{"osd":7,"uuid":"1e403de1-09e2-4370-b9a7-e790ac44bbee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6824","nonce":2933886914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6827","nonce":2933886914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6831","nonce":2933886914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6829","nonce":2933886914}]},"public_addr":"172.21.15.129:6824/2933886914","cluster_addr":"172.21.15.129:6827/2933886914","heartbeat_back_addr":"172.21.15.129:6831/2933886914","heartbeat_front_addr":"172.21.15.129:6829/2933886914","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.849661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.868113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.933488+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.891794+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.901861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.858750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.911712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.996765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:37:59.755 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.752+0000 7ff73e9e7640 1 -- 172.21.15.102:0/2273593401 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff72406aea0 msgr2=0x7ff72406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:59.755 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.753+0000 7ff73e9e7640 1 --2- 172.21.15.102:0/2273593401 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff72406aea0 0x7ff72406d360 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff7380b48e0 tx=0x7ff72c008040 comp rx=0 tx=0).stop 2023-10-14T09:37:59.755 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.753+0000 7ff73e9e7640 1 -- 172.21.15.102:0/2273593401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff720004d00 msgr2=0x7ff7380bd550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:59.755 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.753+0000 7ff73e9e7640 1 --2- 172.21.15.102:0/2273593401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff720004d00 0x7ff7380bd550 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff728011700 tx=0x7ff728011bc0 comp rx=0 tx=0).stop 2023-10-14T09:37:59.756 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.753+0000 7ff73e9e7640 1 -- 172.21.15.102:0/2273593401 shutdown_connections 2023-10-14T09:37:59.756 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.753+0000 7ff73e9e7640 1 --2- 172.21.15.102:0/2273593401 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff72406aea0 0x7ff72406d360 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:59.756 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.753+0000 7ff73e9e7640 1 --2- 172.21.15.102:0/2273593401 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7380bfcb0 0x7ff7380c3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:59.756 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.753+0000 7ff73e9e7640 1 --2- 172.21.15.102:0/2273593401 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff7380bda90 0x7ff7380bf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:59.756 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.753+0000 7ff73e9e7640 1 --2- 172.21.15.102:0/2273593401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff720004d00 0x7ff7380bd550 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:59.756 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.753+0000 7ff73e9e7640 1 -- 172.21.15.102:0/2273593401 >> 172.21.15.102:0/2273593401 conn(0x7ff7380cb410 msgr2=0x7ff7380aec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:59.757 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.753+0000 7ff73e9e7640 1 -- 172.21.15.102:0/2273593401 shutdown_connections 2023-10-14T09:37:59.757 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.753+0000 7ff73e9e7640 1 -- 172.21.15.102:0/2273593401 wait complete. 2023-10-14T09:37:59.773 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T09:37:09.952407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T09:37:19.560925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T09:37:20.363385+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T09:37:59.774 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T09:37:59.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.977+0000 7ff9f24f2640 1 Processor -- start 2023-10-14T09:37:59.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.977+0000 7ff9f24f2640 1 -- start start 2023-10-14T09:37:59.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.979+0000 7ff9f24f2640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff9ec15ad70 0x7ff9ec069da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:59.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.979+0000 7ff9f24f2640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7ff9ec0caac0 0x7ff9ec06a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:59.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.979+0000 7ff9f24f2640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9ec0cb030 con 0x7ff9ec0c9ca0 2023-10-14T09:37:59.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.979+0000 7ff9f24f2640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9ec0c91c0 con 0x7ff9ec0caac0 2023-10-14T09:37:59.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.979+0000 7ff9f24f2640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec0c94a0 con 0x7ff9ec15ad70 2023-10-14T09:37:59.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.979+0000 7ff9e3fff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7ff9ec0c9ca0 0x7ff9ec0ca3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:59822/0 (socket says 172.21.15.102:59822) 2023-10-14T09:37:59.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.979+0000 7ff9e3fff640 1 -- 172.21.15.102:0/1204699883 learned_addr learned my addr 172.21.15.102:0/1204699883 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:37:59.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.980+0000 7ff9ebfff640 1 --2- 172.21.15.102:0/1204699883 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff9ec15ad70 0x7ff9ec069da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:59.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.980+0000 7ff9f0a8f640 1 --2- 172.21.15.102:0/1204699883 >> v2:172.21.15.129:3300/0 conn(0x7ff9ec0caac0 0x7ff9ec06a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:59.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.980+0000 7ff9eb7fe640 1 -- 172.21.15.102:0/1204699883 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2285717684 0 0) 0x7ff9ec0cb030 con 0x7ff9ec0c9ca0 2023-10-14T09:37:59.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.980+0000 7ff9eb7fe640 1 -- 172.21.15.102:0/1204699883 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9d8003520 con 0x7ff9ec0c9ca0 2023-10-14T09:37:59.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.980+0000 7ff9eb7fe640 1 -- 172.21.15.102:0/1204699883 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2198669837 0 0) 0x7ff9d8003520 con 0x7ff9ec0c9ca0 2023-10-14T09:37:59.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.980+0000 7ff9eb7fe640 1 -- 172.21.15.102:0/1204699883 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff9ec15ad70 msgr2=0x7ff9ec069da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:59.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.980+0000 7ff9eb7fe640 1 --2- 172.21.15.102:0/1204699883 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff9ec15ad70 0x7ff9ec069da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:59.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.980+0000 7ff9eb7fe640 1 -- 172.21.15.102:0/1204699883 >> v2:172.21.15.129:3300/0 conn(0x7ff9ec0caac0 msgr2=0x7ff9ec06a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:59.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.980+0000 7ff9eb7fe640 1 --2- 172.21.15.102:0/1204699883 >> v2:172.21.15.129:3300/0 conn(0x7ff9ec0caac0 0x7ff9ec06a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:59.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.980+0000 7ff9eb7fe640 1 -- 172.21.15.102:0/1204699883 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ec0c9780 con 0x7ff9ec0c9ca0 2023-10-14T09:37:59.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.980+0000 7ff9eb7fe640 1 -- 172.21.15.102:0/1204699883 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4030661168 0 0) 0x7ff9d4001670 con 0x7ff9ec0c9ca0 2023-10-14T09:37:59.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.980+0000 7ff9eb7fe640 1 -- 172.21.15.102:0/1204699883 >> v1:172.21.15.102:6789/0 conn(0x7ff9ec0c9ca0 legacy=0x7ff9ec0ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:59.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.980+0000 7ff9eb7fe640 1 --2- 172.21.15.102:0/1204699883 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff9d8003970 0x7ff9d8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:59.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.980+0000 7ff9eb7fe640 1 --2- 172.21.15.102:0/1204699883 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9d80047c0 0x7ff9d8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:59.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.980+0000 7ff9eb7fe640 1 --2- 172.21.15.102:0/1204699883 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff9ec15ad70 0x7ff9d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:59.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.980+0000 7ff9eb7fe640 1 -- 172.21.15.102:0/1204699883 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec0c91c0 con 0x7ff9d80047c0 2023-10-14T09:37:59.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.980+0000 7ff9eb7fe640 1 -- 172.21.15.102:0/1204699883 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec0c94a0 con 0x7ff9d8003970 2023-10-14T09:37:59.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.980+0000 7ff9eb7fe640 1 -- 172.21.15.102:0/1204699883 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d800b980 con 0x7ff9ec15ad70 2023-10-14T09:37:59.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.981+0000 7ff9e3fff640 1 --2- 172.21.15.102:0/1204699883 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9d80047c0 0x7ff9d8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:59.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.981+0000 7ff9ebfff640 1 --2- 172.21.15.102:0/1204699883 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff9d8003970 0x7ff9d8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:59.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.981+0000 7ff9f0a8f640 1 --2- 172.21.15.102:0/1204699883 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff9ec15ad70 0x7ff9d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:59.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.981+0000 7ff9e3fff640 1 -- 172.21.15.102:0/1204699883 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff9ec15ad70 msgr2=0x7ff9d8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:59.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.981+0000 7ff9e3fff640 1 --2- 172.21.15.102:0/1204699883 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff9ec15ad70 0x7ff9d8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:59.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.981+0000 7ff9e3fff640 1 -- 172.21.15.102:0/1204699883 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff9d8003970 msgr2=0x7ff9d8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:37:59.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.981+0000 7ff9e3fff640 1 --2- 172.21.15.102:0/1204699883 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff9d8003970 0x7ff9d8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:59.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.981+0000 7ff9e3fff640 1 -- 172.21.15.102:0/1204699883 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d8003520 con 0x7ff9d80047c0 2023-10-14T09:37:59.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.983+0000 7ff9e3fff640 1 --2- 172.21.15.102:0/1204699883 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9d80047c0 0x7ff9d8004c40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff9d400c290 tx=0x7ff9d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a6213cd107d6609 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:59.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.983+0000 7ff9eb7fe640 1 -- 172.21.15.102:0/1204699883 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d4005ad0 con 0x7ff9d80047c0 2023-10-14T09:37:59.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.983+0000 7ff9eb7fe640 1 -- 172.21.15.102:0/1204699883 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d4005c50 con 0x7ff9d80047c0 2023-10-14T09:37:59.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.983+0000 7ff9eb7fe640 1 -- 172.21.15.102:0/1204699883 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d402c8d0 con 0x7ff9d80047c0 2023-10-14T09:37:59.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.984+0000 7ff9f24f2640 1 -- 172.21.15.102:0/1204699883 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9d80047c0 msgr2=0x7ff9d8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:59.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.984+0000 7ff9f24f2640 1 --2- 172.21.15.102:0/1204699883 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9d80047c0 0x7ff9d8004c40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff9d400c290 tx=0x7ff9d80057f0 comp rx=0 tx=0).stop 2023-10-14T09:37:59.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.984+0000 7ff9f0a8f640 1 -- 172.21.15.102:0/1204699883 reap_dead start 2023-10-14T09:37:59.993 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.984+0000 7ff9f24f2640 1 -- 172.21.15.102:0/1204699883 shutdown_connections 2023-10-14T09:37:59.993 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.984+0000 7ff9f24f2640 1 -- 172.21.15.102:0/1204699883 >> 172.21.15.102:0/1204699883 conn(0x7ff9ec0ce9b0 msgr2=0x7ff9ec0cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:37:59.993 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.984+0000 7ff9f24f2640 1 -- 172.21.15.102:0/1204699883 shutdown_connections 2023-10-14T09:37:59.993 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.984+0000 7ff9f24f2640 1 -- 172.21.15.102:0/1204699883 wait complete. 2023-10-14T09:37:59.993 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.986+0000 7ff9f24f2640 1 Processor -- start 2023-10-14T09:37:59.994 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.986+0000 7ff9f24f2640 1 -- start start 2023-10-14T09:37:59.994 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.987+0000 7ff9f24f2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9d80047c0 0x7ff9ec159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:59.994 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.987+0000 7ff9f24f2640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff9ec0af360 0x7ff9ec06b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:59.994 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.987+0000 7ff9f24f2640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff9ec0af7c0 0x7ff9ec06b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:37:59.995 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.987+0000 7ff9f24f2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec0c4600 con 0x7ff9d80047c0 2023-10-14T09:37:59.995 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.987+0000 7ff9f24f2640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec0c4320 con 0x7ff9ec0af360 2023-10-14T09:37:59.995 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.987+0000 7ff9f24f2640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec0ae880 con 0x7ff9ec0af7c0 2023-10-14T09:37:59.995 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.987+0000 7ff9ebfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9d80047c0 0x7ff9ec159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:37:59.995 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.987+0000 7ff9ebfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9d80047c0 0x7ff9ec159e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40094/0 (socket says 172.21.15.102:40094) 2023-10-14T09:37:59.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.987+0000 7ff9ebfff640 1 -- 172.21.15.102:0/3245146311 learned_addr learned my addr 172.21.15.102:0/3245146311 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:37:59.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.987+0000 7ff9ebfff640 1 -- 172.21.15.102:0/3245146311 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff9ec0af7c0 msgr2=0x7ff9ec06b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:59.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.987+0000 7ff9ebfff640 1 --2- 172.21.15.102:0/3245146311 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff9ec0af7c0 0x7ff9ec06b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:59.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.987+0000 7ff9ebfff640 1 -- 172.21.15.102:0/3245146311 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff9ec0af360 msgr2=0x7ff9ec06b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:37:59.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.987+0000 7ff9ebfff640 1 --2- 172.21.15.102:0/3245146311 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff9ec0af360 0x7ff9ec06b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:37:59.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.987+0000 7ff9ebfff640 1 -- 172.21.15.102:0/3245146311 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ec0aeb60 con 0x7ff9d80047c0 2023-10-14T09:37:59.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.988+0000 7ff9ebfff640 1 --2- 172.21.15.102:0/3245146311 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9d80047c0 0x7ff9ec159e90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc0118e0 tx=0x7ff9dc011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:37:59.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.988+0000 7ff9e97fa640 1 -- 172.21.15.102:0/3245146311 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc00fa70 con 0x7ff9d80047c0 2023-10-14T09:37:59.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.988+0000 7ff9e97fa640 1 -- 172.21.15.102:0/3245146311 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9dc00fbd0 con 0x7ff9d80047c0 2023-10-14T09:37:59.998 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.988+0000 7ff9e97fa640 1 -- 172.21.15.102:0/3245146311 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc014440 con 0x7ff9d80047c0 2023-10-14T09:37:59.998 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.988+0000 7ff9f24f2640 1 -- 172.21.15.102:0/3245146311 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9ec0aee40 con 0x7ff9d80047c0 2023-10-14T09:37:59.998 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.988+0000 7ff9f24f2640 1 -- 172.21.15.102:0/3245146311 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9ec0c3780 con 0x7ff9d80047c0 2023-10-14T09:37:59.998 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.989+0000 7ff9f24f2640 1 -- 172.21.15.102:0/3245146311 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9ec0ae6e0 con 0x7ff9d80047c0 2023-10-14T09:37:59.999 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.990+0000 7ff9e97fa640 1 -- 172.21.15.102:0/3245146311 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff9dc0145a0 con 0x7ff9d80047c0 2023-10-14T09:38:00.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.991+0000 7ff9e97fa640 1 --2- 172.21.15.102:0/3245146311 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff9cc06ae70 0x7ff9cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:00.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.991+0000 7ff9e97fa640 1 -- 172.21.15.102:0/3245146311 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9dc089d30 con 0x7ff9d80047c0 2023-10-14T09:38:00.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.991+0000 7ff9e3fff640 1 --2- 172.21.15.102:0/3245146311 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff9cc06ae70 0x7ff9cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:00.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.992+0000 7ff9e3fff640 1 --2- 172.21.15.102:0/3245146311 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff9cc06ae70 0x7ff9cc06d330 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4034000 tx=0x7ff9d402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:00.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:37:59.996+0000 7ff9e97fa640 1 -- 172.21.15.102:0/3245146311 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff9ec0ae6e0 con 0x7ff9d80047c0 2023-10-14T09:38:00.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.183+0000 7ff9f24f2640 1 -- 172.21.15.102:0/3245146311 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff9ec0ae6e0 con 0x7ff9d80047c0 2023-10-14T09:38:00.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.184+0000 7ff9e97fa640 1 -- 172.21.15.102:0/3245146311 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff9ec0ae6e0 con 0x7ff9d80047c0 2023-10-14T09:38:00.186 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2023-10-14T09:38:00.189 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.187+0000 7ff9f24f2640 1 -- 172.21.15.102:0/3245146311 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff9cc06ae70 msgr2=0x7ff9cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:00.189 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.187+0000 7ff9f24f2640 1 --2- 172.21.15.102:0/3245146311 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff9cc06ae70 0x7ff9cc06d330 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4034000 tx=0x7ff9d402e000 comp rx=0 tx=0).stop 2023-10-14T09:38:00.189 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.187+0000 7ff9f24f2640 1 -- 172.21.15.102:0/3245146311 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9d80047c0 msgr2=0x7ff9ec159e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:00.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.187+0000 7ff9f24f2640 1 --2- 172.21.15.102:0/3245146311 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9d80047c0 0x7ff9ec159e90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc0118e0 tx=0x7ff9dc011da0 comp rx=0 tx=0).stop 2023-10-14T09:38:00.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.187+0000 7ff9f24f2640 1 -- 172.21.15.102:0/3245146311 shutdown_connections 2023-10-14T09:38:00.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.187+0000 7ff9f24f2640 1 --2- 172.21.15.102:0/3245146311 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff9cc06ae70 0x7ff9cc06d330 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:00.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.187+0000 7ff9f24f2640 1 --2- 172.21.15.102:0/3245146311 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff9ec0af7c0 0x7ff9ec06b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:00.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.187+0000 7ff9f24f2640 1 --2- 172.21.15.102:0/3245146311 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff9ec0af360 0x7ff9ec06b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:00.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.187+0000 7ff9f24f2640 1 --2- 172.21.15.102:0/3245146311 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9d80047c0 0x7ff9ec159e90 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:00.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.187+0000 7ff9f24f2640 1 -- 172.21.15.102:0/3245146311 >> 172.21.15.102:0/3245146311 conn(0x7ff9ec0ce9b0 msgr2=0x7ff9ec15d460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:00.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.187+0000 7ff9f24f2640 1 -- 172.21.15.102:0/3245146311 shutdown_connections 2023-10-14T09:38:00.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.188+0000 7ff9f24f2640 1 -- 172.21.15.102:0/3245146311 wait complete. 2023-10-14T09:38:00.207 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T09:38:00.412 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.408+0000 7fb1defdc640 1 Processor -- start 2023-10-14T09:38:00.413 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.409+0000 7fb1defdc640 1 -- start start 2023-10-14T09:38:00.413 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.410+0000 7fb1defdc640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fb1d815d030 0x7fb1d80d1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:00.413 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.410+0000 7fb1defdc640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb1d815d410 0x7fb1d8161450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:00.414 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.410+0000 7fb1defdc640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1d80b5d90 con 0x7fb1d8161990 2023-10-14T09:38:00.414 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.410+0000 7fb1defdc640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d80d2b50 con 0x7fb1d815d030 2023-10-14T09:38:00.414 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.410+0000 7fb1defdc640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d8160fc0 con 0x7fb1d815d410 2023-10-14T09:38:00.416 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.411+0000 7fb1dcd78640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fb1d815d030 0x7fb1d80d1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:00.416 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.411+0000 7fb1d7fff640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb1d815d410 0x7fb1d8161450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:00.417 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.411+0000 7fb1dd579640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fb1d8161990 0x7fb1d80cd260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.102:41896/0 (socket says 172.21.15.102:41896) 2023-10-14T09:38:00.417 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.411+0000 7fb1dcd78640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fb1d815d030 0x7fb1d80d1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.102:52934/0 (socket says 172.21.15.102:52934) 2023-10-14T09:38:00.417 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.411+0000 7fb1dd579640 1 -- 172.21.15.102:0/2547556083 learned_addr learned my addr 172.21.15.102:0/2547556083 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:00.417 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.411+0000 7fb1dcd78640 1 -- 172.21.15.102:0/2547556083 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb1d815d410 msgr2=0x7fb1d8161450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:00.418 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.411+0000 7fb1dcd78640 1 --2- 172.21.15.102:0/2547556083 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb1d815d410 0x7fb1d8161450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:00.418 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.411+0000 7fb1dcd78640 1 -- 172.21.15.102:0/2547556083 >> v1:172.21.15.129:6789/0 conn(0x7fb1d8161990 legacy=0x7fb1d80cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:00.418 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.411+0000 7fb1dcd78640 1 -- 172.21.15.102:0/2547556083 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d80d25d0 con 0x7fb1d815d030 2023-10-14T09:38:00.418 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.413+0000 7fb1dcd78640 1 --2- 172.21.15.102:0/2547556083 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb1d815d030 0x7fb1d80d1630 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb1c80097a0 tx=0x7fb1c802b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c810ebeb7da11248 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:00.419 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.413+0000 7fb1d77fe640 1 -- 172.21.15.102:0/2547556083 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c8030800 con 0x7fb1d815d030 2023-10-14T09:38:00.419 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.413+0000 7fb1d77fe640 1 -- 172.21.15.102:0/2547556083 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c8030960 con 0x7fb1d815d030 2023-10-14T09:38:00.419 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.413+0000 7fb1d77fe640 1 -- 172.21.15.102:0/2547556083 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c8030cf0 con 0x7fb1d815d030 2023-10-14T09:38:00.419 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.414+0000 7fb1defdc640 1 -- 172.21.15.102:0/2547556083 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb1d815d030 msgr2=0x7fb1d80d1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:00.420 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.414+0000 7fb1defdc640 1 --2- 172.21.15.102:0/2547556083 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb1d815d030 0x7fb1d80d1630 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb1c80097a0 tx=0x7fb1c802b940 comp rx=0 tx=0).stop 2023-10-14T09:38:00.420 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.414+0000 7fb1defdc640 1 -- 172.21.15.102:0/2547556083 shutdown_connections 2023-10-14T09:38:00.420 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.414+0000 7fb1defdc640 1 --2- 172.21.15.102:0/2547556083 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb1d815d410 0x7fb1d8161450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:00.420 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.414+0000 7fb1defdc640 1 --2- 172.21.15.102:0/2547556083 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb1d815d030 0x7fb1d80d1630 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:00.420 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.414+0000 7fb1defdc640 1 -- 172.21.15.102:0/2547556083 >> 172.21.15.102:0/2547556083 conn(0x7fb1d80cf720 msgr2=0x7fb1d80cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:00.421 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.414+0000 7fb1defdc640 1 -- 172.21.15.102:0/2547556083 shutdown_connections 2023-10-14T09:38:00.421 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.414+0000 7fb1defdc640 1 -- 172.21.15.102:0/2547556083 wait complete. 2023-10-14T09:38:00.423 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.416+0000 7fb1defdc640 1 Processor -- start 2023-10-14T09:38:00.423 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.416+0000 7fb1defdc640 1 -- start start 2023-10-14T09:38:00.423 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.417+0000 7fb1defdc640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb1d815d030 0x7fb1d80b4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:00.424 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.417+0000 7fb1defdc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1d815d410 0x7fb1d81572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:00.424 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.417+0000 7fb1defdc640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb1d8161990 0x7fb1d8157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:00.424 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.417+0000 7fb1defdc640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d80ca8b0 con 0x7fb1d815d410 2023-10-14T09:38:00.424 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.417+0000 7fb1defdc640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d80c9ce0 con 0x7fb1d8161990 2023-10-14T09:38:00.424 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.417+0000 7fb1defdc640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d80b45b0 con 0x7fb1d815d030 2023-10-14T09:38:00.425 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.417+0000 7fb1d7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1d815d410 0x7fb1d81572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:00.425 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.417+0000 7fb1d7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1d815d410 0x7fb1d81572e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40108/0 (socket says 172.21.15.102:40108) 2023-10-14T09:38:00.425 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.417+0000 7fb1d7fff640 1 -- 172.21.15.102:0/845939263 learned_addr learned my addr 172.21.15.102:0/845939263 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:00.425 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.417+0000 7fb1d7fff640 1 -- 172.21.15.102:0/845939263 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb1d815d030 msgr2=0x7fb1d80b4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:00.425 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.417+0000 7fb1d7fff640 1 --2- 172.21.15.102:0/845939263 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb1d815d030 0x7fb1d80b4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:00.426 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.417+0000 7fb1d7fff640 1 -- 172.21.15.102:0/845939263 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb1d8161990 msgr2=0x7fb1d8157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:00.426 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.417+0000 7fb1d7fff640 1 --2- 172.21.15.102:0/845939263 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb1d8161990 0x7fb1d8157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:00.426 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.417+0000 7fb1d7fff640 1 -- 172.21.15.102:0/845939263 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c8009400 con 0x7fb1d815d410 2023-10-14T09:38:00.426 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.418+0000 7fb1d7fff640 1 --2- 172.21.15.102:0/845939263 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1d815d410 0x7fb1d81572e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb1c000e9b0 tx=0x7fb1c000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:00.426 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.418+0000 7fb1d57fa640 1 -- 172.21.15.102:0/845939263 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0009670 con 0x7fb1d815d410 2023-10-14T09:38:00.427 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.418+0000 7fb1d57fa640 1 -- 172.21.15.102:0/845939263 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c000c9a0 con 0x7fb1d815d410 2023-10-14T09:38:00.427 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.418+0000 7fb1defdc640 1 -- 172.21.15.102:0/845939263 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d80c9f80 con 0x7fb1d815d410 2023-10-14T09:38:00.427 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.418+0000 7fb1d57fa640 1 -- 172.21.15.102:0/845939263 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c000cd50 con 0x7fb1d815d410 2023-10-14T09:38:00.427 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.418+0000 7fb1defdc640 1 -- 172.21.15.102:0/845939263 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d80ca540 con 0x7fb1d815d410 2023-10-14T09:38:00.427 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.419+0000 7fb1defdc640 1 -- 172.21.15.102:0/845939263 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d804e160 con 0x7fb1d815d410 2023-10-14T09:38:00.427 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.420+0000 7fb1d57fa640 1 -- 172.21.15.102:0/845939263 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb1c0013470 con 0x7fb1d815d410 2023-10-14T09:38:00.428 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.421+0000 7fb1d57fa640 1 --2- 172.21.15.102:0/845939263 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fb1b806ae70 0x7fb1b806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:00.428 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.421+0000 7fb1d57fa640 1 -- 172.21.15.102:0/845939263 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1c0089960 con 0x7fb1d815d410 2023-10-14T09:38:00.428 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.421+0000 7fb1dcd78640 1 --2- 172.21.15.102:0/845939263 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fb1b806ae70 0x7fb1b806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:00.429 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.422+0000 7fb1dcd78640 1 --2- 172.21.15.102:0/845939263 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fb1b806ae70 0x7fb1b806d330 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8036000 tx=0x7fb1c803b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:00.429 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.425+0000 7fb1d57fa640 1 -- 172.21.15.102:0/845939263 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb1c0054970 con 0x7fb1d815d410 2023-10-14T09:38:00.617 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.615+0000 7fb1defdc640 1 -- 172.21.15.102:0/845939263 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb1d80c9aa0 con 0x7fb1d815d410 2023-10-14T09:38:00.617 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.616+0000 7fb1d57fa640 1 -- 172.21.15.102:0/845939263 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb1c0017020 con 0x7fb1d815d410 2023-10-14T09:38:00.618 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2023-10-14T09:38:00.620 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.618+0000 7fb1defdc640 1 -- 172.21.15.102:0/845939263 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fb1b806ae70 msgr2=0x7fb1b806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:00.621 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.618+0000 7fb1defdc640 1 --2- 172.21.15.102:0/845939263 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fb1b806ae70 0x7fb1b806d330 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8036000 tx=0x7fb1c803b040 comp rx=0 tx=0).stop 2023-10-14T09:38:00.621 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.618+0000 7fb1defdc640 1 -- 172.21.15.102:0/845939263 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1d815d410 msgr2=0x7fb1d81572e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:00.621 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.618+0000 7fb1defdc640 1 --2- 172.21.15.102:0/845939263 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1d815d410 0x7fb1d81572e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb1c000e9b0 tx=0x7fb1c000ee70 comp rx=0 tx=0).stop 2023-10-14T09:38:00.621 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.618+0000 7fb1defdc640 1 -- 172.21.15.102:0/845939263 shutdown_connections 2023-10-14T09:38:00.621 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.618+0000 7fb1defdc640 1 --2- 172.21.15.102:0/845939263 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fb1b806ae70 0x7fb1b806d330 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:00.622 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.618+0000 7fb1defdc640 1 --2- 172.21.15.102:0/845939263 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb1d8161990 0x7fb1d8157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:00.622 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.618+0000 7fb1defdc640 1 --2- 172.21.15.102:0/845939263 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1d815d410 0x7fb1d81572e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:00.622 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.618+0000 7fb1defdc640 1 --2- 172.21.15.102:0/845939263 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb1d815d030 0x7fb1d80b4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:00.622 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.618+0000 7fb1defdc640 1 -- 172.21.15.102:0/845939263 >> 172.21.15.102:0/845939263 conn(0x7fb1d80cf720 msgr2=0x7fb1d80b5f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:00.622 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.619+0000 7fb1defdc640 1 -- 172.21.15.102:0/845939263 shutdown_connections 2023-10-14T09:38:00.623 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.619+0000 7fb1defdc640 1 -- 172.21.15.102:0/845939263 wait complete. 2023-10-14T09:38:00.639 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T09:38:00.849 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.847+0000 7f350f105640 1 Processor -- start 2023-10-14T09:38:00.850 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.847+0000 7f350f105640 1 -- start start 2023-10-14T09:38:00.851 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.849+0000 7f350f105640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f350806c850 0x7f35080ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:00.851 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.849+0000 7f350f105640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3508070360 con 0x7f3508159ab0 2023-10-14T09:38:00.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.849+0000 7f350f105640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35080cd1f0 con 0x7f3508159e90 2023-10-14T09:38:00.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.849+0000 7f350f105640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f350815d890 con 0x7f350806c850 2023-10-14T09:38:00.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.849+0000 7f350cea1640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f3508159ab0 0x7f350806fc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:59826/0 (socket says 172.21.15.102:59826) 2023-10-14T09:38:00.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.849+0000 7f350cea1640 1 -- 172.21.15.102:0/1583946838 learned_addr learned my addr 172.21.15.102:0/1583946838 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:00.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.849+0000 7f350d6a2640 1 --2- 172.21.15.102:0/1583946838 >> v2:172.21.15.102:3300/0 conn(0x7f350806c850 0x7f35080ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:00.855 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.850+0000 7f35077fe640 1 -- 172.21.15.102:0/1583946838 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3744645761 0 0) 0x7f3508070360 con 0x7f3508159ab0 2023-10-14T09:38:00.855 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.850+0000 7f35077fe640 1 -- 172.21.15.102:0/1583946838 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34f8003520 con 0x7f3508159ab0 2023-10-14T09:38:00.855 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.850+0000 7f350d6a2640 1 -- 172.21.15.102:0/1583946838 >> v1:172.21.15.129:6789/0 conn(0x7f3508159e90 legacy=0x7f350806c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:00.855 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.850+0000 7f350d6a2640 1 -- 172.21.15.102:0/1583946838 >> v1:172.21.15.102:6789/0 conn(0x7f3508159ab0 legacy=0x7f350806fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:00.856 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.850+0000 7f350d6a2640 1 -- 172.21.15.102:0/1583946838 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35080cd4d0 con 0x7f350806c850 2023-10-14T09:38:00.856 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.851+0000 7f350d6a2640 1 --2- 172.21.15.102:0/1583946838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f350806c850 0x7f35080ce370 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3500009d90 tx=0x7f350002bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=167a74c7a9287286 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:00.856 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.851+0000 7f35077fe640 1 -- 172.21.15.102:0/1583946838 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350002cb40 con 0x7f350806c850 2023-10-14T09:38:00.856 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.851+0000 7f35077fe640 1 -- 172.21.15.102:0/1583946838 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350002cca0 con 0x7f350806c850 2023-10-14T09:38:00.857 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.851+0000 7f35077fe640 1 -- 172.21.15.102:0/1583946838 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3500034660 con 0x7f350806c850 2023-10-14T09:38:00.857 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.852+0000 7f350f105640 1 -- 172.21.15.102:0/1583946838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f350806c850 msgr2=0x7f35080ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:00.857 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.852+0000 7f350f105640 1 --2- 172.21.15.102:0/1583946838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f350806c850 0x7f35080ce370 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3500009d90 tx=0x7f350002bd90 comp rx=0 tx=0).stop 2023-10-14T09:38:00.857 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.852+0000 7f350f105640 1 -- 172.21.15.102:0/1583946838 shutdown_connections 2023-10-14T09:38:00.857 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.852+0000 7f350f105640 1 --2- 172.21.15.102:0/1583946838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f350806c850 0x7f35080ce370 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:00.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.852+0000 7f350f105640 1 -- 172.21.15.102:0/1583946838 >> 172.21.15.102:0/1583946838 conn(0x7f35080ce9b0 msgr2=0x7f35080cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:00.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.852+0000 7f350f105640 1 -- 172.21.15.102:0/1583946838 shutdown_connections 2023-10-14T09:38:00.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.852+0000 7f350f105640 1 -- 172.21.15.102:0/1583946838 wait complete. 2023-10-14T09:38:00.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.854+0000 7f350f105640 1 Processor -- start 2023-10-14T09:38:00.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.854+0000 7f350f105640 1 -- start start 2023-10-14T09:38:00.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.855+0000 7f350f105640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f350806c850 0x7f35080c70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:00.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.855+0000 7f350f105640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3508159ab0 0x7f35080acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:00.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.855+0000 7f350f105640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3508159e90 0x7f350814ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:00.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.855+0000 7f350f105640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35080c7620 con 0x7f3508159e90 2023-10-14T09:38:00.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.855+0000 7f350f105640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35080c6040 con 0x7f350806c850 2023-10-14T09:38:00.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.855+0000 7f350f105640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35080c6320 con 0x7f3508159ab0 2023-10-14T09:38:00.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.855+0000 7f350d6a2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3508159e90 0x7f350814ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:00.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.855+0000 7f350d6a2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3508159e90 0x7f350814ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40122/0 (socket says 172.21.15.102:40122) 2023-10-14T09:38:00.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.855+0000 7f350d6a2640 1 -- 172.21.15.102:0/2766645255 learned_addr learned my addr 172.21.15.102:0/2766645255 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:00.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.855+0000 7f350cea1640 1 --2- 172.21.15.102:0/2766645255 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f350806c850 0x7f35080c70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:00.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.856+0000 7f350d6a2640 1 -- 172.21.15.102:0/2766645255 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3508159ab0 msgr2=0x7f35080acb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:00.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.856+0000 7f350d6a2640 1 --2- 172.21.15.102:0/2766645255 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3508159ab0 0x7f35080acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:00.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.856+0000 7f350d6a2640 1 -- 172.21.15.102:0/2766645255 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f350806c850 msgr2=0x7f35080c70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:00.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.856+0000 7f350d6a2640 1 --2- 172.21.15.102:0/2766645255 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f350806c850 0x7f35080c70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:00.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.856+0000 7f350d6a2640 1 -- 172.21.15.102:0/2766645255 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3500009a70 con 0x7f3508159e90 2023-10-14T09:38:00.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.856+0000 7f350d6a2640 1 --2- 172.21.15.102:0/2766645255 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3508159e90 0x7f350814ba10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3500009d90 tx=0x7f3500004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:00.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.856+0000 7f35057fa640 1 -- 172.21.15.102:0/2766645255 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3500040650 con 0x7f3508159e90 2023-10-14T09:38:00.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.856+0000 7f35057fa640 1 -- 172.21.15.102:0/2766645255 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35000407b0 con 0x7f3508159e90 2023-10-14T09:38:00.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.856+0000 7f35057fa640 1 -- 172.21.15.102:0/2766645255 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3500040b60 con 0x7f3508159e90 2023-10-14T09:38:00.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.856+0000 7f350f105640 1 -- 172.21.15.102:0/2766645255 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35080c6600 con 0x7f3508159e90 2023-10-14T09:38:00.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.856+0000 7f350f105640 1 -- 172.21.15.102:0/2766645255 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35080c6bc0 con 0x7f3508159e90 2023-10-14T09:38:00.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.858+0000 7f350f105640 1 -- 172.21.15.102:0/2766645255 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f350804e160 con 0x7f3508159e90 2023-10-14T09:38:00.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.859+0000 7f35057fa640 1 -- 172.21.15.102:0/2766645255 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3500040cc0 con 0x7f3508159e90 2023-10-14T09:38:00.866 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.860+0000 7f35057fa640 1 --2- 172.21.15.102:0/2766645255 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f34ec06ae70 0x7f34ec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:00.866 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.860+0000 7f35057fa640 1 -- 172.21.15.102:0/2766645255 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35000ac540 con 0x7f3508159e90 2023-10-14T09:38:00.866 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.860+0000 7f350cea1640 1 --2- 172.21.15.102:0/2766645255 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f34ec06ae70 0x7f34ec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:00.866 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.861+0000 7f350cea1640 1 --2- 172.21.15.102:0/2766645255 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f34ec06ae70 0x7f34ec06d330 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f34fc005880 tx=0x7f34fc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:00.867 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:00.865+0000 7f35057fa640 1 -- 172.21.15.102:0/2766645255 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3500077610 con 0x7f3508159e90 2023-10-14T09:38:01.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.058+0000 7f350f105640 1 -- 172.21.15.102:0/2766645255 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f35080adf40 con 0x7f3508159e90 2023-10-14T09:38:01.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.059+0000 7f35057fa640 1 -- 172.21.15.102:0/2766645255 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f350007ac30 con 0x7f3508159e90 2023-10-14T09:38:01.061 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2023-10-14T09:38:01.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.062+0000 7f350f105640 1 -- 172.21.15.102:0/2766645255 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f34ec06ae70 msgr2=0x7f34ec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:01.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.062+0000 7f350f105640 1 --2- 172.21.15.102:0/2766645255 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f34ec06ae70 0x7f34ec06d330 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f34fc005880 tx=0x7f34fc009040 comp rx=0 tx=0).stop 2023-10-14T09:38:01.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.062+0000 7f350f105640 1 -- 172.21.15.102:0/2766645255 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3508159e90 msgr2=0x7f350814ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:01.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.062+0000 7f350f105640 1 --2- 172.21.15.102:0/2766645255 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3508159e90 0x7f350814ba10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3500009d90 tx=0x7f3500004a40 comp rx=0 tx=0).stop 2023-10-14T09:38:01.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.062+0000 7f350f105640 1 -- 172.21.15.102:0/2766645255 shutdown_connections 2023-10-14T09:38:01.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.062+0000 7f350f105640 1 --2- 172.21.15.102:0/2766645255 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f34ec06ae70 0x7f34ec06d330 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:01.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.062+0000 7f350f105640 1 --2- 172.21.15.102:0/2766645255 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3508159e90 0x7f350814ba10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:01.066 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.062+0000 7f350f105640 1 --2- 172.21.15.102:0/2766645255 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3508159ab0 0x7f35080acb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:01.066 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.062+0000 7f350f105640 1 --2- 172.21.15.102:0/2766645255 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f350806c850 0x7f35080c70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:01.066 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.062+0000 7f350f105640 1 -- 172.21.15.102:0/2766645255 >> 172.21.15.102:0/2766645255 conn(0x7f35080ce9b0 msgr2=0x7f3508156ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:01.067 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.062+0000 7f350f105640 1 -- 172.21.15.102:0/2766645255 shutdown_connections 2023-10-14T09:38:01.067 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.062+0000 7f350f105640 1 -- 172.21.15.102:0/2766645255 wait complete. 2023-10-14T09:38:01.082 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade' 2023-10-14T09:38:01.295 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.293+0000 7f1d9a57c640 1 Processor -- start 2023-10-14T09:38:01.295 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.293+0000 7f1d9a57c640 1 -- start start 2023-10-14T09:38:01.296 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.294+0000 7f1d9a57c640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f1d940ce390 0x7f1d9415e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:01.296 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.294+0000 7f1d9a57c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d9415ed60 con 0x7f1d9415aaa0 2023-10-14T09:38:01.297 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.294+0000 7f1d9a57c640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d940707e0 con 0x7f1d9415ae80 2023-10-14T09:38:01.297 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.294+0000 7f1d9a57c640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d9406b810 con 0x7f1d940ce390 2023-10-14T09:38:01.297 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.295+0000 7f1d93fff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f1d9415aaa0 0x7f1d940cc560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:59842/0 (socket says 172.21.15.102:59842) 2023-10-14T09:38:01.297 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.295+0000 7f1d93fff640 1 -- 172.21.15.102:0/3540838527 learned_addr learned my addr 172.21.15.102:0/3540838527 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:01.299 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.295+0000 7f1d98b19640 1 --2- 172.21.15.102:0/3540838527 >> v2:172.21.15.129:3300/0 conn(0x7f1d940ce390 0x7f1d9415e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:01.300 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.295+0000 7f1d92ffd640 1 -- 172.21.15.102:0/3540838527 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3500806688 0 0) 0x7f1d9415ed60 con 0x7f1d9415aaa0 2023-10-14T09:38:01.300 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.295+0000 7f1d92ffd640 1 -- 172.21.15.102:0/3540838527 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d7c003520 con 0x7f1d9415aaa0 2023-10-14T09:38:01.300 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.295+0000 7f1d92ffd640 1 -- 172.21.15.102:0/3540838527 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1177149865 0 0) 0x7f1d7c003520 con 0x7f1d9415aaa0 2023-10-14T09:38:01.300 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.296+0000 7f1d92ffd640 1 -- 172.21.15.102:0/3540838527 >> v2:172.21.15.129:3300/0 conn(0x7f1d940ce390 msgr2=0x7f1d9415e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:01.300 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.296+0000 7f1d92ffd640 1 --2- 172.21.15.102:0/3540838527 >> v2:172.21.15.129:3300/0 conn(0x7f1d940ce390 0x7f1d9415e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:01.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.296+0000 7f1d92ffd640 1 -- 172.21.15.102:0/3540838527 >> v1:172.21.15.129:6789/0 conn(0x7f1d9415ae80 legacy=0x7f1d94070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:01.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.296+0000 7f1d92ffd640 1 -- 172.21.15.102:0/3540838527 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d9415ef90 con 0x7f1d9415aaa0 2023-10-14T09:38:01.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.296+0000 7f1d92ffd640 1 -- 172.21.15.102:0/3540838527 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4030661168 0 0) 0x7f1d84001670 con 0x7f1d9415aaa0 2023-10-14T09:38:01.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.296+0000 7f1d98b19640 1 --2- 172.21.15.102:0/3540838527 >> v2:172.21.15.129:3300/0 conn(0x7f1d940ce390 0x7f1d9415e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:38:01.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.296+0000 7f1d92ffd640 1 -- 172.21.15.102:0/3540838527 >> v1:172.21.15.102:6789/0 conn(0x7f1d9415aaa0 legacy=0x7f1d940cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:01.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.296+0000 7f1d92ffd640 1 --2- 172.21.15.102:0/3540838527 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d7c003970 0x7f1d7c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:01.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.296+0000 7f1d92ffd640 1 --2- 172.21.15.102:0/3540838527 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1d7c0047c0 0x7f1d7c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:01.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.296+0000 7f1d92ffd640 1 --2- 172.21.15.102:0/3540838527 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d7c005180 0x7f1d7c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:01.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.296+0000 7f1d92ffd640 1 -- 172.21.15.102:0/3540838527 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9406b810 con 0x7f1d7c003970 2023-10-14T09:38:01.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.296+0000 7f1d92ffd640 1 -- 172.21.15.102:0/3540838527 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c00c0d0 con 0x7f1d7c005180 2023-10-14T09:38:01.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.296+0000 7f1d92ffd640 1 -- 172.21.15.102:0/3540838527 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c00c290 con 0x7f1d7c0047c0 2023-10-14T09:38:01.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.296+0000 7f1d93fff640 1 --2- 172.21.15.102:0/3540838527 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d7c003970 0x7f1d7c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:01.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.296+0000 7f1d93fff640 1 -- 172.21.15.102:0/3540838527 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1d7c0047c0 msgr2=0x7f1d7c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:01.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.296+0000 7f1d98b19640 1 --2- 172.21.15.102:0/3540838527 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d7c005180 0x7f1d7c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:01.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.296+0000 7f1d93fff640 1 --2- 172.21.15.102:0/3540838527 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1d7c0047c0 0x7f1d7c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:01.304 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.296+0000 7f1d93fff640 1 -- 172.21.15.102:0/3540838527 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d7c005180 msgr2=0x7f1d7c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:01.304 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.296+0000 7f1d93fff640 1 --2- 172.21.15.102:0/3540838527 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d7c005180 0x7f1d7c00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:01.304 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.296+0000 7f1d98b19640 1 -- 172.21.15.102:0/3540838527 reap_dead start 2023-10-14T09:38:01.304 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.296+0000 7f1d93fff640 1 -- 172.21.15.102:0/3540838527 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7c003520 con 0x7f1d7c003970 2023-10-14T09:38:01.304 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.297+0000 7f1d93fff640 1 --2- 172.21.15.102:0/3540838527 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d7c003970 0x7f1d7c003d90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1d8400c190 tx=0x7f1d7c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ae1d116134678a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:01.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.298+0000 7f1d92ffd640 1 -- 172.21.15.102:0/3540838527 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d84005ad0 con 0x7f1d7c003970 2023-10-14T09:38:01.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.298+0000 7f1d92ffd640 1 -- 172.21.15.102:0/3540838527 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d84005c30 con 0x7f1d7c003970 2023-10-14T09:38:01.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.298+0000 7f1d92ffd640 1 -- 172.21.15.102:0/3540838527 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8402cae0 con 0x7f1d7c003970 2023-10-14T09:38:01.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.298+0000 7f1d9a57c640 1 -- 172.21.15.102:0/3540838527 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d7c003970 msgr2=0x7f1d7c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:01.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.298+0000 7f1d9a57c640 1 --2- 172.21.15.102:0/3540838527 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d7c003970 0x7f1d7c003d90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1d8400c190 tx=0x7f1d7c0057f0 comp rx=0 tx=0).stop 2023-10-14T09:38:01.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.298+0000 7f1d9a57c640 1 -- 172.21.15.102:0/3540838527 shutdown_connections 2023-10-14T09:38:01.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.298+0000 7f1d9a57c640 1 --2- 172.21.15.102:0/3540838527 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d7c003970 0x7f1d7c003d90 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:01.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.298+0000 7f1d9a57c640 1 -- 172.21.15.102:0/3540838527 >> 172.21.15.102:0/3540838527 conn(0x7f1d940cb410 msgr2=0x7f1d940cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:01.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.298+0000 7f1d9a57c640 1 -- 172.21.15.102:0/3540838527 shutdown_connections 2023-10-14T09:38:01.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.299+0000 7f1d9a57c640 1 -- 172.21.15.102:0/3540838527 wait complete. 2023-10-14T09:38:01.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.300+0000 7f1d9a57c640 1 Processor -- start 2023-10-14T09:38:01.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.300+0000 7f1d9a57c640 1 -- start start 2023-10-14T09:38:01.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.301+0000 7f1d9a57c640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1d7c003970 0x7f1d940c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:01.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.301+0000 7f1d9a57c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d941584b0 0x7f1d941f55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:01.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.301+0000 7f1d9a57c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d941f2970 0x7f1d941f2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:01.311 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.301+0000 7f1d9a57c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d940c3820 con 0x7f1d941f2970 2023-10-14T09:38:01.311 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.301+0000 7f1d9a57c640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d940c3b00 con 0x7f1d941584b0 2023-10-14T09:38:01.311 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.301+0000 7f1d9a57c640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d940c3de0 con 0x7f1d7c003970 2023-10-14T09:38:01.311 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.302+0000 7f1d98b19640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d941f2970 0x7f1d941f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:01.311 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.302+0000 7f1d98b19640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d941f2970 0x7f1d941f2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40134/0 (socket says 172.21.15.102:40134) 2023-10-14T09:38:01.311 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.302+0000 7f1d98b19640 1 -- 172.21.15.102:0/1648421111 learned_addr learned my addr 172.21.15.102:0/1648421111 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:01.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.302+0000 7f1d98b19640 1 -- 172.21.15.102:0/1648421111 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1d7c003970 msgr2=0x7f1d940c2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:01.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.302+0000 7f1d98b19640 1 --2- 172.21.15.102:0/1648421111 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1d7c003970 0x7f1d940c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:01.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.302+0000 7f1d98b19640 1 -- 172.21.15.102:0/1648421111 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d941584b0 msgr2=0x7f1d941f55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:01.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.302+0000 7f1d937fe640 1 --2- 172.21.15.102:0/1648421111 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d941584b0 0x7f1d941f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:01.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.302+0000 7f1d98b19640 1 --2- 172.21.15.102:0/1648421111 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d941584b0 0x7f1d941f55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:01.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.302+0000 7f1d98b19640 1 -- 172.21.15.102:0/1648421111 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d940c40c0 con 0x7f1d941f2970 2023-10-14T09:38:01.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.302+0000 7f1d98b19640 1 --2- 172.21.15.102:0/1648421111 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d941f2970 0x7f1d941f2e20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1d940c5a10 tx=0x7f1d8c004700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:01.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.303+0000 7f1d90ff9640 1 -- 172.21.15.102:0/1648421111 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c007cf0 con 0x7f1d941f2970 2023-10-14T09:38:01.315 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.303+0000 7f1d90ff9640 1 -- 172.21.15.102:0/1648421111 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8c007e50 con 0x7f1d941f2970 2023-10-14T09:38:01.315 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.303+0000 7f1d90ff9640 1 -- 172.21.15.102:0/1648421111 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c014620 con 0x7f1d941f2970 2023-10-14T09:38:01.315 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.303+0000 7f1d9a57c640 1 -- 172.21.15.102:0/1648421111 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d940c43a0 con 0x7f1d941f2970 2023-10-14T09:38:01.315 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.303+0000 7f1d9a57c640 1 -- 172.21.15.102:0/1648421111 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d940c35f0 con 0x7f1d941f2970 2023-10-14T09:38:01.315 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.304+0000 7f1d9a57c640 1 -- 172.21.15.102:0/1648421111 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d940c4590 con 0x7f1d941f2970 2023-10-14T09:38:01.316 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.305+0000 7f1d90ff9640 1 -- 172.21.15.102:0/1648421111 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1d8c01d3b0 con 0x7f1d941f2970 2023-10-14T09:38:01.316 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.306+0000 7f1d90ff9640 1 --2- 172.21.15.102:0/1648421111 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1d8006ae70 0x7f1d8006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:01.316 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.306+0000 7f1d90ff9640 1 -- 172.21.15.102:0/1648421111 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d8c089400 con 0x7f1d941f2970 2023-10-14T09:38:01.316 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.306+0000 7f1d93fff640 1 --2- 172.21.15.102:0/1648421111 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1d8006ae70 0x7f1d8006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:01.316 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.307+0000 7f1d93fff640 1 --2- 172.21.15.102:0/1648421111 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1d8006ae70 0x7f1d8006d330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1d84034000 tx=0x7f1d84039040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:01.317 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.310+0000 7f1d90ff9640 1 -- 172.21.15.102:0/1648421111 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1d8c0544b0 con 0x7f1d941f2970 2023-10-14T09:38:01.441 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T09:38:01.449 DEBUG:teuthology.orchestra.run.smithi129:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T09:38:01.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.576+0000 7f1d9a57c640 1 -- 172.21.15.102:0/1648421111 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]} v 0) v1 -- 0x7f1d9404e160 con 0x7f1d941f2970 2023-10-14T09:38:01.789 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.785+0000 7f1d90ff9640 1 -- 172.21.15.102:0/1648421111 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]}]=0 v61) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1d8c057ad0 con 0x7f1d941f2970 2023-10-14T09:38:01.791 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.789+0000 7f1d9a57c640 1 -- 172.21.15.102:0/1648421111 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1d8006ae70 msgr2=0x7f1d8006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:01.791 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.789+0000 7f1d9a57c640 1 --2- 172.21.15.102:0/1648421111 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1d8006ae70 0x7f1d8006d330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1d84034000 tx=0x7f1d84039040 comp rx=0 tx=0).stop 2023-10-14T09:38:01.791 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.789+0000 7f1d9a57c640 1 -- 172.21.15.102:0/1648421111 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d941f2970 msgr2=0x7f1d941f2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:01.792 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.789+0000 7f1d9a57c640 1 --2- 172.21.15.102:0/1648421111 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d941f2970 0x7f1d941f2e20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1d940c5a10 tx=0x7f1d8c004700 comp rx=0 tx=0).stop 2023-10-14T09:38:01.792 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.789+0000 7f1d9a57c640 1 -- 172.21.15.102:0/1648421111 shutdown_connections 2023-10-14T09:38:01.792 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.789+0000 7f1d9a57c640 1 --2- 172.21.15.102:0/1648421111 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1d8006ae70 0x7f1d8006d330 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:01.792 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.789+0000 7f1d9a57c640 1 --2- 172.21.15.102:0/1648421111 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d941f2970 0x7f1d941f2e20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:01.792 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.789+0000 7f1d9a57c640 1 --2- 172.21.15.102:0/1648421111 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d941584b0 0x7f1d941f55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:01.792 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.789+0000 7f1d9a57c640 1 --2- 172.21.15.102:0/1648421111 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1d7c003970 0x7f1d940c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:01.793 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.789+0000 7f1d9a57c640 1 -- 172.21.15.102:0/1648421111 >> 172.21.15.102:0/1648421111 conn(0x7f1d940cb410 msgr2=0x7f1d940cc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:01.793 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.789+0000 7f1d9a57c640 1 -- 172.21.15.102:0/1648421111 shutdown_connections 2023-10-14T09:38:01.793 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:01.789+0000 7f1d9a57c640 1 -- 172.21.15.102:0/1648421111 wait complete. 2023-10-14T09:38:01.812 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T09:38:02.075 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.073+0000 7fad1df5e640 1 Processor -- start 2023-10-14T09:38:02.075 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.073+0000 7fad1df5e640 1 -- start start 2023-10-14T09:38:02.076 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.074+0000 7fad1df5e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fad18159e90 0x7fad180ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:02.077 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.074+0000 7fad1df5e640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fad1806c140 0x7fad1806c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:02.077 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.074+0000 7fad1df5e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad1806cad0 con 0x7fad18159ab0 2023-10-14T09:38:02.077 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.075+0000 7fad1df5e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad1815d890 con 0x7fad18159e90 2023-10-14T09:38:02.077 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.075+0000 7fad1df5e640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad18070360 con 0x7fad1806c140 2023-10-14T09:38:02.077 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.075+0000 7fad177fe640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fad18159ab0 0x7fad1806fc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:42988/0 (socket says 172.21.15.102:42988) 2023-10-14T09:38:02.078 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.075+0000 7fad177fe640 1 -- 172.21.15.102:0/3874081585 learned_addr learned my addr 172.21.15.102:0/3874081585 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:02.078 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.075+0000 7fad16ffd640 1 --2- 172.21.15.102:0/3874081585 >> v2:172.21.15.102:3300/0 conn(0x7fad18159e90 0x7fad180ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:02.079 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.075+0000 7fad17fff640 1 --2- 172.21.15.102:0/3874081585 >> v2:172.21.15.129:3300/0 conn(0x7fad1806c140 0x7fad1806c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:02.080 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.075+0000 7fad16ffd640 1 -- 172.21.15.102:0/3874081585 >> v2:172.21.15.129:3300/0 conn(0x7fad1806c140 msgr2=0x7fad1806c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:02.080 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.075+0000 7fad16ffd640 1 --2- 172.21.15.102:0/3874081585 >> v2:172.21.15.129:3300/0 conn(0x7fad1806c140 0x7fad1806c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:02.080 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.075+0000 7fad167fc640 1 -- 172.21.15.102:0/3874081585 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3464260586 0 0) 0x7fad08001110 con 0x7fad18159ab0 2023-10-14T09:38:02.080 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.075+0000 7fad16ffd640 1 -- 172.21.15.102:0/3874081585 >> v1:172.21.15.102:6789/0 conn(0x7fad18159ab0 legacy=0x7fad1806fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:02.080 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.076+0000 7fad16ffd640 1 -- 172.21.15.102:0/3874081585 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad180cd1f0 con 0x7fad18159e90 2023-10-14T09:38:02.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.077+0000 7fad16ffd640 1 --2- 172.21.15.102:0/3874081585 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad18159e90 0x7fad180ce370 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fad180adcd0 tx=0x7fad0c02b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d534da97ad48c01 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:02.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.077+0000 7fad167fc640 1 -- 172.21.15.102:0/3874081585 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c031710 con 0x7fad18159e90 2023-10-14T09:38:02.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.077+0000 7fad167fc640 1 -- 172.21.15.102:0/3874081585 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0c02f050 con 0x7fad18159e90 2023-10-14T09:38:02.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.077+0000 7fad167fc640 1 -- 172.21.15.102:0/3874081585 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c031a90 con 0x7fad18159e90 2023-10-14T09:38:02.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.077+0000 7fad1df5e640 1 -- 172.21.15.102:0/3874081585 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad18159e90 msgr2=0x7fad180ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:02.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.077+0000 7fad1df5e640 1 --2- 172.21.15.102:0/3874081585 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad18159e90 0x7fad180ce370 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fad180adcd0 tx=0x7fad0c02b7b0 comp rx=0 tx=0).stop 2023-10-14T09:38:02.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.078+0000 7fad1df5e640 1 -- 172.21.15.102:0/3874081585 shutdown_connections 2023-10-14T09:38:02.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.078+0000 7fad1df5e640 1 --2- 172.21.15.102:0/3874081585 >> v2:172.21.15.129:3300/0 conn(0x7fad1806c140 0x7fad1806c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:02.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.078+0000 7fad1df5e640 1 --2- 172.21.15.102:0/3874081585 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad18159e90 0x7fad180ce370 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:02.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.078+0000 7fad1df5e640 1 -- 172.21.15.102:0/3874081585 >> 172.21.15.102:0/3874081585 conn(0x7fad180ce9b0 msgr2=0x7fad180cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:02.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.078+0000 7fad1df5e640 1 -- 172.21.15.102:0/3874081585 shutdown_connections 2023-10-14T09:38:02.083 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.078+0000 7fad1df5e640 1 -- 172.21.15.102:0/3874081585 wait complete. 2023-10-14T09:38:02.085 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.079+0000 7fad1df5e640 1 Processor -- start 2023-10-14T09:38:02.085 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.080+0000 7fad1df5e640 1 -- start start 2023-10-14T09:38:02.085 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.080+0000 7fad1df5e640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fad1806c140 0x7fad1814dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:02.085 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.080+0000 7fad1df5e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad18159ab0 0x7fad1815c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:02.085 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.080+0000 7fad1df5e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad18159e90 0x7fad181f3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:02.086 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.080+0000 7fad1df5e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad180c4450 con 0x7fad18159ab0 2023-10-14T09:38:02.086 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.080+0000 7fad1df5e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad180c3840 con 0x7fad18159e90 2023-10-14T09:38:02.086 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.080+0000 7fad1df5e640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad180c3b20 con 0x7fad1806c140 2023-10-14T09:38:02.086 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.081+0000 7fad16ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad18159ab0 0x7fad1815c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:02.086 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.081+0000 7fad16ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad18159ab0 0x7fad1815c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41618/0 (socket says 172.21.15.102:41618) 2023-10-14T09:38:02.086 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.081+0000 7fad16ffd640 1 -- 172.21.15.102:0/1476860558 learned_addr learned my addr 172.21.15.102:0/1476860558 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:02.087 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.081+0000 7fad177fe640 1 --2- 172.21.15.102:0/1476860558 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fad1806c140 0x7fad1814dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:02.087 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.081+0000 7fad17fff640 1 --2- 172.21.15.102:0/1476860558 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad18159e90 0x7fad181f3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:02.087 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.081+0000 7fad16ffd640 1 -- 172.21.15.102:0/1476860558 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fad1806c140 msgr2=0x7fad1814dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:02.087 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.081+0000 7fad16ffd640 1 --2- 172.21.15.102:0/1476860558 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fad1806c140 0x7fad1814dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:02.087 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.081+0000 7fad16ffd640 1 -- 172.21.15.102:0/1476860558 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad18159e90 msgr2=0x7fad181f3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:02.088 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.081+0000 7fad16ffd640 1 --2- 172.21.15.102:0/1476860558 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad18159e90 0x7fad181f3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:02.088 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.081+0000 7fad16ffd640 1 -- 172.21.15.102:0/1476860558 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0c009400 con 0x7fad18159ab0 2023-10-14T09:38:02.088 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.082+0000 7fad16ffd640 1 --2- 172.21.15.102:0/1476860558 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad18159ab0 0x7fad1815c9f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fad0c000c00 tx=0x7fad0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:02.088 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.082+0000 7facfffff640 1 -- 172.21.15.102:0/1476860558 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c033910 con 0x7fad18159ab0 2023-10-14T09:38:02.088 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.082+0000 7facfffff640 1 -- 172.21.15.102:0/1476860558 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0c033a70 con 0x7fad18159ab0 2023-10-14T09:38:02.089 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.082+0000 7facfffff640 1 -- 172.21.15.102:0/1476860558 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c033e00 con 0x7fad18159ab0 2023-10-14T09:38:02.089 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.082+0000 7fad1df5e640 1 -- 172.21.15.102:0/1476860558 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad180c3e00 con 0x7fad18159ab0 2023-10-14T09:38:02.089 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.082+0000 7fad1df5e640 1 -- 172.21.15.102:0/1476860558 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad1814e000 con 0x7fad18159ab0 2023-10-14T09:38:02.090 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.083+0000 7fad1df5e640 1 -- 172.21.15.102:0/1476860558 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad1814e190 con 0x7fad18159ab0 2023-10-14T09:38:02.090 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.084+0000 7facfffff640 1 -- 172.21.15.102:0/1476860558 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fad0c03a040 con 0x7fad18159ab0 2023-10-14T09:38:02.090 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.085+0000 7facfffff640 1 --2- 172.21.15.102:0/1476860558 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fad0406ae70 0x7fad0406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:02.090 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.085+0000 7facfffff640 1 -- 172.21.15.102:0/1476860558 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad0c0ab0c0 con 0x7fad18159ab0 2023-10-14T09:38:02.091 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.085+0000 7fad177fe640 1 --2- 172.21.15.102:0/1476860558 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fad0406ae70 0x7fad0406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:02.091 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.086+0000 7fad177fe640 1 --2- 172.21.15.102:0/1476860558 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fad0406ae70 0x7fad0406d330 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fad08000f60 tx=0x7fad080079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:02.091 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.090+0000 7facfffff640 1 -- 172.21.15.102:0/1476860558 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fad0c0760d0 con 0x7fad18159ab0 2023-10-14T09:38:02.280 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.279+0000 7fad1df5e640 1 -- 172.21.15.102:0/1476860558 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fad1804e160 con 0x7fad18159ab0 2023-10-14T09:38:02.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.286+0000 7facfffff640 1 -- 172.21.15.102:0/1476860558 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fad0c0796f0 con 0x7fad18159ab0 2023-10-14T09:38:02.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.288+0000 7fad1df5e640 1 -- 172.21.15.102:0/1476860558 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fad0406ae70 msgr2=0x7fad0406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:02.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.288+0000 7fad1df5e640 1 --2- 172.21.15.102:0/1476860558 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fad0406ae70 0x7fad0406d330 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fad08000f60 tx=0x7fad080079b0 comp rx=0 tx=0).stop 2023-10-14T09:38:02.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.288+0000 7fad1df5e640 1 -- 172.21.15.102:0/1476860558 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad18159ab0 msgr2=0x7fad1815c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:02.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.288+0000 7fad1df5e640 1 --2- 172.21.15.102:0/1476860558 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad18159ab0 0x7fad1815c9f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fad0c000c00 tx=0x7fad0c0046c0 comp rx=0 tx=0).stop 2023-10-14T09:38:02.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.289+0000 7fad1df5e640 1 -- 172.21.15.102:0/1476860558 shutdown_connections 2023-10-14T09:38:02.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.289+0000 7fad1df5e640 1 --2- 172.21.15.102:0/1476860558 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fad0406ae70 0x7fad0406d330 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:02.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.289+0000 7fad1df5e640 1 --2- 172.21.15.102:0/1476860558 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad18159e90 0x7fad181f3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:02.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.289+0000 7fad1df5e640 1 --2- 172.21.15.102:0/1476860558 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad18159ab0 0x7fad1815c9f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:02.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.289+0000 7fad1df5e640 1 --2- 172.21.15.102:0/1476860558 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fad1806c140 0x7fad1814dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:02.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.289+0000 7fad1df5e640 1 -- 172.21.15.102:0/1476860558 >> 172.21.15.102:0/1476860558 conn(0x7fad180ce9b0 msgr2=0x7fad180b0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:02.293 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.289+0000 7fad1df5e640 1 -- 172.21.15.102:0/1476860558 shutdown_connections 2023-10-14T09:38:02.293 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.289+0000 7fad1df5e640 1 -- 172.21.15.102:0/1476860558 wait complete. 2023-10-14T09:38:02.308 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T09:38:02.309 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T09:38:02.430 DEBUG:teuthology.orchestra.run.smithi129:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T09:38:02.552 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T09:38:02.553 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-10-14T09:38:02.553 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T09:38:02.614 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-10-14T09:38:02.614 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T09:38:02.670 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-10-14T09:38:02.671 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T09:38:02.726 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:38:02.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.938+0000 7f3e35c4b640 1 Processor -- start 2023-10-14T09:38:02.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.938+0000 7f3e35c4b640 1 -- start start 2023-10-14T09:38:02.941 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.939+0000 7f3e35c4b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3e3015aaa0 0x7f3e3015e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:02.942 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.939+0000 7f3e35c4b640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f3e3015ae80 0x7f3e300cc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:02.942 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.939+0000 7f3e35c4b640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3e300ccaa0 0x7f3e30070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:02.942 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.939+0000 7f3e35c4b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e3006b810 con 0x7f3e3015aaa0 2023-10-14T09:38:02.942 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.939+0000 7f3e35c4b640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e3015ed60 con 0x7f3e3015ae80 2023-10-14T09:38:02.942 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.939+0000 7f3e35c4b640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e300707e0 con 0x7f3e300ccaa0 2023-10-14T09:38:02.943 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.940+0000 7f3e2f7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3e3015aaa0 0x7f3e3015e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:02.943 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.940+0000 7f3e2f7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3e3015aaa0 0x7f3e3015e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41634/0 (socket says 172.21.15.102:41634) 2023-10-14T09:38:02.943 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.940+0000 7f3e2f7fe640 1 -- 172.21.15.102:0/1471805124 learned_addr learned my addr 172.21.15.102:0/1471805124 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:02.945 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.940+0000 7f3e2ffff640 1 --2- 172.21.15.102:0/1471805124 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3e300ccaa0 0x7f3e30070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:02.945 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.940+0000 7f3e2effd640 1 --2- 172.21.15.102:0/1471805124 >> v2:172.21.15.129:3300/0 conn(0x7f3e3015ae80 0x7f3e300cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:02.945 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.940+0000 7f3e2f7fe640 1 -- 172.21.15.102:0/1471805124 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3e300ccaa0 msgr2=0x7f3e30070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:02.945 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.940+0000 7f3e2f7fe640 1 --2- 172.21.15.102:0/1471805124 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3e300ccaa0 0x7f3e30070f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:02.946 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.940+0000 7f3e2f7fe640 1 -- 172.21.15.102:0/1471805124 >> v2:172.21.15.129:3300/0 conn(0x7f3e3015ae80 msgr2=0x7f3e300cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:02.946 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.940+0000 7f3e2f7fe640 1 --2- 172.21.15.102:0/1471805124 >> v2:172.21.15.129:3300/0 conn(0x7f3e3015ae80 0x7f3e300cc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:02.946 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.940+0000 7f3e2f7fe640 1 -- 172.21.15.102:0/1471805124 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3015ef90 con 0x7f3e3015aaa0 2023-10-14T09:38:02.946 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.940+0000 7f3e2effd640 1 --2- 172.21.15.102:0/1471805124 >> v2:172.21.15.129:3300/0 conn(0x7f3e3015ae80 0x7f3e300cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:02.946 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.940+0000 7f3e2ffff640 1 --2- 172.21.15.102:0/1471805124 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3e300ccaa0 0x7f3e30070f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:02.947 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.941+0000 7f3e2f7fe640 1 --2- 172.21.15.102:0/1471805124 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e3015aaa0 0x7f3e3015e820 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3e300c59c0 tx=0x7f3e2002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=181629b74dc14fe7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:02.947 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.942+0000 7f3e2e7fc640 1 -- 172.21.15.102:0/1471805124 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e20031870 con 0x7f3e3015aaa0 2023-10-14T09:38:02.947 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.942+0000 7f3e2e7fc640 1 -- 172.21.15.102:0/1471805124 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e200319d0 con 0x7f3e3015aaa0 2023-10-14T09:38:02.947 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.942+0000 7f3e2e7fc640 1 -- 172.21.15.102:0/1471805124 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e20031d60 con 0x7f3e3015aaa0 2023-10-14T09:38:02.947 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.942+0000 7f3e35c4b640 1 -- 172.21.15.102:0/1471805124 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e3015aaa0 msgr2=0x7f3e3015e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:02.948 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.942+0000 7f3e35c4b640 1 --2- 172.21.15.102:0/1471805124 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e3015aaa0 0x7f3e3015e820 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3e300c59c0 tx=0x7f3e2002b910 comp rx=0 tx=0).stop 2023-10-14T09:38:02.948 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.942+0000 7f3e35c4b640 1 -- 172.21.15.102:0/1471805124 shutdown_connections 2023-10-14T09:38:02.948 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.942+0000 7f3e35c4b640 1 --2- 172.21.15.102:0/1471805124 >> v2:172.21.15.129:3300/0 conn(0x7f3e3015ae80 0x7f3e300cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:02.948 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.942+0000 7f3e35c4b640 1 --2- 172.21.15.102:0/1471805124 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3e300ccaa0 0x7f3e30070f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:02.948 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.942+0000 7f3e35c4b640 1 --2- 172.21.15.102:0/1471805124 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e3015aaa0 0x7f3e3015e820 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:02.949 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.942+0000 7f3e35c4b640 1 -- 172.21.15.102:0/1471805124 >> 172.21.15.102:0/1471805124 conn(0x7f3e300cb410 msgr2=0x7f3e300cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:02.949 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.942+0000 7f3e35c4b640 1 -- 172.21.15.102:0/1471805124 shutdown_connections 2023-10-14T09:38:02.949 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.943+0000 7f3e35c4b640 1 -- 172.21.15.102:0/1471805124 wait complete. 2023-10-14T09:38:02.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.944+0000 7f3e35c4b640 1 Processor -- start 2023-10-14T09:38:02.952 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.945+0000 7f3e35c4b640 1 -- start start 2023-10-14T09:38:02.952 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.946+0000 7f3e35c4b640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3e300ccaa0 0x7f3e3015b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:02.952 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.946+0000 7f3e35c4b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3e3015aaa0 0x7f3e300c6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:02.952 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.946+0000 7f3e35c4b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e3015ae80 0x7f3e30153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:02.952 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.946+0000 7f3e35c4b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e300c7170 con 0x7f3e3015ae80 2023-10-14T09:38:02.953 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.946+0000 7f3e35c4b640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e30153ec0 con 0x7f3e3015aaa0 2023-10-14T09:38:02.953 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.946+0000 7f3e35c4b640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3015ba20 con 0x7f3e300ccaa0 2023-10-14T09:38:02.953 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.946+0000 7f3e2ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e3015ae80 0x7f3e30153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:02.953 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.946+0000 7f3e2ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e3015ae80 0x7f3e30153980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41648/0 (socket says 172.21.15.102:41648) 2023-10-14T09:38:02.953 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.946+0000 7f3e2ffff640 1 -- 172.21.15.102:0/2280875779 learned_addr learned my addr 172.21.15.102:0/2280875779 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:02.954 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.946+0000 7f3e2f7fe640 1 --2- 172.21.15.102:0/2280875779 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3e300ccaa0 0x7f3e3015b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:02.954 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.946+0000 7f3e2effd640 1 --2- 172.21.15.102:0/2280875779 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3e3015aaa0 0x7f3e300c6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:02.954 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.947+0000 7f3e2ffff640 1 -- 172.21.15.102:0/2280875779 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3e300ccaa0 msgr2=0x7f3e3015b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:02.954 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.947+0000 7f3e2ffff640 1 --2- 172.21.15.102:0/2280875779 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3e300ccaa0 0x7f3e3015b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:02.954 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.947+0000 7f3e2ffff640 1 -- 172.21.15.102:0/2280875779 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3e3015aaa0 msgr2=0x7f3e300c6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:02.955 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.947+0000 7f3e2ffff640 1 --2- 172.21.15.102:0/2280875779 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3e3015aaa0 0x7f3e300c6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:02.955 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.947+0000 7f3e2ffff640 1 -- 172.21.15.102:0/2280875779 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e200094d0 con 0x7f3e3015ae80 2023-10-14T09:38:02.955 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.947+0000 7f3e2ffff640 1 --2- 172.21.15.102:0/2280875779 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e3015ae80 0x7f3e30153980 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3e2800cd10 tx=0x7f3e2800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:02.955 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.947+0000 7f3e27fff640 1 -- 172.21.15.102:0/2280875779 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2800f680 con 0x7f3e3015ae80 2023-10-14T09:38:02.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.947+0000 7f3e27fff640 1 -- 172.21.15.102:0/2280875779 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2800f800 con 0x7f3e3015ae80 2023-10-14T09:38:02.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.947+0000 7f3e27fff640 1 -- 172.21.15.102:0/2280875779 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2800fbb0 con 0x7f3e3015ae80 2023-10-14T09:38:02.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.947+0000 7f3e35c4b640 1 -- 172.21.15.102:0/2280875779 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e3015bd00 con 0x7f3e3015ae80 2023-10-14T09:38:02.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.947+0000 7f3e35c4b640 1 -- 172.21.15.102:0/2280875779 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e3015c2c0 con 0x7f3e3015ae80 2023-10-14T09:38:02.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.949+0000 7f3e35c4b640 1 -- 172.21.15.102:0/2280875779 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e3004e160 con 0x7f3e3015ae80 2023-10-14T09:38:02.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.950+0000 7f3e27fff640 1 -- 172.21.15.102:0/2280875779 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3e2800b040 con 0x7f3e3015ae80 2023-10-14T09:38:02.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.950+0000 7f3e27fff640 1 --2- 172.21.15.102:0/2280875779 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f3e1006ae70 0x7f3e1006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:02.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.951+0000 7f3e27fff640 1 -- 172.21.15.102:0/2280875779 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f3e2808a030 con 0x7f3e3015ae80 2023-10-14T09:38:02.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.951+0000 7f3e2f7fe640 1 --2- 172.21.15.102:0/2280875779 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f3e1006ae70 0x7f3e1006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:02.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.952+0000 7f3e2f7fe640 1 --2- 172.21.15.102:0/2280875779 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f3e1006ae70 0x7f3e1006d330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3e20036000 tx=0x7f3e2003c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:02.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:02.955+0000 7f3e27fff640 1 -- 172.21.15.102:0/2280875779 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3e28054fc0 con 0x7f3e3015ae80 2023-10-14T09:38:03.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.147+0000 7f3e35c4b640 1 -- 172.21.15.102:0/2280875779 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e3015e350 con 0x7f3e3015ae80 2023-10-14T09:38:03.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.149+0000 7f3e27fff640 1 -- 172.21.15.102:0/2280875779 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16838 (secure 0 0 0) 0x7f3e2801d020 con 0x7f3e3015ae80 2023-10-14T09:38:03.151 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:38:03.151 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":23,"fsid":"8a6cd69d-7f5b-4f2a-806a-0176c10aed50","created":"2023-10-14T09:36:56.745172+0000","modified":"2023-10-14T09:38:02.785498+0000","last_up_change":"2023-10-14T09:37:09.791473+0000","last_in_change":"2023-10-14T09:37:00.547186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:37:09.952407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:37:19.560925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:37:20.363385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e5aef8f3-878f-482b-b522-9a5b958b90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6801","nonce":1727250718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6803","nonce":1727250718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6807","nonce":1727250718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6805","nonce":1727250718}]},"public_addr":"172.21.15.102:6801/1727250718","cluster_addr":"172.21.15.102:6803/1727250718","heartbeat_back_addr":"172.21.15.102:6807/1727250718","heartbeat_front_addr":"172.21.15.102:6805/1727250718","state":["exists","up"]},{"osd":1,"uuid":"4a8cf50e-387b-4d47-9588-bd22e375a9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6809","nonce":1095651107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6811","nonce":1095651107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6815","nonce":1095651107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6813","nonce":1095651107}]},"public_addr":"172.21.15.102:6809/1095651107","cluster_addr":"172.21.15.102:6811/1095651107","heartbeat_back_addr":"172.21.15.102:6815/1095651107","heartbeat_front_addr":"172.21.15.102:6813/1095651107","state":["exists","up"]},{"osd":2,"uuid":"009ef55f-8a63-4219-bacd-d7c7b4500867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6820","nonce":2198222556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6825","nonce":2198222556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6831","nonce":2198222556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6829","nonce":2198222556}]},"public_addr":"172.21.15.102:6820/2198222556","cluster_addr":"172.21.15.102:6825/2198222556","heartbeat_back_addr":"172.21.15.102:6831/2198222556","heartbeat_front_addr":"172.21.15.102:6829/2198222556","state":["exists","up"]},{"osd":3,"uuid":"f2110eae-2ff9-4ed9-93d6-bd2361618211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6818","nonce":654726740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6821","nonce":654726740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6827","nonce":654726740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6823","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6824","nonce":654726740}]},"public_addr":"172.21.15.102:6818/654726740","cluster_addr":"172.21.15.102:6821/654726740","heartbeat_back_addr":"172.21.15.102:6827/654726740","heartbeat_front_addr":"172.21.15.102:6824/654726740","state":["exists","up"]},{"osd":4,"uuid":"33f1ae34-3100-40f7-9cb8-0eca2b358693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6817","nonce":507586170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6819","nonce":507586170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6823","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6825","nonce":507586170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6821","nonce":507586170}]},"public_addr":"172.21.15.129:6817/507586170","cluster_addr":"172.21.15.129:6819/507586170","heartbeat_back_addr":"172.21.15.129:6825/507586170","heartbeat_front_addr":"172.21.15.129:6821/507586170","state":["exists","up"]},{"osd":5,"uuid":"fab2fc62-3f3e-450d-93e0-770f39e80710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6801","nonce":1913451073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6803","nonce":1913451073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6807","nonce":1913451073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6805","nonce":1913451073}]},"public_addr":"172.21.15.129:6801/1913451073","cluster_addr":"172.21.15.129:6803/1913451073","heartbeat_back_addr":"172.21.15.129:6807/1913451073","heartbeat_front_addr":"172.21.15.129:6805/1913451073","state":["exists","up"]},{"osd":6,"uuid":"d7cc1d69-92e7-4253-a127-cfc0444a4809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6809","nonce":2853291511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6811","nonce":2853291511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6815","nonce":2853291511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6813","nonce":2853291511}]},"public_addr":"172.21.15.129:6809/2853291511","cluster_addr":"172.21.15.129:6811/2853291511","heartbeat_back_addr":"172.21.15.129:6815/2853291511","heartbeat_front_addr":"172.21.15.129:6813/2853291511","state":["exists","up"]},{"osd":7,"uuid":"1e403de1-09e2-4370-b9a7-e790ac44bbee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6824","nonce":2933886914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6827","nonce":2933886914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6831","nonce":2933886914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6829","nonce":2933886914}]},"public_addr":"172.21.15.129:6824/2933886914","cluster_addr":"172.21.15.129:6827/2933886914","heartbeat_back_addr":"172.21.15.129:6831/2933886914","heartbeat_front_addr":"172.21.15.129:6829/2933886914","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.849661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.868113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.933488+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.891794+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.901861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.858750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.911712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.996765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:38:03.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.151+0000 7f3e35c4b640 1 -- 172.21.15.102:0/2280875779 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f3e1006ae70 msgr2=0x7f3e1006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:03.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.151+0000 7f3e35c4b640 1 --2- 172.21.15.102:0/2280875779 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f3e1006ae70 0x7f3e1006d330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3e20036000 tx=0x7f3e2003c040 comp rx=0 tx=0).stop 2023-10-14T09:38:03.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.152+0000 7f3e35c4b640 1 -- 172.21.15.102:0/2280875779 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e3015ae80 msgr2=0x7f3e30153980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:03.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.152+0000 7f3e35c4b640 1 --2- 172.21.15.102:0/2280875779 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e3015ae80 0x7f3e30153980 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3e2800cd10 tx=0x7f3e2800a650 comp rx=0 tx=0).stop 2023-10-14T09:38:03.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.152+0000 7f3e35c4b640 1 -- 172.21.15.102:0/2280875779 shutdown_connections 2023-10-14T09:38:03.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.152+0000 7f3e35c4b640 1 --2- 172.21.15.102:0/2280875779 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f3e1006ae70 0x7f3e1006d330 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:03.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.152+0000 7f3e35c4b640 1 --2- 172.21.15.102:0/2280875779 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e3015ae80 0x7f3e30153980 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:03.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.152+0000 7f3e35c4b640 1 --2- 172.21.15.102:0/2280875779 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3e3015aaa0 0x7f3e300c6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:03.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.152+0000 7f3e35c4b640 1 --2- 172.21.15.102:0/2280875779 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3e300ccaa0 0x7f3e3015b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:03.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.152+0000 7f3e35c4b640 1 -- 172.21.15.102:0/2280875779 >> 172.21.15.102:0/2280875779 conn(0x7f3e300cb410 msgr2=0x7f3e300ce390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:03.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.152+0000 7f3e35c4b640 1 -- 172.21.15.102:0/2280875779 shutdown_connections 2023-10-14T09:38:03.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.152+0000 7f3e35c4b640 1 -- 172.21.15.102:0/2280875779 wait complete. 2023-10-14T09:38:03.172 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T09:37:09.952407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T09:37:19.560925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T09:37:20.363385+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T09:38:03.173 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T09:38:03.390 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.388+0000 7f2c44000640 1 Processor -- start 2023-10-14T09:38:03.391 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.388+0000 7f2c44000640 1 -- start start 2023-10-14T09:38:03.392 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.390+0000 7f2c44000640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2c3c15d330 0x7f2c3c1618b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:03.392 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.390+0000 7f2c44000640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f2c3c06c7d0 0x7f2c3c065ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:03.392 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.390+0000 7f2c44000640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2c3c06cc80 0x7f2c3c065ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:03.393 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.390+0000 7f2c44000640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c3c06b1e0 con 0x7f2c3c06cc80 2023-10-14T09:38:03.393 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.390+0000 7f2c44000640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c3c0d0890 con 0x7f2c3c06c7d0 2023-10-14T09:38:03.393 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.390+0000 7f2c44000640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c0d05b0 con 0x7f2c3c15d330 2023-10-14T09:38:03.393 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.390+0000 7f2c4259d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2c3c06cc80 0x7f2c3c065ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:03.393 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.390+0000 7f2c4259d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2c3c06cc80 0x7f2c3c065ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41660/0 (socket says 172.21.15.102:41660) 2023-10-14T09:38:03.394 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.390+0000 7f2c4259d640 1 -- 172.21.15.102:0/4133317583 learned_addr learned my addr 172.21.15.102:0/4133317583 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:03.394 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.390+0000 7f2c4159b640 1 --2- 172.21.15.102:0/4133317583 >> v2:172.21.15.129:3300/0 conn(0x7f2c3c06c7d0 0x7f2c3c065ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:03.394 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.390+0000 7f2c41d9c640 1 --2- 172.21.15.102:0/4133317583 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2c3c15d330 0x7f2c3c1618b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:03.394 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.390+0000 7f2c4259d640 1 -- 172.21.15.102:0/4133317583 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2c3c15d330 msgr2=0x7f2c3c1618b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:03.394 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.390+0000 7f2c4259d640 1 --2- 172.21.15.102:0/4133317583 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2c3c15d330 0x7f2c3c1618b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:03.395 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.390+0000 7f2c4259d640 1 -- 172.21.15.102:0/4133317583 >> v2:172.21.15.129:3300/0 conn(0x7f2c3c06c7d0 msgr2=0x7f2c3c065ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:03.395 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.390+0000 7f2c4259d640 1 --2- 172.21.15.102:0/4133317583 >> v2:172.21.15.129:3300/0 conn(0x7f2c3c06c7d0 0x7f2c3c065ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:03.395 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.391+0000 7f2c4259d640 1 -- 172.21.15.102:0/4133317583 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c3c160dd0 con 0x7f2c3c06cc80 2023-10-14T09:38:03.395 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.391+0000 7f2c4159b640 1 --2- 172.21.15.102:0/4133317583 >> v2:172.21.15.129:3300/0 conn(0x7f2c3c06c7d0 0x7f2c3c065ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:03.395 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.391+0000 7f2c41d9c640 1 --2- 172.21.15.102:0/4133317583 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2c3c15d330 0x7f2c3c1618b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:03.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.392+0000 7f2c4259d640 1 --2- 172.21.15.102:0/4133317583 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c3c06cc80 0x7f2c3c065ff0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c0b35b0 tx=0x7f2c3402b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8609c313bda7b32b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:03.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.392+0000 7f2c40d9a640 1 -- 172.21.15.102:0/4133317583 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c340317f0 con 0x7f2c3c06cc80 2023-10-14T09:38:03.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.392+0000 7f2c40d9a640 1 -- 172.21.15.102:0/4133317583 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c34031950 con 0x7f2c3c06cc80 2023-10-14T09:38:03.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.392+0000 7f2c40d9a640 1 -- 172.21.15.102:0/4133317583 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c34031ce0 con 0x7f2c3c06cc80 2023-10-14T09:38:03.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.393+0000 7f2c44000640 1 -- 172.21.15.102:0/4133317583 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c3c06cc80 msgr2=0x7f2c3c065ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:03.398 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.393+0000 7f2c44000640 1 --2- 172.21.15.102:0/4133317583 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c3c06cc80 0x7f2c3c065ff0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c0b35b0 tx=0x7f2c3402b890 comp rx=0 tx=0).stop 2023-10-14T09:38:03.398 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.393+0000 7f2c44000640 1 -- 172.21.15.102:0/4133317583 shutdown_connections 2023-10-14T09:38:03.398 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.393+0000 7f2c44000640 1 --2- 172.21.15.102:0/4133317583 >> v2:172.21.15.129:3300/0 conn(0x7f2c3c06c7d0 0x7f2c3c065ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:03.398 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.393+0000 7f2c44000640 1 --2- 172.21.15.102:0/4133317583 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c3c06cc80 0x7f2c3c065ff0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:03.398 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.393+0000 7f2c44000640 1 --2- 172.21.15.102:0/4133317583 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2c3c15d330 0x7f2c3c1618b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:03.399 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.393+0000 7f2c44000640 1 -- 172.21.15.102:0/4133317583 >> 172.21.15.102:0/4133317583 conn(0x7f2c3c0d0ab0 msgr2=0x7f2c3c0d0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:03.399 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.393+0000 7f2c44000640 1 -- 172.21.15.102:0/4133317583 shutdown_connections 2023-10-14T09:38:03.399 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.393+0000 7f2c44000640 1 -- 172.21.15.102:0/4133317583 wait complete. 2023-10-14T09:38:03.399 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.394+0000 7f2c44000640 1 Processor -- start 2023-10-14T09:38:03.399 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.394+0000 7f2c44000640 1 -- start start 2023-10-14T09:38:03.402 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.395+0000 7f2c44000640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2c3c06c7d0 0x7f2c3c14d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:03.402 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.395+0000 7f2c44000640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2c3c06cc80 0x7f2c3c0c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:03.402 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.395+0000 7f2c44000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c3c15d330 0x7f2c3c0cc320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:03.402 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.395+0000 7f2c44000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c15f920 con 0x7f2c3c15d330 2023-10-14T09:38:03.402 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.395+0000 7f2c44000640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c0ca940 con 0x7f2c3c06cc80 2023-10-14T09:38:03.403 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.395+0000 7f2c44000640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c0c8270 con 0x7f2c3c06c7d0 2023-10-14T09:38:03.403 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.396+0000 7f2c4259d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c3c15d330 0x7f2c3c0cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:03.403 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.396+0000 7f2c4259d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c3c15d330 0x7f2c3c0cc320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41676/0 (socket says 172.21.15.102:41676) 2023-10-14T09:38:03.403 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.396+0000 7f2c4259d640 1 -- 172.21.15.102:0/4182065157 learned_addr learned my addr 172.21.15.102:0/4182065157 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:03.403 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.396+0000 7f2c41d9c640 1 --2- 172.21.15.102:0/4182065157 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2c3c06c7d0 0x7f2c3c14d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:03.404 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.396+0000 7f2c4159b640 1 --2- 172.21.15.102:0/4182065157 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2c3c06cc80 0x7f2c3c0c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:03.404 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.396+0000 7f2c4259d640 1 -- 172.21.15.102:0/4182065157 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2c3c06c7d0 msgr2=0x7f2c3c14d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:03.404 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.396+0000 7f2c4259d640 1 --2- 172.21.15.102:0/4182065157 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2c3c06c7d0 0x7f2c3c14d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:03.404 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.396+0000 7f2c4259d640 1 -- 172.21.15.102:0/4182065157 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2c3c06cc80 msgr2=0x7f2c3c0c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:03.404 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.396+0000 7f2c4259d640 1 --2- 172.21.15.102:0/4182065157 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2c3c06cc80 0x7f2c3c0c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:03.404 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.396+0000 7f2c4259d640 1 -- 172.21.15.102:0/4182065157 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c340094d0 con 0x7f2c3c15d330 2023-10-14T09:38:03.405 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.396+0000 7f2c41d9c640 1 --2- 172.21.15.102:0/4182065157 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2c3c06c7d0 0x7f2c3c14d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:38:03.405 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.396+0000 7f2c4259d640 1 --2- 172.21.15.102:0/4182065157 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c3c15d330 0x7f2c3c0cc320 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2c3402b8d0 tx=0x7f2c340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:03.405 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.397+0000 7f2c3a7fc640 1 -- 172.21.15.102:0/4182065157 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c340329d0 con 0x7f2c3c15d330 2023-10-14T09:38:03.405 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.397+0000 7f2c3a7fc640 1 -- 172.21.15.102:0/4182065157 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c34032b30 con 0x7f2c3c15d330 2023-10-14T09:38:03.405 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.397+0000 7f2c3a7fc640 1 -- 172.21.15.102:0/4182065157 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c340453f0 con 0x7f2c3c15d330 2023-10-14T09:38:03.405 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.397+0000 7f2c44000640 1 -- 172.21.15.102:0/4182065157 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c3c0ca660 con 0x7f2c3c15d330 2023-10-14T09:38:03.406 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.397+0000 7f2c44000640 1 -- 172.21.15.102:0/4182065157 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c3c0c7f00 con 0x7f2c3c15d330 2023-10-14T09:38:03.406 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.398+0000 7f2c44000640 1 -- 172.21.15.102:0/4182065157 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c3c04e160 con 0x7f2c3c15d330 2023-10-14T09:38:03.406 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.398+0000 7f2c3a7fc640 1 -- 172.21.15.102:0/4182065157 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2c34045550 con 0x7f2c3c15d330 2023-10-14T09:38:03.406 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.399+0000 7f2c3a7fc640 1 --2- 172.21.15.102:0/4182065157 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2c2806aea0 0x7f2c2806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:03.406 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.399+0000 7f2c3a7fc640 1 -- 172.21.15.102:0/4182065157 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f2c340abbf0 con 0x7f2c3c15d330 2023-10-14T09:38:03.407 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.400+0000 7f2c41d9c640 1 --2- 172.21.15.102:0/4182065157 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2c2806aea0 0x7f2c2806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:03.407 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.400+0000 7f2c41d9c640 1 --2- 172.21.15.102:0/4182065157 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2c2806aea0 0x7f2c2806d360 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c007130 tx=0x7f2c2c007060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:03.407 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.404+0000 7f2c3a7fc640 1 -- 172.21.15.102:0/4182065157 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2c34076cd0 con 0x7f2c3c15d330 2023-10-14T09:38:03.594 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.593+0000 7f2c44000640 1 -- 172.21.15.102:0/4182065157 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2c3c0c83b0 con 0x7f2c3c15d330 2023-10-14T09:38:03.595 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.594+0000 7f2c3a7fc640 1 -- 172.21.15.102:0/4182065157 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2c3407a2f0 con 0x7f2c3c15d330 2023-10-14T09:38:03.596 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2023-10-14T09:38:03.598 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.596+0000 7f2c44000640 1 -- 172.21.15.102:0/4182065157 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2c2806aea0 msgr2=0x7f2c2806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:03.599 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.596+0000 7f2c44000640 1 --2- 172.21.15.102:0/4182065157 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2c2806aea0 0x7f2c2806d360 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c007130 tx=0x7f2c2c007060 comp rx=0 tx=0).stop 2023-10-14T09:38:03.599 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.596+0000 7f2c44000640 1 -- 172.21.15.102:0/4182065157 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c3c15d330 msgr2=0x7f2c3c0cc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:03.599 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.596+0000 7f2c44000640 1 --2- 172.21.15.102:0/4182065157 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c3c15d330 0x7f2c3c0cc320 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2c3402b8d0 tx=0x7f2c340046c0 comp rx=0 tx=0).stop 2023-10-14T09:38:03.599 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.596+0000 7f2c44000640 1 -- 172.21.15.102:0/4182065157 shutdown_connections 2023-10-14T09:38:03.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.596+0000 7f2c44000640 1 --2- 172.21.15.102:0/4182065157 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2c2806aea0 0x7f2c2806d360 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:03.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.596+0000 7f2c44000640 1 --2- 172.21.15.102:0/4182065157 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c3c15d330 0x7f2c3c0cc320 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:03.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.596+0000 7f2c44000640 1 --2- 172.21.15.102:0/4182065157 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2c3c06cc80 0x7f2c3c0c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:03.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.596+0000 7f2c44000640 1 --2- 172.21.15.102:0/4182065157 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2c3c06c7d0 0x7f2c3c14d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:03.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.596+0000 7f2c44000640 1 -- 172.21.15.102:0/4182065157 >> 172.21.15.102:0/4182065157 conn(0x7f2c3c0d0ab0 msgr2=0x7f2c3c15b350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:03.601 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.596+0000 7f2c44000640 1 -- 172.21.15.102:0/4182065157 shutdown_connections 2023-10-14T09:38:03.601 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.596+0000 7f2c44000640 1 -- 172.21.15.102:0/4182065157 wait complete. 2023-10-14T09:38:03.618 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T09:38:03.838 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.836+0000 7f67fb1c9640 1 Processor -- start 2023-10-14T09:38:03.838 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.836+0000 7f67fb1c9640 1 -- start start 2023-10-14T09:38:03.839 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.837+0000 7f67fb1c9640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f67f406a4b0 0x7f67f40ca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:03.839 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.837+0000 7f67fb1c9640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67f40cb030 con 0x7f67f40c9ca0 2023-10-14T09:38:03.839 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.837+0000 7f67fb1c9640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67f40c91c0 con 0x7f67f415ad70 2023-10-14T09:38:03.840 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.837+0000 7f67fb1c9640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67f40c94a0 con 0x7f67f406a4b0 2023-10-14T09:38:03.840 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.837+0000 7f67f9766640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f67f40c9ca0 0x7f67f40ad4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:42992/0 (socket says 172.21.15.102:42992) 2023-10-14T09:38:03.840 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.837+0000 7f67f3fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f67f406a4b0 0x7f67f40ca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:03.840 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.837+0000 7f67f9766640 1 -- 172.21.15.102:0/835365422 learned_addr learned my addr 172.21.15.102:0/835365422 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:03.842 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.838+0000 7f67f3fff640 1 -- 172.21.15.102:0/835365422 >> v1:172.21.15.129:6789/0 conn(0x7f67f415ad70 legacy=0x7f67f4069da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:03.842 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.838+0000 7f67f3fff640 1 -- 172.21.15.102:0/835365422 >> v1:172.21.15.102:6789/0 conn(0x7f67f40c9ca0 legacy=0x7f67f40ad4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:03.842 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.838+0000 7f67f3fff640 1 -- 172.21.15.102:0/835365422 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f40c9780 con 0x7f67f406a4b0 2023-10-14T09:38:03.842 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.839+0000 7f67f3fff640 1 --2- 172.21.15.102:0/835365422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67f406a4b0 0x7f67f40ca3b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f67e4009d90 tx=0x7f67e402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1da760053884f229 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:03.843 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.839+0000 7f67f37fe640 1 -- 172.21.15.102:0/835365422 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e402cd00 con 0x7f67f406a4b0 2023-10-14T09:38:03.843 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.839+0000 7f67f37fe640 1 -- 172.21.15.102:0/835365422 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e402ce60 con 0x7f67f406a4b0 2023-10-14T09:38:03.843 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.839+0000 7f67f37fe640 1 -- 172.21.15.102:0/835365422 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e4034660 con 0x7f67f406a4b0 2023-10-14T09:38:03.843 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.840+0000 7f67fb1c9640 1 -- 172.21.15.102:0/835365422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67f406a4b0 msgr2=0x7f67f40ca3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:03.843 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.840+0000 7f67fb1c9640 1 --2- 172.21.15.102:0/835365422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67f406a4b0 0x7f67f40ca3b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f67e4009d90 tx=0x7f67e402bf50 comp rx=0 tx=0).stop 2023-10-14T09:38:03.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.840+0000 7f67fb1c9640 1 -- 172.21.15.102:0/835365422 shutdown_connections 2023-10-14T09:38:03.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.840+0000 7f67fb1c9640 1 --2- 172.21.15.102:0/835365422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67f406a4b0 0x7f67f40ca3b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:03.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.840+0000 7f67fb1c9640 1 -- 172.21.15.102:0/835365422 >> 172.21.15.102:0/835365422 conn(0x7f67f40ce9b0 msgr2=0x7f67f40cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:03.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.840+0000 7f67fb1c9640 1 -- 172.21.15.102:0/835365422 shutdown_connections 2023-10-14T09:38:03.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.840+0000 7f67fb1c9640 1 -- 172.21.15.102:0/835365422 wait complete. 2023-10-14T09:38:03.847 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.842+0000 7f67fb1c9640 1 Processor -- start 2023-10-14T09:38:03.847 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.842+0000 7f67fb1c9640 1 -- start start 2023-10-14T09:38:03.847 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.843+0000 7f67fb1c9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f67f406a4b0 0x7f67f41f1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:03.847 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.843+0000 7f67fb1c9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67f40c9ca0 0x7f67f41f2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:03.847 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.843+0000 7f67fb1c9640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f67f415ad70 0x7f67f40aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:03.848 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.843+0000 7f67fb1c9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f4152a20 con 0x7f67f40c9ca0 2023-10-14T09:38:03.848 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.843+0000 7f67fb1c9640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f415ced0 con 0x7f67f406a4b0 2023-10-14T09:38:03.848 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.843+0000 7f67fb1c9640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f415d1b0 con 0x7f67f415ad70 2023-10-14T09:38:03.848 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.843+0000 7f67f3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67f40c9ca0 0x7f67f41f2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:03.848 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.843+0000 7f67f3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67f40c9ca0 0x7f67f41f2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41684/0 (socket says 172.21.15.102:41684) 2023-10-14T09:38:03.849 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.843+0000 7f67f3fff640 1 -- 172.21.15.102:0/708002291 learned_addr learned my addr 172.21.15.102:0/708002291 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:03.849 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.844+0000 7f67f8f65640 1 --2- 172.21.15.102:0/708002291 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f67f406a4b0 0x7f67f41f1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:03.849 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.844+0000 7f67f9766640 1 --2- 172.21.15.102:0/708002291 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f67f415ad70 0x7f67f40aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:03.849 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.844+0000 7f67f3fff640 1 -- 172.21.15.102:0/708002291 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f67f415ad70 msgr2=0x7f67f40aeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:03.849 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.844+0000 7f67f3fff640 1 --2- 172.21.15.102:0/708002291 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f67f415ad70 0x7f67f40aeb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:03.850 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.844+0000 7f67f3fff640 1 -- 172.21.15.102:0/708002291 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f67f406a4b0 msgr2=0x7f67f41f1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:03.850 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.844+0000 7f67f3fff640 1 --2- 172.21.15.102:0/708002291 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f67f406a4b0 0x7f67f41f1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:03.850 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.844+0000 7f67f3fff640 1 -- 172.21.15.102:0/708002291 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e4009a70 con 0x7f67f40c9ca0 2023-10-14T09:38:03.850 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.844+0000 7f67f8f65640 1 --2- 172.21.15.102:0/708002291 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f67f406a4b0 0x7f67f41f1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:38:03.850 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.844+0000 7f67f9766640 1 --2- 172.21.15.102:0/708002291 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f67f415ad70 0x7f67f40aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:03.851 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.844+0000 7f67f3fff640 1 --2- 172.21.15.102:0/708002291 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67f40c9ca0 0x7f67f41f2df0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f67e4009d90 tx=0x7f67e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:03.851 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.844+0000 7f67f17fa640 1 -- 172.21.15.102:0/708002291 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e403d600 con 0x7f67f40c9ca0 2023-10-14T09:38:03.851 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.844+0000 7f67f17fa640 1 -- 172.21.15.102:0/708002291 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e403d760 con 0x7f67f40c9ca0 2023-10-14T09:38:03.851 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.844+0000 7f67f17fa640 1 -- 172.21.15.102:0/708002291 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e403db10 con 0x7f67f40c9ca0 2023-10-14T09:38:03.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.844+0000 7f67fb1c9640 1 -- 172.21.15.102:0/708002291 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67f415d490 con 0x7f67f40c9ca0 2023-10-14T09:38:03.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.845+0000 7f67fb1c9640 1 -- 172.21.15.102:0/708002291 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67f415da50 con 0x7f67f40c9ca0 2023-10-14T09:38:03.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.846+0000 7f67fb1c9640 1 -- 172.21.15.102:0/708002291 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67f404e160 con 0x7f67f40c9ca0 2023-10-14T09:38:03.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.847+0000 7f67f17fa640 1 -- 172.21.15.102:0/708002291 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f67e403b040 con 0x7f67f40c9ca0 2023-10-14T09:38:03.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.848+0000 7f67f17fa640 1 --2- 172.21.15.102:0/708002291 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f67d406ae70 0x7f67d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:03.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.848+0000 7f67f17fa640 1 -- 172.21.15.102:0/708002291 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f67e40ab750 con 0x7f67f40c9ca0 2023-10-14T09:38:03.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.848+0000 7f67f8f65640 1 --2- 172.21.15.102:0/708002291 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f67d406ae70 0x7f67d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:03.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.848+0000 7f67f8f65640 1 --2- 172.21.15.102:0/708002291 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f67d406ae70 0x7f67d406d330 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f67dc007fd0 tx=0x7f67dc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:03.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:03.852+0000 7f67f17fa640 1 -- 172.21.15.102:0/708002291 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f67e4076770 con 0x7f67f40c9ca0 2023-10-14T09:38:04.052 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.050+0000 7f67fb1c9640 1 -- 172.21.15.102:0/708002291 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f67f40b2bd0 con 0x7f67f40c9ca0 2023-10-14T09:38:04.053 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.051+0000 7f67f17fa640 1 -- 172.21.15.102:0/708002291 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f67e4039020 con 0x7f67f40c9ca0 2023-10-14T09:38:04.053 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2023-10-14T09:38:04.056 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.053+0000 7f67fb1c9640 1 -- 172.21.15.102:0/708002291 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f67d406ae70 msgr2=0x7f67d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:04.056 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.053+0000 7f67fb1c9640 1 --2- 172.21.15.102:0/708002291 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f67d406ae70 0x7f67d406d330 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f67dc007fd0 tx=0x7f67dc009040 comp rx=0 tx=0).stop 2023-10-14T09:38:04.056 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.054+0000 7f67fb1c9640 1 -- 172.21.15.102:0/708002291 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67f40c9ca0 msgr2=0x7f67f41f2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:04.056 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.054+0000 7f67fb1c9640 1 --2- 172.21.15.102:0/708002291 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67f40c9ca0 0x7f67f41f2df0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f67e4009d90 tx=0x7f67e4004a40 comp rx=0 tx=0).stop 2023-10-14T09:38:04.057 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.054+0000 7f67fb1c9640 1 -- 172.21.15.102:0/708002291 shutdown_connections 2023-10-14T09:38:04.057 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.054+0000 7f67fb1c9640 1 --2- 172.21.15.102:0/708002291 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f67d406ae70 0x7f67d406d330 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:04.057 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.054+0000 7f67fb1c9640 1 --2- 172.21.15.102:0/708002291 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f67f415ad70 0x7f67f40aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:04.057 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.054+0000 7f67fb1c9640 1 --2- 172.21.15.102:0/708002291 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67f40c9ca0 0x7f67f41f2df0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:04.057 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.054+0000 7f67fb1c9640 1 --2- 172.21.15.102:0/708002291 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f67f406a4b0 0x7f67f41f1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:04.057 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.054+0000 7f67fb1c9640 1 -- 172.21.15.102:0/708002291 >> 172.21.15.102:0/708002291 conn(0x7f67f40ce9b0 msgr2=0x7f67f40ced90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:04.058 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.054+0000 7f67fb1c9640 1 -- 172.21.15.102:0/708002291 shutdown_connections 2023-10-14T09:38:04.058 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.054+0000 7f67fb1c9640 1 -- 172.21.15.102:0/708002291 wait complete. 2023-10-14T09:38:04.075 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T09:38:04.288 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.286+0000 7f07ec1f5640 1 Processor -- start 2023-10-14T09:38:04.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.287+0000 7f07ec1f5640 1 -- start start 2023-10-14T09:38:04.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.288+0000 7f07ec1f5640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f07e415ad70 0x7f07e4069da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:04.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.288+0000 7f07ec1f5640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f07e40c9ca0 0x7f07e406a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:04.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.288+0000 7f07ec1f5640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e40cb030 con 0x7f07e40ca3b0 2023-10-14T09:38:04.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.288+0000 7f07ec1f5640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e40c91c0 con 0x7f07e415ad70 2023-10-14T09:38:04.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.288+0000 7f07ec1f5640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e40c94a0 con 0x7f07e40c9ca0 2023-10-14T09:38:04.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.289+0000 7f07e9790640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f07e40c9ca0 0x7f07e406a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:04.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.289+0000 7f07e9f91640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f07e415ad70 0x7f07e4069da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:04.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.289+0000 7f07e9790640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f07e40c9ca0 0x7f07e406a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.102:48962/0 (socket says 172.21.15.102:48962) 2023-10-14T09:38:04.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.289+0000 7f07e9790640 1 -- 172.21.15.102:0/424817537 learned_addr learned my addr 172.21.15.102:0/424817537 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:04.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.289+0000 7f07e9f91640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f07e415ad70 0x7f07e4069da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.102:37152/0 (socket says 172.21.15.102:37152) 2023-10-14T09:38:04.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.290+0000 7f07e9f91640 1 -- 172.21.15.102:0/424817537 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f07e40c9ca0 msgr2=0x7f07e406a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:04.293 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.290+0000 7f07e9f91640 1 --2- 172.21.15.102:0/424817537 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f07e40c9ca0 0x7f07e406a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:04.293 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.290+0000 7f07e9f91640 1 -- 172.21.15.102:0/424817537 >> v1:172.21.15.129:6789/0 conn(0x7f07e40ca3b0 legacy=0x7f07e40ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:04.293 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.290+0000 7f07e9f91640 1 -- 172.21.15.102:0/424817537 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e40c9780 con 0x7f07e415ad70 2023-10-14T09:38:04.294 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.291+0000 7f07e9f91640 1 --2- 172.21.15.102:0/424817537 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f07e415ad70 0x7f07e4069da0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f07e00097a0 tx=0x7f07e002b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a15d26fb4fe26843 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:04.294 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.292+0000 7f07e8f8f640 1 -- 172.21.15.102:0/424817537 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e002d040 con 0x7f07e415ad70 2023-10-14T09:38:04.295 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.292+0000 7f07e8f8f640 1 -- 172.21.15.102:0/424817537 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e0031810 con 0x7f07e415ad70 2023-10-14T09:38:04.295 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.292+0000 7f07e8f8f640 1 -- 172.21.15.102:0/424817537 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e0031ba0 con 0x7f07e415ad70 2023-10-14T09:38:04.295 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.292+0000 7f07ec1f5640 1 -- 172.21.15.102:0/424817537 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f07e415ad70 msgr2=0x7f07e4069da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:04.295 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.292+0000 7f07ec1f5640 1 --2- 172.21.15.102:0/424817537 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f07e415ad70 0x7f07e4069da0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f07e00097a0 tx=0x7f07e002b8b0 comp rx=0 tx=0).stop 2023-10-14T09:38:04.295 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.292+0000 7f07ec1f5640 1 -- 172.21.15.102:0/424817537 shutdown_connections 2023-10-14T09:38:04.296 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.292+0000 7f07ec1f5640 1 --2- 172.21.15.102:0/424817537 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f07e40c9ca0 0x7f07e406a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:04.296 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.292+0000 7f07ec1f5640 1 --2- 172.21.15.102:0/424817537 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f07e415ad70 0x7f07e4069da0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:04.296 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.292+0000 7f07ec1f5640 1 -- 172.21.15.102:0/424817537 >> 172.21.15.102:0/424817537 conn(0x7f07e40ce9b0 msgr2=0x7f07e40cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:04.296 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.293+0000 7f07ec1f5640 1 -- 172.21.15.102:0/424817537 shutdown_connections 2023-10-14T09:38:04.296 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.293+0000 7f07ec1f5640 1 -- 172.21.15.102:0/424817537 wait complete. 2023-10-14T09:38:04.299 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.294+0000 7f07ec1f5640 1 Processor -- start 2023-10-14T09:38:04.299 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.294+0000 7f07ec1f5640 1 -- start start 2023-10-14T09:38:04.299 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.295+0000 7f07ec1f5640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f07e40c9ca0 0x7f07e414bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:04.299 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.295+0000 7f07ec1f5640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f07e40ca3b0 0x7f07e40afa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:04.300 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.295+0000 7f07ec1f5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07e415ad70 0x7f07e41efc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:04.300 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.295+0000 7f07ec1f5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e4148d70 con 0x7f07e415ad70 2023-10-14T09:38:04.300 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.295+0000 7f07ec1f5640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e4149050 con 0x7f07e40ca3b0 2023-10-14T09:38:04.300 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.295+0000 7f07ec1f5640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e4149330 con 0x7f07e40c9ca0 2023-10-14T09:38:04.300 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.296+0000 7f07ea792640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07e415ad70 0x7f07e41efc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:04.300 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.296+0000 7f07ea792640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07e415ad70 0x7f07e41efc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41690/0 (socket says 172.21.15.102:41690) 2023-10-14T09:38:04.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.296+0000 7f07ea792640 1 -- 172.21.15.102:0/731241674 learned_addr learned my addr 172.21.15.102:0/731241674 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:04.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.296+0000 7f07e9790640 1 --2- 172.21.15.102:0/731241674 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f07e40ca3b0 0x7f07e40afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:04.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.296+0000 7f07e9f91640 1 --2- 172.21.15.102:0/731241674 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f07e40c9ca0 0x7f07e414bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:04.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.296+0000 7f07ea792640 1 -- 172.21.15.102:0/731241674 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f07e40c9ca0 msgr2=0x7f07e414bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:04.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.296+0000 7f07ea792640 1 --2- 172.21.15.102:0/731241674 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f07e40c9ca0 0x7f07e414bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:04.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.296+0000 7f07ea792640 1 -- 172.21.15.102:0/731241674 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f07e40ca3b0 msgr2=0x7f07e40afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:04.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.296+0000 7f07ea792640 1 --2- 172.21.15.102:0/731241674 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f07e40ca3b0 0x7f07e40afa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:04.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.296+0000 7f07ea792640 1 -- 172.21.15.102:0/731241674 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e0009400 con 0x7f07e415ad70 2023-10-14T09:38:04.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.297+0000 7f07ea792640 1 --2- 172.21.15.102:0/731241674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07e415ad70 0x7f07e41efc20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f07dc00c7a0 tx=0x7f07dc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:04.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.297+0000 7f07da7fc640 1 -- 172.21.15.102:0/731241674 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07dc003b70 con 0x7f07e415ad70 2023-10-14T09:38:04.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.297+0000 7f07da7fc640 1 -- 172.21.15.102:0/731241674 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07dc003cf0 con 0x7f07e415ad70 2023-10-14T09:38:04.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.297+0000 7f07da7fc640 1 -- 172.21.15.102:0/731241674 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07dc003ea0 con 0x7f07e415ad70 2023-10-14T09:38:04.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.297+0000 7f07ec1f5640 1 -- 172.21.15.102:0/731241674 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e4149610 con 0x7f07e415ad70 2023-10-14T09:38:04.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.297+0000 7f07ec1f5640 1 -- 172.21.15.102:0/731241674 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e4148a00 con 0x7f07e415ad70 2023-10-14T09:38:04.304 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.298+0000 7f07ec1f5640 1 -- 172.21.15.102:0/731241674 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e4149b30 con 0x7f07e415ad70 2023-10-14T09:38:04.304 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.299+0000 7f07da7fc640 1 -- 172.21.15.102:0/731241674 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f07dc00aa90 con 0x7f07e415ad70 2023-10-14T09:38:04.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.301+0000 7f07da7fc640 1 --2- 172.21.15.102:0/731241674 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f07c806ae70 0x7f07c806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:04.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.301+0000 7f07da7fc640 1 -- 172.21.15.102:0/731241674 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f07dc0895a0 con 0x7f07e415ad70 2023-10-14T09:38:04.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.301+0000 7f07e9f91640 1 --2- 172.21.15.102:0/731241674 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f07c806ae70 0x7f07c806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:04.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.302+0000 7f07e9f91640 1 --2- 172.21.15.102:0/731241674 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f07c806ae70 0x7f07c806d330 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f07e0036000 tx=0x7f07e003c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:04.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.305+0000 7f07da7fc640 1 -- 172.21.15.102:0/731241674 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f07e4149b30 con 0x7f07e415ad70 2023-10-14T09:38:04.496 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.494+0000 7f07ec1f5640 1 -- 172.21.15.102:0/731241674 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f07e4149b30 con 0x7f07e415ad70 2023-10-14T09:38:04.497 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.495+0000 7f07da7fc640 1 -- 172.21.15.102:0/731241674 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f07e4149b30 con 0x7f07e415ad70 2023-10-14T09:38:04.497 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2023-10-14T09:38:04.499 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.497+0000 7f07ec1f5640 1 -- 172.21.15.102:0/731241674 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f07c806ae70 msgr2=0x7f07c806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:04.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.497+0000 7f07ec1f5640 1 --2- 172.21.15.102:0/731241674 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f07c806ae70 0x7f07c806d330 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f07e0036000 tx=0x7f07e003c040 comp rx=0 tx=0).stop 2023-10-14T09:38:04.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.497+0000 7f07ec1f5640 1 -- 172.21.15.102:0/731241674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07e415ad70 msgr2=0x7f07e41efc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:04.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.497+0000 7f07ec1f5640 1 --2- 172.21.15.102:0/731241674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07e415ad70 0x7f07e41efc20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f07dc00c7a0 tx=0x7f07dc00cc60 comp rx=0 tx=0).stop 2023-10-14T09:38:04.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.497+0000 7f07ec1f5640 1 -- 172.21.15.102:0/731241674 shutdown_connections 2023-10-14T09:38:04.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.497+0000 7f07ec1f5640 1 --2- 172.21.15.102:0/731241674 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f07c806ae70 0x7f07c806d330 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:04.501 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.497+0000 7f07ec1f5640 1 --2- 172.21.15.102:0/731241674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07e415ad70 0x7f07e41efc20 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:04.501 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.497+0000 7f07ec1f5640 1 --2- 172.21.15.102:0/731241674 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f07e40ca3b0 0x7f07e40afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:04.501 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.497+0000 7f07ec1f5640 1 --2- 172.21.15.102:0/731241674 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f07e40c9ca0 0x7f07e414bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:04.501 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.497+0000 7f07ec1f5640 1 -- 172.21.15.102:0/731241674 >> 172.21.15.102:0/731241674 conn(0x7f07e40ce9b0 msgr2=0x7f07e415b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:04.501 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.497+0000 7f07ec1f5640 1 -- 172.21.15.102:0/731241674 shutdown_connections 2023-10-14T09:38:04.502 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.498+0000 7f07ec1f5640 1 -- 172.21.15.102:0/731241674 wait complete. 2023-10-14T09:38:04.517 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T09:38:04.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.729+0000 7f4abda97640 1 Processor -- start 2023-10-14T09:38:04.732 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.730+0000 7f4abda97640 1 -- start start 2023-10-14T09:38:04.733 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.731+0000 7f4abda97640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f4ab80caac0 0x7f4ab80ad4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:04.733 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.731+0000 7f4abda97640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab80cb030 con 0x7f4ab806a4b0 2023-10-14T09:38:04.734 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.731+0000 7f4abda97640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab80c91c0 con 0x7f4ab815ad70 2023-10-14T09:38:04.734 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.731+0000 7f4abda97640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ab80c94a0 con 0x7f4ab80caac0 2023-10-14T09:38:04.734 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.732+0000 7f4aaffff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f4ab806a4b0 0x7f4ab80ca3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:42996/0 (socket says 172.21.15.102:42996) 2023-10-14T09:38:04.734 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.732+0000 7f4aaffff640 1 -- 172.21.15.102:0/42487760 learned_addr learned my addr 172.21.15.102:0/42487760 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:04.734 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.732+0000 7f4ab7fff640 1 --2- 172.21.15.102:0/42487760 >> v2:172.21.15.129:3300/0 conn(0x7f4ab80caac0 0x7f4ab80ad4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:04.737 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.732+0000 7f4ab6ffd640 1 -- 172.21.15.102:0/42487760 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3209714436 0 0) 0x7f4ab80cb030 con 0x7f4ab806a4b0 2023-10-14T09:38:04.737 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.732+0000 7f4ab6ffd640 1 -- 172.21.15.102:0/42487760 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4aa4003520 con 0x7f4ab806a4b0 2023-10-14T09:38:04.737 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.732+0000 7f4ab6ffd640 1 -- 172.21.15.102:0/42487760 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2496217368 0 0) 0x7f4aa4003520 con 0x7f4ab806a4b0 2023-10-14T09:38:04.737 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.732+0000 7f4ab6ffd640 1 -- 172.21.15.102:0/42487760 >> v2:172.21.15.129:3300/0 conn(0x7f4ab80caac0 msgr2=0x7f4ab80ad4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:04.738 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.732+0000 7f4ab6ffd640 1 --2- 172.21.15.102:0/42487760 >> v2:172.21.15.129:3300/0 conn(0x7f4ab80caac0 0x7f4ab80ad4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:04.738 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.732+0000 7f4ab6ffd640 1 -- 172.21.15.102:0/42487760 >> v1:172.21.15.129:6789/0 conn(0x7f4ab815ad70 legacy=0x7f4ab8069da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:04.738 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.732+0000 7f4ab6ffd640 1 -- 172.21.15.102:0/42487760 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab80c9780 con 0x7f4ab806a4b0 2023-10-14T09:38:04.738 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.732+0000 7f4ab6ffd640 1 -- 172.21.15.102:0/42487760 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4030661168 0 0) 0x7f4aa0001670 con 0x7f4ab806a4b0 2023-10-14T09:38:04.738 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.733+0000 7f4ab6ffd640 1 -- 172.21.15.102:0/42487760 >> v1:172.21.15.102:6789/0 conn(0x7f4ab806a4b0 legacy=0x7f4ab80ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:04.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.733+0000 7f4ab6ffd640 1 --2- 172.21.15.102:0/42487760 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4aa4003970 0x7f4aa4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:04.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.733+0000 7f4ab6ffd640 1 --2- 172.21.15.102:0/42487760 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4aa40047c0 0x7f4aa4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:04.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.733+0000 7f4ab6ffd640 1 --2- 172.21.15.102:0/42487760 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4aa4005180 0x7f4aa400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:04.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.733+0000 7f4ab6ffd640 1 -- 172.21.15.102:0/42487760 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab80c94a0 con 0x7f4aa40047c0 2023-10-14T09:38:04.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.733+0000 7f4ab6ffd640 1 -- 172.21.15.102:0/42487760 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa400c020 con 0x7f4aa4003970 2023-10-14T09:38:04.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.733+0000 7f4ab6ffd640 1 -- 172.21.15.102:0/42487760 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa400c1e0 con 0x7f4aa4005180 2023-10-14T09:38:04.740 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.733+0000 7f4aaffff640 1 --2- 172.21.15.102:0/42487760 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4aa40047c0 0x7f4aa4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:04.740 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.733+0000 7f4ab77fe640 1 --2- 172.21.15.102:0/42487760 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4aa4003970 0x7f4aa4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:04.740 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.733+0000 7f4ab7fff640 1 --2- 172.21.15.102:0/42487760 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4aa4005180 0x7f4aa400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:04.740 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.733+0000 7f4aaffff640 1 -- 172.21.15.102:0/42487760 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4aa4005180 msgr2=0x7f4aa400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:04.740 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.733+0000 7f4aaffff640 1 --2- 172.21.15.102:0/42487760 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4aa4005180 0x7f4aa400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:04.741 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.733+0000 7f4aaffff640 1 -- 172.21.15.102:0/42487760 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4aa4003970 msgr2=0x7f4aa4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:04.741 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.733+0000 7f4aaffff640 1 --2- 172.21.15.102:0/42487760 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4aa4003970 0x7f4aa4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:04.741 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.733+0000 7f4aaffff640 1 -- 172.21.15.102:0/42487760 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa4003520 con 0x7f4aa40047c0 2023-10-14T09:38:04.741 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.733+0000 7f4ab7fff640 1 -- 172.21.15.102:0/42487760 reap_dead start 2023-10-14T09:38:04.741 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.735+0000 7f4aaffff640 1 --2- 172.21.15.102:0/42487760 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4aa40047c0 0x7f4aa4004c40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4aa000c240 tx=0x7f4aa40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab9385fe9638b440 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:04.742 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.735+0000 7f4ab6ffd640 1 -- 172.21.15.102:0/42487760 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa0005ad0 con 0x7f4aa40047c0 2023-10-14T09:38:04.742 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.735+0000 7f4ab6ffd640 1 -- 172.21.15.102:0/42487760 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa0005c30 con 0x7f4aa40047c0 2023-10-14T09:38:04.742 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.735+0000 7f4ab6ffd640 1 -- 172.21.15.102:0/42487760 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa002ca90 con 0x7f4aa40047c0 2023-10-14T09:38:04.742 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.735+0000 7f4abda97640 1 -- 172.21.15.102:0/42487760 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4aa40047c0 msgr2=0x7f4aa4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:04.742 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.735+0000 7f4abda97640 1 --2- 172.21.15.102:0/42487760 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4aa40047c0 0x7f4aa4004c40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4aa000c240 tx=0x7f4aa40057f0 comp rx=0 tx=0).stop 2023-10-14T09:38:04.745 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.736+0000 7f4abda97640 1 -- 172.21.15.102:0/42487760 shutdown_connections 2023-10-14T09:38:04.745 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.736+0000 7f4abda97640 1 --2- 172.21.15.102:0/42487760 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4aa40047c0 0x7f4aa4004c40 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:04.746 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.736+0000 7f4abda97640 1 -- 172.21.15.102:0/42487760 >> 172.21.15.102:0/42487760 conn(0x7f4ab80ce9b0 msgr2=0x7f4ab80cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:04.746 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.736+0000 7f4abda97640 1 -- 172.21.15.102:0/42487760 shutdown_connections 2023-10-14T09:38:04.746 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.736+0000 7f4abda97640 1 -- 172.21.15.102:0/42487760 wait complete. 2023-10-14T09:38:04.746 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.737+0000 7f4abda97640 1 Processor -- start 2023-10-14T09:38:04.746 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.738+0000 7f4abda97640 1 -- start start 2023-10-14T09:38:04.747 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.738+0000 7f4abda97640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4aa40047c0 0x7f4ab8159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:04.747 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.738+0000 7f4abda97640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4ab80c4960 0x7f4ab80ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:04.747 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.738+0000 7f4abda97640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ab80aecf0 0x7f4ab80af180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:04.747 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.738+0000 7f4abda97640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab81595a0 con 0x7f4ab80aecf0 2023-10-14T09:38:04.747 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.738+0000 7f4abda97640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab80af6c0 con 0x7f4ab80c4960 2023-10-14T09:38:04.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.738+0000 7f4abda97640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab80ae2a0 con 0x7f4aa40047c0 2023-10-14T09:38:04.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.739+0000 7f4ab7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ab80aecf0 0x7f4ab80af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:04.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.739+0000 7f4ab7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ab80aecf0 0x7f4ab80af180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41708/0 (socket says 172.21.15.102:41708) 2023-10-14T09:38:04.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.739+0000 7f4ab7fff640 1 -- 172.21.15.102:0/3926759589 learned_addr learned my addr 172.21.15.102:0/3926759589 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:04.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.739+0000 7f4ab77fe640 1 --2- 172.21.15.102:0/3926759589 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4aa40047c0 0x7f4ab8159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:04.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.739+0000 7f4aaffff640 1 --2- 172.21.15.102:0/3926759589 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4ab80c4960 0x7f4ab80ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:04.749 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.739+0000 7f4ab7fff640 1 -- 172.21.15.102:0/3926759589 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4aa40047c0 msgr2=0x7f4ab8159060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:04.749 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.739+0000 7f4ab7fff640 1 --2- 172.21.15.102:0/3926759589 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4aa40047c0 0x7f4ab8159060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:04.749 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.739+0000 7f4ab7fff640 1 -- 172.21.15.102:0/3926759589 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4ab80c4960 msgr2=0x7f4ab80ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:04.749 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.739+0000 7f4ab7fff640 1 --2- 172.21.15.102:0/3926759589 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4ab80c4960 0x7f4ab80ac890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:04.749 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.739+0000 7f4ab7fff640 1 -- 172.21.15.102:0/3926759589 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab80ad200 con 0x7f4ab80aecf0 2023-10-14T09:38:04.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.739+0000 7f4ab7fff640 1 --2- 172.21.15.102:0/3926759589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ab80aecf0 0x7f4ab80af180 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4ab806d860 tx=0x7f4ab00115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:04.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.740+0000 7f4ab4ff9640 1 -- 172.21.15.102:0/3926759589 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab000e070 con 0x7f4ab80aecf0 2023-10-14T09:38:04.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.740+0000 7f4ab4ff9640 1 -- 172.21.15.102:0/3926759589 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab0011e10 con 0x7f4ab80aecf0 2023-10-14T09:38:04.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.740+0000 7f4ab4ff9640 1 -- 172.21.15.102:0/3926759589 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0003990 con 0x7f4ab80aecf0 2023-10-14T09:38:04.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.740+0000 7f4abda97640 1 -- 172.21.15.102:0/3926759589 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ab80ad4e0 con 0x7f4ab80aecf0 2023-10-14T09:38:04.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.740+0000 7f4abda97640 1 -- 172.21.15.102:0/3926759589 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab80adaa0 con 0x7f4ab80aecf0 2023-10-14T09:38:04.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.741+0000 7f4abda97640 1 -- 172.21.15.102:0/3926759589 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ab804e160 con 0x7f4ab80aecf0 2023-10-14T09:38:04.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.742+0000 7f4ab4ff9640 1 -- 172.21.15.102:0/3926759589 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4ab0003af0 con 0x7f4ab80aecf0 2023-10-14T09:38:04.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.743+0000 7f4ab4ff9640 1 --2- 172.21.15.102:0/3926759589 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4a9806aea0 0x7f4a9806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:04.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.743+0000 7f4ab4ff9640 1 -- 172.21.15.102:0/3926759589 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f4ab0089f80 con 0x7f4ab80aecf0 2023-10-14T09:38:04.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.743+0000 7f4ab77fe640 1 --2- 172.21.15.102:0/3926759589 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4a9806aea0 0x7f4a9806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:04.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.744+0000 7f4ab77fe640 1 --2- 172.21.15.102:0/3926759589 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4a9806aea0 0x7f4a9806d360 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8007fd0 tx=0x7f4aa8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:04.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.747+0000 7f4ab4ff9640 1 -- 172.21.15.102:0/3926759589 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4ab0054f00 con 0x7f4ab80aecf0 2023-10-14T09:38:04.954 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.953+0000 7f4abda97640 1 -- 172.21.15.102:0/3926759589 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4ab806c040 con 0x7f4ab80aecf0 2023-10-14T09:38:04.955 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.953+0000 7f4ab4ff9640 1 -- 172.21.15.102:0/3926759589 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4ab0058520 con 0x7f4ab80aecf0 2023-10-14T09:38:04.955 INFO:teuthology.orchestra.run.smithi102.stderr:listed 0 entries 2023-10-14T09:38:04.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.956+0000 7f4abda97640 1 -- 172.21.15.102:0/3926759589 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4a9806aea0 msgr2=0x7f4a9806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:04.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.956+0000 7f4abda97640 1 --2- 172.21.15.102:0/3926759589 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4a9806aea0 0x7f4a9806d360 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8007fd0 tx=0x7f4aa8009040 comp rx=0 tx=0).stop 2023-10-14T09:38:04.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.956+0000 7f4abda97640 1 -- 172.21.15.102:0/3926759589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ab80aecf0 msgr2=0x7f4ab80af180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:04.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.956+0000 7f4abda97640 1 --2- 172.21.15.102:0/3926759589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ab80aecf0 0x7f4ab80af180 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4ab806d860 tx=0x7f4ab00115a0 comp rx=0 tx=0).stop 2023-10-14T09:38:04.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.956+0000 7f4abda97640 1 -- 172.21.15.102:0/3926759589 shutdown_connections 2023-10-14T09:38:04.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.956+0000 7f4abda97640 1 --2- 172.21.15.102:0/3926759589 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4a9806aea0 0x7f4a9806d360 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:04.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.956+0000 7f4abda97640 1 --2- 172.21.15.102:0/3926759589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ab80aecf0 0x7f4ab80af180 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:04.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.956+0000 7f4abda97640 1 --2- 172.21.15.102:0/3926759589 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4ab80c4960 0x7f4ab80ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:04.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.956+0000 7f4abda97640 1 --2- 172.21.15.102:0/3926759589 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4aa40047c0 0x7f4ab8159060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:04.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.956+0000 7f4abda97640 1 -- 172.21.15.102:0/3926759589 >> 172.21.15.102:0/3926759589 conn(0x7f4ab80ce9b0 msgr2=0x7f4ab80afa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:04.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.956+0000 7f4abda97640 1 -- 172.21.15.102:0/3926759589 shutdown_connections 2023-10-14T09:38:04.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:04.957+0000 7f4abda97640 1 -- 172.21.15.102:0/3926759589 wait complete. 2023-10-14T09:38:04.977 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-14T09:38:04.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:38:04.978 DEBUG:teuthology.orchestra.run.smithi102:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-14T09:38:05.069 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi102.front.sepia.ceph.com 2023-10-14T09:38:05.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:38:05.070 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T09:38:05.128 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2023-10-14T09:38:05.129 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T09:38:05.189 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2023-10-14T09:38:05.190 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T09:38:05.241 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2023-10-14T09:38:05.241 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T09:38:05.294 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:38:05.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.514+0000 7f83ccafc640 1 Processor -- start 2023-10-14T09:38:05.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.514+0000 7f83ccafc640 1 -- start start 2023-10-14T09:38:05.517 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.515+0000 7f83ccafc640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f83c8159b20 0x7f83c806bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:05.518 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.515+0000 7f83ccafc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f83c8159f00 0x7f83c80b0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:05.518 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.516+0000 7f83ccafc640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83c806f7f0 con 0x7f83c806c120 2023-10-14T09:38:05.518 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.516+0000 7f83ccafc640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83c806c5e0 con 0x7f83c8159f00 2023-10-14T09:38:05.518 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.516+0000 7f83ccafc640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c806c8c0 con 0x7f83c8159b20 2023-10-14T09:38:05.519 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.516+0000 7f83bdd9b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f83c8159f00 0x7f83c80b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:05.519 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.516+0000 7f83bdd9b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f83c8159f00 0x7f83c80b0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41712/0 (socket says 172.21.15.102:41712) 2023-10-14T09:38:05.519 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.516+0000 7f83bdd9b640 1 -- 172.21.15.102:0/2483771701 learned_addr learned my addr 172.21.15.102:0/2483771701 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:05.519 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.516+0000 7f83c659c640 1 --2- 172.21.15.102:0/2483771701 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f83c8159b20 0x7f83c806bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:05.520 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.516+0000 7f83bdd9b640 1 -- 172.21.15.102:0/2483771701 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f83c8159b20 msgr2=0x7f83c806bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:05.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.516+0000 7f83bdd9b640 1 --2- 172.21.15.102:0/2483771701 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f83c8159b20 0x7f83c806bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:05.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.516+0000 7f83bdd9b640 1 -- 172.21.15.102:0/2483771701 >> v1:172.21.15.129:6789/0 conn(0x7f83c806c120 legacy=0x7f83c80cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:05.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.516+0000 7f83bdd9b640 1 -- 172.21.15.102:0/2483771701 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c806cba0 con 0x7f83c8159f00 2023-10-14T09:38:05.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.517+0000 7f83bdd9b640 1 --2- 172.21.15.102:0/2483771701 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83c8159f00 0x7f83c80b0410 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009870 tx=0x7f83b002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbb29f0a6907ca61 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:05.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.518+0000 7f83c5d9b640 1 -- 172.21.15.102:0/2483771701 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b0031640 con 0x7f83c8159f00 2023-10-14T09:38:05.522 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.518+0000 7f83c5d9b640 1 -- 172.21.15.102:0/2483771701 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b00317a0 con 0x7f83c8159f00 2023-10-14T09:38:05.522 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.518+0000 7f83c5d9b640 1 -- 172.21.15.102:0/2483771701 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b0031b30 con 0x7f83c8159f00 2023-10-14T09:38:05.522 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.518+0000 7f83ccafc640 1 -- 172.21.15.102:0/2483771701 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83c8159f00 msgr2=0x7f83c80b0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:05.522 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.518+0000 7f83ccafc640 1 --2- 172.21.15.102:0/2483771701 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83c8159f00 0x7f83c80b0410 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009870 tx=0x7f83b002b8f0 comp rx=0 tx=0).stop 2023-10-14T09:38:05.523 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.519+0000 7f83ccafc640 1 -- 172.21.15.102:0/2483771701 shutdown_connections 2023-10-14T09:38:05.523 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.519+0000 7f83ccafc640 1 --2- 172.21.15.102:0/2483771701 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83c8159f00 0x7f83c80b0410 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:05.523 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.519+0000 7f83ccafc640 1 --2- 172.21.15.102:0/2483771701 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f83c8159b20 0x7f83c806bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:05.523 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.519+0000 7f83ccafc640 1 -- 172.21.15.102:0/2483771701 >> 172.21.15.102:0/2483771701 conn(0x7f83c80cb410 msgr2=0x7f83c80cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:05.523 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.519+0000 7f83ccafc640 1 -- 172.21.15.102:0/2483771701 shutdown_connections 2023-10-14T09:38:05.523 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.519+0000 7f83ccafc640 1 -- 172.21.15.102:0/2483771701 wait complete. 2023-10-14T09:38:05.526 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.520+0000 7f83ccafc640 1 Processor -- start 2023-10-14T09:38:05.526 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.521+0000 7f83ccafc640 1 -- start start 2023-10-14T09:38:05.526 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.521+0000 7f83ccafc640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f83c806c120 0x7f83c8167590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:05.526 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.521+0000 7f83ccafc640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f83c8159b20 0x7f83c80b0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:05.527 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.522+0000 7f83ccafc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83c8159f00 0x7f83c80b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:05.527 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.522+0000 7f83ccafc640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c80b2f90 con 0x7f83c8159f00 2023-10-14T09:38:05.527 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.522+0000 7f83ccafc640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c80b3810 con 0x7f83c806c120 2023-10-14T09:38:05.527 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.522+0000 7f83ccafc640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c80b1a90 con 0x7f83c8159b20 2023-10-14T09:38:05.527 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.522+0000 7f83c6d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83c8159f00 0x7f83c80b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:05.527 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.522+0000 7f83c6d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83c8159f00 0x7f83c80b3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41722/0 (socket says 172.21.15.102:41722) 2023-10-14T09:38:05.528 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.522+0000 7f83c6d9d640 1 -- 172.21.15.102:0/271001206 learned_addr learned my addr 172.21.15.102:0/271001206 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:05.528 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.522+0000 7f83c659c640 1 --2- 172.21.15.102:0/271001206 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f83c806c120 0x7f83c8167590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:05.528 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.522+0000 7f83bdd9b640 1 --2- 172.21.15.102:0/271001206 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f83c8159b20 0x7f83c80b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:05.528 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.522+0000 7f83c6d9d640 1 -- 172.21.15.102:0/271001206 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f83c8159b20 msgr2=0x7f83c80b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:05.528 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.522+0000 7f83c6d9d640 1 --2- 172.21.15.102:0/271001206 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f83c8159b20 0x7f83c80b0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:05.529 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.522+0000 7f83c6d9d640 1 -- 172.21.15.102:0/271001206 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f83c806c120 msgr2=0x7f83c8167590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:05.529 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.522+0000 7f83c6d9d640 1 --2- 172.21.15.102:0/271001206 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f83c806c120 0x7f83c8167590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:05.529 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.522+0000 7f83c6d9d640 1 -- 172.21.15.102:0/271001206 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b00094d0 con 0x7f83c8159f00 2023-10-14T09:38:05.529 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.522+0000 7f83bdd9b640 1 --2- 172.21.15.102:0/271001206 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f83c8159b20 0x7f83c80b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:05.529 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.522+0000 7f83c659c640 1 --2- 172.21.15.102:0/271001206 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f83c806c120 0x7f83c8167590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:05.530 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.523+0000 7f83c6d9d640 1 --2- 172.21.15.102:0/271001206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83c8159f00 0x7f83c80b3ca0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f83c000c780 tx=0x7f83c000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:05.530 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.523+0000 7f83bf7fe640 1 -- 172.21.15.102:0/271001206 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c0003d80 con 0x7f83c8159f00 2023-10-14T09:38:05.530 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.523+0000 7f83bf7fe640 1 -- 172.21.15.102:0/271001206 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c000ce30 con 0x7f83c8159f00 2023-10-14T09:38:05.530 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.523+0000 7f83ccafc640 1 -- 172.21.15.102:0/271001206 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c80b41e0 con 0x7f83c8159f00 2023-10-14T09:38:05.530 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.523+0000 7f83bf7fe640 1 -- 172.21.15.102:0/271001206 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c00052b0 con 0x7f83c8159f00 2023-10-14T09:38:05.531 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.523+0000 7f83ccafc640 1 -- 172.21.15.102:0/271001206 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c80b31c0 con 0x7f83c8159f00 2023-10-14T09:38:05.531 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.524+0000 7f83ccafc640 1 -- 172.21.15.102:0/271001206 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c80b39c0 con 0x7f83c8159f00 2023-10-14T09:38:05.531 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.525+0000 7f83bf7fe640 1 -- 172.21.15.102:0/271001206 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f83c0005410 con 0x7f83c8159f00 2023-10-14T09:38:05.532 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.526+0000 7f83bf7fe640 1 --2- 172.21.15.102:0/271001206 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f83a806ae70 0x7f83a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:05.532 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.526+0000 7f83bf7fe640 1 -- 172.21.15.102:0/271001206 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f83c0088f30 con 0x7f83c8159f00 2023-10-14T09:38:05.532 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.526+0000 7f83c659c640 1 --2- 172.21.15.102:0/271001206 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f83a806ae70 0x7f83a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:05.532 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.527+0000 7f83c659c640 1 --2- 172.21.15.102:0/271001206 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f83a806ae70 0x7f83a806d330 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f83b8006fd0 tx=0x7f83b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:05.533 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.531+0000 7f83bf7fe640 1 -- 172.21.15.102:0/271001206 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f83c80b39c0 con 0x7f83c8159f00 2023-10-14T09:38:05.723 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.721+0000 7f83ccafc640 1 -- 172.21.15.102:0/271001206 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83c80b39c0 con 0x7f83c8159f00 2023-10-14T09:38:05.726 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.724+0000 7f83bf7fe640 1 -- 172.21.15.102:0/271001206 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16838 (secure 0 0 0) 0x7f83c80b39c0 con 0x7f83c8159f00 2023-10-14T09:38:05.726 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:38:05.727 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":24,"fsid":"8a6cd69d-7f5b-4f2a-806a-0176c10aed50","created":"2023-10-14T09:36:56.745172+0000","modified":"2023-10-14T09:38:03.788214+0000","last_up_change":"2023-10-14T09:37:09.791473+0000","last_in_change":"2023-10-14T09:37:00.547186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:37:09.952407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:37:19.560925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:37:20.363385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e5aef8f3-878f-482b-b522-9a5b958b90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6801","nonce":1727250718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6803","nonce":1727250718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6807","nonce":1727250718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6805","nonce":1727250718}]},"public_addr":"172.21.15.102:6801/1727250718","cluster_addr":"172.21.15.102:6803/1727250718","heartbeat_back_addr":"172.21.15.102:6807/1727250718","heartbeat_front_addr":"172.21.15.102:6805/1727250718","state":["exists","up"]},{"osd":1,"uuid":"4a8cf50e-387b-4d47-9588-bd22e375a9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6809","nonce":1095651107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6811","nonce":1095651107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6815","nonce":1095651107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6813","nonce":1095651107}]},"public_addr":"172.21.15.102:6809/1095651107","cluster_addr":"172.21.15.102:6811/1095651107","heartbeat_back_addr":"172.21.15.102:6815/1095651107","heartbeat_front_addr":"172.21.15.102:6813/1095651107","state":["exists","up"]},{"osd":2,"uuid":"009ef55f-8a63-4219-bacd-d7c7b4500867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6820","nonce":2198222556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6825","nonce":2198222556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6831","nonce":2198222556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6829","nonce":2198222556}]},"public_addr":"172.21.15.102:6820/2198222556","cluster_addr":"172.21.15.102:6825/2198222556","heartbeat_back_addr":"172.21.15.102:6831/2198222556","heartbeat_front_addr":"172.21.15.102:6829/2198222556","state":["exists","up"]},{"osd":3,"uuid":"f2110eae-2ff9-4ed9-93d6-bd2361618211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6818","nonce":654726740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6821","nonce":654726740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6827","nonce":654726740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6823","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6824","nonce":654726740}]},"public_addr":"172.21.15.102:6818/654726740","cluster_addr":"172.21.15.102:6821/654726740","heartbeat_back_addr":"172.21.15.102:6827/654726740","heartbeat_front_addr":"172.21.15.102:6824/654726740","state":["exists","up"]},{"osd":4,"uuid":"33f1ae34-3100-40f7-9cb8-0eca2b358693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6817","nonce":507586170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6819","nonce":507586170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6823","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6825","nonce":507586170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6821","nonce":507586170}]},"public_addr":"172.21.15.129:6817/507586170","cluster_addr":"172.21.15.129:6819/507586170","heartbeat_back_addr":"172.21.15.129:6825/507586170","heartbeat_front_addr":"172.21.15.129:6821/507586170","state":["exists","up"]},{"osd":5,"uuid":"fab2fc62-3f3e-450d-93e0-770f39e80710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6801","nonce":1913451073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6803","nonce":1913451073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6807","nonce":1913451073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6805","nonce":1913451073}]},"public_addr":"172.21.15.129:6801/1913451073","cluster_addr":"172.21.15.129:6803/1913451073","heartbeat_back_addr":"172.21.15.129:6807/1913451073","heartbeat_front_addr":"172.21.15.129:6805/1913451073","state":["exists","up"]},{"osd":6,"uuid":"d7cc1d69-92e7-4253-a127-cfc0444a4809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6809","nonce":2853291511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6811","nonce":2853291511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6815","nonce":2853291511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6813","nonce":2853291511}]},"public_addr":"172.21.15.129:6809/2853291511","cluster_addr":"172.21.15.129:6811/2853291511","heartbeat_back_addr":"172.21.15.129:6815/2853291511","heartbeat_front_addr":"172.21.15.129:6813/2853291511","state":["exists","up"]},{"osd":7,"uuid":"1e403de1-09e2-4370-b9a7-e790ac44bbee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6824","nonce":2933886914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6827","nonce":2933886914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6831","nonce":2933886914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6829","nonce":2933886914}]},"public_addr":"172.21.15.129:6824/2933886914","cluster_addr":"172.21.15.129:6827/2933886914","heartbeat_back_addr":"172.21.15.129:6831/2933886914","heartbeat_front_addr":"172.21.15.129:6829/2933886914","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.849661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.868113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.933488+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.891794+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.901861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.858750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.911712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.996765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:38:05.729 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.727+0000 7f83ccafc640 1 -- 172.21.15.102:0/271001206 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f83a806ae70 msgr2=0x7f83a806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:05.729 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.727+0000 7f83ccafc640 1 --2- 172.21.15.102:0/271001206 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f83a806ae70 0x7f83a806d330 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f83b8006fd0 tx=0x7f83b8008040 comp rx=0 tx=0).stop 2023-10-14T09:38:05.729 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.727+0000 7f83ccafc640 1 -- 172.21.15.102:0/271001206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83c8159f00 msgr2=0x7f83c80b3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:05.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.727+0000 7f83ccafc640 1 --2- 172.21.15.102:0/271001206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83c8159f00 0x7f83c80b3ca0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f83c000c780 tx=0x7f83c000cc40 comp rx=0 tx=0).stop 2023-10-14T09:38:05.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.727+0000 7f83ccafc640 1 -- 172.21.15.102:0/271001206 shutdown_connections 2023-10-14T09:38:05.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.727+0000 7f83ccafc640 1 --2- 172.21.15.102:0/271001206 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f83a806ae70 0x7f83a806d330 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:05.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.727+0000 7f83ccafc640 1 --2- 172.21.15.102:0/271001206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83c8159f00 0x7f83c80b3ca0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:05.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.727+0000 7f83ccafc640 1 --2- 172.21.15.102:0/271001206 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f83c8159b20 0x7f83c80b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:05.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.727+0000 7f83ccafc640 1 --2- 172.21.15.102:0/271001206 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f83c806c120 0x7f83c8167590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:05.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.727+0000 7f83ccafc640 1 -- 172.21.15.102:0/271001206 >> 172.21.15.102:0/271001206 conn(0x7f83c80cb410 msgr2=0x7f83c80cd250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:05.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.727+0000 7f83ccafc640 1 -- 172.21.15.102:0/271001206 shutdown_connections 2023-10-14T09:38:05.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.727+0000 7f83ccafc640 1 -- 172.21.15.102:0/271001206 wait complete. 2023-10-14T09:38:05.746 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T09:37:09.952407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T09:37:19.560925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T09:37:20.363385+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T09:38:05.747 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T09:38:05.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.949+0000 7f0edb45d640 1 Processor -- start 2023-10-14T09:38:05.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.949+0000 7f0edb45d640 1 -- start start 2023-10-14T09:38:05.952 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.950+0000 7f0edb45d640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f0ed4159e90 0x7f0ed40ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:05.952 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.950+0000 7f0edb45d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed4070360 con 0x7f0ed406c140 2023-10-14T09:38:05.952 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.950+0000 7f0edb45d640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed40cd1f0 con 0x7f0ed4159ab0 2023-10-14T09:38:05.953 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.950+0000 7f0edb45d640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed415d890 con 0x7f0ed4159e90 2023-10-14T09:38:05.953 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.951+0000 7f0ed99fa640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f0ed406c140 0x7f0ed415dce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:43000/0 (socket says 172.21.15.102:43000) 2023-10-14T09:38:05.953 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.951+0000 7f0ed99fa640 1 -- 172.21.15.102:0/2835865979 learned_addr learned my addr 172.21.15.102:0/2835865979 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:05.955 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.951+0000 7f0ed89f8640 1 --2- 172.21.15.102:0/2835865979 >> v2:172.21.15.129:3300/0 conn(0x7f0ed4159e90 0x7f0ed40ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:05.955 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.951+0000 7f0ecbfff640 1 -- 172.21.15.102:0/2835865979 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009482907 0 0) 0x7f0ed4070360 con 0x7f0ed406c140 2023-10-14T09:38:05.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.951+0000 7f0ecbfff640 1 -- 172.21.15.102:0/2835865979 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ec0005730 con 0x7f0ed406c140 2023-10-14T09:38:05.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.952+0000 7f0ecbfff640 1 -- 172.21.15.102:0/2835865979 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2620148545 0 0) 0x7f0ec0005730 con 0x7f0ed406c140 2023-10-14T09:38:05.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.952+0000 7f0ecbfff640 1 -- 172.21.15.102:0/2835865979 >> v2:172.21.15.129:3300/0 conn(0x7f0ed4159e90 msgr2=0x7f0ed40ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:05.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.952+0000 7f0ecbfff640 1 --2- 172.21.15.102:0/2835865979 >> v2:172.21.15.129:3300/0 conn(0x7f0ed4159e90 0x7f0ed40ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:05.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.952+0000 7f0ecbfff640 1 -- 172.21.15.102:0/2835865979 >> v1:172.21.15.129:6789/0 conn(0x7f0ed4159ab0 legacy=0x7f0ed406fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:05.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.952+0000 7f0ecbfff640 1 -- 172.21.15.102:0/2835865979 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed40cd4d0 con 0x7f0ed406c140 2023-10-14T09:38:05.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.952+0000 7f0ecbfff640 1 -- 172.21.15.102:0/2835865979 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4030661168 0 0) 0x7f0ecc0019f0 con 0x7f0ed406c140 2023-10-14T09:38:05.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.952+0000 7f0ecbfff640 1 -- 172.21.15.102:0/2835865979 >> v1:172.21.15.102:6789/0 conn(0x7f0ed406c140 legacy=0x7f0ed415dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:05.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.952+0000 7f0ecbfff640 1 --2- 172.21.15.102:0/2835865979 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0ec0005b80 0x7f0ec0005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:05.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.952+0000 7f0ecbfff640 1 --2- 172.21.15.102:0/2835865979 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ec00069d0 0x7f0ec0006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:05.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.952+0000 7f0ecbfff640 1 --2- 172.21.15.102:0/2835865979 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0ec00074b0 0x7f0ec000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:05.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.952+0000 7f0ecbfff640 1 -- 172.21.15.102:0/2835865979 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed415d890 con 0x7f0ec00069d0 2023-10-14T09:38:05.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.952+0000 7f0ecbfff640 1 -- 172.21.15.102:0/2835865979 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec000e380 con 0x7f0ec00074b0 2023-10-14T09:38:05.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.952+0000 7f0ecbfff640 1 -- 172.21.15.102:0/2835865979 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec000e540 con 0x7f0ec0005b80 2023-10-14T09:38:05.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.952+0000 7f0ed89f8640 1 --2- 172.21.15.102:0/2835865979 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ec00069d0 0x7f0ec0006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:05.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.952+0000 7f0ed99fa640 1 --2- 172.21.15.102:0/2835865979 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0ec00074b0 0x7f0ec000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:05.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.953+0000 7f0ed91f9640 1 --2- 172.21.15.102:0/2835865979 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0ec0005b80 0x7f0ec0005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:05.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.953+0000 7f0ed89f8640 1 -- 172.21.15.102:0/2835865979 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0ec0005b80 msgr2=0x7f0ec0005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:05.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.953+0000 7f0ed89f8640 1 --2- 172.21.15.102:0/2835865979 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0ec0005b80 0x7f0ec0005fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:05.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.953+0000 7f0ed89f8640 1 -- 172.21.15.102:0/2835865979 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0ec00074b0 msgr2=0x7f0ec000db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:05.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.953+0000 7f0ed89f8640 1 --2- 172.21.15.102:0/2835865979 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0ec00074b0 0x7f0ec000db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:05.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.953+0000 7f0ed89f8640 1 -- 172.21.15.102:0/2835865979 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec0005730 con 0x7f0ec00069d0 2023-10-14T09:38:05.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.953+0000 7f0ed99fa640 1 -- 172.21.15.102:0/2835865979 reap_dead start 2023-10-14T09:38:05.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.954+0000 7f0ed89f8640 1 --2- 172.21.15.102:0/2835865979 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ec00069d0 0x7f0ec0006e50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4009a90 tx=0x7f0ec0007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1623de13c102c625 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:05.962 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.954+0000 7f0ecbfff640 1 -- 172.21.15.102:0/2835865979 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec402c680 con 0x7f0ec00069d0 2023-10-14T09:38:05.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.954+0000 7f0ecbfff640 1 -- 172.21.15.102:0/2835865979 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec402c7e0 con 0x7f0ec00069d0 2023-10-14T09:38:05.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.954+0000 7f0ecbfff640 1 -- 172.21.15.102:0/2835865979 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec402cb70 con 0x7f0ec00069d0 2023-10-14T09:38:05.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.955+0000 7f0edb45d640 1 -- 172.21.15.102:0/2835865979 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ec00069d0 msgr2=0x7f0ec0006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:05.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.955+0000 7f0edb45d640 1 --2- 172.21.15.102:0/2835865979 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ec00069d0 0x7f0ec0006e50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4009a90 tx=0x7f0ec0007a00 comp rx=0 tx=0).stop 2023-10-14T09:38:05.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.955+0000 7f0edb45d640 1 -- 172.21.15.102:0/2835865979 shutdown_connections 2023-10-14T09:38:05.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.955+0000 7f0edb45d640 1 --2- 172.21.15.102:0/2835865979 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ec00069d0 0x7f0ec0006e50 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:05.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.955+0000 7f0edb45d640 1 -- 172.21.15.102:0/2835865979 >> 172.21.15.102:0/2835865979 conn(0x7f0ed40ce9b0 msgr2=0x7f0ed40cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:05.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.955+0000 7f0edb45d640 1 -- 172.21.15.102:0/2835865979 shutdown_connections 2023-10-14T09:38:05.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.955+0000 7f0edb45d640 1 -- 172.21.15.102:0/2835865979 wait complete. 2023-10-14T09:38:05.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.957+0000 7f0edb45d640 1 Processor -- start 2023-10-14T09:38:05.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.957+0000 7f0edb45d640 1 -- start start 2023-10-14T09:38:05.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.958+0000 7f0edb45d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0ec00069d0 0x7f0ed414de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:05.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.958+0000 7f0edb45d640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0ed40c7890 0x7f0ed4158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:05.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.958+0000 7f0edb45d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ed40c7d10 0x7f0ed4159100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:05.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.958+0000 7f0edb45d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed40c33b0 con 0x7f0ed40c7d10 2023-10-14T09:38:05.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.958+0000 7f0edb45d640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed40c24e0 con 0x7f0ec00069d0 2023-10-14T09:38:05.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.958+0000 7f0edb45d640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed414e380 con 0x7f0ed40c7890 2023-10-14T09:38:05.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.958+0000 7f0ed99fa640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ed40c7d10 0x7f0ed4159100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:05.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.958+0000 7f0ed99fa640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ed40c7d10 0x7f0ed4159100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41740/0 (socket says 172.21.15.102:41740) 2023-10-14T09:38:05.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.958+0000 7f0ed99fa640 1 -- 172.21.15.102:0/2261810484 learned_addr learned my addr 172.21.15.102:0/2261810484 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:05.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.958+0000 7f0ed89f8640 1 --2- 172.21.15.102:0/2261810484 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0ed40c7890 0x7f0ed4158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:05.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.958+0000 7f0ed99fa640 1 -- 172.21.15.102:0/2261810484 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0ed40c7890 msgr2=0x7f0ed4158bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:05.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.958+0000 7f0ed91f9640 1 --2- 172.21.15.102:0/2261810484 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0ec00069d0 0x7f0ed414de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:05.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.958+0000 7f0ed99fa640 1 --2- 172.21.15.102:0/2261810484 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0ed40c7890 0x7f0ed4158bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:05.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.958+0000 7f0ed99fa640 1 -- 172.21.15.102:0/2261810484 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0ec00069d0 msgr2=0x7f0ed414de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:05.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.958+0000 7f0ed99fa640 1 --2- 172.21.15.102:0/2261810484 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0ec00069d0 0x7f0ed414de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:05.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.958+0000 7f0ed99fa640 1 -- 172.21.15.102:0/2261810484 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed415d5b0 con 0x7f0ed40c7d10 2023-10-14T09:38:05.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.959+0000 7f0ed99fa640 1 --2- 172.21.15.102:0/2261810484 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ed40c7d10 0x7f0ed4159100 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40b15a0 tx=0x7f0ecc007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:05.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.959+0000 7f0ec9ffb640 1 -- 172.21.15.102:0/2261810484 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc00eaa0 con 0x7f0ed40c7d10 2023-10-14T09:38:05.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.959+0000 7f0ec9ffb640 1 -- 172.21.15.102:0/2261810484 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ecc00ec20 con 0x7f0ed40c7d10 2023-10-14T09:38:05.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.959+0000 7f0ec9ffb640 1 -- 172.21.15.102:0/2261810484 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc013420 con 0x7f0ed40c7d10 2023-10-14T09:38:05.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.959+0000 7f0edb45d640 1 -- 172.21.15.102:0/2261810484 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed40c2730 con 0x7f0ed40c7d10 2023-10-14T09:38:05.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.959+0000 7f0edb45d640 1 -- 172.21.15.102:0/2261810484 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed40c2cf0 con 0x7f0ed40c7d10 2023-10-14T09:38:05.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.960+0000 7f0edb45d640 1 -- 172.21.15.102:0/2261810484 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed40c34f0 con 0x7f0ed40c7d10 2023-10-14T09:38:05.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.961+0000 7f0ec9ffb640 1 -- 172.21.15.102:0/2261810484 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0ecc013580 con 0x7f0ed40c7d10 2023-10-14T09:38:05.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.962+0000 7f0ec9ffb640 1 --2- 172.21.15.102:0/2261810484 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f0eb806aea0 0x7f0eb806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:05.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.962+0000 7f0ec9ffb640 1 -- 172.21.15.102:0/2261810484 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f0ecc089960 con 0x7f0ed40c7d10 2023-10-14T09:38:05.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.962+0000 7f0ed91f9640 1 --2- 172.21.15.102:0/2261810484 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f0eb806aea0 0x7f0eb806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:05.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.963+0000 7f0ed91f9640 1 --2- 172.21.15.102:0/2261810484 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f0eb806aea0 0x7f0eb806d360 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4063ab0 tx=0x7f0ed0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:05.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:05.966+0000 7f0ec9ffb640 1 -- 172.21.15.102:0/2261810484 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0ed40c34f0 con 0x7f0ed40c7d10 2023-10-14T09:38:06.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.156+0000 7f0edb45d640 1 -- 172.21.15.102:0/2261810484 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0ed40c34f0 con 0x7f0ed40c7d10 2023-10-14T09:38:06.158 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.157+0000 7f0ec9ffb640 1 -- 172.21.15.102:0/2261810484 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0ed40c34f0 con 0x7f0ed40c7d10 2023-10-14T09:38:06.159 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2023-10-14T09:38:06.161 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.159+0000 7f0edb45d640 1 -- 172.21.15.102:0/2261810484 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f0eb806aea0 msgr2=0x7f0eb806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:06.161 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.159+0000 7f0edb45d640 1 --2- 172.21.15.102:0/2261810484 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f0eb806aea0 0x7f0eb806d360 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4063ab0 tx=0x7f0ed0009040 comp rx=0 tx=0).stop 2023-10-14T09:38:06.162 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.159+0000 7f0edb45d640 1 -- 172.21.15.102:0/2261810484 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ed40c7d10 msgr2=0x7f0ed4159100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:06.162 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.159+0000 7f0edb45d640 1 --2- 172.21.15.102:0/2261810484 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ed40c7d10 0x7f0ed4159100 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40b15a0 tx=0x7f0ecc007bc0 comp rx=0 tx=0).stop 2023-10-14T09:38:06.162 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.159+0000 7f0edb45d640 1 -- 172.21.15.102:0/2261810484 shutdown_connections 2023-10-14T09:38:06.162 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.159+0000 7f0edb45d640 1 --2- 172.21.15.102:0/2261810484 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f0eb806aea0 0x7f0eb806d360 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:06.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.159+0000 7f0edb45d640 1 --2- 172.21.15.102:0/2261810484 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ed40c7d10 0x7f0ed4159100 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:06.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.159+0000 7f0edb45d640 1 --2- 172.21.15.102:0/2261810484 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0ed40c7890 0x7f0ed4158bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:06.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.159+0000 7f0edb45d640 1 --2- 172.21.15.102:0/2261810484 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0ec00069d0 0x7f0ed414de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:06.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.159+0000 7f0edb45d640 1 -- 172.21.15.102:0/2261810484 >> 172.21.15.102:0/2261810484 conn(0x7f0ed40ce9b0 msgr2=0x7f0ed40ced90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:06.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.160+0000 7f0edb45d640 1 -- 172.21.15.102:0/2261810484 shutdown_connections 2023-10-14T09:38:06.164 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.160+0000 7f0edb45d640 1 -- 172.21.15.102:0/2261810484 wait complete. 2023-10-14T09:38:06.179 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T09:38:06.394 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.392+0000 7f7fa9efc640 1 Processor -- start 2023-10-14T09:38:06.395 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.392+0000 7f7fa9efc640 1 -- start start 2023-10-14T09:38:06.395 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.394+0000 7f7fa9efc640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f7fa4159950 0x7f7fa415a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:06.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.394+0000 7f7fa9efc640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7fa406c810 0x7f7fa40708e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:06.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.394+0000 7f7fa9efc640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa415aef0 con 0x7f7fa4070450 2023-10-14T09:38:06.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.394+0000 7f7fa9efc640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa4070e20 con 0x7f7fa4159950 2023-10-14T09:38:06.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.394+0000 7f7fa9efc640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa415e490 con 0x7f7fa406c810 2023-10-14T09:38:06.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.394+0000 7f7fa96fb640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7fa406c810 0x7f7fa40708e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:06.398 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.394+0000 7f7fa96fb640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7fa406c810 0x7f7fa40708e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.102:49050/0 (socket says 172.21.15.102:49050) 2023-10-14T09:38:06.398 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.394+0000 7f7fa96fb640 1 -- 172.21.15.102:0/1236225422 learned_addr learned my addr 172.21.15.102:0/1236225422 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:06.398 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.394+0000 7f7fa8efa640 1 --2- 172.21.15.102:0/1236225422 >> v2:172.21.15.129:3300/0 conn(0x7f7fa4159950 0x7f7fa415a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:06.398 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.395+0000 7f7fa96fb640 1 -- 172.21.15.102:0/1236225422 >> v2:172.21.15.129:3300/0 conn(0x7f7fa4159950 msgr2=0x7f7fa415a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:06.399 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.395+0000 7f7fa96fb640 1 --2- 172.21.15.102:0/1236225422 >> v2:172.21.15.129:3300/0 conn(0x7f7fa4159950 0x7f7fa415a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:06.399 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.395+0000 7f7fa96fb640 1 -- 172.21.15.102:0/1236225422 >> v1:172.21.15.129:6789/0 conn(0x7f7fa4070450 legacy=0x7f7fa406c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:06.399 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.395+0000 7f7fa96fb640 1 -- 172.21.15.102:0/1236225422 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa406cc60 con 0x7f7fa406c810 2023-10-14T09:38:06.400 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.396+0000 7f7fa96fb640 1 --2- 172.21.15.102:0/1236225422 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7fa406c810 0x7f7fa40708e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c009e50 tx=0x7f7f9c02be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42aabad7a2f793c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:06.400 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.397+0000 7f7fa37fe640 1 -- 172.21.15.102:0/1236225422 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c02c9e0 con 0x7f7fa406c810 2023-10-14T09:38:06.401 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.397+0000 7f7fa37fe640 1 -- 172.21.15.102:0/1236225422 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9c02cb40 con 0x7f7fa406c810 2023-10-14T09:38:06.401 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.397+0000 7f7fa37fe640 1 -- 172.21.15.102:0/1236225422 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c0343f0 con 0x7f7fa406c810 2023-10-14T09:38:06.401 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.398+0000 7f7fa9efc640 1 -- 172.21.15.102:0/1236225422 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7fa406c810 msgr2=0x7f7fa40708e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:06.401 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.398+0000 7f7fa9efc640 1 --2- 172.21.15.102:0/1236225422 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7fa406c810 0x7f7fa40708e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c009e50 tx=0x7f7f9c02be40 comp rx=0 tx=0).stop 2023-10-14T09:38:06.401 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.398+0000 7f7fa9efc640 1 -- 172.21.15.102:0/1236225422 shutdown_connections 2023-10-14T09:38:06.402 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.398+0000 7f7fa9efc640 1 --2- 172.21.15.102:0/1236225422 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7fa406c810 0x7f7fa40708e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:06.402 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.398+0000 7f7fa9efc640 1 --2- 172.21.15.102:0/1236225422 >> v2:172.21.15.129:3300/0 conn(0x7f7fa4159950 0x7f7fa415a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:06.402 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.398+0000 7f7fa9efc640 1 -- 172.21.15.102:0/1236225422 >> 172.21.15.102:0/1236225422 conn(0x7f7fa40ce6a0 msgr2=0x7f7fa40ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:06.402 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.398+0000 7f7fa9efc640 1 -- 172.21.15.102:0/1236225422 shutdown_connections 2023-10-14T09:38:06.402 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.398+0000 7f7fa9efc640 1 -- 172.21.15.102:0/1236225422 wait complete. 2023-10-14T09:38:06.405 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.399+0000 7f7fa9efc640 1 Processor -- start 2023-10-14T09:38:06.405 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.400+0000 7f7fa9efc640 1 -- start start 2023-10-14T09:38:06.405 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.400+0000 7f7fa9efc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7fa406c810 0x7f7fa414d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:06.405 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.400+0000 7f7fa9efc640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7fa4070450 0x7f7fa41558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:06.405 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.400+0000 7f7fa9efc640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7fa4159950 0x7f7fa41513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:06.406 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.400+0000 7f7fa9efc640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa4150f40 con 0x7f7fa406c810 2023-10-14T09:38:06.406 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.400+0000 7f7fa9efc640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa415d5d0 con 0x7f7fa4070450 2023-10-14T09:38:06.406 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.400+0000 7f7fa9efc640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa4150610 con 0x7f7fa4159950 2023-10-14T09:38:06.406 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.401+0000 7f7fa8efa640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7fa406c810 0x7f7fa414d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:06.406 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.401+0000 7f7fa8efa640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7fa406c810 0x7f7fa414d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41754/0 (socket says 172.21.15.102:41754) 2023-10-14T09:38:06.407 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.401+0000 7f7fa8efa640 1 -- 172.21.15.102:0/3211675665 learned_addr learned my addr 172.21.15.102:0/3211675665 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:06.407 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.401+0000 7f7fa3fff640 1 --2- 172.21.15.102:0/3211675665 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7fa4070450 0x7f7fa41558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:06.407 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.401+0000 7f7fa96fb640 1 --2- 172.21.15.102:0/3211675665 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7fa4159950 0x7f7fa41513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:06.407 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.401+0000 7f7fa8efa640 1 -- 172.21.15.102:0/3211675665 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7fa4159950 msgr2=0x7f7fa41513d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:06.407 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.401+0000 7f7fa8efa640 1 --2- 172.21.15.102:0/3211675665 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7fa4159950 0x7f7fa41513d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:06.407 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.401+0000 7f7fa8efa640 1 -- 172.21.15.102:0/3211675665 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7fa4070450 msgr2=0x7f7fa41558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:06.408 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.401+0000 7f7fa8efa640 1 --2- 172.21.15.102:0/3211675665 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7fa4070450 0x7f7fa41558d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:06.408 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.401+0000 7f7fa8efa640 1 -- 172.21.15.102:0/3211675665 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f9c009b30 con 0x7f7fa406c810 2023-10-14T09:38:06.408 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.401+0000 7f7fa96fb640 1 --2- 172.21.15.102:0/3211675665 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7fa4159950 0x7f7fa41513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:06.408 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.402+0000 7f7fa8efa640 1 --2- 172.21.15.102:0/3211675665 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7fa406c810 0x7f7fa414d000 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7f9800e870 tx=0x7f7f9800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:06.408 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.402+0000 7f7fa17fa640 1 -- 172.21.15.102:0/3211675665 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f980094f0 con 0x7f7fa406c810 2023-10-14T09:38:06.408 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.402+0000 7f7fa17fa640 1 -- 172.21.15.102:0/3211675665 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9800c940 con 0x7f7fa406c810 2023-10-14T09:38:06.409 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.402+0000 7f7fa17fa640 1 -- 172.21.15.102:0/3211675665 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9800ccf0 con 0x7f7fa406c810 2023-10-14T09:38:06.409 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.402+0000 7f7fa9efc640 1 -- 172.21.15.102:0/3211675665 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa41508f0 con 0x7f7fa406c810 2023-10-14T09:38:06.409 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.402+0000 7f7fa9efc640 1 -- 172.21.15.102:0/3211675665 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa414fcf0 con 0x7f7fa406c810 2023-10-14T09:38:06.410 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.403+0000 7f7fa9efc640 1 -- 172.21.15.102:0/3211675665 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa404e9b0 con 0x7f7fa406c810 2023-10-14T09:38:06.410 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.404+0000 7f7fa17fa640 1 -- 172.21.15.102:0/3211675665 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7f98013470 con 0x7f7fa406c810 2023-10-14T09:38:06.410 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.405+0000 7f7fa17fa640 1 --2- 172.21.15.102:0/3211675665 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f7f8806ae70 0x7f7f8806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:06.411 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.405+0000 7f7fa17fa640 1 -- 172.21.15.102:0/3211675665 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f7f98089880 con 0x7f7fa406c810 2023-10-14T09:38:06.411 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.405+0000 7f7fa3fff640 1 --2- 172.21.15.102:0/3211675665 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f7f8806ae70 0x7f7f8806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:06.411 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.406+0000 7f7fa3fff640 1 --2- 172.21.15.102:0/3211675665 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f7f8806ae70 0x7f7f8806d330 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7fa41f5c60 tx=0x7f7f90009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:06.411 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.410+0000 7f7fa17fa640 1 -- 172.21.15.102:0/3211675665 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7f98054780 con 0x7f7fa406c810 2023-10-14T09:38:06.588 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.586+0000 7f7fa9efc640 1 -- 172.21.15.102:0/3211675665 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7fa40b4620 con 0x7f7fa406c810 2023-10-14T09:38:06.588 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.586+0000 7f7fa17fa640 1 -- 172.21.15.102:0/3211675665 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7f98057da0 con 0x7f7fa406c810 2023-10-14T09:38:06.588 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2023-10-14T09:38:06.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.589+0000 7f7fa9efc640 1 -- 172.21.15.102:0/3211675665 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f7f8806ae70 msgr2=0x7f7f8806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:06.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.589+0000 7f7fa9efc640 1 --2- 172.21.15.102:0/3211675665 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f7f8806ae70 0x7f7f8806d330 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7fa41f5c60 tx=0x7f7f90009040 comp rx=0 tx=0).stop 2023-10-14T09:38:06.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.589+0000 7f7fa9efc640 1 -- 172.21.15.102:0/3211675665 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7fa406c810 msgr2=0x7f7fa414d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:06.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.589+0000 7f7fa9efc640 1 --2- 172.21.15.102:0/3211675665 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7fa406c810 0x7f7fa414d000 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7f9800e870 tx=0x7f7f9800ed30 comp rx=0 tx=0).stop 2023-10-14T09:38:06.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.589+0000 7f7fa9efc640 1 -- 172.21.15.102:0/3211675665 shutdown_connections 2023-10-14T09:38:06.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.589+0000 7f7fa9efc640 1 --2- 172.21.15.102:0/3211675665 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f7f8806ae70 0x7f7f8806d330 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:06.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.589+0000 7f7fa9efc640 1 --2- 172.21.15.102:0/3211675665 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7fa4159950 0x7f7fa41513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:06.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.589+0000 7f7fa9efc640 1 --2- 172.21.15.102:0/3211675665 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7fa4070450 0x7f7fa41558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:06.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.589+0000 7f7fa9efc640 1 --2- 172.21.15.102:0/3211675665 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7fa406c810 0x7f7fa414d000 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:06.593 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.589+0000 7f7fa9efc640 1 -- 172.21.15.102:0/3211675665 >> 172.21.15.102:0/3211675665 conn(0x7f7fa40ce6a0 msgr2=0x7f7fa406aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:06.593 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.589+0000 7f7fa9efc640 1 -- 172.21.15.102:0/3211675665 shutdown_connections 2023-10-14T09:38:06.593 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.589+0000 7f7fa9efc640 1 -- 172.21.15.102:0/3211675665 wait complete. 2023-10-14T09:38:06.608 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T09:38:06.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.812+0000 7f2527c64640 1 Processor -- start 2023-10-14T09:38:06.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.813+0000 7f2527c64640 1 -- start start 2023-10-14T09:38:06.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.814+0000 7f2527c64640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f252006a4b0 0x7f25200ca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:06.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.814+0000 7f2527c64640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f25200c9ca0 0x7f25200ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:06.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.814+0000 7f2527c64640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25200cb030 con 0x7f252015ad70 2023-10-14T09:38:06.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.814+0000 7f2527c64640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25200cae30 con 0x7f25200c9ca0 2023-10-14T09:38:06.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.814+0000 7f2527c64640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25200c91c0 con 0x7f252006a4b0 2023-10-14T09:38:06.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.814+0000 7f2525a00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f252015ad70 0x7f2520069da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:43014/0 (socket says 172.21.15.102:43014) 2023-10-14T09:38:06.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.814+0000 7f2525a00640 1 -- 172.21.15.102:0/3691727337 learned_addr learned my addr 172.21.15.102:0/3691727337 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:06.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.815+0000 7f2526201640 1 --2- 172.21.15.102:0/3691727337 >> v2:172.21.15.102:3300/0 conn(0x7f25200c9ca0 0x7f25200ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:06.819 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.815+0000 7f25251ff640 1 --2- 172.21.15.102:0/3691727337 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f252006a4b0 0x7f25200ca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:06.819 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.815+0000 7f25249fe640 1 -- 172.21.15.102:0/3691727337 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3563479040 0 0) 0x7f25200cb030 con 0x7f252015ad70 2023-10-14T09:38:06.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.815+0000 7f25249fe640 1 -- 172.21.15.102:0/3691727337 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f250c003520 con 0x7f252015ad70 2023-10-14T09:38:06.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.815+0000 7f2526201640 1 -- 172.21.15.102:0/3691727337 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f252006a4b0 msgr2=0x7f25200ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:06.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.815+0000 7f2526201640 1 --2- 172.21.15.102:0/3691727337 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f252006a4b0 0x7f25200ca3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:06.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.815+0000 7f2526201640 1 -- 172.21.15.102:0/3691727337 >> v1:172.21.15.102:6789/0 conn(0x7f252015ad70 legacy=0x7f2520069da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:06.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.815+0000 7f2526201640 1 -- 172.21.15.102:0/3691727337 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25200c94a0 con 0x7f25200c9ca0 2023-10-14T09:38:06.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.815+0000 7f25251ff640 1 --2- 172.21.15.102:0/3691727337 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f252006a4b0 0x7f25200ca3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:06.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.816+0000 7f2526201640 1 --2- 172.21.15.102:0/3691727337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f25200c9ca0 0x7f25200ca8f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2518009d90 tx=0x7f251802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dbbc6118ea4927c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:06.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.817+0000 7f25249fe640 1 -- 172.21.15.102:0/3691727337 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251802cc50 con 0x7f25200c9ca0 2023-10-14T09:38:06.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.817+0000 7f25249fe640 1 -- 172.21.15.102:0/3691727337 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251802cdb0 con 0x7f25200c9ca0 2023-10-14T09:38:06.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.817+0000 7f25249fe640 1 -- 172.21.15.102:0/3691727337 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2518034660 con 0x7f25200c9ca0 2023-10-14T09:38:06.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.817+0000 7f2527c64640 1 -- 172.21.15.102:0/3691727337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f25200c9ca0 msgr2=0x7f25200ca8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:06.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.817+0000 7f2527c64640 1 --2- 172.21.15.102:0/3691727337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f25200c9ca0 0x7f25200ca8f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2518009d90 tx=0x7f251802bea0 comp rx=0 tx=0).stop 2023-10-14T09:38:06.822 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.817+0000 7f2527c64640 1 -- 172.21.15.102:0/3691727337 shutdown_connections 2023-10-14T09:38:06.822 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.817+0000 7f2527c64640 1 --2- 172.21.15.102:0/3691727337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f25200c9ca0 0x7f25200ca8f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:06.822 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.817+0000 7f2527c64640 1 --2- 172.21.15.102:0/3691727337 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f252006a4b0 0x7f25200ca3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:06.822 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.817+0000 7f2527c64640 1 -- 172.21.15.102:0/3691727337 >> 172.21.15.102:0/3691727337 conn(0x7f25200ce9b0 msgr2=0x7f25200cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:06.822 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.817+0000 7f2527c64640 1 -- 172.21.15.102:0/3691727337 shutdown_connections 2023-10-14T09:38:06.823 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.817+0000 7f2527c64640 1 -- 172.21.15.102:0/3691727337 wait complete. 2023-10-14T09:38:06.824 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.819+0000 7f2527c64640 1 Processor -- start 2023-10-14T09:38:06.825 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.819+0000 7f2527c64640 1 -- start start 2023-10-14T09:38:06.825 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.820+0000 7f2527c64640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f252006a4b0 0x7f2520158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:06.825 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.820+0000 7f2527c64640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f25200c9ca0 0x7f25200c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:06.825 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.820+0000 7f2527c64640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f252015ad70 0x7f25201f2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:06.825 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.820+0000 7f2527c64640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25200c67f0 con 0x7f252006a4b0 2023-10-14T09:38:06.826 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.820+0000 7f2527c64640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25200c5c20 con 0x7f252015ad70 2023-10-14T09:38:06.826 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.820+0000 7f2527c64640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25200c5ec0 con 0x7f25200c9ca0 2023-10-14T09:38:06.826 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.820+0000 7f2525a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f252006a4b0 0x7f2520158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:06.826 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.820+0000 7f2525a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f252006a4b0 0x7f2520158e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41774/0 (socket says 172.21.15.102:41774) 2023-10-14T09:38:06.826 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.820+0000 7f2525a00640 1 -- 172.21.15.102:0/1328086504 learned_addr learned my addr 172.21.15.102:0/1328086504 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:06.827 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.821+0000 7f25251ff640 1 --2- 172.21.15.102:0/1328086504 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f25200c9ca0 0x7f25200c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:06.827 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.821+0000 7f2526201640 1 --2- 172.21.15.102:0/1328086504 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f252015ad70 0x7f25201f2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:06.827 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.821+0000 7f2525a00640 1 -- 172.21.15.102:0/1328086504 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f25200c9ca0 msgr2=0x7f25200c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:06.827 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.821+0000 7f2525a00640 1 --2- 172.21.15.102:0/1328086504 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f25200c9ca0 0x7f25200c6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:06.827 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.821+0000 7f2525a00640 1 -- 172.21.15.102:0/1328086504 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f252015ad70 msgr2=0x7f25201f2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:06.828 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.821+0000 7f2525a00640 1 --2- 172.21.15.102:0/1328086504 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f252015ad70 0x7f25201f2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:06.828 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.821+0000 7f2525a00640 1 -- 172.21.15.102:0/1328086504 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2518009a70 con 0x7f252006a4b0 2023-10-14T09:38:06.828 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.821+0000 7f2525a00640 1 --2- 172.21.15.102:0/1328086504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f252006a4b0 0x7f2520158e80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f251c00c410 tx=0x7f251c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:06.828 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.821+0000 7f25127fc640 1 -- 172.21.15.102:0/1328086504 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251c005ce0 con 0x7f252006a4b0 2023-10-14T09:38:06.828 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.821+0000 7f25127fc640 1 -- 172.21.15.102:0/1328086504 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251c005e40 con 0x7f252006a4b0 2023-10-14T09:38:06.828 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.821+0000 7f25127fc640 1 -- 172.21.15.102:0/1328086504 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251c0072f0 con 0x7f252006a4b0 2023-10-14T09:38:06.829 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.821+0000 7f2527c64640 1 -- 172.21.15.102:0/1328086504 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25200c61a0 con 0x7f252006a4b0 2023-10-14T09:38:06.829 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.822+0000 7f2527c64640 1 -- 172.21.15.102:0/1328086504 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25201593c0 con 0x7f252006a4b0 2023-10-14T09:38:06.829 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.823+0000 7f2527c64640 1 -- 172.21.15.102:0/1328086504 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f252004e160 con 0x7f252006a4b0 2023-10-14T09:38:06.830 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.824+0000 7f25127fc640 1 -- 172.21.15.102:0/1328086504 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f251c007510 con 0x7f252006a4b0 2023-10-14T09:38:06.830 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.824+0000 7f25127fc640 1 --2- 172.21.15.102:0/1328086504 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f250406ae70 0x7f250406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:06.830 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.825+0000 7f25127fc640 1 -- 172.21.15.102:0/1328086504 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f251c088d50 con 0x7f252006a4b0 2023-10-14T09:38:06.830 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.825+0000 7f25251ff640 1 --2- 172.21.15.102:0/1328086504 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f250406ae70 0x7f250406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:06.831 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.825+0000 7f25251ff640 1 --2- 172.21.15.102:0/1328086504 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f250406ae70 0x7f250406d330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f252015e500 tx=0x7f2514008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:06.831 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:06.829+0000 7f25127fc640 1 -- 172.21.15.102:0/1328086504 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f251c08c030 con 0x7f252006a4b0 2023-10-14T09:38:07.006 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.004+0000 7f2527c64640 1 -- 172.21.15.102:0/1328086504 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f25200c8f00 con 0x7f252006a4b0 2023-10-14T09:38:07.007 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.005+0000 7f25127fc640 1 -- 172.21.15.102:0/1328086504 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f251c017020 con 0x7f252006a4b0 2023-10-14T09:38:07.007 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2023-10-14T09:38:07.009 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.007+0000 7f2527c64640 1 -- 172.21.15.102:0/1328086504 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f250406ae70 msgr2=0x7f250406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:07.009 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.007+0000 7f2527c64640 1 --2- 172.21.15.102:0/1328086504 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f250406ae70 0x7f250406d330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f252015e500 tx=0x7f2514008040 comp rx=0 tx=0).stop 2023-10-14T09:38:07.009 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.007+0000 7f2527c64640 1 -- 172.21.15.102:0/1328086504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f252006a4b0 msgr2=0x7f2520158e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:07.010 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.007+0000 7f2527c64640 1 --2- 172.21.15.102:0/1328086504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f252006a4b0 0x7f2520158e80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f251c00c410 tx=0x7f251c00c8d0 comp rx=0 tx=0).stop 2023-10-14T09:38:07.010 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.007+0000 7f2527c64640 1 -- 172.21.15.102:0/1328086504 shutdown_connections 2023-10-14T09:38:07.010 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.007+0000 7f2527c64640 1 --2- 172.21.15.102:0/1328086504 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f250406ae70 0x7f250406d330 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:07.010 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.007+0000 7f2527c64640 1 --2- 172.21.15.102:0/1328086504 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f252015ad70 0x7f25201f2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:07.010 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.007+0000 7f2527c64640 1 --2- 172.21.15.102:0/1328086504 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f25200c9ca0 0x7f25200c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:07.011 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.007+0000 7f2527c64640 1 --2- 172.21.15.102:0/1328086504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f252006a4b0 0x7f2520158e80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:07.011 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.007+0000 7f2527c64640 1 -- 172.21.15.102:0/1328086504 >> 172.21.15.102:0/1328086504 conn(0x7f25200ce9b0 msgr2=0x7f25200b15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:07.011 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.007+0000 7f2527c64640 1 -- 172.21.15.102:0/1328086504 shutdown_connections 2023-10-14T09:38:07.011 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.007+0000 7f2527c64640 1 -- 172.21.15.102:0/1328086504 wait complete. 2023-10-14T09:38:07.026 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T09:38:07.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.235+0000 7fbc44039640 1 Processor -- start 2023-10-14T09:38:07.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.236+0000 7fbc44039640 1 -- start start 2023-10-14T09:38:07.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.237+0000 7fbc44039640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbc3c15d330 0x7fbc3c1618b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:07.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.237+0000 7fbc44039640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fbc3c06c7d0 0x7fbc3c065ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:07.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.237+0000 7fbc44039640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbc3c06cc80 0x7fbc3c065ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:07.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.237+0000 7fbc44039640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc3c06b1e0 con 0x7fbc3c15d330 2023-10-14T09:38:07.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.237+0000 7fbc44039640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc3c0d0890 con 0x7fbc3c06c7d0 2023-10-14T09:38:07.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.237+0000 7fbc44039640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c0d05b0 con 0x7fbc3c06cc80 2023-10-14T09:38:07.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.237+0000 7fbc41dd5640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbc3c15d330 0x7fbc3c1618b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:07.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.237+0000 7fbc41dd5640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbc3c15d330 0x7fbc3c1618b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41784/0 (socket says 172.21.15.102:41784) 2023-10-14T09:38:07.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.237+0000 7fbc41dd5640 1 -- 172.21.15.102:0/2035345467 learned_addr learned my addr 172.21.15.102:0/2035345467 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:07.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.238+0000 7fbc41dd5640 1 -- 172.21.15.102:0/2035345467 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbc3c06cc80 msgr2=0x7fbc3c065ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:07.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.238+0000 7fbc41dd5640 1 --2- 172.21.15.102:0/2035345467 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbc3c06cc80 0x7fbc3c065ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:07.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.238+0000 7fbc41dd5640 1 -- 172.21.15.102:0/2035345467 >> v2:172.21.15.129:3300/0 conn(0x7fbc3c06c7d0 msgr2=0x7fbc3c065ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:07.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.238+0000 7fbc415d4640 1 --2- 172.21.15.102:0/2035345467 >> v2:172.21.15.129:3300/0 conn(0x7fbc3c06c7d0 0x7fbc3c065ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:07.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.238+0000 7fbc41dd5640 1 --2- 172.21.15.102:0/2035345467 >> v2:172.21.15.129:3300/0 conn(0x7fbc3c06c7d0 0x7fbc3c065ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:07.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.238+0000 7fbc41dd5640 1 -- 172.21.15.102:0/2035345467 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3c160dd0 con 0x7fbc3c15d330 2023-10-14T09:38:07.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.239+0000 7fbc41dd5640 1 --2- 172.21.15.102:0/2035345467 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc3c15d330 0x7fbc3c1618b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c0b6bc0 tx=0x7fbc3802b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c5aedb61a1f287 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:07.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.239+0000 7fbc40dd3640 1 -- 172.21.15.102:0/2035345467 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc380317d0 con 0x7fbc3c15d330 2023-10-14T09:38:07.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.239+0000 7fbc40dd3640 1 -- 172.21.15.102:0/2035345467 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc38031930 con 0x7fbc3c15d330 2023-10-14T09:38:07.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.239+0000 7fbc40dd3640 1 -- 172.21.15.102:0/2035345467 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc38031cc0 con 0x7fbc3c15d330 2023-10-14T09:38:07.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.240+0000 7fbc44039640 1 -- 172.21.15.102:0/2035345467 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc3c15d330 msgr2=0x7fbc3c1618b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:07.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.240+0000 7fbc44039640 1 --2- 172.21.15.102:0/2035345467 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc3c15d330 0x7fbc3c1618b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c0b6bc0 tx=0x7fbc3802b870 comp rx=0 tx=0).stop 2023-10-14T09:38:07.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.240+0000 7fbc44039640 1 -- 172.21.15.102:0/2035345467 shutdown_connections 2023-10-14T09:38:07.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.240+0000 7fbc44039640 1 --2- 172.21.15.102:0/2035345467 >> v2:172.21.15.129:3300/0 conn(0x7fbc3c06c7d0 0x7fbc3c065ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:07.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.240+0000 7fbc44039640 1 --2- 172.21.15.102:0/2035345467 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbc3c06cc80 0x7fbc3c065ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:07.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.240+0000 7fbc44039640 1 --2- 172.21.15.102:0/2035345467 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc3c15d330 0x7fbc3c1618b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:07.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.240+0000 7fbc44039640 1 -- 172.21.15.102:0/2035345467 >> 172.21.15.102:0/2035345467 conn(0x7fbc3c0d0ab0 msgr2=0x7fbc3c0d0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:07.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.240+0000 7fbc44039640 1 -- 172.21.15.102:0/2035345467 shutdown_connections 2023-10-14T09:38:07.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.240+0000 7fbc44039640 1 -- 172.21.15.102:0/2035345467 wait complete. 2023-10-14T09:38:07.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.242+0000 7fbc44039640 1 Processor -- start 2023-10-14T09:38:07.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.242+0000 7fbc44039640 1 -- start start 2023-10-14T09:38:07.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.243+0000 7fbc44039640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc3c06c7d0 0x7fbc3c156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:07.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.243+0000 7fbc44039640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbc3c06cc80 0x7fbc3c1e8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:07.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.243+0000 7fbc44039640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbc3c15d330 0x7fbc3c1560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:07.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.243+0000 7fbc44039640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c0ad960 con 0x7fbc3c06c7d0 2023-10-14T09:38:07.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.243+0000 7fbc44039640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c0acde0 con 0x7fbc3c06cc80 2023-10-14T09:38:07.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.243+0000 7fbc44039640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c0ad0c0 con 0x7fbc3c15d330 2023-10-14T09:38:07.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.243+0000 7fbc41dd5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc3c06c7d0 0x7fbc3c156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:07.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.243+0000 7fbc41dd5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc3c06c7d0 0x7fbc3c156c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41790/0 (socket says 172.21.15.102:41790) 2023-10-14T09:38:07.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.243+0000 7fbc41dd5640 1 -- 172.21.15.102:0/78717165 learned_addr learned my addr 172.21.15.102:0/78717165 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:07.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.243+0000 7fbc415d4640 1 --2- 172.21.15.102:0/78717165 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbc3c06cc80 0x7fbc3c1e8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:07.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.243+0000 7fbc41dd5640 1 -- 172.21.15.102:0/78717165 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbc3c15d330 msgr2=0x7fbc3c1560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:07.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.243+0000 7fbc41dd5640 1 --2- 172.21.15.102:0/78717165 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbc3c15d330 0x7fbc3c1560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:07.251 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.243+0000 7fbc41dd5640 1 -- 172.21.15.102:0/78717165 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbc3c06cc80 msgr2=0x7fbc3c1e8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:07.251 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.243+0000 7fbc41dd5640 1 --2- 172.21.15.102:0/78717165 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbc3c06cc80 0x7fbc3c1e8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:07.251 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.243+0000 7fbc41dd5640 1 -- 172.21.15.102:0/78717165 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc380094d0 con 0x7fbc3c06c7d0 2023-10-14T09:38:07.251 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.244+0000 7fbc41dd5640 1 --2- 172.21.15.102:0/78717165 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc3c06c7d0 0x7fbc3c156c10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbc3802b8b0 tx=0x7fbc380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:07.251 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.244+0000 7fbc327fc640 1 -- 172.21.15.102:0/78717165 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc380329b0 con 0x7fbc3c06c7d0 2023-10-14T09:38:07.251 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.244+0000 7fbc327fc640 1 -- 172.21.15.102:0/78717165 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc38032b30 con 0x7fbc3c06c7d0 2023-10-14T09:38:07.252 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.244+0000 7fbc327fc640 1 -- 172.21.15.102:0/78717165 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc380453f0 con 0x7fbc3c06c7d0 2023-10-14T09:38:07.252 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.244+0000 7fbc44039640 1 -- 172.21.15.102:0/78717165 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc3c0ad3a0 con 0x7fbc3c06c7d0 2023-10-14T09:38:07.252 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.244+0000 7fbc44039640 1 -- 172.21.15.102:0/78717165 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc3c157380 con 0x7fbc3c06c7d0 2023-10-14T09:38:07.252 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.245+0000 7fbc44039640 1 -- 172.21.15.102:0/78717165 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc3c04e160 con 0x7fbc3c06c7d0 2023-10-14T09:38:07.252 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.246+0000 7fbc327fc640 1 -- 172.21.15.102:0/78717165 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbc38030070 con 0x7fbc3c06c7d0 2023-10-14T09:38:07.253 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.247+0000 7fbc327fc640 1 --2- 172.21.15.102:0/78717165 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fbc2006ae70 0x7fbc2006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:07.253 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.247+0000 7fbc327fc640 1 -- 172.21.15.102:0/78717165 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fbc380ab2f0 con 0x7fbc3c06c7d0 2023-10-14T09:38:07.254 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.247+0000 7fbc415d4640 1 --2- 172.21.15.102:0/78717165 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fbc2006ae70 0x7fbc2006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:07.254 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.248+0000 7fbc415d4640 1 --2- 172.21.15.102:0/78717165 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fbc2006ae70 0x7fbc2006d330 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c1f6050 tx=0x7fbc2c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:07.254 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.251+0000 7fbc327fc640 1 -- 172.21.15.102:0/78717165 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbc380763b0 con 0x7fbc3c06c7d0 2023-10-14T09:38:07.442 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.440+0000 7fbc44039640 1 -- 172.21.15.102:0/78717165 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbc3c06f3a0 con 0x7fbc3c06c7d0 2023-10-14T09:38:07.443 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.441+0000 7fbc327fc640 1 -- 172.21.15.102:0/78717165 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbc380799d0 con 0x7fbc3c06c7d0 2023-10-14T09:38:07.443 INFO:teuthology.orchestra.run.smithi102.stderr:listed 0 entries 2023-10-14T09:38:07.445 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.443+0000 7fbc44039640 1 -- 172.21.15.102:0/78717165 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fbc2006ae70 msgr2=0x7fbc2006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:07.446 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.443+0000 7fbc44039640 1 --2- 172.21.15.102:0/78717165 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fbc2006ae70 0x7fbc2006d330 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c1f6050 tx=0x7fbc2c008040 comp rx=0 tx=0).stop 2023-10-14T09:38:07.446 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.443+0000 7fbc44039640 1 -- 172.21.15.102:0/78717165 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc3c06c7d0 msgr2=0x7fbc3c156c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:07.446 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.443+0000 7fbc44039640 1 --2- 172.21.15.102:0/78717165 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc3c06c7d0 0x7fbc3c156c10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbc3802b8b0 tx=0x7fbc380046c0 comp rx=0 tx=0).stop 2023-10-14T09:38:07.446 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.443+0000 7fbc44039640 1 -- 172.21.15.102:0/78717165 shutdown_connections 2023-10-14T09:38:07.446 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.443+0000 7fbc44039640 1 --2- 172.21.15.102:0/78717165 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fbc2006ae70 0x7fbc2006d330 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:07.447 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.443+0000 7fbc44039640 1 --2- 172.21.15.102:0/78717165 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbc3c15d330 0x7fbc3c1560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:07.447 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.443+0000 7fbc44039640 1 --2- 172.21.15.102:0/78717165 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbc3c06cc80 0x7fbc3c1e8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:07.447 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.443+0000 7fbc44039640 1 --2- 172.21.15.102:0/78717165 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc3c06c7d0 0x7fbc3c156c10 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:07.447 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.443+0000 7fbc44039640 1 -- 172.21.15.102:0/78717165 >> 172.21.15.102:0/78717165 conn(0x7fbc3c0d0ab0 msgr2=0x7fbc3c065ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:07.447 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.444+0000 7fbc44039640 1 -- 172.21.15.102:0/78717165 shutdown_connections 2023-10-14T09:38:07.447 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:07.444+0000 7fbc44039640 1 -- 172.21.15.102:0/78717165 wait complete. 2023-10-14T09:38:07.464 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-14T09:38:07.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:38:07.464 DEBUG:teuthology.orchestra.run.smithi129:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-14T09:38:07.576 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi129.front.sepia.ceph.com 2023-10-14T09:38:07.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:38:07.577 DEBUG:teuthology.orchestra.run.smithi129:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-14T09:38:07.640 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-10-14T09:38:07.640 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T09:38:07.698 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-10-14T09:38:07.699 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T09:38:07.751 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-10-14T09:38:07.752 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T09:38:07.804 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:38:08.017 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.015+0000 7efc4cd05640 1 Processor -- start 2023-10-14T09:38:08.018 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.016+0000 7efc4cd05640 1 -- start start 2023-10-14T09:38:08.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.017+0000 7efc4cd05640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7efc4815aaa0 0x7efc4815e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:08.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.017+0000 7efc4cd05640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7efc4815ae80 0x7efc480cc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:08.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.017+0000 7efc4cd05640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc4815ed60 con 0x7efc480ccaa0 2023-10-14T09:38:08.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.017+0000 7efc4cd05640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc4806b810 con 0x7efc4815aaa0 2023-10-14T09:38:08.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.017+0000 7efc4cd05640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc480707e0 con 0x7efc4815ae80 2023-10-14T09:38:08.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.017+0000 7efc4659c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7efc4815aaa0 0x7efc4815e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:08.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.018+0000 7efc46d9d640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7efc480ccaa0 0x7efc48070f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:43026/0 (socket says 172.21.15.102:43026) 2023-10-14T09:38:08.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.018+0000 7efc4659c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7efc4815aaa0 0x7efc4815e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41796/0 (socket says 172.21.15.102:41796) 2023-10-14T09:38:08.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.018+0000 7efc46d9d640 1 -- 172.21.15.102:0/761697975 learned_addr learned my addr 172.21.15.102:0/761697975 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:08.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.018+0000 7efc3ffff640 1 --2- 172.21.15.102:0/761697975 >> v2:172.21.15.129:3300/0 conn(0x7efc4815ae80 0x7efc480cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:08.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.018+0000 7efc4659c640 1 -- 172.21.15.102:0/761697975 >> v2:172.21.15.129:3300/0 conn(0x7efc4815ae80 msgr2=0x7efc480cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:08.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.018+0000 7efc4659c640 1 --2- 172.21.15.102:0/761697975 >> v2:172.21.15.129:3300/0 conn(0x7efc4815ae80 0x7efc480cc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:08.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.018+0000 7efc4659c640 1 -- 172.21.15.102:0/761697975 >> v1:172.21.15.102:6789/0 conn(0x7efc480ccaa0 legacy=0x7efc48070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:08.023 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.018+0000 7efc4659c640 1 -- 172.21.15.102:0/761697975 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4815ef90 con 0x7efc4815aaa0 2023-10-14T09:38:08.024 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.019+0000 7efc4659c640 1 --2- 172.21.15.102:0/761697975 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc4815aaa0 0x7efc4815e820 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7efc480c59c0 tx=0x7efc3802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b44ea6685f5137 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:08.024 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.020+0000 7efc45d9b640 1 -- 172.21.15.102:0/761697975 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc38031830 con 0x7efc4815aaa0 2023-10-14T09:38:08.025 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.020+0000 7efc45d9b640 1 -- 172.21.15.102:0/761697975 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc38031990 con 0x7efc4815aaa0 2023-10-14T09:38:08.025 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.020+0000 7efc45d9b640 1 -- 172.21.15.102:0/761697975 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc38031d20 con 0x7efc4815aaa0 2023-10-14T09:38:08.025 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.020+0000 7efc4cd05640 1 -- 172.21.15.102:0/761697975 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc4815aaa0 msgr2=0x7efc4815e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:08.025 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.020+0000 7efc4cd05640 1 --2- 172.21.15.102:0/761697975 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc4815aaa0 0x7efc4815e820 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7efc480c59c0 tx=0x7efc3802b8d0 comp rx=0 tx=0).stop 2023-10-14T09:38:08.025 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.020+0000 7efc4cd05640 1 -- 172.21.15.102:0/761697975 shutdown_connections 2023-10-14T09:38:08.026 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.020+0000 7efc4cd05640 1 --2- 172.21.15.102:0/761697975 >> v2:172.21.15.129:3300/0 conn(0x7efc4815ae80 0x7efc480cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:08.026 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.020+0000 7efc4cd05640 1 --2- 172.21.15.102:0/761697975 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc4815aaa0 0x7efc4815e820 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:08.026 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.020+0000 7efc4cd05640 1 -- 172.21.15.102:0/761697975 >> 172.21.15.102:0/761697975 conn(0x7efc480cb410 msgr2=0x7efc480cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:08.026 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.020+0000 7efc4cd05640 1 -- 172.21.15.102:0/761697975 shutdown_connections 2023-10-14T09:38:08.026 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.021+0000 7efc4cd05640 1 -- 172.21.15.102:0/761697975 wait complete. 2023-10-14T09:38:08.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.022+0000 7efc4cd05640 1 Processor -- start 2023-10-14T09:38:08.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.022+0000 7efc4cd05640 1 -- start start 2023-10-14T09:38:08.029 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.023+0000 7efc4cd05640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efc480ccaa0 0x7efc480af9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:08.029 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.023+0000 7efc4cd05640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7efc4815aaa0 0x7efc480ae230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:08.029 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.023+0000 7efc4cd05640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc4815ae80 0x7efc4815d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:08.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.023+0000 7efc4cd05640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4815dc50 con 0x7efc4815ae80 2023-10-14T09:38:08.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.023+0000 7efc4cd05640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc480ae930 con 0x7efc480ccaa0 2023-10-14T09:38:08.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.023+0000 7efc4cd05640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc480aec10 con 0x7efc4815aaa0 2023-10-14T09:38:08.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.023+0000 7efc46d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc4815ae80 0x7efc4815d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:08.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.023+0000 7efc46d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc4815ae80 0x7efc4815d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41810/0 (socket says 172.21.15.102:41810) 2023-10-14T09:38:08.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.023+0000 7efc46d9d640 1 -- 172.21.15.102:0/2752102158 learned_addr learned my addr 172.21.15.102:0/2752102158 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:08.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.024+0000 7efc4659c640 1 --2- 172.21.15.102:0/2752102158 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efc480ccaa0 0x7efc480af9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:08.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.024+0000 7efc46d9d640 1 -- 172.21.15.102:0/2752102158 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7efc4815aaa0 msgr2=0x7efc480ae230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:08.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.024+0000 7efc46d9d640 1 --2- 172.21.15.102:0/2752102158 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7efc4815aaa0 0x7efc480ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:08.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.024+0000 7efc46d9d640 1 -- 172.21.15.102:0/2752102158 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efc480ccaa0 msgr2=0x7efc480af9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:08.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.024+0000 7efc46d9d640 1 --2- 172.21.15.102:0/2752102158 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efc480ccaa0 0x7efc480af9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:08.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.024+0000 7efc46d9d640 1 -- 172.21.15.102:0/2752102158 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc38009400 con 0x7efc4815ae80 2023-10-14T09:38:08.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.024+0000 7efc46d9d640 1 --2- 172.21.15.102:0/2752102158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc4815ae80 0x7efc4815d710 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7efc4000cbc0 tx=0x7efc4000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:08.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.024+0000 7efc3effd640 1 -- 172.21.15.102:0/2752102158 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4000ad40 con 0x7efc4815ae80 2023-10-14T09:38:08.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.024+0000 7efc3effd640 1 -- 172.21.15.102:0/2752102158 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc40012400 con 0x7efc4815ae80 2023-10-14T09:38:08.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.024+0000 7efc3effd640 1 -- 172.21.15.102:0/2752102158 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4000aea0 con 0x7efc4815ae80 2023-10-14T09:38:08.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.024+0000 7efc4cd05640 1 -- 172.21.15.102:0/2752102158 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc480aeef0 con 0x7efc4815ae80 2023-10-14T09:38:08.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.025+0000 7efc4cd05640 1 -- 172.21.15.102:0/2752102158 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc480af4b0 con 0x7efc4815ae80 2023-10-14T09:38:08.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.026+0000 7efc4cd05640 1 -- 172.21.15.102:0/2752102158 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc480af6a0 con 0x7efc4815ae80 2023-10-14T09:38:08.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.027+0000 7efc3effd640 1 -- 172.21.15.102:0/2752102158 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efc40007070 con 0x7efc4815ae80 2023-10-14T09:38:08.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.028+0000 7efc3effd640 1 --2- 172.21.15.102:0/2752102158 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7efc2806ae70 0x7efc2806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:08.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.028+0000 7efc3effd640 1 -- 172.21.15.102:0/2752102158 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7efc400894b0 con 0x7efc4815ae80 2023-10-14T09:38:08.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.028+0000 7efc4659c640 1 --2- 172.21.15.102:0/2752102158 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7efc2806ae70 0x7efc2806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:08.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.029+0000 7efc4659c640 1 --2- 172.21.15.102:0/2752102158 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7efc2806ae70 0x7efc2806d330 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efc38036000 tx=0x7efc38008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:08.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.032+0000 7efc3effd640 1 -- 172.21.15.102:0/2752102158 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efc40054580 con 0x7efc4815ae80 2023-10-14T09:38:08.222 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.220+0000 7efc4cd05640 1 -- 172.21.15.102:0/2752102158 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc4804e160 con 0x7efc4815ae80 2023-10-14T09:38:08.224 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.222+0000 7efc3effd640 1 -- 172.21.15.102:0/2752102158 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16838 (secure 0 0 0) 0x7efc40057ba0 con 0x7efc4815ae80 2023-10-14T09:38:08.225 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:38:08.225 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":24,"fsid":"8a6cd69d-7f5b-4f2a-806a-0176c10aed50","created":"2023-10-14T09:36:56.745172+0000","modified":"2023-10-14T09:38:03.788214+0000","last_up_change":"2023-10-14T09:37:09.791473+0000","last_in_change":"2023-10-14T09:37:00.547186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:37:09.952407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:37:19.560925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:37:20.363385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e5aef8f3-878f-482b-b522-9a5b958b90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6801","nonce":1727250718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6803","nonce":1727250718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6807","nonce":1727250718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6805","nonce":1727250718}]},"public_addr":"172.21.15.102:6801/1727250718","cluster_addr":"172.21.15.102:6803/1727250718","heartbeat_back_addr":"172.21.15.102:6807/1727250718","heartbeat_front_addr":"172.21.15.102:6805/1727250718","state":["exists","up"]},{"osd":1,"uuid":"4a8cf50e-387b-4d47-9588-bd22e375a9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6809","nonce":1095651107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6811","nonce":1095651107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6815","nonce":1095651107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6813","nonce":1095651107}]},"public_addr":"172.21.15.102:6809/1095651107","cluster_addr":"172.21.15.102:6811/1095651107","heartbeat_back_addr":"172.21.15.102:6815/1095651107","heartbeat_front_addr":"172.21.15.102:6813/1095651107","state":["exists","up"]},{"osd":2,"uuid":"009ef55f-8a63-4219-bacd-d7c7b4500867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6820","nonce":2198222556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6825","nonce":2198222556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6831","nonce":2198222556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6829","nonce":2198222556}]},"public_addr":"172.21.15.102:6820/2198222556","cluster_addr":"172.21.15.102:6825/2198222556","heartbeat_back_addr":"172.21.15.102:6831/2198222556","heartbeat_front_addr":"172.21.15.102:6829/2198222556","state":["exists","up"]},{"osd":3,"uuid":"f2110eae-2ff9-4ed9-93d6-bd2361618211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6818","nonce":654726740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6821","nonce":654726740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6827","nonce":654726740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6823","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6824","nonce":654726740}]},"public_addr":"172.21.15.102:6818/654726740","cluster_addr":"172.21.15.102:6821/654726740","heartbeat_back_addr":"172.21.15.102:6827/654726740","heartbeat_front_addr":"172.21.15.102:6824/654726740","state":["exists","up"]},{"osd":4,"uuid":"33f1ae34-3100-40f7-9cb8-0eca2b358693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6817","nonce":507586170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6819","nonce":507586170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6823","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6825","nonce":507586170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6821","nonce":507586170}]},"public_addr":"172.21.15.129:6817/507586170","cluster_addr":"172.21.15.129:6819/507586170","heartbeat_back_addr":"172.21.15.129:6825/507586170","heartbeat_front_addr":"172.21.15.129:6821/507586170","state":["exists","up"]},{"osd":5,"uuid":"fab2fc62-3f3e-450d-93e0-770f39e80710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6801","nonce":1913451073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6803","nonce":1913451073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6807","nonce":1913451073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6805","nonce":1913451073}]},"public_addr":"172.21.15.129:6801/1913451073","cluster_addr":"172.21.15.129:6803/1913451073","heartbeat_back_addr":"172.21.15.129:6807/1913451073","heartbeat_front_addr":"172.21.15.129:6805/1913451073","state":["exists","up"]},{"osd":6,"uuid":"d7cc1d69-92e7-4253-a127-cfc0444a4809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6809","nonce":2853291511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6811","nonce":2853291511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6815","nonce":2853291511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6813","nonce":2853291511}]},"public_addr":"172.21.15.129:6809/2853291511","cluster_addr":"172.21.15.129:6811/2853291511","heartbeat_back_addr":"172.21.15.129:6815/2853291511","heartbeat_front_addr":"172.21.15.129:6813/2853291511","state":["exists","up"]},{"osd":7,"uuid":"1e403de1-09e2-4370-b9a7-e790ac44bbee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6824","nonce":2933886914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6827","nonce":2933886914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6831","nonce":2933886914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6829","nonce":2933886914}]},"public_addr":"172.21.15.129:6824/2933886914","cluster_addr":"172.21.15.129:6827/2933886914","heartbeat_back_addr":"172.21.15.129:6831/2933886914","heartbeat_front_addr":"172.21.15.129:6829/2933886914","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.849661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.868113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.933488+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.891794+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.901861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.858750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.911712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.996765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:38:08.226 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.224+0000 7efc4cd05640 1 -- 172.21.15.102:0/2752102158 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7efc2806ae70 msgr2=0x7efc2806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:08.227 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.224+0000 7efc4cd05640 1 --2- 172.21.15.102:0/2752102158 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7efc2806ae70 0x7efc2806d330 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efc38036000 tx=0x7efc38008030 comp rx=0 tx=0).stop 2023-10-14T09:38:08.227 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.224+0000 7efc4cd05640 1 -- 172.21.15.102:0/2752102158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc4815ae80 msgr2=0x7efc4815d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:08.227 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.224+0000 7efc4cd05640 1 --2- 172.21.15.102:0/2752102158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc4815ae80 0x7efc4815d710 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7efc4000cbc0 tx=0x7efc4000a430 comp rx=0 tx=0).stop 2023-10-14T09:38:08.227 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.224+0000 7efc4cd05640 1 -- 172.21.15.102:0/2752102158 shutdown_connections 2023-10-14T09:38:08.227 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.224+0000 7efc4cd05640 1 --2- 172.21.15.102:0/2752102158 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7efc2806ae70 0x7efc2806d330 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:08.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.224+0000 7efc4cd05640 1 --2- 172.21.15.102:0/2752102158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc4815ae80 0x7efc4815d710 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:08.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.224+0000 7efc4cd05640 1 --2- 172.21.15.102:0/2752102158 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7efc4815aaa0 0x7efc480ae230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:08.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.224+0000 7efc4cd05640 1 --2- 172.21.15.102:0/2752102158 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efc480ccaa0 0x7efc480af9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:08.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.225+0000 7efc4cd05640 1 -- 172.21.15.102:0/2752102158 >> 172.21.15.102:0/2752102158 conn(0x7efc480cb410 msgr2=0x7efc480cea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:08.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.225+0000 7efc4cd05640 1 -- 172.21.15.102:0/2752102158 shutdown_connections 2023-10-14T09:38:08.229 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.225+0000 7efc4cd05640 1 -- 172.21.15.102:0/2752102158 wait complete. 2023-10-14T09:38:08.246 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T09:37:09.952407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T09:37:19.560925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T09:37:20.363385+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T09:38:08.247 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T09:38:08.461 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.459+0000 7f315bf25640 1 Processor -- start 2023-10-14T09:38:08.461 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.459+0000 7f315bf25640 1 -- start start 2023-10-14T09:38:08.463 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.461+0000 7f315bf25640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f315415ad70 0x7f3154069da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:08.463 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.461+0000 7f315bf25640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31540cb030 con 0x7f31540c9ca0 2023-10-14T09:38:08.463 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.461+0000 7f315bf25640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31540c91c0 con 0x7f31540caac0 2023-10-14T09:38:08.463 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.461+0000 7f315bf25640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31540c94a0 con 0x7f315415ad70 2023-10-14T09:38:08.466 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.461+0000 7f31594c0640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f31540c9ca0 0x7f31540ca3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:43032/0 (socket says 172.21.15.102:43032) 2023-10-14T09:38:08.466 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.461+0000 7f31594c0640 1 -- 172.21.15.102:0/3732175405 learned_addr learned my addr 172.21.15.102:0/3732175405 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:08.466 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.462+0000 7f3159cc1640 1 --2- 172.21.15.102:0/3732175405 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f315415ad70 0x7f3154069da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:08.467 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.462+0000 7f3158cbf640 1 -- 172.21.15.102:0/3732175405 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2439842231 0 0) 0x7f31540cb030 con 0x7f31540c9ca0 2023-10-14T09:38:08.467 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.462+0000 7f3158cbf640 1 -- 172.21.15.102:0/3732175405 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3140003520 con 0x7f31540c9ca0 2023-10-14T09:38:08.467 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.462+0000 7f3158cbf640 1 -- 172.21.15.102:0/3732175405 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4120847470 0 0) 0x7f3140003520 con 0x7f31540c9ca0 2023-10-14T09:38:08.467 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.462+0000 7f3158cbf640 1 -- 172.21.15.102:0/3732175405 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f315415ad70 msgr2=0x7f3154069da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:08.467 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.462+0000 7f3158cbf640 1 --2- 172.21.15.102:0/3732175405 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f315415ad70 0x7f3154069da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:08.468 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.462+0000 7f3158cbf640 1 -- 172.21.15.102:0/3732175405 >> v1:172.21.15.129:6789/0 conn(0x7f31540caac0 legacy=0x7f31540ad4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:08.468 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.462+0000 7f3158cbf640 1 -- 172.21.15.102:0/3732175405 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31540c9780 con 0x7f31540c9ca0 2023-10-14T09:38:08.468 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.462+0000 7f3158cbf640 1 -- 172.21.15.102:0/3732175405 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4030661168 0 0) 0x7f3144001670 con 0x7f31540c9ca0 2023-10-14T09:38:08.468 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.462+0000 7f3158cbf640 1 -- 172.21.15.102:0/3732175405 >> v1:172.21.15.102:6789/0 conn(0x7f31540c9ca0 legacy=0x7f31540ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:08.468 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.462+0000 7f3158cbf640 1 --2- 172.21.15.102:0/3732175405 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f315415ad70 0x7f31400039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:08.469 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.463+0000 7f3158cbf640 1 --2- 172.21.15.102:0/3732175405 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3140003f20 0x7f31400047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:08.469 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.463+0000 7f3158cbf640 1 --2- 172.21.15.102:0/3732175405 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3140004d00 0x7f3140005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:08.469 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.463+0000 7f3158cbf640 1 -- 172.21.15.102:0/3732175405 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31540c94a0 con 0x7f3140003f20 2023-10-14T09:38:08.469 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.463+0000 7f3158cbf640 1 -- 172.21.15.102:0/3732175405 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314000ba60 con 0x7f3140004d00 2023-10-14T09:38:08.469 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.463+0000 7f3158cbf640 1 -- 172.21.15.102:0/3732175405 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f314000bc20 con 0x7f315415ad70 2023-10-14T09:38:08.470 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.463+0000 7f31594c0640 1 --2- 172.21.15.102:0/3732175405 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3140003f20 0x7f31400047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:08.470 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.463+0000 7f3159cc1640 1 --2- 172.21.15.102:0/3732175405 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f315415ad70 0x7f31400039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:08.470 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.463+0000 7f31594c0640 1 -- 172.21.15.102:0/3732175405 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f315415ad70 msgr2=0x7f31400039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:08.470 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.463+0000 7f315a4c2640 1 --2- 172.21.15.102:0/3732175405 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3140004d00 0x7f3140005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:08.470 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.463+0000 7f31594c0640 1 --2- 172.21.15.102:0/3732175405 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f315415ad70 0x7f31400039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:08.471 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.463+0000 7f31594c0640 1 -- 172.21.15.102:0/3732175405 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3140004d00 msgr2=0x7f3140005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:08.471 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.463+0000 7f31594c0640 1 --2- 172.21.15.102:0/3732175405 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3140004d00 0x7f3140005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:08.471 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.463+0000 7f31594c0640 1 -- 172.21.15.102:0/3732175405 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3140003520 con 0x7f3140003f20 2023-10-14T09:38:08.471 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.463+0000 7f315a4c2640 1 --2- 172.21.15.102:0/3732175405 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3140004d00 0x7f3140005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:08.471 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.464+0000 7f31594c0640 1 --2- 172.21.15.102:0/3732175405 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3140003f20 0x7f31400047c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f314400c240 tx=0x7f31400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=819b66ce7c89b3ae server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:08.475 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.465+0000 7f3158cbf640 1 -- 172.21.15.102:0/3732175405 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3144005ad0 con 0x7f3140003f20 2023-10-14T09:38:08.475 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.465+0000 7f3158cbf640 1 -- 172.21.15.102:0/3732175405 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3144005c30 con 0x7f3140003f20 2023-10-14T09:38:08.475 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.465+0000 7f3158cbf640 1 -- 172.21.15.102:0/3732175405 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314402caf0 con 0x7f3140003f20 2023-10-14T09:38:08.476 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.465+0000 7f315bf25640 1 -- 172.21.15.102:0/3732175405 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3140003f20 msgr2=0x7f31400047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:08.476 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.465+0000 7f315bf25640 1 --2- 172.21.15.102:0/3732175405 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3140003f20 0x7f31400047c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f314400c240 tx=0x7f31400057f0 comp rx=0 tx=0).stop 2023-10-14T09:38:08.476 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.465+0000 7f315a4c2640 1 -- 172.21.15.102:0/3732175405 reap_dead start 2023-10-14T09:38:08.476 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.465+0000 7f315bf25640 1 -- 172.21.15.102:0/3732175405 shutdown_connections 2023-10-14T09:38:08.476 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.465+0000 7f315bf25640 1 -- 172.21.15.102:0/3732175405 >> 172.21.15.102:0/3732175405 conn(0x7f31540ce9b0 msgr2=0x7f31540cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:08.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.465+0000 7f315bf25640 1 -- 172.21.15.102:0/3732175405 shutdown_connections 2023-10-14T09:38:08.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.466+0000 7f315bf25640 1 -- 172.21.15.102:0/3732175405 wait complete. 2023-10-14T09:38:08.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.467+0000 7f315bf25640 1 Processor -- start 2023-10-14T09:38:08.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.467+0000 7f315bf25640 1 -- start start 2023-10-14T09:38:08.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.468+0000 7f315bf25640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3140003f20 0x7f3154159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:08.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.468+0000 7f315bf25640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31540c8590 0x7f31540c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:08.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.468+0000 7f315bf25640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f31540c5fc0 0x7f31540c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:08.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.468+0000 7f315bf25640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31540aed20 con 0x7f31540c8590 2023-10-14T09:38:08.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.468+0000 7f315bf25640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3154159ac0 con 0x7f3140003f20 2023-10-14T09:38:08.479 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.468+0000 7f315bf25640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31541595c0 con 0x7f31540c5fc0 2023-10-14T09:38:08.479 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.468+0000 7f31594c0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31540c8590 0x7f31540c5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:08.479 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.469+0000 7f31594c0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31540c8590 0x7f31540c5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41828/0 (socket says 172.21.15.102:41828) 2023-10-14T09:38:08.479 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.469+0000 7f31594c0640 1 -- 172.21.15.102:0/2856417726 learned_addr learned my addr 172.21.15.102:0/2856417726 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:08.479 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.469+0000 7f315a4c2640 1 --2- 172.21.15.102:0/2856417726 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f31540c5fc0 0x7f31540c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:08.480 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.469+0000 7f3159cc1640 1 --2- 172.21.15.102:0/2856417726 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3140003f20 0x7f3154159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:08.480 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.469+0000 7f31594c0640 1 -- 172.21.15.102:0/2856417726 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f31540c5fc0 msgr2=0x7f31540c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:08.480 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.469+0000 7f31594c0640 1 --2- 172.21.15.102:0/2856417726 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f31540c5fc0 0x7f31540c6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:08.480 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.469+0000 7f31594c0640 1 -- 172.21.15.102:0/2856417726 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3140003f20 msgr2=0x7f3154159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:08.480 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.469+0000 7f31594c0640 1 --2- 172.21.15.102:0/2856417726 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3140003f20 0x7f3154159080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:08.481 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.469+0000 7f31594c0640 1 -- 172.21.15.102:0/2856417726 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31540ae110 con 0x7f31540c8590 2023-10-14T09:38:08.481 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.469+0000 7f31594c0640 1 --2- 172.21.15.102:0/2856417726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31540c8590 0x7f31540c5a80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3144000c00 tx=0x7f3144001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:08.481 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.470+0000 7f314a7fc640 1 -- 172.21.15.102:0/2856417726 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3144039070 con 0x7f31540c8590 2023-10-14T09:38:08.481 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.470+0000 7f314a7fc640 1 -- 172.21.15.102:0/2856417726 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314402cce0 con 0x7f31540c8590 2023-10-14T09:38:08.481 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.470+0000 7f315bf25640 1 -- 172.21.15.102:0/2856417726 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31540ae3f0 con 0x7f31540c8590 2023-10-14T09:38:08.482 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.470+0000 7f314a7fc640 1 -- 172.21.15.102:0/2856417726 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314403c040 con 0x7f31540c8590 2023-10-14T09:38:08.482 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.470+0000 7f315bf25640 1 -- 172.21.15.102:0/2856417726 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31540ae9b0 con 0x7f31540c8590 2023-10-14T09:38:08.482 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.471+0000 7f315bf25640 1 -- 172.21.15.102:0/2856417726 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31540aee90 con 0x7f31540c8590 2023-10-14T09:38:08.482 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.472+0000 7f314a7fc640 1 -- 172.21.15.102:0/2856417726 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3144032070 con 0x7f31540c8590 2023-10-14T09:38:08.483 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.473+0000 7f314a7fc640 1 --2- 172.21.15.102:0/2856417726 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f313806aea0 0x7f313806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:08.483 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.473+0000 7f314a7fc640 1 -- 172.21.15.102:0/2856417726 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f31440aaac0 con 0x7f31540c8590 2023-10-14T09:38:08.483 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.473+0000 7f3159cc1640 1 --2- 172.21.15.102:0/2856417726 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f313806aea0 0x7f313806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:08.484 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.474+0000 7f3159cc1640 1 --2- 172.21.15.102:0/2856417726 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f313806aea0 0x7f313806d360 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3150007380 tx=0x7f315000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:08.484 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.477+0000 7f314a7fc640 1 -- 172.21.15.102:0/2856417726 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3144075b70 con 0x7f31540c8590 2023-10-14T09:38:08.667 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.666+0000 7f315bf25640 1 -- 172.21.15.102:0/2856417726 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f315404e160 con 0x7f31540c8590 2023-10-14T09:38:08.668 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.667+0000 7f314a7fc640 1 -- 172.21.15.102:0/2856417726 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f31440aae60 con 0x7f31540c8590 2023-10-14T09:38:08.669 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2023-10-14T09:38:08.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.669+0000 7f315bf25640 1 -- 172.21.15.102:0/2856417726 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f313806aea0 msgr2=0x7f313806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:08.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.669+0000 7f315bf25640 1 --2- 172.21.15.102:0/2856417726 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f313806aea0 0x7f313806d360 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3150007380 tx=0x7f315000b040 comp rx=0 tx=0).stop 2023-10-14T09:38:08.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.669+0000 7f315bf25640 1 -- 172.21.15.102:0/2856417726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31540c8590 msgr2=0x7f31540c5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:08.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.669+0000 7f315bf25640 1 --2- 172.21.15.102:0/2856417726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31540c8590 0x7f31540c5a80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3144000c00 tx=0x7f3144001a00 comp rx=0 tx=0).stop 2023-10-14T09:38:08.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.669+0000 7f315bf25640 1 -- 172.21.15.102:0/2856417726 shutdown_connections 2023-10-14T09:38:08.673 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.669+0000 7f315bf25640 1 --2- 172.21.15.102:0/2856417726 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f313806aea0 0x7f313806d360 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:08.673 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.669+0000 7f315bf25640 1 --2- 172.21.15.102:0/2856417726 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f31540c5fc0 0x7f31540c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:08.673 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.669+0000 7f315bf25640 1 --2- 172.21.15.102:0/2856417726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31540c8590 0x7f31540c5a80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:08.673 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.669+0000 7f315bf25640 1 --2- 172.21.15.102:0/2856417726 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3140003f20 0x7f3154159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:08.673 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.670+0000 7f315bf25640 1 -- 172.21.15.102:0/2856417726 >> 172.21.15.102:0/2856417726 conn(0x7f31540ce9b0 msgr2=0x7f315415b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:08.674 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.670+0000 7f315bf25640 1 -- 172.21.15.102:0/2856417726 shutdown_connections 2023-10-14T09:38:08.674 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.670+0000 7f315bf25640 1 -- 172.21.15.102:0/2856417726 wait complete. 2023-10-14T09:38:08.690 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T09:38:08.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.910+0000 7ff7d56bb640 1 Processor -- start 2023-10-14T09:38:08.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.910+0000 7ff7d56bb640 1 -- start start 2023-10-14T09:38:08.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.911+0000 7ff7d56bb640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7ff7d0159ab0 0x7ff7d00ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:08.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.911+0000 7ff7d56bb640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7d0159e90 0x7ff7d006fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:08.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.912+0000 7ff7d56bb640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7d00cd1f0 con 0x7ff7d006c140 2023-10-14T09:38:08.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.912+0000 7ff7d56bb640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7d015d890 con 0x7ff7d0159ab0 2023-10-14T09:38:08.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.912+0000 7ff7d56bb640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d00cd4d0 con 0x7ff7d0159e90 2023-10-14T09:38:08.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.912+0000 7ff7cf7fe640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7ff7d006c140 0x7ff7d015dce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:43036/0 (socket says 172.21.15.102:43036) 2023-10-14T09:38:08.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.912+0000 7ff7cf7fe640 1 -- 172.21.15.102:0/1763943630 learned_addr learned my addr 172.21.15.102:0/1763943630 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:08.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.912+0000 7ff7cdffb640 1 -- 172.21.15.102:0/1763943630 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1035247932 0 0) 0x7ff7d00cd1f0 con 0x7ff7d006c140 2023-10-14T09:38:08.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.912+0000 7ff7ceffd640 1 --2- 172.21.15.102:0/1763943630 >> v2:172.21.15.129:3300/0 conn(0x7ff7d0159ab0 0x7ff7d00ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:08.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.912+0000 7ff7cdffb640 1 -- 172.21.15.102:0/1763943630 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7b8003520 con 0x7ff7d006c140 2023-10-14T09:38:08.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.913+0000 7ff7ce7fc640 1 --2- 172.21.15.102:0/1763943630 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7d0159e90 0x7ff7d006fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:08.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.913+0000 7ff7cdffb640 1 -- 172.21.15.102:0/1763943630 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2718098589 0 0) 0x7ff7b8003520 con 0x7ff7d006c140 2023-10-14T09:38:08.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.913+0000 7ff7cdffb640 1 -- 172.21.15.102:0/1763943630 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7d0159e90 msgr2=0x7ff7d006fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:08.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.913+0000 7ff7cdffb640 1 --2- 172.21.15.102:0/1763943630 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7d0159e90 0x7ff7d006fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:08.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.913+0000 7ff7cdffb640 1 -- 172.21.15.102:0/1763943630 >> v2:172.21.15.129:3300/0 conn(0x7ff7d0159ab0 msgr2=0x7ff7d00ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:08.920 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.913+0000 7ff7cdffb640 1 --2- 172.21.15.102:0/1763943630 >> v2:172.21.15.129:3300/0 conn(0x7ff7d0159ab0 0x7ff7d00ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:08.920 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.913+0000 7ff7cdffb640 1 -- 172.21.15.102:0/1763943630 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d00cd7b0 con 0x7ff7d006c140 2023-10-14T09:38:08.920 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.913+0000 7ff7cdffb640 1 -- 172.21.15.102:0/1763943630 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4030661168 0 0) 0x7ff7c80019f0 con 0x7ff7d006c140 2023-10-14T09:38:08.920 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.913+0000 7ff7cdffb640 1 -- 172.21.15.102:0/1763943630 >> v1:172.21.15.102:6789/0 conn(0x7ff7d006c140 legacy=0x7ff7d015dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:08.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.913+0000 7ff7cdffb640 1 --2- 172.21.15.102:0/1763943630 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7d0159e90 0x7ff7b8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:08.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.913+0000 7ff7cdffb640 1 --2- 172.21.15.102:0/1763943630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7b8003fa0 0x7ff7b80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:08.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.913+0000 7ff7cdffb640 1 --2- 172.21.15.102:0/1763943630 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff7b8004d50 0x7ff7b80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:08.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.913+0000 7ff7cdffb640 1 -- 172.21.15.102:0/1763943630 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d015d890 con 0x7ff7b8003fa0 2023-10-14T09:38:08.922 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.913+0000 7ff7cdffb640 1 -- 172.21.15.102:0/1763943630 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d00cd4d0 con 0x7ff7b8004d50 2023-10-14T09:38:08.922 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.913+0000 7ff7cdffb640 1 -- 172.21.15.102:0/1763943630 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b800dec0 con 0x7ff7d0159e90 2023-10-14T09:38:08.922 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.913+0000 7ff7ce7fc640 1 --2- 172.21.15.102:0/1763943630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7b8003fa0 0x7ff7b80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:08.922 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.913+0000 7ff7ceffd640 1 --2- 172.21.15.102:0/1763943630 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7d0159e90 0x7ff7b8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:08.922 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.914+0000 7ff7ce7fc640 1 -- 172.21.15.102:0/1763943630 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7d0159e90 msgr2=0x7ff7b8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:08.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.914+0000 7ff7ce7fc640 1 --2- 172.21.15.102:0/1763943630 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7d0159e90 0x7ff7b8003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:08.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.914+0000 7ff7ce7fc640 1 -- 172.21.15.102:0/1763943630 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff7b8004d50 msgr2=0x7ff7b80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:08.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.914+0000 7ff7ce7fc640 1 --2- 172.21.15.102:0/1763943630 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff7b8004d50 0x7ff7b80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:08.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.914+0000 7ff7ce7fc640 1 -- 172.21.15.102:0/1763943630 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b8003520 con 0x7ff7b8003fa0 2023-10-14T09:38:08.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.914+0000 7ff7ceffd640 1 --2- 172.21.15.102:0/1763943630 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7d0159e90 0x7ff7b8003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:08.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.915+0000 7ff7ce7fc640 1 --2- 172.21.15.102:0/1763943630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7b8003fa0 0x7ff7b80047c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff7c400a9a0 tx=0x7ff7b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b2e6b9a9c8f885 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:08.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.915+0000 7ff7cdffb640 1 -- 172.21.15.102:0/1763943630 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c4030400 con 0x7ff7b8003fa0 2023-10-14T09:38:08.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.915+0000 7ff7cdffb640 1 -- 172.21.15.102:0/1763943630 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c4030560 con 0x7ff7b8003fa0 2023-10-14T09:38:08.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.915+0000 7ff7cdffb640 1 -- 172.21.15.102:0/1763943630 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c4030950 con 0x7ff7b8003fa0 2023-10-14T09:38:08.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.915+0000 7ff7d56bb640 1 -- 172.21.15.102:0/1763943630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7b8003fa0 msgr2=0x7ff7b80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:08.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.915+0000 7ff7d56bb640 1 --2- 172.21.15.102:0/1763943630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7b8003fa0 0x7ff7b80047c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff7c400a9a0 tx=0x7ff7b80057f0 comp rx=0 tx=0).stop 2023-10-14T09:38:08.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.915+0000 7ff7cf7fe640 1 -- 172.21.15.102:0/1763943630 reap_dead start 2023-10-14T09:38:08.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.916+0000 7ff7d56bb640 1 -- 172.21.15.102:0/1763943630 shutdown_connections 2023-10-14T09:38:08.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.916+0000 7ff7d56bb640 1 -- 172.21.15.102:0/1763943630 >> 172.21.15.102:0/1763943630 conn(0x7ff7d00ce9b0 msgr2=0x7ff7d00cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:08.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.916+0000 7ff7d56bb640 1 -- 172.21.15.102:0/1763943630 shutdown_connections 2023-10-14T09:38:08.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.916+0000 7ff7d56bb640 1 -- 172.21.15.102:0/1763943630 wait complete. 2023-10-14T09:38:08.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.917+0000 7ff7d56bb640 1 Processor -- start 2023-10-14T09:38:08.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.918+0000 7ff7d56bb640 1 -- start start 2023-10-14T09:38:08.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.918+0000 7ff7d56bb640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff7b8003fa0 0x7ff7d00c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:08.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.918+0000 7ff7d56bb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7d00aee40 0x7ff7d01586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:08.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.918+0000 7ff7d56bb640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7d0158d00 0x7ff7d006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:08.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.918+0000 7ff7d56bb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d00ae9b0 con 0x7ff7d00aee40 2023-10-14T09:38:08.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.918+0000 7ff7d56bb640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d00c80f0 con 0x7ff7b8003fa0 2023-10-14T09:38:08.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.918+0000 7ff7d56bb640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d00c7b30 con 0x7ff7d0158d00 2023-10-14T09:38:08.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.919+0000 7ff7ce7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7d00aee40 0x7ff7d01586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:08.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.919+0000 7ff7ce7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7d00aee40 0x7ff7d01586c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41844/0 (socket says 172.21.15.102:41844) 2023-10-14T09:38:08.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.919+0000 7ff7ce7fc640 1 -- 172.21.15.102:0/2678239086 learned_addr learned my addr 172.21.15.102:0/2678239086 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:08.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.919+0000 7ff7ce7fc640 1 -- 172.21.15.102:0/2678239086 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7d0158d00 msgr2=0x7ff7d006fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:08.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.919+0000 7ff7ce7fc640 1 --2- 172.21.15.102:0/2678239086 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7d0158d00 0x7ff7d006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:08.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.919+0000 7ff7ce7fc640 1 -- 172.21.15.102:0/2678239086 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff7b8003fa0 msgr2=0x7ff7d00c74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:08.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.919+0000 7ff7ce7fc640 1 --2- 172.21.15.102:0/2678239086 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff7b8003fa0 0x7ff7d00c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:08.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.919+0000 7ff7ce7fc640 1 -- 172.21.15.102:0/2678239086 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d00c7e10 con 0x7ff7d00aee40 2023-10-14T09:38:08.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.920+0000 7ff7ce7fc640 1 --2- 172.21.15.102:0/2678239086 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7d00aee40 0x7ff7d01586c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff7c400a9a0 tx=0x7ff7c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:08.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.920+0000 7ff7b77fe640 1 -- 172.21.15.102:0/2678239086 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c40399e0 con 0x7ff7d00aee40 2023-10-14T09:38:08.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.920+0000 7ff7b77fe640 1 -- 172.21.15.102:0/2678239086 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c4039b40 con 0x7ff7d00aee40 2023-10-14T09:38:08.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.920+0000 7ff7d56bb640 1 -- 172.21.15.102:0/2678239086 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7d00ae640 con 0x7ff7d00aee40 2023-10-14T09:38:08.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.920+0000 7ff7b77fe640 1 -- 172.21.15.102:0/2678239086 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c4043400 con 0x7ff7d00aee40 2023-10-14T09:38:08.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.920+0000 7ff7d56bb640 1 -- 172.21.15.102:0/2678239086 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7d00701e0 con 0x7ff7d00aee40 2023-10-14T09:38:08.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.921+0000 7ff7d56bb640 1 -- 172.21.15.102:0/2678239086 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7d00ae4a0 con 0x7ff7d00aee40 2023-10-14T09:38:08.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.922+0000 7ff7b77fe640 1 -- 172.21.15.102:0/2678239086 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff7c4043560 con 0x7ff7d00aee40 2023-10-14T09:38:08.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.923+0000 7ff7b77fe640 1 --2- 172.21.15.102:0/2678239086 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff7bc06ae70 0x7ff7bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:08.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.923+0000 7ff7b77fe640 1 -- 172.21.15.102:0/2678239086 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7ff7c403e070 con 0x7ff7d00aee40 2023-10-14T09:38:08.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.923+0000 7ff7ceffd640 1 --2- 172.21.15.102:0/2678239086 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff7bc06ae70 0x7ff7bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:08.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.924+0000 7ff7ceffd640 1 --2- 172.21.15.102:0/2678239086 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff7bc06ae70 0x7ff7bc06d330 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0006fd0 tx=0x7ff7c00093d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:08.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:08.928+0000 7ff7b77fe640 1 -- 172.21.15.102:0/2678239086 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff7d00ae4a0 con 0x7ff7d00aee40 2023-10-14T09:38:09.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.118+0000 7ff7d56bb640 1 -- 172.21.15.102:0/2678239086 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff7d00ae4a0 con 0x7ff7d00aee40 2023-10-14T09:38:09.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.118+0000 7ff7b77fe640 1 -- 172.21.15.102:0/2678239086 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff7d00ae4a0 con 0x7ff7d00aee40 2023-10-14T09:38:09.121 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2023-10-14T09:38:09.123 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.121+0000 7ff7d56bb640 1 -- 172.21.15.102:0/2678239086 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff7bc06ae70 msgr2=0x7ff7bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:09.123 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.121+0000 7ff7d56bb640 1 --2- 172.21.15.102:0/2678239086 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff7bc06ae70 0x7ff7bc06d330 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0006fd0 tx=0x7ff7c00093d0 comp rx=0 tx=0).stop 2023-10-14T09:38:09.124 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.121+0000 7ff7d56bb640 1 -- 172.21.15.102:0/2678239086 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7d00aee40 msgr2=0x7ff7d01586c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:09.124 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.121+0000 7ff7d56bb640 1 --2- 172.21.15.102:0/2678239086 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7d00aee40 0x7ff7d01586c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff7c400a9a0 tx=0x7ff7c40046c0 comp rx=0 tx=0).stop 2023-10-14T09:38:09.124 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.121+0000 7ff7d56bb640 1 -- 172.21.15.102:0/2678239086 shutdown_connections 2023-10-14T09:38:09.124 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.121+0000 7ff7d56bb640 1 --2- 172.21.15.102:0/2678239086 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff7bc06ae70 0x7ff7bc06d330 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:09.125 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.121+0000 7ff7d56bb640 1 --2- 172.21.15.102:0/2678239086 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7d0158d00 0x7ff7d006fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:09.125 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.121+0000 7ff7d56bb640 1 --2- 172.21.15.102:0/2678239086 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7d00aee40 0x7ff7d01586c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:09.125 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.121+0000 7ff7d56bb640 1 --2- 172.21.15.102:0/2678239086 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff7b8003fa0 0x7ff7d00c74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:09.125 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.121+0000 7ff7d56bb640 1 -- 172.21.15.102:0/2678239086 >> 172.21.15.102:0/2678239086 conn(0x7ff7d00ce9b0 msgr2=0x7ff7d00ad410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:09.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.121+0000 7ff7d56bb640 1 -- 172.21.15.102:0/2678239086 shutdown_connections 2023-10-14T09:38:09.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.121+0000 7ff7d56bb640 1 -- 172.21.15.102:0/2678239086 wait complete. 2023-10-14T09:38:09.142 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T09:38:09.355 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.353+0000 7f3731d24640 1 Processor -- start 2023-10-14T09:38:09.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.354+0000 7f3731d24640 1 -- start start 2023-10-14T09:38:09.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.355+0000 7f3731d24640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f372c15ad70 0x7f372c069da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:09.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.355+0000 7f3731d24640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f372c0c9ca0 0x7f372c06a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:09.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.355+0000 7f3731d24640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f372c0cb030 con 0x7f372c0ca3b0 2023-10-14T09:38:09.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.355+0000 7f3731d24640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f372c0c91c0 con 0x7f372c15ad70 2023-10-14T09:38:09.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.355+0000 7f3731d24640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f372c0c94a0 con 0x7f372c0c9ca0 2023-10-14T09:38:09.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.355+0000 7f372b7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f372c15ad70 0x7f372c069da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:09.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.356+0000 7f372b7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f372c15ad70 0x7f372c069da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41860/0 (socket says 172.21.15.102:41860) 2023-10-14T09:38:09.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.356+0000 7f372b7fe640 1 -- 172.21.15.102:0/3334937928 learned_addr learned my addr 172.21.15.102:0/3334937928 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:09.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.356+0000 7f3723fff640 1 --2- 172.21.15.102:0/3334937928 >> v2:172.21.15.129:3300/0 conn(0x7f372c0c9ca0 0x7f372c06a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:09.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.356+0000 7f372b7fe640 1 -- 172.21.15.102:0/3334937928 >> v2:172.21.15.129:3300/0 conn(0x7f372c0c9ca0 msgr2=0x7f372c06a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:09.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.356+0000 7f372b7fe640 1 --2- 172.21.15.102:0/3334937928 >> v2:172.21.15.129:3300/0 conn(0x7f372c0c9ca0 0x7f372c06a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:09.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.356+0000 7f372b7fe640 1 -- 172.21.15.102:0/3334937928 >> v1:172.21.15.129:6789/0 conn(0x7f372c0ca3b0 legacy=0x7f372c0ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:09.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.356+0000 7f372b7fe640 1 -- 172.21.15.102:0/3334937928 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f372c0c9780 con 0x7f372c15ad70 2023-10-14T09:38:09.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.357+0000 7f372b7fe640 1 --2- 172.21.15.102:0/3334937928 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f372c15ad70 0x7f372c069da0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f372c0ce870 tx=0x7f371c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d5c3a732eaa390 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:09.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.357+0000 7f372affd640 1 -- 172.21.15.102:0/3334937928 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c031870 con 0x7f372c15ad70 2023-10-14T09:38:09.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.357+0000 7f372affd640 1 -- 172.21.15.102:0/3334937928 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371c0319d0 con 0x7f372c15ad70 2023-10-14T09:38:09.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.357+0000 7f372affd640 1 -- 172.21.15.102:0/3334937928 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c031d60 con 0x7f372c15ad70 2023-10-14T09:38:09.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.358+0000 7f3731d24640 1 -- 172.21.15.102:0/3334937928 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f372c15ad70 msgr2=0x7f372c069da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:09.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.358+0000 7f3731d24640 1 --2- 172.21.15.102:0/3334937928 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f372c15ad70 0x7f372c069da0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f372c0ce870 tx=0x7f371c02b910 comp rx=0 tx=0).stop 2023-10-14T09:38:09.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.358+0000 7f3731d24640 1 -- 172.21.15.102:0/3334937928 shutdown_connections 2023-10-14T09:38:09.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.358+0000 7f3731d24640 1 --2- 172.21.15.102:0/3334937928 >> v2:172.21.15.129:3300/0 conn(0x7f372c0c9ca0 0x7f372c06a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:09.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.358+0000 7f3731d24640 1 --2- 172.21.15.102:0/3334937928 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f372c15ad70 0x7f372c069da0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:09.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.358+0000 7f3731d24640 1 -- 172.21.15.102:0/3334937928 >> 172.21.15.102:0/3334937928 conn(0x7f372c0ce9b0 msgr2=0x7f372c0cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:09.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.358+0000 7f3731d24640 1 -- 172.21.15.102:0/3334937928 shutdown_connections 2023-10-14T09:38:09.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.358+0000 7f3731d24640 1 -- 172.21.15.102:0/3334937928 wait complete. 2023-10-14T09:38:09.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.360+0000 7f3731d24640 1 Processor -- start 2023-10-14T09:38:09.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.360+0000 7f3731d24640 1 -- start start 2023-10-14T09:38:09.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.361+0000 7f3731d24640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f372c0c9ca0 0x7f372c0cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:09.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.361+0000 7f3731d24640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f372c0ca3b0 0x7f372c0cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:09.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.361+0000 7f3731d24640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f372c15ad70 0x7f372c15c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:09.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.361+0000 7f3731d24640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372c0c6730 con 0x7f372c15ad70 2023-10-14T09:38:09.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.361+0000 7f3731d24640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372c0c5b20 con 0x7f372c0ca3b0 2023-10-14T09:38:09.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.361+0000 7f3731d24640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f372c0c5e00 con 0x7f372c0c9ca0 2023-10-14T09:38:09.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.361+0000 7f372bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f372c15ad70 0x7f372c15c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:09.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.361+0000 7f372bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f372c15ad70 0x7f372c15c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41872/0 (socket says 172.21.15.102:41872) 2023-10-14T09:38:09.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.361+0000 7f372bfff640 1 -- 172.21.15.102:0/542876763 learned_addr learned my addr 172.21.15.102:0/542876763 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:09.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.362+0000 7f372b7fe640 1 --2- 172.21.15.102:0/542876763 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f372c0c9ca0 0x7f372c0cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:09.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.362+0000 7f3723fff640 1 --2- 172.21.15.102:0/542876763 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f372c0ca3b0 0x7f372c0cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:09.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.362+0000 7f372bfff640 1 -- 172.21.15.102:0/542876763 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f372c0c9ca0 msgr2=0x7f372c0cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:09.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.362+0000 7f372bfff640 1 --2- 172.21.15.102:0/542876763 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f372c0c9ca0 0x7f372c0cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:09.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.362+0000 7f372bfff640 1 -- 172.21.15.102:0/542876763 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f372c0ca3b0 msgr2=0x7f372c0cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:09.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.362+0000 7f372bfff640 1 --2- 172.21.15.102:0/542876763 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f372c0ca3b0 0x7f372c0cdb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:09.371 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.362+0000 7f372bfff640 1 -- 172.21.15.102:0/542876763 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f371c0094d0 con 0x7f372c15ad70 2023-10-14T09:38:09.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.362+0000 7f372bfff640 1 --2- 172.21.15.102:0/542876763 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f372c15ad70 0x7f372c15c100 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f372400c780 tx=0x7f372400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:09.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.362+0000 7f3728ff9640 1 -- 172.21.15.102:0/542876763 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3724004b60 con 0x7f372c15ad70 2023-10-14T09:38:09.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.362+0000 7f3728ff9640 1 -- 172.21.15.102:0/542876763 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f372400ce90 con 0x7f372c15ad70 2023-10-14T09:38:09.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.362+0000 7f3728ff9640 1 -- 172.21.15.102:0/542876763 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372400a850 con 0x7f372c15ad70 2023-10-14T09:38:09.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.362+0000 7f3731d24640 1 -- 172.21.15.102:0/542876763 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f372c0c60e0 con 0x7f372c15ad70 2023-10-14T09:38:09.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.363+0000 7f3731d24640 1 -- 172.21.15.102:0/542876763 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f372c158f60 con 0x7f372c15ad70 2023-10-14T09:38:09.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.364+0000 7f3731d24640 1 -- 172.21.15.102:0/542876763 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f372c0c68a0 con 0x7f372c15ad70 2023-10-14T09:38:09.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.365+0000 7f3728ff9640 1 -- 172.21.15.102:0/542876763 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f372400a9b0 con 0x7f372c15ad70 2023-10-14T09:38:09.375 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.366+0000 7f3728ff9640 1 --2- 172.21.15.102:0/542876763 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f370c06ae70 0x7f370c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:09.375 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.366+0000 7f3728ff9640 1 -- 172.21.15.102:0/542876763 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f3724089900 con 0x7f372c15ad70 2023-10-14T09:38:09.376 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.366+0000 7f372b7fe640 1 --2- 172.21.15.102:0/542876763 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f370c06ae70 0x7f370c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:09.376 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.367+0000 7f372b7fe640 1 --2- 172.21.15.102:0/542876763 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f370c06ae70 0x7f370c06d330 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f371c036000 tx=0x7f371c03c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:09.376 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.370+0000 7f3728ff9640 1 -- 172.21.15.102:0/542876763 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3724054920 con 0x7f372c15ad70 2023-10-14T09:38:09.560 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.558+0000 7f3731d24640 1 -- 172.21.15.102:0/542876763 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f372c04e160 con 0x7f372c15ad70 2023-10-14T09:38:09.561 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.559+0000 7f3728ff9640 1 -- 172.21.15.102:0/542876763 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3724057f40 con 0x7f372c15ad70 2023-10-14T09:38:09.561 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2023-10-14T09:38:09.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.561+0000 7f3731d24640 1 -- 172.21.15.102:0/542876763 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f370c06ae70 msgr2=0x7f370c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:09.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.562+0000 7f3731d24640 1 --2- 172.21.15.102:0/542876763 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f370c06ae70 0x7f370c06d330 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f371c036000 tx=0x7f371c03c040 comp rx=0 tx=0).stop 2023-10-14T09:38:09.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.562+0000 7f3731d24640 1 -- 172.21.15.102:0/542876763 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f372c15ad70 msgr2=0x7f372c15c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:09.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.562+0000 7f3731d24640 1 --2- 172.21.15.102:0/542876763 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f372c15ad70 0x7f372c15c100 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f372400c780 tx=0x7f372400cc40 comp rx=0 tx=0).stop 2023-10-14T09:38:09.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.562+0000 7f3731d24640 1 -- 172.21.15.102:0/542876763 shutdown_connections 2023-10-14T09:38:09.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.562+0000 7f3731d24640 1 --2- 172.21.15.102:0/542876763 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f370c06ae70 0x7f370c06d330 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:09.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.562+0000 7f3731d24640 1 --2- 172.21.15.102:0/542876763 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f372c15ad70 0x7f372c15c100 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:09.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.562+0000 7f3731d24640 1 --2- 172.21.15.102:0/542876763 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f372c0ca3b0 0x7f372c0cdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:09.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.562+0000 7f3731d24640 1 --2- 172.21.15.102:0/542876763 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f372c0c9ca0 0x7f372c0cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:09.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.562+0000 7f3731d24640 1 -- 172.21.15.102:0/542876763 >> 172.21.15.102:0/542876763 conn(0x7f372c0ce9b0 msgr2=0x7f372c0acc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:09.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.562+0000 7f3731d24640 1 -- 172.21.15.102:0/542876763 shutdown_connections 2023-10-14T09:38:09.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.562+0000 7f3731d24640 1 -- 172.21.15.102:0/542876763 wait complete. 2023-10-14T09:38:09.582 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T09:38:09.800 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.798+0000 7fef12d16640 1 Processor -- start 2023-10-14T09:38:09.800 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.798+0000 7fef12d16640 1 -- start start 2023-10-14T09:38:09.801 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.799+0000 7fef12d16640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fef0c15ad70 0x7fef0c069da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:09.802 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.799+0000 7fef12d16640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef0c0cb030 con 0x7fef0c0caac0 2023-10-14T09:38:09.802 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.799+0000 7fef12d16640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef0c0c91c0 con 0x7fef0c0c9ca0 2023-10-14T09:38:09.802 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.799+0000 7fef12d16640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef0c0c94a0 con 0x7fef0c15ad70 2023-10-14T09:38:09.802 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.800+0000 7fef112b3640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fef0c0caac0 0x7fef0c0ad4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:43046/0 (socket says 172.21.15.102:43046) 2023-10-14T09:38:09.802 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.800+0000 7fef112b3640 1 -- 172.21.15.102:0/55918608 learned_addr learned my addr 172.21.15.102:0/55918608 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:09.805 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.800+0000 7fef037fe640 1 -- 172.21.15.102:0/55918608 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2241406361 0 0) 0x7fef0c0cb030 con 0x7fef0c0caac0 2023-10-14T09:38:09.805 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.800+0000 7fef037fe640 1 -- 172.21.15.102:0/55918608 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feef4003520 con 0x7fef0c0caac0 2023-10-14T09:38:09.805 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.800+0000 7fef10ab2640 1 --2- 172.21.15.102:0/55918608 >> v2:172.21.15.129:3300/0 conn(0x7fef0c15ad70 0x7fef0c069da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:09.806 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.801+0000 7fef037fe640 1 -- 172.21.15.102:0/55918608 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3532111084 0 0) 0x7feef4003520 con 0x7fef0c0caac0 2023-10-14T09:38:09.806 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.801+0000 7fef037fe640 1 -- 172.21.15.102:0/55918608 >> v2:172.21.15.129:3300/0 conn(0x7fef0c15ad70 msgr2=0x7fef0c069da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:09.806 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.801+0000 7fef037fe640 1 --2- 172.21.15.102:0/55918608 >> v2:172.21.15.129:3300/0 conn(0x7fef0c15ad70 0x7fef0c069da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:09.806 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.801+0000 7fef037fe640 1 -- 172.21.15.102:0/55918608 >> v1:172.21.15.129:6789/0 conn(0x7fef0c0c9ca0 legacy=0x7fef0c0ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:09.806 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.801+0000 7fef037fe640 1 -- 172.21.15.102:0/55918608 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef0c0c9780 con 0x7fef0c0caac0 2023-10-14T09:38:09.807 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.801+0000 7fef037fe640 1 -- 172.21.15.102:0/55918608 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4030661168 0 0) 0x7fef04001670 con 0x7fef0c0caac0 2023-10-14T09:38:09.807 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.801+0000 7fef037fe640 1 -- 172.21.15.102:0/55918608 >> v1:172.21.15.102:6789/0 conn(0x7fef0c0caac0 legacy=0x7fef0c0ad4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:09.807 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.801+0000 7fef037fe640 1 --2- 172.21.15.102:0/55918608 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7feef40039c0 0x7feef4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:09.807 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.801+0000 7fef037fe640 1 --2- 172.21.15.102:0/55918608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feef40047c0 0x7feef4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:09.807 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.801+0000 7fef037fe640 1 --2- 172.21.15.102:0/55918608 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feef40051d0 0x7feef400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:09.808 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.801+0000 7fef037fe640 1 -- 172.21.15.102:0/55918608 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0c0c94a0 con 0x7feef40047c0 2023-10-14T09:38:09.808 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.801+0000 7fef037fe640 1 -- 172.21.15.102:0/55918608 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef400c120 con 0x7feef40051d0 2023-10-14T09:38:09.808 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.801+0000 7fef037fe640 1 -- 172.21.15.102:0/55918608 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef400c2e0 con 0x7feef40039c0 2023-10-14T09:38:09.808 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.801+0000 7fef03fff640 1 --2- 172.21.15.102:0/55918608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feef40047c0 0x7feef4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:09.808 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.801+0000 7fef03fff640 1 -- 172.21.15.102:0/55918608 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7feef40039c0 msgr2=0x7feef4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:09.809 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.801+0000 7fef03fff640 1 --2- 172.21.15.102:0/55918608 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7feef40039c0 0x7feef4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:09.809 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.801+0000 7fef03fff640 1 -- 172.21.15.102:0/55918608 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feef40051d0 msgr2=0x7feef400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:09.809 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.801+0000 7fef03fff640 1 --2- 172.21.15.102:0/55918608 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feef40051d0 0x7feef400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:09.809 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.801+0000 7fef03fff640 1 -- 172.21.15.102:0/55918608 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef4003520 con 0x7feef40047c0 2023-10-14T09:38:09.809 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.801+0000 7fef112b3640 1 -- 172.21.15.102:0/55918608 reap_dead start 2023-10-14T09:38:09.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.802+0000 7fef03fff640 1 --2- 172.21.15.102:0/55918608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feef40047c0 0x7feef4004c40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7feefc001750 tx=0x7feef40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5335e222a1e35a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:09.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.803+0000 7fef037fe640 1 -- 172.21.15.102:0/55918608 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc0052d0 con 0x7feef40047c0 2023-10-14T09:38:09.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.803+0000 7fef037fe640 1 -- 172.21.15.102:0/55918608 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feefc02e050 con 0x7feef40047c0 2023-10-14T09:38:09.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.803+0000 7fef037fe640 1 -- 172.21.15.102:0/55918608 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc003830 con 0x7feef40047c0 2023-10-14T09:38:09.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.803+0000 7fef12d16640 1 -- 172.21.15.102:0/55918608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feef40047c0 msgr2=0x7feef4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:09.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.803+0000 7fef12d16640 1 --2- 172.21.15.102:0/55918608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feef40047c0 0x7feef4004c40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7feefc001750 tx=0x7feef40057f0 comp rx=0 tx=0).stop 2023-10-14T09:38:09.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.803+0000 7fef12d16640 1 -- 172.21.15.102:0/55918608 shutdown_connections 2023-10-14T09:38:09.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.803+0000 7fef12d16640 1 --2- 172.21.15.102:0/55918608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feef40047c0 0x7feef4004c40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:09.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.803+0000 7fef12d16640 1 -- 172.21.15.102:0/55918608 >> 172.21.15.102:0/55918608 conn(0x7fef0c0ce9b0 msgr2=0x7fef0c0cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:09.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.803+0000 7fef12d16640 1 -- 172.21.15.102:0/55918608 shutdown_connections 2023-10-14T09:38:09.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.803+0000 7fef12d16640 1 -- 172.21.15.102:0/55918608 wait complete. 2023-10-14T09:38:09.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.805+0000 7fef12d16640 1 Processor -- start 2023-10-14T09:38:09.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.805+0000 7fef12d16640 1 -- start start 2023-10-14T09:38:09.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.806+0000 7fef12d16640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7feef40047c0 0x7fef0c0c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:09.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.806+0000 7fef12d16640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef0c0c8750 0x7fef0c0cc540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:09.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.806+0000 7fef12d16640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fef0c0cca80 0x7fef0c0ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:09.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.806+0000 7fef12d16640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0c0c8330 con 0x7fef0c0c8750 2023-10-14T09:38:09.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.806+0000 7fef12d16640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0c0c7450 con 0x7fef0c0cca80 2023-10-14T09:38:09.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.806+0000 7fef12d16640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef0c0c76b0 con 0x7feef40047c0 2023-10-14T09:38:09.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.806+0000 7fef03fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef0c0c8750 0x7fef0c0cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:09.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.806+0000 7fef03fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef0c0c8750 0x7fef0c0cc540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41898/0 (socket says 172.21.15.102:41898) 2023-10-14T09:38:09.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.806+0000 7fef03fff640 1 -- 172.21.15.102:0/2798873676 learned_addr learned my addr 172.21.15.102:0/2798873676 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:09.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.807+0000 7fef03fff640 1 -- 172.21.15.102:0/2798873676 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7feef40047c0 msgr2=0x7fef0c0c6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:09.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.807+0000 7fef03fff640 1 --2- 172.21.15.102:0/2798873676 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7feef40047c0 0x7fef0c0c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:09.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.807+0000 7fef03fff640 1 -- 172.21.15.102:0/2798873676 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fef0c0cca80 msgr2=0x7fef0c0ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:09.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.807+0000 7fef03fff640 1 --2- 172.21.15.102:0/2798873676 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fef0c0cca80 0x7fef0c0ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:09.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.807+0000 7fef03fff640 1 -- 172.21.15.102:0/2798873676 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef0c0c7990 con 0x7fef0c0c8750 2023-10-14T09:38:09.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.807+0000 7fef03fff640 1 --2- 172.21.15.102:0/2798873676 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef0c0c8750 0x7fef0c0cc540 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7feefc005040 tx=0x7feefc001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:09.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.807+0000 7fef017fa640 1 -- 172.21.15.102:0/2798873676 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc003e80 con 0x7fef0c0c8750 2023-10-14T09:38:09.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.807+0000 7fef017fa640 1 -- 172.21.15.102:0/2798873676 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feefc007a30 con 0x7fef0c0c8750 2023-10-14T09:38:09.818 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.807+0000 7fef017fa640 1 -- 172.21.15.102:0/2798873676 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc03d670 con 0x7fef0c0c8750 2023-10-14T09:38:09.818 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.808+0000 7fef12d16640 1 -- 172.21.15.102:0/2798873676 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef0c0c7c70 con 0x7fef0c0c8750 2023-10-14T09:38:09.818 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.808+0000 7fef12d16640 1 -- 172.21.15.102:0/2798873676 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef0c1edf90 con 0x7fef0c0c8750 2023-10-14T09:38:09.818 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.809+0000 7fef12d16640 1 -- 172.21.15.102:0/2798873676 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef0c1ee120 con 0x7fef0c0c8750 2023-10-14T09:38:09.818 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.810+0000 7fef017fa640 1 -- 172.21.15.102:0/2798873676 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7feefc03d7d0 con 0x7fef0c0c8750 2023-10-14T09:38:09.819 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.811+0000 7fef017fa640 1 --2- 172.21.15.102:0/2798873676 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7feef806ae30 0x7feef806d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:09.819 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.811+0000 7fef017fa640 1 -- 172.21.15.102:0/2798873676 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7feefc0ab810 con 0x7fef0c0c8750 2023-10-14T09:38:09.819 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.811+0000 7fef10ab2640 1 --2- 172.21.15.102:0/2798873676 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7feef806ae30 0x7feef806d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:09.819 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.811+0000 7fef10ab2640 1 --2- 172.21.15.102:0/2798873676 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7feef806ae30 0x7feef806d2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fef080094c0 tx=0x7fef08009430 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:09.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:09.815+0000 7fef017fa640 1 -- 172.21.15.102:0/2798873676 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feefc07a220 con 0x7fef0c0c8750 2023-10-14T09:38:10.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.020+0000 7fef12d16640 1 -- 172.21.15.102:0/2798873676 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fef0c04e160 con 0x7fef0c0c8750 2023-10-14T09:38:10.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.021+0000 7fef017fa640 1 -- 172.21.15.102:0/2798873676 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7feefc04b080 con 0x7fef0c0c8750 2023-10-14T09:38:10.023 INFO:teuthology.orchestra.run.smithi102.stderr:listed 0 entries 2023-10-14T09:38:10.026 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.024+0000 7fef12d16640 1 -- 172.21.15.102:0/2798873676 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7feef806ae30 msgr2=0x7feef806d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:10.026 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.024+0000 7fef12d16640 1 --2- 172.21.15.102:0/2798873676 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7feef806ae30 0x7feef806d2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fef080094c0 tx=0x7fef08009430 comp rx=0 tx=0).stop 2023-10-14T09:38:10.026 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.024+0000 7fef12d16640 1 -- 172.21.15.102:0/2798873676 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef0c0c8750 msgr2=0x7fef0c0cc540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:10.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.024+0000 7fef12d16640 1 --2- 172.21.15.102:0/2798873676 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef0c0c8750 0x7fef0c0cc540 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7feefc005040 tx=0x7feefc001120 comp rx=0 tx=0).stop 2023-10-14T09:38:10.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.024+0000 7fef12d16640 1 -- 172.21.15.102:0/2798873676 shutdown_connections 2023-10-14T09:38:10.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.024+0000 7fef12d16640 1 --2- 172.21.15.102:0/2798873676 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7feef806ae30 0x7feef806d2f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:10.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.024+0000 7fef12d16640 1 --2- 172.21.15.102:0/2798873676 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fef0c0cca80 0x7fef0c0ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:10.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.024+0000 7fef12d16640 1 --2- 172.21.15.102:0/2798873676 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef0c0c8750 0x7fef0c0cc540 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:10.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.024+0000 7fef12d16640 1 --2- 172.21.15.102:0/2798873676 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7feef40047c0 0x7fef0c0c6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:10.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.024+0000 7fef12d16640 1 -- 172.21.15.102:0/2798873676 >> 172.21.15.102:0/2798873676 conn(0x7fef0c0ce9b0 msgr2=0x7fef0c1577f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:10.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.024+0000 7fef12d16640 1 -- 172.21.15.102:0/2798873676 shutdown_connections 2023-10-14T09:38:10.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.024+0000 7fef12d16640 1 -- 172.21.15.102:0/2798873676 wait complete. 2023-10-14T09:38:10.044 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-14T09:38:10.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:38:10.045 DEBUG:teuthology.orchestra.run.smithi102:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-14T09:38:10.143 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi102.front.sepia.ceph.com 2023-10-14T09:38:10.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:38:10.144 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-14T09:38:10.195 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2023-10-14T09:38:10.195 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T09:38:10.256 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2023-10-14T09:38:10.257 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T09:38:10.310 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2023-10-14T09:38:10.310 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T09:38:10.362 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:38:10.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.582+0000 7fdd2dbc9640 1 Processor -- start 2023-10-14T09:38:10.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.583+0000 7fdd2dbc9640 1 -- start start 2023-10-14T09:38:10.586 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.584+0000 7fdd2dbc9640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fdd280cf730 0x7fdd280ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:10.586 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.584+0000 7fdd2dbc9640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fdd280afee0 0x7fdd280b3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:10.586 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.584+0000 7fdd2dbc9640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd280cee00 con 0x7fdd2815b010 2023-10-14T09:38:10.587 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.584+0000 7fdd2dbc9640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd280aeba0 con 0x7fdd280afee0 2023-10-14T09:38:10.587 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.584+0000 7fdd2dbc9640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd280ae270 con 0x7fdd280cf730 2023-10-14T09:38:10.587 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.584+0000 7fdd277fe640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fdd2815b010 0x7fdd280cf020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:43052/0 (socket says 172.21.15.102:43052) 2023-10-14T09:38:10.587 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.584+0000 7fdd277fe640 1 -- 172.21.15.102:0/2258423013 learned_addr learned my addr 172.21.15.102:0/2258423013 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:10.587 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.584+0000 7fdd27fff640 1 --2- 172.21.15.102:0/2258423013 >> v2:172.21.15.102:3300/0 conn(0x7fdd280afee0 0x7fdd280b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:10.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.585+0000 7fdd26ffd640 1 --2- 172.21.15.102:0/2258423013 >> v2:172.21.15.129:3300/0 conn(0x7fdd280cf730 0x7fdd280ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:10.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.585+0000 7fdd27fff640 1 -- 172.21.15.102:0/2258423013 >> v2:172.21.15.129:3300/0 conn(0x7fdd280cf730 msgr2=0x7fdd280ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:10.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.585+0000 7fdd27fff640 1 --2- 172.21.15.102:0/2258423013 >> v2:172.21.15.129:3300/0 conn(0x7fdd280cf730 0x7fdd280ce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:10.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.585+0000 7fdd27fff640 1 -- 172.21.15.102:0/2258423013 >> v1:172.21.15.102:6789/0 conn(0x7fdd2815b010 legacy=0x7fdd280cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:10.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.585+0000 7fdd27fff640 1 -- 172.21.15.102:0/2258423013 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd280ae550 con 0x7fdd280afee0 2023-10-14T09:38:10.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.585+0000 7fdd267fc640 1 -- 172.21.15.102:0/2258423013 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3877171954 0 0) 0x7fdd18001290 con 0x7fdd2815b010 2023-10-14T09:38:10.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.586+0000 7fdd27fff640 1 --2- 172.21.15.102:0/2258423013 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd280afee0 0x7fdd280b3920 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdd280ccd40 tx=0x7fdd2002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea059f8d064907f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:10.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.586+0000 7fdd267fc640 1 -- 172.21.15.102:0/2258423013 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd20030610 con 0x7fdd280afee0 2023-10-14T09:38:10.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.586+0000 7fdd267fc640 1 -- 172.21.15.102:0/2258423013 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd20030770 con 0x7fdd280afee0 2023-10-14T09:38:10.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.586+0000 7fdd267fc640 1 -- 172.21.15.102:0/2258423013 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd20030b00 con 0x7fdd280afee0 2023-10-14T09:38:10.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.587+0000 7fdd2dbc9640 1 -- 172.21.15.102:0/2258423013 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd280afee0 msgr2=0x7fdd280b3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:10.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.587+0000 7fdd2dbc9640 1 --2- 172.21.15.102:0/2258423013 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd280afee0 0x7fdd280b3920 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdd280ccd40 tx=0x7fdd2002b960 comp rx=0 tx=0).stop 2023-10-14T09:38:10.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.587+0000 7fdd2dbc9640 1 -- 172.21.15.102:0/2258423013 shutdown_connections 2023-10-14T09:38:10.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.587+0000 7fdd2dbc9640 1 --2- 172.21.15.102:0/2258423013 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd280afee0 0x7fdd280b3920 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:10.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.587+0000 7fdd2dbc9640 1 --2- 172.21.15.102:0/2258423013 >> v2:172.21.15.129:3300/0 conn(0x7fdd280cf730 0x7fdd280ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:10.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.587+0000 7fdd2dbc9640 1 -- 172.21.15.102:0/2258423013 >> 172.21.15.102:0/2258423013 conn(0x7fdd280d0ad0 msgr2=0x7fdd280d0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:10.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.587+0000 7fdd2dbc9640 1 -- 172.21.15.102:0/2258423013 shutdown_connections 2023-10-14T09:38:10.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.587+0000 7fdd2dbc9640 1 -- 172.21.15.102:0/2258423013 wait complete. 2023-10-14T09:38:10.594 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.589+0000 7fdd2dbc9640 1 Processor -- start 2023-10-14T09:38:10.595 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.589+0000 7fdd2dbc9640 1 -- start start 2023-10-14T09:38:10.595 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.590+0000 7fdd2dbc9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd280afee0 0x7fdd280b4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:10.595 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.590+0000 7fdd2dbc9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdd280cf730 0x7fdd281efdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:10.595 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.590+0000 7fdd2dbc9640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdd2815b010 0x7fdd280b5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:10.595 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.590+0000 7fdd2dbc9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd281f2a10 con 0x7fdd280afee0 2023-10-14T09:38:10.596 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.590+0000 7fdd2dbc9640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd280b6360 con 0x7fdd280cf730 2023-10-14T09:38:10.596 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.590+0000 7fdd2dbc9640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd281f2c40 con 0x7fdd2815b010 2023-10-14T09:38:10.596 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.590+0000 7fdd277fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd280afee0 0x7fdd280b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:10.596 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.590+0000 7fdd277fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd280afee0 0x7fdd280b4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41918/0 (socket says 172.21.15.102:41918) 2023-10-14T09:38:10.596 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.590+0000 7fdd277fe640 1 -- 172.21.15.102:0/2268736768 learned_addr learned my addr 172.21.15.102:0/2268736768 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:10.597 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.590+0000 7fdd277fe640 1 -- 172.21.15.102:0/2268736768 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdd2815b010 msgr2=0x7fdd280b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:10.597 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.590+0000 7fdd277fe640 1 --2- 172.21.15.102:0/2268736768 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdd2815b010 0x7fdd280b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:10.597 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.590+0000 7fdd26ffd640 1 --2- 172.21.15.102:0/2268736768 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdd280cf730 0x7fdd281efdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:10.597 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.590+0000 7fdd277fe640 1 -- 172.21.15.102:0/2268736768 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdd280cf730 msgr2=0x7fdd281efdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:10.597 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.590+0000 7fdd277fe640 1 --2- 172.21.15.102:0/2268736768 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdd280cf730 0x7fdd281efdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:10.597 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.590+0000 7fdd277fe640 1 -- 172.21.15.102:0/2268736768 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd20009400 con 0x7fdd280afee0 2023-10-14T09:38:10.598 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.591+0000 7fdd277fe640 1 --2- 172.21.15.102:0/2268736768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd280afee0 0x7fdd280b4190 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdd180014f0 tx=0x7fdd1800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:10.598 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.591+0000 7fdd1ffff640 1 -- 172.21.15.102:0/2268736768 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd18007480 con 0x7fdd280afee0 2023-10-14T09:38:10.598 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.591+0000 7fdd1ffff640 1 -- 172.21.15.102:0/2268736768 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd18007600 con 0x7fdd280afee0 2023-10-14T09:38:10.598 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.591+0000 7fdd1ffff640 1 -- 172.21.15.102:0/2268736768 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd180059e0 con 0x7fdd280afee0 2023-10-14T09:38:10.599 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.591+0000 7fdd2dbc9640 1 -- 172.21.15.102:0/2268736768 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd281f2f20 con 0x7fdd280afee0 2023-10-14T09:38:10.599 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.591+0000 7fdd2dbc9640 1 -- 172.21.15.102:0/2268736768 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd281f0310 con 0x7fdd280afee0 2023-10-14T09:38:10.599 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.592+0000 7fdd2dbc9640 1 -- 172.21.15.102:0/2268736768 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd281f3440 con 0x7fdd280afee0 2023-10-14T09:38:10.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.593+0000 7fdd1ffff640 1 -- 172.21.15.102:0/2268736768 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdd18005b40 con 0x7fdd280afee0 2023-10-14T09:38:10.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.594+0000 7fdd1ffff640 1 --2- 172.21.15.102:0/2268736768 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fdd0c06aec0 0x7fdd0c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:10.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.594+0000 7fdd1ffff640 1 -- 172.21.15.102:0/2268736768 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fdd18088b40 con 0x7fdd280afee0 2023-10-14T09:38:10.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.594+0000 7fdd26ffd640 1 --2- 172.21.15.102:0/2268736768 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fdd0c06aec0 0x7fdd0c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:10.601 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.595+0000 7fdd26ffd640 1 --2- 172.21.15.102:0/2268736768 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fdd0c06aec0 0x7fdd0c06d380 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdd280b46d0 tx=0x7fdd10008440 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:10.601 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.598+0000 7fdd1ffff640 1 -- 172.21.15.102:0/2268736768 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdd281f3440 con 0x7fdd280afee0 2023-10-14T09:38:10.790 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.788+0000 7fdd2dbc9640 1 -- 172.21.15.102:0/2268736768 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd281f3440 con 0x7fdd280afee0 2023-10-14T09:38:10.793 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.791+0000 7fdd1ffff640 1 -- 172.21.15.102:0/2268736768 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16838 (secure 0 0 0) 0x7fdd281f3440 con 0x7fdd280afee0 2023-10-14T09:38:10.793 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:38:10.794 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":24,"fsid":"8a6cd69d-7f5b-4f2a-806a-0176c10aed50","created":"2023-10-14T09:36:56.745172+0000","modified":"2023-10-14T09:38:03.788214+0000","last_up_change":"2023-10-14T09:37:09.791473+0000","last_in_change":"2023-10-14T09:37:00.547186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:37:09.952407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:37:19.560925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:37:20.363385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e5aef8f3-878f-482b-b522-9a5b958b90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6801","nonce":1727250718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6803","nonce":1727250718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6807","nonce":1727250718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6805","nonce":1727250718}]},"public_addr":"172.21.15.102:6801/1727250718","cluster_addr":"172.21.15.102:6803/1727250718","heartbeat_back_addr":"172.21.15.102:6807/1727250718","heartbeat_front_addr":"172.21.15.102:6805/1727250718","state":["exists","up"]},{"osd":1,"uuid":"4a8cf50e-387b-4d47-9588-bd22e375a9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6809","nonce":1095651107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6811","nonce":1095651107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6815","nonce":1095651107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6813","nonce":1095651107}]},"public_addr":"172.21.15.102:6809/1095651107","cluster_addr":"172.21.15.102:6811/1095651107","heartbeat_back_addr":"172.21.15.102:6815/1095651107","heartbeat_front_addr":"172.21.15.102:6813/1095651107","state":["exists","up"]},{"osd":2,"uuid":"009ef55f-8a63-4219-bacd-d7c7b4500867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6820","nonce":2198222556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6825","nonce":2198222556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6831","nonce":2198222556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6829","nonce":2198222556}]},"public_addr":"172.21.15.102:6820/2198222556","cluster_addr":"172.21.15.102:6825/2198222556","heartbeat_back_addr":"172.21.15.102:6831/2198222556","heartbeat_front_addr":"172.21.15.102:6829/2198222556","state":["exists","up"]},{"osd":3,"uuid":"f2110eae-2ff9-4ed9-93d6-bd2361618211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6818","nonce":654726740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6821","nonce":654726740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6827","nonce":654726740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6823","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6824","nonce":654726740}]},"public_addr":"172.21.15.102:6818/654726740","cluster_addr":"172.21.15.102:6821/654726740","heartbeat_back_addr":"172.21.15.102:6827/654726740","heartbeat_front_addr":"172.21.15.102:6824/654726740","state":["exists","up"]},{"osd":4,"uuid":"33f1ae34-3100-40f7-9cb8-0eca2b358693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6817","nonce":507586170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6819","nonce":507586170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6823","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6825","nonce":507586170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6821","nonce":507586170}]},"public_addr":"172.21.15.129:6817/507586170","cluster_addr":"172.21.15.129:6819/507586170","heartbeat_back_addr":"172.21.15.129:6825/507586170","heartbeat_front_addr":"172.21.15.129:6821/507586170","state":["exists","up"]},{"osd":5,"uuid":"fab2fc62-3f3e-450d-93e0-770f39e80710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6801","nonce":1913451073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6803","nonce":1913451073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6807","nonce":1913451073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6805","nonce":1913451073}]},"public_addr":"172.21.15.129:6801/1913451073","cluster_addr":"172.21.15.129:6803/1913451073","heartbeat_back_addr":"172.21.15.129:6807/1913451073","heartbeat_front_addr":"172.21.15.129:6805/1913451073","state":["exists","up"]},{"osd":6,"uuid":"d7cc1d69-92e7-4253-a127-cfc0444a4809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6809","nonce":2853291511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6811","nonce":2853291511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6815","nonce":2853291511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6813","nonce":2853291511}]},"public_addr":"172.21.15.129:6809/2853291511","cluster_addr":"172.21.15.129:6811/2853291511","heartbeat_back_addr":"172.21.15.129:6815/2853291511","heartbeat_front_addr":"172.21.15.129:6813/2853291511","state":["exists","up"]},{"osd":7,"uuid":"1e403de1-09e2-4370-b9a7-e790ac44bbee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6824","nonce":2933886914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6827","nonce":2933886914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6831","nonce":2933886914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6829","nonce":2933886914}]},"public_addr":"172.21.15.129:6824/2933886914","cluster_addr":"172.21.15.129:6827/2933886914","heartbeat_back_addr":"172.21.15.129:6831/2933886914","heartbeat_front_addr":"172.21.15.129:6829/2933886914","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.849661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.868113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.933488+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.891794+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.901861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.858750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.911712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.996765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:38:10.796 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.793+0000 7fdd2dbc9640 1 -- 172.21.15.102:0/2268736768 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fdd0c06aec0 msgr2=0x7fdd0c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:10.796 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.793+0000 7fdd2dbc9640 1 --2- 172.21.15.102:0/2268736768 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fdd0c06aec0 0x7fdd0c06d380 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdd280b46d0 tx=0x7fdd10008440 comp rx=0 tx=0).stop 2023-10-14T09:38:10.796 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.793+0000 7fdd2dbc9640 1 -- 172.21.15.102:0/2268736768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd280afee0 msgr2=0x7fdd280b4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:10.796 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.793+0000 7fdd2dbc9640 1 --2- 172.21.15.102:0/2268736768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd280afee0 0x7fdd280b4190 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdd180014f0 tx=0x7fdd1800c960 comp rx=0 tx=0).stop 2023-10-14T09:38:10.797 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.794+0000 7fdd2dbc9640 1 -- 172.21.15.102:0/2268736768 shutdown_connections 2023-10-14T09:38:10.797 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.794+0000 7fdd2dbc9640 1 --2- 172.21.15.102:0/2268736768 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fdd0c06aec0 0x7fdd0c06d380 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:10.797 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.794+0000 7fdd2dbc9640 1 --2- 172.21.15.102:0/2268736768 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdd2815b010 0x7fdd280b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:10.797 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.794+0000 7fdd2dbc9640 1 --2- 172.21.15.102:0/2268736768 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdd280cf730 0x7fdd281efdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:10.797 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.794+0000 7fdd2dbc9640 1 --2- 172.21.15.102:0/2268736768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd280afee0 0x7fdd280b4190 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:10.797 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.794+0000 7fdd2dbc9640 1 -- 172.21.15.102:0/2268736768 >> 172.21.15.102:0/2268736768 conn(0x7fdd280d0ad0 msgr2=0x7fdd280cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:10.798 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.794+0000 7fdd2dbc9640 1 -- 172.21.15.102:0/2268736768 shutdown_connections 2023-10-14T09:38:10.798 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:10.794+0000 7fdd2dbc9640 1 -- 172.21.15.102:0/2268736768 wait complete. 2023-10-14T09:38:10.815 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T09:37:09.952407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T09:37:19.560925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T09:37:20.363385+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T09:38:10.816 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T09:38:11.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.031+0000 7fc5ca64f640 1 Processor -- start 2023-10-14T09:38:11.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.031+0000 7fc5ca64f640 1 -- start start 2023-10-14T09:38:11.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.032+0000 7fc5ca64f640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc5c415ad70 0x7fc5c4069da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:11.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.032+0000 7fc5ca64f640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fc5c40c9ca0 0x7fc5c406a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:11.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.032+0000 7fc5ca64f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc5c40ca3b0 0x7fc5c40ca840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:11.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.032+0000 7fc5ca64f640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5c40cad80 con 0x7fc5c40ca3b0 2023-10-14T09:38:11.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.032+0000 7fc5ca64f640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5c40cb030 con 0x7fc5c40c9ca0 2023-10-14T09:38:11.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.032+0000 7fc5ca64f640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c40c91c0 con 0x7fc5c415ad70 2023-10-14T09:38:11.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.032+0000 7fc5c8bec640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc5c40ca3b0 0x7fc5c40ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:11.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.032+0000 7fc5c8bec640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc5c40ca3b0 0x7fc5c40ca840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41926/0 (socket says 172.21.15.102:41926) 2023-10-14T09:38:11.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.032+0000 7fc5c8bec640 1 -- 172.21.15.102:0/127282945 learned_addr learned my addr 172.21.15.102:0/127282945 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:11.037 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.033+0000 7fc5c8bec640 1 -- 172.21.15.102:0/127282945 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc5c415ad70 msgr2=0x7fc5c4069da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:11.037 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.033+0000 7fc5c8bec640 1 --2- 172.21.15.102:0/127282945 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc5c415ad70 0x7fc5c4069da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:11.037 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.033+0000 7fc5c8bec640 1 -- 172.21.15.102:0/127282945 >> v2:172.21.15.129:3300/0 conn(0x7fc5c40c9ca0 msgr2=0x7fc5c406a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:11.038 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.033+0000 7fc5c8bec640 1 --2- 172.21.15.102:0/127282945 >> v2:172.21.15.129:3300/0 conn(0x7fc5c40c9ca0 0x7fc5c406a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:11.038 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.033+0000 7fc5c8bec640 1 -- 172.21.15.102:0/127282945 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c40c94a0 con 0x7fc5c40ca3b0 2023-10-14T09:38:11.038 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.034+0000 7fc5c8bec640 1 --2- 172.21.15.102:0/127282945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5c40ca3b0 0x7fc5c40ca840 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc5c406af00 tx=0x7fc5bc02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f6a0209b3d4b22 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:11.038 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.034+0000 7fc5c37fe640 1 -- 172.21.15.102:0/127282945 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc02ca80 con 0x7fc5c40ca3b0 2023-10-14T09:38:11.038 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.034+0000 7fc5c37fe640 1 -- 172.21.15.102:0/127282945 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5bc02cbe0 con 0x7fc5c40ca3b0 2023-10-14T09:38:11.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.034+0000 7fc5c37fe640 1 -- 172.21.15.102:0/127282945 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc0343f0 con 0x7fc5c40ca3b0 2023-10-14T09:38:11.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.035+0000 7fc5ca64f640 1 -- 172.21.15.102:0/127282945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5c40ca3b0 msgr2=0x7fc5c40ca840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:11.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.035+0000 7fc5ca64f640 1 --2- 172.21.15.102:0/127282945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5c40ca3b0 0x7fc5c40ca840 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc5c406af00 tx=0x7fc5bc02bee0 comp rx=0 tx=0).stop 2023-10-14T09:38:11.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.035+0000 7fc5ca64f640 1 -- 172.21.15.102:0/127282945 shutdown_connections 2023-10-14T09:38:11.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.035+0000 7fc5ca64f640 1 --2- 172.21.15.102:0/127282945 >> v2:172.21.15.129:3300/0 conn(0x7fc5c40c9ca0 0x7fc5c406a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:11.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.035+0000 7fc5ca64f640 1 --2- 172.21.15.102:0/127282945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5c40ca3b0 0x7fc5c40ca840 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:11.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.035+0000 7fc5ca64f640 1 --2- 172.21.15.102:0/127282945 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc5c415ad70 0x7fc5c4069da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:11.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.035+0000 7fc5ca64f640 1 -- 172.21.15.102:0/127282945 >> 172.21.15.102:0/127282945 conn(0x7fc5c40ce9b0 msgr2=0x7fc5c40cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:11.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.035+0000 7fc5ca64f640 1 -- 172.21.15.102:0/127282945 shutdown_connections 2023-10-14T09:38:11.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.035+0000 7fc5ca64f640 1 -- 172.21.15.102:0/127282945 wait complete. 2023-10-14T09:38:11.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.037+0000 7fc5ca64f640 1 Processor -- start 2023-10-14T09:38:11.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.037+0000 7fc5ca64f640 1 -- start start 2023-10-14T09:38:11.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.038+0000 7fc5ca64f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5c40c9ca0 0x7fc5c41f6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:11.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.038+0000 7fc5ca64f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5c40ca3b0 0x7fc5c415d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:11.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.038+0000 7fc5ca64f640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc5c415ad70 0x7fc5c414e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:11.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.038+0000 7fc5ca64f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c414f550 con 0x7fc5c40c9ca0 2023-10-14T09:38:11.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.038+0000 7fc5ca64f640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c414f270 con 0x7fc5c40ca3b0 2023-10-14T09:38:11.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.038+0000 7fc5ca64f640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c41f5ad0 con 0x7fc5c415ad70 2023-10-14T09:38:11.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.038+0000 7fc5c3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5c40c9ca0 0x7fc5c41f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:11.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.038+0000 7fc5c3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5c40c9ca0 0x7fc5c41f6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41938/0 (socket says 172.21.15.102:41938) 2023-10-14T09:38:11.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.038+0000 7fc5c3fff640 1 -- 172.21.15.102:0/4103953723 learned_addr learned my addr 172.21.15.102:0/4103953723 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:11.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.039+0000 7fc5bbfff640 1 --2- 172.21.15.102:0/4103953723 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5c40ca3b0 0x7fc5c415d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:11.046 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.039+0000 7fc5c3fff640 1 -- 172.21.15.102:0/4103953723 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc5c415ad70 msgr2=0x7fc5c414e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:11.046 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.039+0000 7fc5c3fff640 1 --2- 172.21.15.102:0/4103953723 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc5c415ad70 0x7fc5c414e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:11.046 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.039+0000 7fc5c3fff640 1 -- 172.21.15.102:0/4103953723 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5c40ca3b0 msgr2=0x7fc5c415d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:11.046 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.039+0000 7fc5c3fff640 1 --2- 172.21.15.102:0/4103953723 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5c40ca3b0 0x7fc5c415d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:11.046 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.039+0000 7fc5c3fff640 1 -- 172.21.15.102:0/4103953723 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5bc009b30 con 0x7fc5c40c9ca0 2023-10-14T09:38:11.047 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.039+0000 7fc5bbfff640 1 --2- 172.21.15.102:0/4103953723 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5c40ca3b0 0x7fc5c415d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:11.047 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.039+0000 7fc5c3fff640 1 --2- 172.21.15.102:0/4103953723 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5c40c9ca0 0x7fc5c41f6590 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc5b400b410 tx=0x7fc5b400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:11.047 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.039+0000 7fc5c17fa640 1 -- 172.21.15.102:0/4103953723 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4011830 con 0x7fc5c40c9ca0 2023-10-14T09:38:11.047 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.039+0000 7fc5c17fa640 1 -- 172.21.15.102:0/4103953723 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b40119b0 con 0x7fc5c40c9ca0 2023-10-14T09:38:11.048 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.039+0000 7fc5ca64f640 1 -- 172.21.15.102:0/4103953723 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5c41f5db0 con 0x7fc5c40c9ca0 2023-10-14T09:38:11.048 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.039+0000 7fc5c17fa640 1 -- 172.21.15.102:0/4103953723 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4011d60 con 0x7fc5c40c9ca0 2023-10-14T09:38:11.048 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.039+0000 7fc5ca64f640 1 -- 172.21.15.102:0/4103953723 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c415dc90 con 0x7fc5c40c9ca0 2023-10-14T09:38:11.048 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.041+0000 7fc5ca64f640 1 -- 172.21.15.102:0/4103953723 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5c404e160 con 0x7fc5c40c9ca0 2023-10-14T09:38:11.048 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.041+0000 7fc5c17fa640 1 -- 172.21.15.102:0/4103953723 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc5b401a400 con 0x7fc5c40c9ca0 2023-10-14T09:38:11.049 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.043+0000 7fc5c17fa640 1 --2- 172.21.15.102:0/4103953723 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc5a406ae70 0x7fc5a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:11.049 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.043+0000 7fc5c17fa640 1 -- 172.21.15.102:0/4103953723 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fc5b40897b0 con 0x7fc5c40c9ca0 2023-10-14T09:38:11.050 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.043+0000 7fc5bbfff640 1 --2- 172.21.15.102:0/4103953723 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc5a406ae70 0x7fc5a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:11.050 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.044+0000 7fc5bbfff640 1 --2- 172.21.15.102:0/4103953723 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc5a406ae70 0x7fc5a406d330 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac006fd0 tx=0x7fc5ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:11.050 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.047+0000 7fc5c17fa640 1 -- 172.21.15.102:0/4103953723 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc5b4054860 con 0x7fc5c40c9ca0 2023-10-14T09:38:11.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.237+0000 7fc5ca64f640 1 -- 172.21.15.102:0/4103953723 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc5c40afea0 con 0x7fc5c40c9ca0 2023-10-14T09:38:11.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.238+0000 7fc5c17fa640 1 -- 172.21.15.102:0/4103953723 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc5b40150a0 con 0x7fc5c40c9ca0 2023-10-14T09:38:11.240 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2023-10-14T09:38:11.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.240+0000 7fc5ca64f640 1 -- 172.21.15.102:0/4103953723 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc5a406ae70 msgr2=0x7fc5a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:11.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.240+0000 7fc5ca64f640 1 --2- 172.21.15.102:0/4103953723 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc5a406ae70 0x7fc5a406d330 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac006fd0 tx=0x7fc5ac008040 comp rx=0 tx=0).stop 2023-10-14T09:38:11.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.240+0000 7fc5ca64f640 1 -- 172.21.15.102:0/4103953723 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5c40c9ca0 msgr2=0x7fc5c41f6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:11.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.240+0000 7fc5ca64f640 1 --2- 172.21.15.102:0/4103953723 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5c40c9ca0 0x7fc5c41f6590 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc5b400b410 tx=0x7fc5b400b8d0 comp rx=0 tx=0).stop 2023-10-14T09:38:11.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.241+0000 7fc5ca64f640 1 -- 172.21.15.102:0/4103953723 shutdown_connections 2023-10-14T09:38:11.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.241+0000 7fc5ca64f640 1 --2- 172.21.15.102:0/4103953723 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc5a406ae70 0x7fc5a406d330 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:11.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.241+0000 7fc5ca64f640 1 --2- 172.21.15.102:0/4103953723 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc5c415ad70 0x7fc5c414e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:11.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.241+0000 7fc5ca64f640 1 --2- 172.21.15.102:0/4103953723 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5c40ca3b0 0x7fc5c415d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:11.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.241+0000 7fc5ca64f640 1 --2- 172.21.15.102:0/4103953723 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5c40c9ca0 0x7fc5c41f6590 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:11.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.241+0000 7fc5ca64f640 1 -- 172.21.15.102:0/4103953723 >> 172.21.15.102:0/4103953723 conn(0x7fc5c40ce9b0 msgr2=0x7fc5c40c2470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:11.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.241+0000 7fc5ca64f640 1 -- 172.21.15.102:0/4103953723 shutdown_connections 2023-10-14T09:38:11.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.241+0000 7fc5ca64f640 1 -- 172.21.15.102:0/4103953723 wait complete. 2023-10-14T09:38:11.261 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T09:38:11.479 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.477+0000 7f7ee2f6e640 1 Processor -- start 2023-10-14T09:38:11.479 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.478+0000 7f7ee2f6e640 1 -- start start 2023-10-14T09:38:11.482 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.479+0000 7f7ee2f6e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7edc15ad70 0x7f7edc069da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:11.482 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.479+0000 7f7ee2f6e640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7edc0c9ca0 0x7f7edc06a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:11.482 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.479+0000 7f7ee2f6e640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f7edc0ca3b0 0x7f7edc0ca840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:11.482 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.479+0000 7f7ee2f6e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7edc0cad80 con 0x7f7edc15ad70 2023-10-14T09:38:11.483 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.479+0000 7f7ee2f6e640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7edc0cb030 con 0x7f7edc0ca3b0 2023-10-14T09:38:11.483 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.479+0000 7f7ee2f6e640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc0c91c0 con 0x7f7edc0c9ca0 2023-10-14T09:38:11.483 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.479+0000 7f7ee0d0a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7edc15ad70 0x7f7edc069da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:11.483 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.480+0000 7f7ee0d0a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7edc15ad70 0x7f7edc069da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41944/0 (socket says 172.21.15.102:41944) 2023-10-14T09:38:11.483 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.480+0000 7f7ee0d0a640 1 -- 172.21.15.102:0/2551244940 learned_addr learned my addr 172.21.15.102:0/2551244940 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:11.483 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.480+0000 7f7ee150b640 1 --2- 172.21.15.102:0/2551244940 >> v2:172.21.15.129:3300/0 conn(0x7f7edc0ca3b0 0x7f7edc0ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:11.484 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.480+0000 7f7edbfff640 1 --2- 172.21.15.102:0/2551244940 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7edc0c9ca0 0x7f7edc06a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:11.484 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.480+0000 7f7ee0d0a640 1 -- 172.21.15.102:0/2551244940 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7edc0c9ca0 msgr2=0x7f7edc06a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:11.484 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.480+0000 7f7ee0d0a640 1 --2- 172.21.15.102:0/2551244940 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7edc0c9ca0 0x7f7edc06a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:11.484 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.480+0000 7f7ee0d0a640 1 -- 172.21.15.102:0/2551244940 >> v2:172.21.15.129:3300/0 conn(0x7f7edc0ca3b0 msgr2=0x7f7edc0ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:11.484 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.480+0000 7f7ee0d0a640 1 --2- 172.21.15.102:0/2551244940 >> v2:172.21.15.129:3300/0 conn(0x7f7edc0ca3b0 0x7f7edc0ca840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:11.484 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.480+0000 7f7ee0d0a640 1 -- 172.21.15.102:0/2551244940 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7edc0c94a0 con 0x7f7edc15ad70 2023-10-14T09:38:11.485 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.480+0000 7f7ee150b640 1 --2- 172.21.15.102:0/2551244940 >> v2:172.21.15.129:3300/0 conn(0x7f7edc0ca3b0 0x7f7edc0ca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:11.486 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.481+0000 7f7ee0d0a640 1 --2- 172.21.15.102:0/2551244940 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7edc15ad70 0x7f7edc069da0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7edc0cf820 tx=0x7f7ecc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b276b85256a64399 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:11.486 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.481+0000 7f7edb7fe640 1 -- 172.21.15.102:0/2551244940 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc02ca70 con 0x7f7edc15ad70 2023-10-14T09:38:11.487 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.482+0000 7f7edb7fe640 1 -- 172.21.15.102:0/2551244940 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ecc02cbd0 con 0x7f7edc15ad70 2023-10-14T09:38:11.487 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.482+0000 7f7edb7fe640 1 -- 172.21.15.102:0/2551244940 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc0343f0 con 0x7f7edc15ad70 2023-10-14T09:38:11.487 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.482+0000 7f7ee2f6e640 1 -- 172.21.15.102:0/2551244940 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7edc15ad70 msgr2=0x7f7edc069da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:11.487 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.482+0000 7f7ee2f6e640 1 --2- 172.21.15.102:0/2551244940 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7edc15ad70 0x7f7edc069da0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7edc0cf820 tx=0x7f7ecc02bed0 comp rx=0 tx=0).stop 2023-10-14T09:38:11.487 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.482+0000 7f7ee2f6e640 1 -- 172.21.15.102:0/2551244940 shutdown_connections 2023-10-14T09:38:11.487 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.482+0000 7f7ee2f6e640 1 --2- 172.21.15.102:0/2551244940 >> v2:172.21.15.129:3300/0 conn(0x7f7edc0ca3b0 0x7f7edc0ca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:11.488 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.482+0000 7f7ee2f6e640 1 --2- 172.21.15.102:0/2551244940 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7edc0c9ca0 0x7f7edc06a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:11.488 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.482+0000 7f7ee2f6e640 1 --2- 172.21.15.102:0/2551244940 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7edc15ad70 0x7f7edc069da0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:11.488 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.482+0000 7f7ee2f6e640 1 -- 172.21.15.102:0/2551244940 >> 172.21.15.102:0/2551244940 conn(0x7f7edc0ce9b0 msgr2=0x7f7edc0cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:11.488 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.482+0000 7f7ee2f6e640 1 -- 172.21.15.102:0/2551244940 shutdown_connections 2023-10-14T09:38:11.488 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.482+0000 7f7ee2f6e640 1 -- 172.21.15.102:0/2551244940 wait complete. 2023-10-14T09:38:11.489 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.484+0000 7f7ee2f6e640 1 Processor -- start 2023-10-14T09:38:11.489 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.485+0000 7f7ee2f6e640 1 -- start start 2023-10-14T09:38:11.491 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.486+0000 7f7ee2f6e640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7edc0c9ca0 0x7f7edc0ad8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:11.491 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.486+0000 7f7ee2f6e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7edc0ca3b0 0x7f7edc0aef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:11.491 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.486+0000 7f7ee2f6e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7edc15ad70 0x7f7edc1f6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:11.492 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.486+0000 7f7ee2f6e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc1f67b0 con 0x7f7edc15ad70 2023-10-14T09:38:11.492 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.486+0000 7f7ee2f6e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc0adec0 con 0x7f7edc0ca3b0 2023-10-14T09:38:11.492 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.486+0000 7f7ee2f6e640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc0ae1a0 con 0x7f7edc0c9ca0 2023-10-14T09:38:11.492 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.486+0000 7f7ee150b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7edc15ad70 0x7f7edc1f6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:11.492 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.486+0000 7f7ee150b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7edc15ad70 0x7f7edc1f6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41950/0 (socket says 172.21.15.102:41950) 2023-10-14T09:38:11.493 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.486+0000 7f7ee150b640 1 -- 172.21.15.102:0/3956321233 learned_addr learned my addr 172.21.15.102:0/3956321233 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:11.493 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.486+0000 7f7edbfff640 1 --2- 172.21.15.102:0/3956321233 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7edc0ca3b0 0x7f7edc0aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:11.493 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.486+0000 7f7ee0d0a640 1 --2- 172.21.15.102:0/3956321233 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7edc0c9ca0 0x7f7edc0ad8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:11.493 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.486+0000 7f7ee150b640 1 -- 172.21.15.102:0/3956321233 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7edc0c9ca0 msgr2=0x7f7edc0ad8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:11.493 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.486+0000 7f7ee150b640 1 --2- 172.21.15.102:0/3956321233 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7edc0c9ca0 0x7f7edc0ad8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:11.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.486+0000 7f7ee150b640 1 -- 172.21.15.102:0/3956321233 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7edc0ca3b0 msgr2=0x7f7edc0aef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:11.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.486+0000 7f7ee150b640 1 --2- 172.21.15.102:0/3956321233 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7edc0ca3b0 0x7f7edc0aef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:11.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.487+0000 7f7ee150b640 1 -- 172.21.15.102:0/3956321233 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ecc009b30 con 0x7f7edc15ad70 2023-10-14T09:38:11.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.487+0000 7f7edbfff640 1 --2- 172.21.15.102:0/3956321233 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7edc0ca3b0 0x7f7edc0aef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:11.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.487+0000 7f7ee0d0a640 1 --2- 172.21.15.102:0/3956321233 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7edc0c9ca0 0x7f7edc0ad8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:11.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.487+0000 7f7ee150b640 1 --2- 172.21.15.102:0/3956321233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7edc15ad70 0x7f7edc1f6270 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7ed400c7f0 tx=0x7f7ed400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:11.495 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.487+0000 7f7ed97fa640 1 -- 172.21.15.102:0/3956321233 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed4007820 con 0x7f7edc15ad70 2023-10-14T09:38:11.495 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.487+0000 7f7ed97fa640 1 -- 172.21.15.102:0/3956321233 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed4007980 con 0x7f7edc15ad70 2023-10-14T09:38:11.495 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.487+0000 7f7ee2f6e640 1 -- 172.21.15.102:0/3956321233 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7edc0ae480 con 0x7f7edc15ad70 2023-10-14T09:38:11.495 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.487+0000 7f7ed97fa640 1 -- 172.21.15.102:0/3956321233 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed4007d70 con 0x7f7edc15ad70 2023-10-14T09:38:11.495 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.487+0000 7f7ee2f6e640 1 -- 172.21.15.102:0/3956321233 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7edc0aea40 con 0x7f7edc15ad70 2023-10-14T09:38:11.496 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.488+0000 7f7ee2f6e640 1 -- 172.21.15.102:0/3956321233 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7edc0aec30 con 0x7f7edc15ad70 2023-10-14T09:38:11.496 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.489+0000 7f7ed97fa640 1 -- 172.21.15.102:0/3956321233 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7ed40113f0 con 0x7f7edc15ad70 2023-10-14T09:38:11.497 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.490+0000 7f7ed97fa640 1 --2- 172.21.15.102:0/3956321233 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f7ebc06aea0 0x7f7ebc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:11.497 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.490+0000 7f7ed97fa640 1 -- 172.21.15.102:0/3956321233 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f7ed4089a90 con 0x7f7edc15ad70 2023-10-14T09:38:11.497 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.490+0000 7f7ee0d0a640 1 --2- 172.21.15.102:0/3956321233 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f7ebc06aea0 0x7f7ebc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:11.497 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.491+0000 7f7ee0d0a640 1 --2- 172.21.15.102:0/3956321233 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f7ebc06aea0 0x7f7ebc06d360 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc035000 tx=0x7f7ecc030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:11.498 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.495+0000 7f7ed97fa640 1 -- 172.21.15.102:0/3956321233 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7ed4054a10 con 0x7f7edc15ad70 2023-10-14T09:38:11.690 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.689+0000 7f7ee2f6e640 1 -- 172.21.15.102:0/3956321233 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7edc04e160 con 0x7f7edc15ad70 2023-10-14T09:38:11.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.690+0000 7f7ed97fa640 1 -- 172.21.15.102:0/3956321233 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7ed401f020 con 0x7f7edc15ad70 2023-10-14T09:38:11.692 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2023-10-14T09:38:11.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.692+0000 7f7ee2f6e640 1 -- 172.21.15.102:0/3956321233 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f7ebc06aea0 msgr2=0x7f7ebc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:11.695 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.692+0000 7f7ee2f6e640 1 --2- 172.21.15.102:0/3956321233 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f7ebc06aea0 0x7f7ebc06d360 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc035000 tx=0x7f7ecc030000 comp rx=0 tx=0).stop 2023-10-14T09:38:11.695 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.692+0000 7f7ee2f6e640 1 -- 172.21.15.102:0/3956321233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7edc15ad70 msgr2=0x7f7edc1f6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:11.695 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.692+0000 7f7ee2f6e640 1 --2- 172.21.15.102:0/3956321233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7edc15ad70 0x7f7edc1f6270 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7ed400c7f0 tx=0x7f7ed400ccb0 comp rx=0 tx=0).stop 2023-10-14T09:38:11.695 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.692+0000 7f7ee2f6e640 1 -- 172.21.15.102:0/3956321233 shutdown_connections 2023-10-14T09:38:11.695 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.692+0000 7f7ee2f6e640 1 --2- 172.21.15.102:0/3956321233 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f7ebc06aea0 0x7f7ebc06d360 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:11.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.692+0000 7f7ee2f6e640 1 --2- 172.21.15.102:0/3956321233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7edc15ad70 0x7f7edc1f6270 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:11.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.692+0000 7f7ee2f6e640 1 --2- 172.21.15.102:0/3956321233 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7edc0ca3b0 0x7f7edc0aef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:11.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.692+0000 7f7ee2f6e640 1 --2- 172.21.15.102:0/3956321233 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7edc0c9ca0 0x7f7edc0ad8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:11.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.692+0000 7f7ee2f6e640 1 -- 172.21.15.102:0/3956321233 >> 172.21.15.102:0/3956321233 conn(0x7f7edc0ce9b0 msgr2=0x7f7edc0c7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:11.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.693+0000 7f7ee2f6e640 1 -- 172.21.15.102:0/3956321233 shutdown_connections 2023-10-14T09:38:11.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.693+0000 7f7ee2f6e640 1 -- 172.21.15.102:0/3956321233 wait complete. 2023-10-14T09:38:11.712 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T09:38:11.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.915+0000 7f0d5759e640 1 Processor -- start 2023-10-14T09:38:11.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.915+0000 7f0d5759e640 1 -- start start 2023-10-14T09:38:11.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.917+0000 7f0d5759e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0d5806c040 0x7f0d5806c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:11.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.917+0000 7f0d5759e640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0d580cda80 0x7f0d5815ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:11.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.917+0000 7f0d5759e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d5806c960 con 0x7f0d580ad970 2023-10-14T09:38:11.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.917+0000 7f0d5759e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d5815b9d0 con 0x7f0d5806c040 2023-10-14T09:38:11.920 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.917+0000 7f0d5759e640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5815bcb0 con 0x7f0d580cda80 2023-10-14T09:38:11.920 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.917+0000 7f0d5659c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0d5806c040 0x7f0d5806c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:11.920 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.917+0000 7f0d5659c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0d5806c040 0x7f0d5806c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37420/0 (socket says 172.21.15.102:37420) 2023-10-14T09:38:11.920 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.917+0000 7f0d4ffff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f0d580ad970 0x7f0d5815e680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:56904/0 (socket says 172.21.15.102:56904) 2023-10-14T09:38:11.920 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.917+0000 7f0d5659c640 1 -- 172.21.15.102:0/3391831186 learned_addr learned my addr 172.21.15.102:0/3391831186 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:11.922 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.917+0000 7f0d56d9d640 1 --2- 172.21.15.102:0/3391831186 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0d580cda80 0x7f0d5815ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:11.922 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.918+0000 7f0d5659c640 1 -- 172.21.15.102:0/3391831186 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0d580cda80 msgr2=0x7f0d5815ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:11.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.918+0000 7f0d5659c640 1 --2- 172.21.15.102:0/3391831186 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0d580cda80 0x7f0d5815ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:11.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.918+0000 7f0d5659c640 1 -- 172.21.15.102:0/3391831186 >> v1:172.21.15.102:6789/0 conn(0x7f0d580ad970 legacy=0x7f0d5815e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:11.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.918+0000 7f0d5659c640 1 -- 172.21.15.102:0/3391831186 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5815bf90 con 0x7f0d5806c040 2023-10-14T09:38:11.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.918+0000 7f0d55d9b640 1 -- 172.21.15.102:0/3391831186 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1274896918 0 0) 0x7f0d5806c960 con 0x7f0d580ad970 2023-10-14T09:38:11.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.918+0000 7f0d56d9d640 1 --2- 172.21.15.102:0/3391831186 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0d580cda80 0x7f0d5815ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:11.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.919+0000 7f0d5659c640 1 --2- 172.21.15.102:0/3391831186 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d5806c040 0x7f0d5806c420 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0d48009870 tx=0x7f0d4802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c211482470ec9df5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:11.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.919+0000 7f0d55d9b640 1 -- 172.21.15.102:0/3391831186 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d48030840 con 0x7f0d5806c040 2023-10-14T09:38:11.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.919+0000 7f0d55d9b640 1 -- 172.21.15.102:0/3391831186 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d480309a0 con 0x7f0d5806c040 2023-10-14T09:38:11.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.919+0000 7f0d55d9b640 1 -- 172.21.15.102:0/3391831186 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d48030d30 con 0x7f0d5806c040 2023-10-14T09:38:11.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.920+0000 7f0d5759e640 1 -- 172.21.15.102:0/3391831186 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d5806c040 msgr2=0x7f0d5806c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:11.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.920+0000 7f0d5759e640 1 --2- 172.21.15.102:0/3391831186 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d5806c040 0x7f0d5806c420 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0d48009870 tx=0x7f0d4802b980 comp rx=0 tx=0).stop 2023-10-14T09:38:11.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.920+0000 7f0d5759e640 1 -- 172.21.15.102:0/3391831186 shutdown_connections 2023-10-14T09:38:11.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.920+0000 7f0d5759e640 1 --2- 172.21.15.102:0/3391831186 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0d580cda80 0x7f0d5815ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:11.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.920+0000 7f0d5759e640 1 --2- 172.21.15.102:0/3391831186 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d5806c040 0x7f0d5806c420 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:11.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.920+0000 7f0d5759e640 1 -- 172.21.15.102:0/3391831186 >> 172.21.15.102:0/3391831186 conn(0x7f0d580ce6a0 msgr2=0x7f0d580ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:11.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.920+0000 7f0d5759e640 1 -- 172.21.15.102:0/3391831186 shutdown_connections 2023-10-14T09:38:11.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.920+0000 7f0d5759e640 1 -- 172.21.15.102:0/3391831186 wait complete. 2023-10-14T09:38:11.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.921+0000 7f0d5759e640 1 Processor -- start 2023-10-14T09:38:11.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.922+0000 7f0d5759e640 1 -- start start 2023-10-14T09:38:11.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.922+0000 7f0d5759e640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0d5806c040 0x7f0d580c2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:11.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.922+0000 7f0d5759e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d580ad970 0x7f0d58153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:11.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.922+0000 7f0d5759e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0d580cda80 0x7f0d5815c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:11.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.922+0000 7f0d5759e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d580c3440 con 0x7f0d580ad970 2023-10-14T09:38:11.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.922+0000 7f0d5759e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d580c21d0 con 0x7f0d580cda80 2023-10-14T09:38:11.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.923+0000 7f0d5759e640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d580c2a70 con 0x7f0d5806c040 2023-10-14T09:38:11.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.923+0000 7f0d4ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d580ad970 0x7f0d58153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:11.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.923+0000 7f0d4ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d580ad970 0x7f0d58153c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37430/0 (socket says 172.21.15.102:37430) 2023-10-14T09:38:11.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.923+0000 7f0d4ffff640 1 -- 172.21.15.102:0/2421132358 learned_addr learned my addr 172.21.15.102:0/2421132358 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:11.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.923+0000 7f0d56d9d640 1 --2- 172.21.15.102:0/2421132358 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0d580cda80 0x7f0d5815c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:11.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.923+0000 7f0d5659c640 1 --2- 172.21.15.102:0/2421132358 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0d5806c040 0x7f0d580c2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:11.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.923+0000 7f0d4ffff640 1 -- 172.21.15.102:0/2421132358 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0d5806c040 msgr2=0x7f0d580c2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:11.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.923+0000 7f0d4ffff640 1 --2- 172.21.15.102:0/2421132358 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0d5806c040 0x7f0d580c2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:11.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.923+0000 7f0d4ffff640 1 -- 172.21.15.102:0/2421132358 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0d580cda80 msgr2=0x7f0d5815c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:11.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.923+0000 7f0d4ffff640 1 --2- 172.21.15.102:0/2421132358 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0d580cda80 0x7f0d5815c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:11.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.923+0000 7f0d4ffff640 1 -- 172.21.15.102:0/2421132358 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d480094d0 con 0x7f0d580ad970 2023-10-14T09:38:11.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.924+0000 7f0d4ffff640 1 --2- 172.21.15.102:0/2421132358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d580ad970 0x7f0d58153c20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0d4000c4b0 tx=0x7f0d4000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:11.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.924+0000 7f0d4effd640 1 -- 172.21.15.102:0/2421132358 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d400074e0 con 0x7f0d580ad970 2023-10-14T09:38:11.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.924+0000 7f0d4effd640 1 -- 172.21.15.102:0/2421132358 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d40007660 con 0x7f0d580ad970 2023-10-14T09:38:11.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.924+0000 7f0d4effd640 1 -- 172.21.15.102:0/2421132358 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d40004a20 con 0x7f0d580ad970 2023-10-14T09:38:11.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.924+0000 7f0d5759e640 1 -- 172.21.15.102:0/2421132358 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d58154160 con 0x7f0d580ad970 2023-10-14T09:38:11.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.924+0000 7f0d5759e640 1 -- 172.21.15.102:0/2421132358 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d580c2420 con 0x7f0d580ad970 2023-10-14T09:38:11.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.925+0000 7f0d5759e640 1 -- 172.21.15.102:0/2421132358 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d5806b330 con 0x7f0d580ad970 2023-10-14T09:38:11.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.926+0000 7f0d4effd640 1 -- 172.21.15.102:0/2421132358 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0d40004b80 con 0x7f0d580ad970 2023-10-14T09:38:11.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.927+0000 7f0d4effd640 1 --2- 172.21.15.102:0/2421132358 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f0d3806ae70 0x7f0d3806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:11.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.927+0000 7f0d4effd640 1 -- 172.21.15.102:0/2421132358 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f0d400887e0 con 0x7f0d580ad970 2023-10-14T09:38:11.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.927+0000 7f0d5659c640 1 --2- 172.21.15.102:0/2421132358 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f0d3806ae70 0x7f0d3806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:11.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.928+0000 7f0d5659c640 1 --2- 172.21.15.102:0/2421132358 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f0d3806ae70 0x7f0d3806d330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0d48036000 tx=0x7f0d4803b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:11.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:11.932+0000 7f0d4effd640 1 -- 172.21.15.102:0/2421132358 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0d40053950 con 0x7f0d580ad970 2023-10-14T09:38:12.122 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.120+0000 7f0d5759e640 1 -- 172.21.15.102:0/2421132358 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0d5804e9b0 con 0x7f0d580ad970 2023-10-14T09:38:12.123 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.121+0000 7f0d4effd640 1 -- 172.21.15.102:0/2421132358 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0d40018020 con 0x7f0d580ad970 2023-10-14T09:38:12.123 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2023-10-14T09:38:12.125 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.123+0000 7f0d5759e640 1 -- 172.21.15.102:0/2421132358 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f0d3806ae70 msgr2=0x7f0d3806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:12.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.123+0000 7f0d5759e640 1 --2- 172.21.15.102:0/2421132358 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f0d3806ae70 0x7f0d3806d330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0d48036000 tx=0x7f0d4803b040 comp rx=0 tx=0).stop 2023-10-14T09:38:12.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.123+0000 7f0d5759e640 1 -- 172.21.15.102:0/2421132358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d580ad970 msgr2=0x7f0d58153c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:12.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.123+0000 7f0d5759e640 1 --2- 172.21.15.102:0/2421132358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d580ad970 0x7f0d58153c20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0d4000c4b0 tx=0x7f0d4000c970 comp rx=0 tx=0).stop 2023-10-14T09:38:12.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.123+0000 7f0d5759e640 1 -- 172.21.15.102:0/2421132358 shutdown_connections 2023-10-14T09:38:12.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.123+0000 7f0d5759e640 1 --2- 172.21.15.102:0/2421132358 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f0d3806ae70 0x7f0d3806d330 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:12.127 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.123+0000 7f0d5759e640 1 --2- 172.21.15.102:0/2421132358 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0d580cda80 0x7f0d5815c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:12.127 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.123+0000 7f0d5759e640 1 --2- 172.21.15.102:0/2421132358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d580ad970 0x7f0d58153c20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:12.127 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.123+0000 7f0d5759e640 1 --2- 172.21.15.102:0/2421132358 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0d5806c040 0x7f0d580c2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:12.127 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.123+0000 7f0d5759e640 1 -- 172.21.15.102:0/2421132358 >> 172.21.15.102:0/2421132358 conn(0x7f0d580ce6a0 msgr2=0x7f0d5815db40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:12.127 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.123+0000 7f0d5759e640 1 -- 172.21.15.102:0/2421132358 shutdown_connections 2023-10-14T09:38:12.128 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.124+0000 7f0d5759e640 1 -- 172.21.15.102:0/2421132358 wait complete. 2023-10-14T09:38:12.144 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T09:38:12.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.351+0000 7f589b59e640 1 Processor -- start 2023-10-14T09:38:12.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.351+0000 7f589b59e640 1 -- start start 2023-10-14T09:38:12.355 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.353+0000 7f589b59e640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f589c15b320 0x7f589c0cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:12.355 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.353+0000 7f589b59e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f589c15b9d0 con 0x7f589c06c040 2023-10-14T09:38:12.355 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.353+0000 7f589b59e640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f589c15bcb0 con 0x7f589c0ad970 2023-10-14T09:38:12.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.353+0000 7f589b59e640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f589c15b7d0 con 0x7f589c15b320 2023-10-14T09:38:12.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.353+0000 7f589a59c640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f589c06c040 0x7f589c06c420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:56916/0 (socket says 172.21.15.102:56916) 2023-10-14T09:38:12.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.353+0000 7f589a59c640 1 -- 172.21.15.102:0/3737375735 learned_addr learned my addr 172.21.15.102:0/3737375735 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:12.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.353+0000 7f589ad9d640 1 --2- 172.21.15.102:0/3737375735 >> v2:172.21.15.129:3300/0 conn(0x7f589c15b320 0x7f589c0cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:12.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.353+0000 7f5899d9b640 1 -- 172.21.15.102:0/3737375735 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 552342354 0 0) 0x7f589c15b9d0 con 0x7f589c06c040 2023-10-14T09:38:12.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.353+0000 7f5899d9b640 1 -- 172.21.15.102:0/3737375735 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5888003520 con 0x7f589c06c040 2023-10-14T09:38:12.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.354+0000 7f5899d9b640 1 -- 172.21.15.102:0/3737375735 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1787991120 0 0) 0x7f5888003520 con 0x7f589c06c040 2023-10-14T09:38:12.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.354+0000 7f5899d9b640 1 -- 172.21.15.102:0/3737375735 >> v2:172.21.15.129:3300/0 conn(0x7f589c15b320 msgr2=0x7f589c0cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:12.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.354+0000 7f5899d9b640 1 --2- 172.21.15.102:0/3737375735 >> v2:172.21.15.129:3300/0 conn(0x7f589c15b320 0x7f589c0cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:12.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.354+0000 7f5899d9b640 1 -- 172.21.15.102:0/3737375735 >> v1:172.21.15.129:6789/0 conn(0x7f589c0ad970 legacy=0x7f589c0cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:12.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.354+0000 7f5899d9b640 1 -- 172.21.15.102:0/3737375735 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f589c15bf90 con 0x7f589c06c040 2023-10-14T09:38:12.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.354+0000 7f5899d9b640 1 -- 172.21.15.102:0/3737375735 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4030661168 0 0) 0x7f588c001670 con 0x7f589c06c040 2023-10-14T09:38:12.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.354+0000 7f5899d9b640 1 -- 172.21.15.102:0/3737375735 >> v1:172.21.15.102:6789/0 conn(0x7f589c06c040 legacy=0x7f589c06c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:12.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.354+0000 7f5899d9b640 1 --2- 172.21.15.102:0/3737375735 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f58880039a0 0x7f5888003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:12.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.354+0000 7f5899d9b640 1 --2- 172.21.15.102:0/3737375735 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f58880047c0 0x7f5888004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:12.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.354+0000 7f5899d9b640 1 --2- 172.21.15.102:0/3737375735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5888005180 0x7f588800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:12.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.354+0000 7f5899d9b640 1 -- 172.21.15.102:0/3737375735 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589c15b7d0 con 0x7f5888005180 2023-10-14T09:38:12.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.354+0000 7f5899d9b640 1 -- 172.21.15.102:0/3737375735 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588800c050 con 0x7f58880039a0 2023-10-14T09:38:12.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.354+0000 7f5899d9b640 1 -- 172.21.15.102:0/3737375735 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f588800c210 con 0x7f58880047c0 2023-10-14T09:38:12.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.354+0000 7f589ad9d640 1 --2- 172.21.15.102:0/3737375735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5888005180 0x7f588800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:12.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.354+0000 7f589a59c640 1 --2- 172.21.15.102:0/3737375735 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f58880039a0 0x7f5888003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:12.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.355+0000 7f589ad9d640 1 -- 172.21.15.102:0/3737375735 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f58880047c0 msgr2=0x7f5888004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:12.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.355+0000 7f5893fff640 1 --2- 172.21.15.102:0/3737375735 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f58880047c0 0x7f5888004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:12.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.355+0000 7f589ad9d640 1 --2- 172.21.15.102:0/3737375735 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f58880047c0 0x7f5888004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:12.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.355+0000 7f589ad9d640 1 -- 172.21.15.102:0/3737375735 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f58880039a0 msgr2=0x7f5888003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:12.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.355+0000 7f589ad9d640 1 --2- 172.21.15.102:0/3737375735 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f58880039a0 0x7f5888003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:12.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.355+0000 7f589ad9d640 1 -- 172.21.15.102:0/3737375735 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5888003520 con 0x7f5888005180 2023-10-14T09:38:12.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.355+0000 7f5893fff640 1 --2- 172.21.15.102:0/3737375735 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f58880047c0 0x7f5888004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:12.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.356+0000 7f589ad9d640 1 -- 172.21.15.102:0/3737375735 reap_dead start 2023-10-14T09:38:12.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.356+0000 7f589ad9d640 1 --2- 172.21.15.102:0/3737375735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5888005180 0x7f588800b980 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5894009fc0 tx=0x7f58880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25dc8e73cea6f205 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:12.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.356+0000 7f5899d9b640 1 -- 172.21.15.102:0/3737375735 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589402cc50 con 0x7f5888005180 2023-10-14T09:38:12.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.356+0000 7f5899d9b640 1 -- 172.21.15.102:0/3737375735 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589400f040 con 0x7f5888005180 2023-10-14T09:38:12.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.356+0000 7f5899d9b640 1 -- 172.21.15.102:0/3737375735 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5894003990 con 0x7f5888005180 2023-10-14T09:38:12.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.357+0000 7f589b59e640 1 -- 172.21.15.102:0/3737375735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5888005180 msgr2=0x7f588800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:12.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.357+0000 7f589b59e640 1 --2- 172.21.15.102:0/3737375735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5888005180 0x7f588800b980 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5894009fc0 tx=0x7f58880057f0 comp rx=0 tx=0).stop 2023-10-14T09:38:12.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.357+0000 7f589b59e640 1 -- 172.21.15.102:0/3737375735 shutdown_connections 2023-10-14T09:38:12.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.357+0000 7f589b59e640 1 --2- 172.21.15.102:0/3737375735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5888005180 0x7f588800b980 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:12.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.357+0000 7f589b59e640 1 -- 172.21.15.102:0/3737375735 >> 172.21.15.102:0/3737375735 conn(0x7f589c0ce6a0 msgr2=0x7f589c0ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:12.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.357+0000 7f589b59e640 1 -- 172.21.15.102:0/3737375735 shutdown_connections 2023-10-14T09:38:12.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.357+0000 7f589b59e640 1 -- 172.21.15.102:0/3737375735 wait complete. 2023-10-14T09:38:12.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.359+0000 7f589b59e640 1 Processor -- start 2023-10-14T09:38:12.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.359+0000 7f589b59e640 1 -- start start 2023-10-14T09:38:12.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.360+0000 7f589b59e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5888005180 0x7f589c149470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:12.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.360+0000 7f589b59e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f589c1f2330 0x7f589c1f2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:12.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.360+0000 7f589b59e640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f589c15c1b0 0x7f589c15c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:12.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.360+0000 7f589b59e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589c15cba0 con 0x7f5888005180 2023-10-14T09:38:12.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.360+0000 7f589b59e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589c1f3130 con 0x7f589c1f2330 2023-10-14T09:38:12.371 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.360+0000 7f589b59e640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f589c15e630 con 0x7f589c15c1b0 2023-10-14T09:38:12.371 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.360+0000 7f589a59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5888005180 0x7f589c149470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:12.371 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.360+0000 7f589a59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5888005180 0x7f589c149470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37446/0 (socket says 172.21.15.102:37446) 2023-10-14T09:38:12.371 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.360+0000 7f589a59c640 1 -- 172.21.15.102:0/208124622 learned_addr learned my addr 172.21.15.102:0/208124622 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:12.372 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.360+0000 7f589a59c640 1 -- 172.21.15.102:0/208124622 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f589c15c1b0 msgr2=0x7f589c15c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:12.372 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.360+0000 7f589a59c640 1 --2- 172.21.15.102:0/208124622 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f589c15c1b0 0x7f589c15c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:12.372 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.360+0000 7f589a59c640 1 -- 172.21.15.102:0/208124622 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f589c1f2330 msgr2=0x7f589c1f2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:12.372 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.360+0000 7f589a59c640 1 --2- 172.21.15.102:0/208124622 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f589c1f2330 0x7f589c1f2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:12.372 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.360+0000 7f589a59c640 1 -- 172.21.15.102:0/208124622 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f589c15e910 con 0x7f5888005180 2023-10-14T09:38:12.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.361+0000 7f589a59c640 1 --2- 172.21.15.102:0/208124622 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5888005180 0x7f589c149470 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f588c00e780 tx=0x7f588c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:12.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.361+0000 7f5892ffd640 1 -- 172.21.15.102:0/208124622 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c00ee90 con 0x7f5888005180 2023-10-14T09:38:12.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.361+0000 7f5892ffd640 1 -- 172.21.15.102:0/208124622 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588c00c8d0 con 0x7f5888005180 2023-10-14T09:38:12.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.361+0000 7f589b59e640 1 -- 172.21.15.102:0/208124622 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f589c15ebf0 con 0x7f5888005180 2023-10-14T09:38:12.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.361+0000 7f5892ffd640 1 -- 172.21.15.102:0/208124622 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c00cc80 con 0x7f5888005180 2023-10-14T09:38:12.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.361+0000 7f589b59e640 1 -- 172.21.15.102:0/208124622 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f589c15f1b0 con 0x7f5888005180 2023-10-14T09:38:12.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.362+0000 7f589b59e640 1 -- 172.21.15.102:0/208124622 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f589c06b330 con 0x7f5888005180 2023-10-14T09:38:12.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.363+0000 7f5892ffd640 1 -- 172.21.15.102:0/208124622 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f588c01d460 con 0x7f5888005180 2023-10-14T09:38:12.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.364+0000 7f5892ffd640 1 --2- 172.21.15.102:0/208124622 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f587c06ae70 0x7f587c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:12.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.364+0000 7f5892ffd640 1 -- 172.21.15.102:0/208124622 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f588c089610 con 0x7f5888005180 2023-10-14T09:38:12.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.364+0000 7f5893fff640 1 --2- 172.21.15.102:0/208124622 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f587c06ae70 0x7f587c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:12.375 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.365+0000 7f5893fff640 1 --2- 172.21.15.102:0/208124622 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f587c06ae70 0x7f587c06d330 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5884000f60 tx=0x7f5884009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:12.375 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.368+0000 7f5892ffd640 1 -- 172.21.15.102:0/208124622 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f588c054620 con 0x7f5888005180 2023-10-14T09:38:12.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.569+0000 7f589b59e640 1 -- 172.21.15.102:0/208124622 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f589c04e9b0 con 0x7f5888005180 2023-10-14T09:38:12.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.570+0000 7f5892ffd640 1 -- 172.21.15.102:0/208124622 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f588c05e030 con 0x7f5888005180 2023-10-14T09:38:12.572 INFO:teuthology.orchestra.run.smithi102.stderr:listed 0 entries 2023-10-14T09:38:12.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.572+0000 7f589b59e640 1 -- 172.21.15.102:0/208124622 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f587c06ae70 msgr2=0x7f587c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:12.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.572+0000 7f589b59e640 1 --2- 172.21.15.102:0/208124622 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f587c06ae70 0x7f587c06d330 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5884000f60 tx=0x7f5884009040 comp rx=0 tx=0).stop 2023-10-14T09:38:12.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.573+0000 7f589b59e640 1 -- 172.21.15.102:0/208124622 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5888005180 msgr2=0x7f589c149470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:12.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.573+0000 7f589b59e640 1 --2- 172.21.15.102:0/208124622 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5888005180 0x7f589c149470 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f588c00e780 tx=0x7f588c00ec40 comp rx=0 tx=0).stop 2023-10-14T09:38:12.576 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.573+0000 7f589b59e640 1 -- 172.21.15.102:0/208124622 shutdown_connections 2023-10-14T09:38:12.576 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.573+0000 7f589b59e640 1 --2- 172.21.15.102:0/208124622 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f587c06ae70 0x7f587c06d330 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:12.576 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.573+0000 7f589b59e640 1 --2- 172.21.15.102:0/208124622 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f589c15c1b0 0x7f589c15c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:12.576 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.573+0000 7f589b59e640 1 --2- 172.21.15.102:0/208124622 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f589c1f2330 0x7f589c1f2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:12.576 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.573+0000 7f589b59e640 1 --2- 172.21.15.102:0/208124622 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5888005180 0x7f589c149470 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:12.576 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.573+0000 7f589b59e640 1 -- 172.21.15.102:0/208124622 >> 172.21.15.102:0/208124622 conn(0x7f589c0ce6a0 msgr2=0x7f589c0ac890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:12.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.573+0000 7f589b59e640 1 -- 172.21.15.102:0/208124622 shutdown_connections 2023-10-14T09:38:12.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.573+0000 7f589b59e640 1 -- 172.21.15.102:0/208124622 wait complete. 2023-10-14T09:38:12.594 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-14T09:38:12.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:38:12.595 DEBUG:teuthology.orchestra.run.smithi129:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-14T09:38:12.705 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi129.front.sepia.ceph.com 2023-10-14T09:38:12.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:38:12.706 DEBUG:teuthology.orchestra.run.smithi129:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-14T09:38:12.751 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-14T09:38:12.752 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:38:12.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.970+0000 7f2ef4f05640 1 Processor -- start 2023-10-14T09:38:12.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.970+0000 7f2ef4f05640 1 -- start start 2023-10-14T09:38:12.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.972+0000 7f2ef4f05640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2ef015aaa0 0x7f2ef015e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:12.974 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.972+0000 7f2ef4f05640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f2ef015ae80 0x7f2ef00cc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:12.974 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.972+0000 7f2ef4f05640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef015ed60 con 0x7f2ef00ccaa0 2023-10-14T09:38:12.974 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.972+0000 7f2ef4f05640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef006b810 con 0x7f2ef015ae80 2023-10-14T09:38:12.974 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.972+0000 7f2ef4f05640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef00707e0 con 0x7f2ef015aaa0 2023-10-14T09:38:12.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.972+0000 7f2eedd9b640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f2ef015ae80 0x7f2ef00cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:12.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.972+0000 7f2eee59c640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2ef015aaa0 0x7f2ef015e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:12.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.972+0000 7f2eedd9b640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f2ef015ae80 0x7f2ef00cc560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.102:54442/0 (socket says 172.21.15.102:54442) 2023-10-14T09:38:12.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.972+0000 7f2eedd9b640 1 -- 172.21.15.102:0/410279837 learned_addr learned my addr 172.21.15.102:0/410279837 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:12.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.972+0000 7f2eee59c640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2ef015aaa0 0x7f2ef015e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.102:39188/0 (socket says 172.21.15.102:39188) 2023-10-14T09:38:12.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.973+0000 7f2eedd9b640 1 -- 172.21.15.102:0/410279837 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2ef015aaa0 msgr2=0x7f2ef015e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:12.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.973+0000 7f2eedd9b640 1 --2- 172.21.15.102:0/410279837 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2ef015aaa0 0x7f2ef015e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:12.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.973+0000 7f2eedd9b640 1 -- 172.21.15.102:0/410279837 >> v1:172.21.15.129:6789/0 conn(0x7f2ef00ccaa0 legacy=0x7f2ef0070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:12.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.973+0000 7f2eedd9b640 1 -- 172.21.15.102:0/410279837 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef015ef90 con 0x7f2ef015ae80 2023-10-14T09:38:12.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.975+0000 7f2eedd9b640 1 --2- 172.21.15.102:0/410279837 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2ef015ae80 0x7f2ef00cc560 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4009870 tx=0x7f2ee402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc3df7b59fae8ae4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:12.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.975+0000 7f2eed59a640 1 -- 172.21.15.102:0/410279837 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee4030840 con 0x7f2ef015ae80 2023-10-14T09:38:12.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.975+0000 7f2eed59a640 1 -- 172.21.15.102:0/410279837 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee40309a0 con 0x7f2ef015ae80 2023-10-14T09:38:12.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.975+0000 7f2eed59a640 1 -- 172.21.15.102:0/410279837 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee4030d30 con 0x7f2ef015ae80 2023-10-14T09:38:12.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.976+0000 7f2ef4f05640 1 -- 172.21.15.102:0/410279837 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2ef015ae80 msgr2=0x7f2ef00cc560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:12.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.976+0000 7f2ef4f05640 1 --2- 172.21.15.102:0/410279837 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2ef015ae80 0x7f2ef00cc560 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4009870 tx=0x7f2ee402b980 comp rx=0 tx=0).stop 2023-10-14T09:38:12.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.976+0000 7f2ef4f05640 1 -- 172.21.15.102:0/410279837 shutdown_connections 2023-10-14T09:38:12.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.976+0000 7f2ef4f05640 1 --2- 172.21.15.102:0/410279837 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2ef015ae80 0x7f2ef00cc560 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:12.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.976+0000 7f2ef4f05640 1 --2- 172.21.15.102:0/410279837 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2ef015aaa0 0x7f2ef015e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:12.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.976+0000 7f2ef4f05640 1 -- 172.21.15.102:0/410279837 >> 172.21.15.102:0/410279837 conn(0x7f2ef00cb410 msgr2=0x7f2ef00cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:12.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.976+0000 7f2ef4f05640 1 -- 172.21.15.102:0/410279837 shutdown_connections 2023-10-14T09:38:12.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.976+0000 7f2ef4f05640 1 -- 172.21.15.102:0/410279837 wait complete. 2023-10-14T09:38:12.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.978+0000 7f2ef4f05640 1 Processor -- start 2023-10-14T09:38:12.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.978+0000 7f2ef4f05640 1 -- start start 2023-10-14T09:38:12.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.979+0000 7f2ef4f05640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2ef00ccaa0 0x7f2ef00c34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:12.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.979+0000 7f2ef4f05640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2ef015aaa0 0x7f2ef01f3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:12.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.979+0000 7f2ef4f05640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ef015ae80 0x7f2ef01f5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:12.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.979+0000 7f2ef4f05640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef0156d90 con 0x7f2ef015ae80 2023-10-14T09:38:12.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.979+0000 7f2ef4f05640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef0158830 con 0x7f2ef015aaa0 2023-10-14T09:38:12.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.979+0000 7f2ef4f05640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef0156810 con 0x7f2ef00ccaa0 2023-10-14T09:38:12.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.979+0000 7f2eeed9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ef015ae80 0x7f2ef01f5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:12.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.979+0000 7f2eeed9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ef015ae80 0x7f2ef01f5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37462/0 (socket says 172.21.15.102:37462) 2023-10-14T09:38:12.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.979+0000 7f2eeed9d640 1 -- 172.21.15.102:0/2421935644 learned_addr learned my addr 172.21.15.102:0/2421935644 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:12.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.980+0000 7f2eee59c640 1 --2- 172.21.15.102:0/2421935644 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2ef00ccaa0 0x7f2ef00c34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:12.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.980+0000 7f2eedd9b640 1 --2- 172.21.15.102:0/2421935644 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2ef015aaa0 0x7f2ef01f3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:12.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.980+0000 7f2eeed9d640 1 -- 172.21.15.102:0/2421935644 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2ef00ccaa0 msgr2=0x7f2ef00c34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:12.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.980+0000 7f2eeed9d640 1 --2- 172.21.15.102:0/2421935644 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2ef00ccaa0 0x7f2ef00c34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:12.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.980+0000 7f2eeed9d640 1 -- 172.21.15.102:0/2421935644 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2ef015aaa0 msgr2=0x7f2ef01f3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:12.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.980+0000 7f2eeed9d640 1 --2- 172.21.15.102:0/2421935644 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2ef015aaa0 0x7f2ef01f3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:12.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.980+0000 7f2eeed9d640 1 -- 172.21.15.102:0/2421935644 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee40094d0 con 0x7f2ef015ae80 2023-10-14T09:38:12.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.980+0000 7f2eeed9d640 1 --2- 172.21.15.102:0/2421935644 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ef015ae80 0x7f2ef01f5e20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800c6b0 tx=0x7f2ee800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:12.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.980+0000 7f2edeffd640 1 -- 172.21.15.102:0/2421935644 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8003b70 con 0x7f2ef015ae80 2023-10-14T09:38:12.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.980+0000 7f2edeffd640 1 -- 172.21.15.102:0/2421935644 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee8003cf0 con 0x7f2ef015ae80 2023-10-14T09:38:12.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.980+0000 7f2edeffd640 1 -- 172.21.15.102:0/2421935644 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8003ea0 con 0x7f2ef015ae80 2023-10-14T09:38:12.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.980+0000 7f2ef4f05640 1 -- 172.21.15.102:0/2421935644 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef0158220 con 0x7f2ef015ae80 2023-10-14T09:38:12.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.981+0000 7f2ef4f05640 1 -- 172.21.15.102:0/2421935644 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef01584c0 con 0x7f2ef015ae80 2023-10-14T09:38:12.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.982+0000 7f2ef4f05640 1 -- 172.21.15.102:0/2421935644 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef01589a0 con 0x7f2ef015ae80 2023-10-14T09:38:12.990 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.983+0000 7f2edeffd640 1 -- 172.21.15.102:0/2421935644 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2ee8005310 con 0x7f2ef015ae80 2023-10-14T09:38:12.990 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.983+0000 7f2edeffd640 1 --2- 172.21.15.102:0/2421935644 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2ed006ae70 0x7f2ed006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:12.990 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.984+0000 7f2edeffd640 1 -- 172.21.15.102:0/2421935644 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f2ee8089460 con 0x7f2ef015ae80 2023-10-14T09:38:12.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.984+0000 7f2eee59c640 1 --2- 172.21.15.102:0/2421935644 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2ed006ae70 0x7f2ed006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:12.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.985+0000 7f2eee59c640 1 --2- 172.21.15.102:0/2421935644 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2ed006ae70 0x7f2ed006d330 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0156690 tx=0x7f2ee0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:12.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:12.988+0000 7f2edeffd640 1 -- 172.21.15.102:0/2421935644 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2ee8054470 con 0x7f2ef015ae80 2023-10-14T09:38:13.214 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.212+0000 7f2ef4f05640 1 -- 172.21.15.102:0/2421935644 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ef004e160 con 0x7f2ef015ae80 2023-10-14T09:38:13.215 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.213+0000 7f2edeffd640 1 -- 172.21.15.102:0/2421935644 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4916 (secure 0 0 0) 0x7f2ee8057a90 con 0x7f2ef015ae80 2023-10-14T09:38:13.216 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:38:13.216 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6835/3867702876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6833","nonce":3867702876},{"type":"v1","addr":"172.21.15.129:6835","nonce":3867702876}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6834/1559210030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":1559210030},{"type":"v1","addr":"172.21.15.129:6834","nonce":1559210030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1277026451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1277026451},{"type":"v1","addr":"172.21.15.102:6835","nonce":1277026451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T09:37:21.362625+0000","modified":"2023-10-14T09:37:24.408132+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6837/527707922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":527707922},{"type":"v1","addr":"172.21.15.102:6837","nonce":527707922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T09:38:13.216 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 8 2023-10-14T09:38:13.218 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.216+0000 7f2ef4f05640 1 -- 172.21.15.102:0/2421935644 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2ed006ae70 msgr2=0x7f2ed006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:13.218 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.216+0000 7f2ef4f05640 1 --2- 172.21.15.102:0/2421935644 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2ed006ae70 0x7f2ed006d330 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0156690 tx=0x7f2ee0008040 comp rx=0 tx=0).stop 2023-10-14T09:38:13.218 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.216+0000 7f2ef4f05640 1 -- 172.21.15.102:0/2421935644 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ef015ae80 msgr2=0x7f2ef01f5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:13.218 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.216+0000 7f2ef4f05640 1 --2- 172.21.15.102:0/2421935644 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ef015ae80 0x7f2ef01f5e20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800c6b0 tx=0x7f2ee800cb70 comp rx=0 tx=0).stop 2023-10-14T09:38:13.219 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.216+0000 7f2ef4f05640 1 -- 172.21.15.102:0/2421935644 shutdown_connections 2023-10-14T09:38:13.219 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.216+0000 7f2ef4f05640 1 --2- 172.21.15.102:0/2421935644 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2ed006ae70 0x7f2ed006d330 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:13.219 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.216+0000 7f2ef4f05640 1 --2- 172.21.15.102:0/2421935644 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ef015ae80 0x7f2ef01f5e20 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:13.219 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.216+0000 7f2ef4f05640 1 --2- 172.21.15.102:0/2421935644 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2ef015aaa0 0x7f2ef01f3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:13.220 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.216+0000 7f2ef4f05640 1 --2- 172.21.15.102:0/2421935644 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2ef00ccaa0 0x7f2ef00c34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:13.220 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.216+0000 7f2ef4f05640 1 -- 172.21.15.102:0/2421935644 >> 172.21.15.102:0/2421935644 conn(0x7f2ef00cb410 msgr2=0x7f2ef00b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:13.220 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.216+0000 7f2ef4f05640 1 -- 172.21.15.102:0/2421935644 shutdown_connections 2023-10-14T09:38:13.220 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.216+0000 7f2ef4f05640 1 -- 172.21.15.102:0/2421935644 wait complete. 2023-10-14T09:38:13.235 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:38:13.442 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.440+0000 7fd4da464640 1 Processor -- start 2023-10-14T09:38:13.442 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.440+0000 7fd4da464640 1 -- start start 2023-10-14T09:38:13.443 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.441+0000 7fd4da464640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd4d40cf800 0x7fd4d4165ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:13.443 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.441+0000 7fd4da464640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4d40cc940 con 0x7fd4d40cd510 2023-10-14T09:38:13.444 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.441+0000 7fd4da464640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4d40cbd30 con 0x7fd4d40cb730 2023-10-14T09:38:13.444 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.441+0000 7fd4da464640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4d40cfc70 con 0x7fd4d40cf800 2023-10-14T09:38:13.444 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.441+0000 7fd4d3fff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fd4d40cd510 0x7fd4d415f220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:56918/0 (socket says 172.21.15.102:56918) 2023-10-14T09:38:13.444 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.441+0000 7fd4d3fff640 1 -- 172.21.15.102:0/2955414090 learned_addr learned my addr 172.21.15.102:0/2955414090 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:13.445 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.442+0000 7fd4d8a01640 1 --2- 172.21.15.102:0/2955414090 >> v2:172.21.15.102:3300/0 conn(0x7fd4d40cf800 0x7fd4d4165ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:13.446 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.442+0000 7fd4d2ffd640 1 -- 172.21.15.102:0/2955414090 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 780815705 0 0) 0x7fd4d40cc940 con 0x7fd4d40cd510 2023-10-14T09:38:13.446 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.442+0000 7fd4d2ffd640 1 -- 172.21.15.102:0/2955414090 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4c0003520 con 0x7fd4d40cd510 2023-10-14T09:38:13.447 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.442+0000 7fd4d8a01640 1 -- 172.21.15.102:0/2955414090 >> v1:172.21.15.129:6789/0 conn(0x7fd4d40cb730 legacy=0x7fd4d40cd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:13.447 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.442+0000 7fd4d8a01640 1 -- 172.21.15.102:0/2955414090 >> v1:172.21.15.102:6789/0 conn(0x7fd4d40cd510 legacy=0x7fd4d415f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:13.447 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.442+0000 7fd4d8a01640 1 -- 172.21.15.102:0/2955414090 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d40cc010 con 0x7fd4d40cf800 2023-10-14T09:38:13.447 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.443+0000 7fd4d8a01640 1 --2- 172.21.15.102:0/2955414090 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4d40cf800 0x7fd4d4165ba0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc0097a0 tx=0x7fd4cc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2129cd87fa6e3ee server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:13.447 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.443+0000 7fd4d2ffd640 1 -- 172.21.15.102:0/2955414090 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc031830 con 0x7fd4d40cf800 2023-10-14T09:38:13.448 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.443+0000 7fd4d2ffd640 1 -- 172.21.15.102:0/2955414090 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4cc031990 con 0x7fd4d40cf800 2023-10-14T09:38:13.448 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.443+0000 7fd4d2ffd640 1 -- 172.21.15.102:0/2955414090 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc031d20 con 0x7fd4d40cf800 2023-10-14T09:38:13.448 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.444+0000 7fd4da464640 1 -- 172.21.15.102:0/2955414090 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4d40cf800 msgr2=0x7fd4d4165ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:13.448 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.444+0000 7fd4da464640 1 --2- 172.21.15.102:0/2955414090 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4d40cf800 0x7fd4d4165ba0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc0097a0 tx=0x7fd4cc02b8d0 comp rx=0 tx=0).stop 2023-10-14T09:38:13.449 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.444+0000 7fd4da464640 1 -- 172.21.15.102:0/2955414090 shutdown_connections 2023-10-14T09:38:13.449 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.444+0000 7fd4da464640 1 --2- 172.21.15.102:0/2955414090 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4d40cf800 0x7fd4d4165ba0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:13.449 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.444+0000 7fd4da464640 1 -- 172.21.15.102:0/2955414090 >> 172.21.15.102:0/2955414090 conn(0x7fd4d4099ea0 msgr2=0x7fd4d40d0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:13.449 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.444+0000 7fd4da464640 1 -- 172.21.15.102:0/2955414090 shutdown_connections 2023-10-14T09:38:13.449 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.444+0000 7fd4da464640 1 -- 172.21.15.102:0/2955414090 wait complete. 2023-10-14T09:38:13.452 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.446+0000 7fd4da464640 1 Processor -- start 2023-10-14T09:38:13.452 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.446+0000 7fd4da464640 1 -- start start 2023-10-14T09:38:13.452 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.447+0000 7fd4da464640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd4d40cb730 0x7fd4d41f3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:13.452 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.447+0000 7fd4da464640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4d40cd510 0x7fd4d40b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:13.452 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.447+0000 7fd4da464640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd4d40cf800 0x7fd4d40c4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:13.453 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.447+0000 7fd4da464640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d41f2e70 con 0x7fd4d40cd510 2023-10-14T09:38:13.453 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.447+0000 7fd4da464640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d41f27f0 con 0x7fd4d40cb730 2023-10-14T09:38:13.453 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.447+0000 7fd4da464640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d40c4ea0 con 0x7fd4d40cf800 2023-10-14T09:38:13.453 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.447+0000 7fd4d37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4d40cd510 0x7fd4d40b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:13.454 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.447+0000 7fd4d37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4d40cd510 0x7fd4d40b0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37476/0 (socket says 172.21.15.102:37476) 2023-10-14T09:38:13.454 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.447+0000 7fd4d37fe640 1 -- 172.21.15.102:0/773332697 learned_addr learned my addr 172.21.15.102:0/773332697 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:13.454 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.447+0000 7fd4d3fff640 1 --2- 172.21.15.102:0/773332697 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd4d40cb730 0x7fd4d41f3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:13.454 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.447+0000 7fd4d37fe640 1 -- 172.21.15.102:0/773332697 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd4d40cf800 msgr2=0x7fd4d40c4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:13.454 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.447+0000 7fd4d37fe640 1 --2- 172.21.15.102:0/773332697 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd4d40cf800 0x7fd4d40c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:13.455 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.447+0000 7fd4d37fe640 1 -- 172.21.15.102:0/773332697 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd4d40cb730 msgr2=0x7fd4d41f3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:13.455 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.447+0000 7fd4d37fe640 1 --2- 172.21.15.102:0/773332697 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd4d40cb730 0x7fd4d41f3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:13.455 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.447+0000 7fd4d37fe640 1 -- 172.21.15.102:0/773332697 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4cc009400 con 0x7fd4d40cd510 2023-10-14T09:38:13.455 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.448+0000 7fd4d37fe640 1 --2- 172.21.15.102:0/773332697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4d40cd510 0x7fd4d40b0fb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc00c430 tx=0x7fd4bc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:13.455 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.448+0000 7fd4d0ff9640 1 -- 172.21.15.102:0/773332697 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc011790 con 0x7fd4d40cd510 2023-10-14T09:38:13.456 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.448+0000 7fd4d0ff9640 1 -- 172.21.15.102:0/773332697 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4bc0118f0 con 0x7fd4d40cd510 2023-10-14T09:38:13.456 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.448+0000 7fd4d0ff9640 1 -- 172.21.15.102:0/773332697 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc011ca0 con 0x7fd4d40cd510 2023-10-14T09:38:13.456 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.448+0000 7fd4da464640 1 -- 172.21.15.102:0/773332697 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4d41f2a90 con 0x7fd4d40cd510 2023-10-14T09:38:13.456 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.448+0000 7fd4da464640 1 -- 172.21.15.102:0/773332697 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d40c5180 con 0x7fd4d40cd510 2023-10-14T09:38:13.456 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.449+0000 7fd4da464640 1 -- 172.21.15.102:0/773332697 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d41f2fb0 con 0x7fd4d40cd510 2023-10-14T09:38:13.457 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.450+0000 7fd4d0ff9640 1 -- 172.21.15.102:0/773332697 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd4bc01c460 con 0x7fd4d40cd510 2023-10-14T09:38:13.457 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.451+0000 7fd4d0ff9640 1 --2- 172.21.15.102:0/773332697 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd4b406ae70 0x7fd4b406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:13.458 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.451+0000 7fd4d0ff9640 1 -- 172.21.15.102:0/773332697 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fd4bc089690 con 0x7fd4d40cd510 2023-10-14T09:38:13.458 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.451+0000 7fd4d3fff640 1 --2- 172.21.15.102:0/773332697 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd4b406ae70 0x7fd4b406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:13.458 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.452+0000 7fd4d3fff640 1 --2- 172.21.15.102:0/773332697 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd4b406ae70 0x7fd4b406d330 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4007fd0 tx=0x7fd4c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:13.458 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.456+0000 7fd4d0ff9640 1 -- 172.21.15.102:0/773332697 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd4d41f2fb0 con 0x7fd4d40cd510 2023-10-14T09:38:13.634 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.632+0000 7fd4da464640 1 -- 172.21.15.102:0/773332697 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4d41f2fb0 con 0x7fd4d40cd510 2023-10-14T09:38:13.637 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.635+0000 7fd4d0ff9640 1 -- 172.21.15.102:0/773332697 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16838 (secure 0 0 0) 0x7fd4d41f2fb0 con 0x7fd4d40cd510 2023-10-14T09:38:13.638 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:38:13.638 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":24,"fsid":"8a6cd69d-7f5b-4f2a-806a-0176c10aed50","created":"2023-10-14T09:36:56.745172+0000","modified":"2023-10-14T09:38:03.788214+0000","last_up_change":"2023-10-14T09:37:09.791473+0000","last_in_change":"2023-10-14T09:37:00.547186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:37:09.952407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:37:19.560925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:37:20.363385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e5aef8f3-878f-482b-b522-9a5b958b90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6801","nonce":1727250718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6803","nonce":1727250718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6807","nonce":1727250718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6805","nonce":1727250718}]},"public_addr":"172.21.15.102:6801/1727250718","cluster_addr":"172.21.15.102:6803/1727250718","heartbeat_back_addr":"172.21.15.102:6807/1727250718","heartbeat_front_addr":"172.21.15.102:6805/1727250718","state":["exists","up"]},{"osd":1,"uuid":"4a8cf50e-387b-4d47-9588-bd22e375a9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6809","nonce":1095651107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6811","nonce":1095651107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6815","nonce":1095651107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6813","nonce":1095651107}]},"public_addr":"172.21.15.102:6809/1095651107","cluster_addr":"172.21.15.102:6811/1095651107","heartbeat_back_addr":"172.21.15.102:6815/1095651107","heartbeat_front_addr":"172.21.15.102:6813/1095651107","state":["exists","up"]},{"osd":2,"uuid":"009ef55f-8a63-4219-bacd-d7c7b4500867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6820","nonce":2198222556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6825","nonce":2198222556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6831","nonce":2198222556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6829","nonce":2198222556}]},"public_addr":"172.21.15.102:6820/2198222556","cluster_addr":"172.21.15.102:6825/2198222556","heartbeat_back_addr":"172.21.15.102:6831/2198222556","heartbeat_front_addr":"172.21.15.102:6829/2198222556","state":["exists","up"]},{"osd":3,"uuid":"f2110eae-2ff9-4ed9-93d6-bd2361618211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6818","nonce":654726740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6821","nonce":654726740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6827","nonce":654726740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6823","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6824","nonce":654726740}]},"public_addr":"172.21.15.102:6818/654726740","cluster_addr":"172.21.15.102:6821/654726740","heartbeat_back_addr":"172.21.15.102:6827/654726740","heartbeat_front_addr":"172.21.15.102:6824/654726740","state":["exists","up"]},{"osd":4,"uuid":"33f1ae34-3100-40f7-9cb8-0eca2b358693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6817","nonce":507586170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6819","nonce":507586170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6823","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6825","nonce":507586170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6821","nonce":507586170}]},"public_addr":"172.21.15.129:6817/507586170","cluster_addr":"172.21.15.129:6819/507586170","heartbeat_back_addr":"172.21.15.129:6825/507586170","heartbeat_front_addr":"172.21.15.129:6821/507586170","state":["exists","up"]},{"osd":5,"uuid":"fab2fc62-3f3e-450d-93e0-770f39e80710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6801","nonce":1913451073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6803","nonce":1913451073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6807","nonce":1913451073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6805","nonce":1913451073}]},"public_addr":"172.21.15.129:6801/1913451073","cluster_addr":"172.21.15.129:6803/1913451073","heartbeat_back_addr":"172.21.15.129:6807/1913451073","heartbeat_front_addr":"172.21.15.129:6805/1913451073","state":["exists","up"]},{"osd":6,"uuid":"d7cc1d69-92e7-4253-a127-cfc0444a4809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6809","nonce":2853291511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6811","nonce":2853291511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6815","nonce":2853291511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6813","nonce":2853291511}]},"public_addr":"172.21.15.129:6809/2853291511","cluster_addr":"172.21.15.129:6811/2853291511","heartbeat_back_addr":"172.21.15.129:6815/2853291511","heartbeat_front_addr":"172.21.15.129:6813/2853291511","state":["exists","up"]},{"osd":7,"uuid":"1e403de1-09e2-4370-b9a7-e790ac44bbee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6824","nonce":2933886914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6827","nonce":2933886914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6831","nonce":2933886914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6829","nonce":2933886914}]},"public_addr":"172.21.15.129:6824/2933886914","cluster_addr":"172.21.15.129:6827/2933886914","heartbeat_back_addr":"172.21.15.129:6831/2933886914","heartbeat_front_addr":"172.21.15.129:6829/2933886914","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.849661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.868113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.933488+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.891794+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.901861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.858750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.911712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.996765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:38:13.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.639+0000 7fd4da464640 1 -- 172.21.15.102:0/773332697 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd4b406ae70 msgr2=0x7fd4b406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:13.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.639+0000 7fd4da464640 1 --2- 172.21.15.102:0/773332697 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd4b406ae70 0x7fd4b406d330 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4007fd0 tx=0x7fd4c4009040 comp rx=0 tx=0).stop 2023-10-14T09:38:13.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.639+0000 7fd4da464640 1 -- 172.21.15.102:0/773332697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4d40cd510 msgr2=0x7fd4d40b0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:13.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.639+0000 7fd4da464640 1 --2- 172.21.15.102:0/773332697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4d40cd510 0x7fd4d40b0fb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc00c430 tx=0x7fd4bc00c8f0 comp rx=0 tx=0).stop 2023-10-14T09:38:13.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.639+0000 7fd4da464640 1 -- 172.21.15.102:0/773332697 shutdown_connections 2023-10-14T09:38:13.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.639+0000 7fd4da464640 1 --2- 172.21.15.102:0/773332697 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd4b406ae70 0x7fd4b406d330 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:13.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.639+0000 7fd4da464640 1 --2- 172.21.15.102:0/773332697 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd4d40cf800 0x7fd4d40c4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:13.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.639+0000 7fd4da464640 1 --2- 172.21.15.102:0/773332697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4d40cd510 0x7fd4d40b0fb0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:13.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.639+0000 7fd4da464640 1 --2- 172.21.15.102:0/773332697 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd4d40cb730 0x7fd4d41f3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:13.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.639+0000 7fd4da464640 1 -- 172.21.15.102:0/773332697 >> 172.21.15.102:0/773332697 conn(0x7fd4d4099ea0 msgr2=0x7fd4d40b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:13.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.640+0000 7fd4da464640 1 -- 172.21.15.102:0/773332697 shutdown_connections 2023-10-14T09:38:13.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.640+0000 7fd4da464640 1 -- 172.21.15.102:0/773332697 wait complete. 2023-10-14T09:38:13.658 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T09:37:09.952407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T09:37:19.560925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T09:37:20.363385+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T09:38:13.659 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T09:38:13.856 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.854+0000 7fd8bdb6c640 1 Processor -- start 2023-10-14T09:38:13.856 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.854+0000 7fd8bdb6c640 1 -- start start 2023-10-14T09:38:13.857 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.856+0000 7fd8bdb6c640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fd8b80cfaf0 0x7fd8b80b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:13.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.856+0000 7fd8bdb6c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b80d3980 con 0x7fd8b80cf710 2023-10-14T09:38:13.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.856+0000 7fd8bdb6c640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b80ce630 con 0x7fd8b80b3420 2023-10-14T09:38:13.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.856+0000 7fd8bdb6c640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b80d3c60 con 0x7fd8b80cfaf0 2023-10-14T09:38:13.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.856+0000 7fd8b77fe640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fd8b80cf710 0x7fd8b80b2d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:56934/0 (socket says 172.21.15.102:56934) 2023-10-14T09:38:13.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.856+0000 7fd8b77fe640 1 -- 172.21.15.102:0/2274309863 learned_addr learned my addr 172.21.15.102:0/2274309863 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:13.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.856+0000 7fd8b6ffd640 1 -- 172.21.15.102:0/2274309863 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1174472461 0 0) 0x7fd8b80d3980 con 0x7fd8b80cf710 2023-10-14T09:38:13.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.856+0000 7fd8b6ffd640 1 -- 172.21.15.102:0/2274309863 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8a4003520 con 0x7fd8b80cf710 2023-10-14T09:38:13.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.856+0000 7fd8b7fff640 1 --2- 172.21.15.102:0/2274309863 >> v2:172.21.15.129:3300/0 conn(0x7fd8b80cfaf0 0x7fd8b80b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:13.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.857+0000 7fd8b6ffd640 1 -- 172.21.15.102:0/2274309863 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2838508320 0 0) 0x7fd8a4003520 con 0x7fd8b80cf710 2023-10-14T09:38:13.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.857+0000 7fd8b6ffd640 1 -- 172.21.15.102:0/2274309863 >> v2:172.21.15.129:3300/0 conn(0x7fd8b80cfaf0 msgr2=0x7fd8b80b63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:13.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.857+0000 7fd8b6ffd640 1 --2- 172.21.15.102:0/2274309863 >> v2:172.21.15.129:3300/0 conn(0x7fd8b80cfaf0 0x7fd8b80b63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:13.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.857+0000 7fd8b6ffd640 1 -- 172.21.15.102:0/2274309863 >> v1:172.21.15.129:6789/0 conn(0x7fd8b80b3420 legacy=0x7fd8b80b5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:13.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.857+0000 7fd8b6ffd640 1 -- 172.21.15.102:0/2274309863 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b80ce910 con 0x7fd8b80cf710 2023-10-14T09:38:13.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.857+0000 7fd8b6ffd640 1 -- 172.21.15.102:0/2274309863 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4030661168 0 0) 0x7fd8a80017f0 con 0x7fd8b80cf710 2023-10-14T09:38:13.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.857+0000 7fd8b6ffd640 1 -- 172.21.15.102:0/2274309863 >> v1:172.21.15.102:6789/0 conn(0x7fd8b80cf710 legacy=0x7fd8b80b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:13.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.857+0000 7fd8b6ffd640 1 --2- 172.21.15.102:0/2274309863 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd8a40039c0 0x7fd8a4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:13.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.857+0000 7fd8b6ffd640 1 --2- 172.21.15.102:0/2274309863 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8a40047c0 0x7fd8a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:13.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.857+0000 7fd8b6ffd640 1 --2- 172.21.15.102:0/2274309863 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd8a40051d0 0x7fd8a400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:13.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.857+0000 7fd8b6ffd640 1 -- 172.21.15.102:0/2274309863 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b80d3c60 con 0x7fd8a40047c0 2023-10-14T09:38:13.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.857+0000 7fd8b6ffd640 1 -- 172.21.15.102:0/2274309863 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a400c120 con 0x7fd8a40051d0 2023-10-14T09:38:13.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.857+0000 7fd8b6ffd640 1 -- 172.21.15.102:0/2274309863 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a400c2e0 con 0x7fd8a40039c0 2023-10-14T09:38:13.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.857+0000 7fd8affff640 1 --2- 172.21.15.102:0/2274309863 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8a40047c0 0x7fd8a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:13.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.857+0000 7fd8affff640 1 -- 172.21.15.102:0/2274309863 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd8a40039c0 msgr2=0x7fd8a4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:13.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.857+0000 7fd8affff640 1 --2- 172.21.15.102:0/2274309863 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd8a40039c0 0x7fd8a4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:13.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.857+0000 7fd8affff640 1 -- 172.21.15.102:0/2274309863 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd8a40051d0 msgr2=0x7fd8a400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:13.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.857+0000 7fd8affff640 1 --2- 172.21.15.102:0/2274309863 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd8a40051d0 0x7fd8a400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:13.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.857+0000 7fd8affff640 1 -- 172.21.15.102:0/2274309863 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a4003520 con 0x7fd8a40047c0 2023-10-14T09:38:13.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.857+0000 7fd8b7fff640 1 -- 172.21.15.102:0/2274309863 reap_dead start 2023-10-14T09:38:13.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.859+0000 7fd8affff640 1 --2- 172.21.15.102:0/2274309863 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8a40047c0 0x7fd8a4004c40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0001720 tx=0x7fd8a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=287c1ad13599603d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:13.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.859+0000 7fd8b6ffd640 1 -- 172.21.15.102:0/2274309863 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a00052d0 con 0x7fd8a40047c0 2023-10-14T09:38:13.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.859+0000 7fd8b6ffd640 1 -- 172.21.15.102:0/2274309863 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a002e050 con 0x7fd8a40047c0 2023-10-14T09:38:13.866 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.859+0000 7fd8b6ffd640 1 -- 172.21.15.102:0/2274309863 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0003830 con 0x7fd8a40047c0 2023-10-14T09:38:13.868 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.859+0000 7fd8bdb6c640 1 -- 172.21.15.102:0/2274309863 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8a40047c0 msgr2=0x7fd8a4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:13.868 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.859+0000 7fd8bdb6c640 1 --2- 172.21.15.102:0/2274309863 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8a40047c0 0x7fd8a4004c40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0001720 tx=0x7fd8a40057f0 comp rx=0 tx=0).stop 2023-10-14T09:38:13.869 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.859+0000 7fd8bdb6c640 1 -- 172.21.15.102:0/2274309863 shutdown_connections 2023-10-14T09:38:13.869 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.859+0000 7fd8bdb6c640 1 --2- 172.21.15.102:0/2274309863 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8a40047c0 0x7fd8a4004c40 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:13.869 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.859+0000 7fd8bdb6c640 1 -- 172.21.15.102:0/2274309863 >> 172.21.15.102:0/2274309863 conn(0x7fd8b80d2cc0 msgr2=0x7fd8b80d30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:13.869 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.860+0000 7fd8bdb6c640 1 -- 172.21.15.102:0/2274309863 shutdown_connections 2023-10-14T09:38:13.869 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.860+0000 7fd8bdb6c640 1 -- 172.21.15.102:0/2274309863 wait complete. 2023-10-14T09:38:13.870 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.861+0000 7fd8bdb6c640 1 Processor -- start 2023-10-14T09:38:13.870 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.861+0000 7fd8bdb6c640 1 -- start start 2023-10-14T09:38:13.870 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.862+0000 7fd8bdb6c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd8a40047c0 0x7fd8b815fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:13.870 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.862+0000 7fd8bdb6c640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd8b80d0870 0x7fd8b80d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:13.871 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.862+0000 7fd8bdb6c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8b815da00 0x7fd8b815de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:13.871 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.862+0000 7fd8bdb6c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b80d1230 con 0x7fd8b815da00 2023-10-14T09:38:13.871 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.862+0000 7fd8bdb6c640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b81602a0 con 0x7fd8a40047c0 2023-10-14T09:38:13.871 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.862+0000 7fd8bdb6c640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b80c8580 con 0x7fd8b80d0870 2023-10-14T09:38:13.871 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.863+0000 7fd8b7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8b815da00 0x7fd8b815de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:13.872 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.863+0000 7fd8b7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8b815da00 0x7fd8b815de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37490/0 (socket says 172.21.15.102:37490) 2023-10-14T09:38:13.872 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.863+0000 7fd8b7fff640 1 -- 172.21.15.102:0/627594014 learned_addr learned my addr 172.21.15.102:0/627594014 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:13.872 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.863+0000 7fd8b7fff640 1 -- 172.21.15.102:0/627594014 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd8b80d0870 msgr2=0x7fd8b80d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:13.872 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.863+0000 7fd8b7fff640 1 --2- 172.21.15.102:0/627594014 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd8b80d0870 0x7fd8b80d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:13.872 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.863+0000 7fd8b7fff640 1 -- 172.21.15.102:0/627594014 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd8a40047c0 msgr2=0x7fd8b815fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:13.873 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.863+0000 7fd8b77fe640 1 --2- 172.21.15.102:0/627594014 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd8a40047c0 0x7fd8b815fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:13.873 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.863+0000 7fd8b7fff640 1 --2- 172.21.15.102:0/627594014 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd8a40047c0 0x7fd8b815fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:13.873 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.863+0000 7fd8b7fff640 1 -- 172.21.15.102:0/627594014 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b815e730 con 0x7fd8b815da00 2023-10-14T09:38:13.873 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.863+0000 7fd8b7fff640 1 --2- 172.21.15.102:0/627594014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8b815da00 0x7fd8b815de80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd8b808d4b0 tx=0x7fd8b000ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:13.873 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.864+0000 7fd8b4ff9640 1 -- 172.21.15.102:0/627594014 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b0010040 con 0x7fd8b815da00 2023-10-14T09:38:13.873 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.864+0000 7fd8b4ff9640 1 -- 172.21.15.102:0/627594014 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b000bb30 con 0x7fd8b815da00 2023-10-14T09:38:13.874 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.864+0000 7fd8b4ff9640 1 -- 172.21.15.102:0/627594014 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b0014400 con 0x7fd8b815da00 2023-10-14T09:38:13.874 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.864+0000 7fd8bdb6c640 1 -- 172.21.15.102:0/627594014 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b815ea10 con 0x7fd8b815da00 2023-10-14T09:38:13.874 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.864+0000 7fd8bdb6c640 1 -- 172.21.15.102:0/627594014 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b80c6ad0 con 0x7fd8b815da00 2023-10-14T09:38:13.874 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.865+0000 7fd8bdb6c640 1 -- 172.21.15.102:0/627594014 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b804e160 con 0x7fd8b815da00 2023-10-14T09:38:13.874 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.866+0000 7fd8b4ff9640 1 -- 172.21.15.102:0/627594014 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd8b0014560 con 0x7fd8b815da00 2023-10-14T09:38:13.875 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.867+0000 7fd8b4ff9640 1 --2- 172.21.15.102:0/627594014 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd89806ae70 0x7fd89806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:13.875 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.867+0000 7fd8b4ff9640 1 -- 172.21.15.102:0/627594014 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fd8b0089e60 con 0x7fd8b815da00 2023-10-14T09:38:13.875 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.867+0000 7fd8b77fe640 1 --2- 172.21.15.102:0/627594014 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd89806ae70 0x7fd89806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:13.876 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.868+0000 7fd8b77fe640 1 --2- 172.21.15.102:0/627594014 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd89806ae70 0x7fd89806d330 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8063ab0 tx=0x7fd8a8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:13.876 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:13.872+0000 7fd8b4ff9640 1 -- 172.21.15.102:0/627594014 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd8b0054f10 con 0x7fd8b815da00 2023-10-14T09:38:14.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.061+0000 7fd8bdb6c640 1 -- 172.21.15.102:0/627594014 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd8b80b31e0 con 0x7fd8b815da00 2023-10-14T09:38:14.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.062+0000 7fd8b4ff9640 1 -- 172.21.15.102:0/627594014 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd8b0018020 con 0x7fd8b815da00 2023-10-14T09:38:14.064 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2023-10-14T09:38:14.067 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.064+0000 7fd8bdb6c640 1 -- 172.21.15.102:0/627594014 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd89806ae70 msgr2=0x7fd89806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:14.067 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.064+0000 7fd8bdb6c640 1 --2- 172.21.15.102:0/627594014 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd89806ae70 0x7fd89806d330 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8063ab0 tx=0x7fd8a8009040 comp rx=0 tx=0).stop 2023-10-14T09:38:14.067 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.064+0000 7fd8bdb6c640 1 -- 172.21.15.102:0/627594014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8b815da00 msgr2=0x7fd8b815de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:14.067 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.064+0000 7fd8bdb6c640 1 --2- 172.21.15.102:0/627594014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8b815da00 0x7fd8b815de80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd8b808d4b0 tx=0x7fd8b000ef50 comp rx=0 tx=0).stop 2023-10-14T09:38:14.068 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.065+0000 7fd8bdb6c640 1 -- 172.21.15.102:0/627594014 shutdown_connections 2023-10-14T09:38:14.068 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.065+0000 7fd8bdb6c640 1 --2- 172.21.15.102:0/627594014 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd89806ae70 0x7fd89806d330 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:14.068 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.065+0000 7fd8bdb6c640 1 --2- 172.21.15.102:0/627594014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8b815da00 0x7fd8b815de80 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:14.068 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.065+0000 7fd8bdb6c640 1 --2- 172.21.15.102:0/627594014 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd8b80d0870 0x7fd8b80d0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:14.068 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.065+0000 7fd8bdb6c640 1 --2- 172.21.15.102:0/627594014 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd8a40047c0 0x7fd8b815fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:14.068 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.065+0000 7fd8bdb6c640 1 -- 172.21.15.102:0/627594014 >> 172.21.15.102:0/627594014 conn(0x7fd8b80d2cc0 msgr2=0x7fd8b80b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:14.069 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.065+0000 7fd8bdb6c640 1 -- 172.21.15.102:0/627594014 shutdown_connections 2023-10-14T09:38:14.069 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.065+0000 7fd8bdb6c640 1 -- 172.21.15.102:0/627594014 wait complete. 2023-10-14T09:38:14.085 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T09:38:14.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.301+0000 7f82012b4640 1 Processor -- start 2023-10-14T09:38:14.304 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.302+0000 7f82012b4640 1 -- start start 2023-10-14T09:38:14.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.303+0000 7f82012b4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f81fc159ab0 0x7f81fc0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:14.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.303+0000 7f82012b4640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f81fc06c140 0x7f81fc06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:14.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.303+0000 7f82012b4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81fc070360 con 0x7f81fc159e90 2023-10-14T09:38:14.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.303+0000 7f82012b4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81fc06cb10 con 0x7f81fc159ab0 2023-10-14T09:38:14.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.303+0000 7f82012b4640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc15d890 con 0x7f81fc06c140 2023-10-14T09:38:14.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.304+0000 7f81faffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f81fc159ab0 0x7f81fc0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:14.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.304+0000 7f81faffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f81fc159ab0 0x7f81fc0ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37492/0 (socket says 172.21.15.102:37492) 2023-10-14T09:38:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.304+0000 7f81faffd640 1 -- 172.21.15.102:0/375762509 learned_addr learned my addr 172.21.15.102:0/375762509 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.304+0000 7f81faffd640 1 -- 172.21.15.102:0/375762509 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f81fc06c140 msgr2=0x7f81fc06c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.304+0000 7f81fb7fe640 1 --2- 172.21.15.102:0/375762509 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f81fc06c140 0x7f81fc06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.304+0000 7f81faffd640 1 --2- 172.21.15.102:0/375762509 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f81fc06c140 0x7f81fc06c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.304+0000 7f81faffd640 1 -- 172.21.15.102:0/375762509 >> v1:172.21.15.102:6789/0 conn(0x7f81fc159e90 legacy=0x7f81fc06fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:14.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.304+0000 7f81fa7fc640 1 -- 172.21.15.102:0/375762509 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1971907017 0 0) 0x7f81fc070360 con 0x7f81fc159e90 2023-10-14T09:38:14.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.304+0000 7f81faffd640 1 -- 172.21.15.102:0/375762509 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81fc0cd1f0 con 0x7f81fc159ab0 2023-10-14T09:38:14.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.304+0000 7f81fb7fe640 1 --2- 172.21.15.102:0/375762509 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f81fc06c140 0x7f81fc06c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:14.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.305+0000 7f81faffd640 1 --2- 172.21.15.102:0/375762509 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81fc159ab0 0x7f81fc0ce370 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f81ec009870 tx=0x7f81ec02b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab0f0be22592aba server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:14.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.306+0000 7f81fa7fc640 1 -- 172.21.15.102:0/375762509 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec0317d0 con 0x7f81fc159ab0 2023-10-14T09:38:14.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.306+0000 7f81fa7fc640 1 -- 172.21.15.102:0/375762509 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ec031930 con 0x7f81fc159ab0 2023-10-14T09:38:14.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.306+0000 7f81fa7fc640 1 -- 172.21.15.102:0/375762509 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec031cc0 con 0x7f81fc159ab0 2023-10-14T09:38:14.312 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.306+0000 7f82012b4640 1 -- 172.21.15.102:0/375762509 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81fc159ab0 msgr2=0x7f81fc0ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:14.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.306+0000 7f82012b4640 1 --2- 172.21.15.102:0/375762509 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81fc159ab0 0x7f81fc0ce370 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f81ec009870 tx=0x7f81ec02b870 comp rx=0 tx=0).stop 2023-10-14T09:38:14.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.306+0000 7f82012b4640 1 -- 172.21.15.102:0/375762509 shutdown_connections 2023-10-14T09:38:14.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.306+0000 7f82012b4640 1 --2- 172.21.15.102:0/375762509 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f81fc06c140 0x7f81fc06c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:14.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.306+0000 7f82012b4640 1 --2- 172.21.15.102:0/375762509 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81fc159ab0 0x7f81fc0ce370 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:14.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.306+0000 7f82012b4640 1 -- 172.21.15.102:0/375762509 >> 172.21.15.102:0/375762509 conn(0x7f81fc0ce9b0 msgr2=0x7f81fc0cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:14.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.306+0000 7f82012b4640 1 -- 172.21.15.102:0/375762509 shutdown_connections 2023-10-14T09:38:14.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.306+0000 7f82012b4640 1 -- 172.21.15.102:0/375762509 wait complete. 2023-10-14T09:38:14.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.308+0000 7f82012b4640 1 Processor -- start 2023-10-14T09:38:14.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.308+0000 7f82012b4640 1 -- start start 2023-10-14T09:38:14.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.309+0000 7f82012b4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81fc06c140 0x7f81fc155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:14.315 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.309+0000 7f82012b4640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f81fc159ab0 0x7f81fc0b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:14.315 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.309+0000 7f82012b4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f81fc159e90 0x7f81fc0c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:14.315 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.309+0000 7f82012b4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc156520 con 0x7f81fc06c140 2023-10-14T09:38:14.315 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.309+0000 7f82012b4640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc0b2730 con 0x7f81fc159e90 2023-10-14T09:38:14.315 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.309+0000 7f82012b4640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc0b2cc0 con 0x7f81fc159ab0 2023-10-14T09:38:14.316 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.309+0000 7f81faffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81fc06c140 0x7f81fc155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:14.316 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.309+0000 7f81faffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81fc06c140 0x7f81fc155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37506/0 (socket says 172.21.15.102:37506) 2023-10-14T09:38:14.316 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.309+0000 7f81faffd640 1 -- 172.21.15.102:0/366249967 learned_addr learned my addr 172.21.15.102:0/366249967 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:14.316 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.310+0000 7f81faffd640 1 -- 172.21.15.102:0/366249967 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f81fc159ab0 msgr2=0x7f81fc0b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:14.316 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.310+0000 7f81faffd640 1 --2- 172.21.15.102:0/366249967 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f81fc159ab0 0x7f81fc0b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:14.316 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.310+0000 7f81faffd640 1 -- 172.21.15.102:0/366249967 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f81fc159e90 msgr2=0x7f81fc0c44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:14.317 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.310+0000 7f81faffd640 1 --2- 172.21.15.102:0/366249967 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f81fc159e90 0x7f81fc0c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:14.317 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.310+0000 7f81faffd640 1 -- 172.21.15.102:0/366249967 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ec0094d0 con 0x7f81fc06c140 2023-10-14T09:38:14.317 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.310+0000 7f81faffd640 1 --2- 172.21.15.102:0/366249967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81fc06c140 0x7f81fc155fe0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f81ec000c00 tx=0x7f81ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:14.317 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.310+0000 7f81f3fff640 1 -- 172.21.15.102:0/366249967 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec032970 con 0x7f81fc06c140 2023-10-14T09:38:14.317 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.310+0000 7f81f3fff640 1 -- 172.21.15.102:0/366249967 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ec032af0 con 0x7f81fc06c140 2023-10-14T09:38:14.318 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.311+0000 7f82012b4640 1 -- 172.21.15.102:0/366249967 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81fc0b1e90 con 0x7f81fc06c140 2023-10-14T09:38:14.318 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.311+0000 7f81f3fff640 1 -- 172.21.15.102:0/366249967 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec032ea0 con 0x7f81fc06c140 2023-10-14T09:38:14.318 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.311+0000 7f82012b4640 1 -- 172.21.15.102:0/366249967 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81fc0b2450 con 0x7f81fc06c140 2023-10-14T09:38:14.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.312+0000 7f82012b4640 1 -- 172.21.15.102:0/366249967 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81fc0b2a90 con 0x7f81fc06c140 2023-10-14T09:38:14.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.313+0000 7f81f3fff640 1 -- 172.21.15.102:0/366249967 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f81ec030070 con 0x7f81fc06c140 2023-10-14T09:38:14.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.313+0000 7f81f3fff640 1 --2- 172.21.15.102:0/366249967 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f81dc06ae70 0x7f81dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:14.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.314+0000 7f81f3fff640 1 -- 172.21.15.102:0/366249967 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f81ec0ab380 con 0x7f81fc06c140 2023-10-14T09:38:14.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.314+0000 7f81f27fc640 1 --2- 172.21.15.102:0/366249967 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f81dc06ae70 0x7f81dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:14.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.314+0000 7f81f27fc640 1 --2- 172.21.15.102:0/366249967 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f81dc06ae70 0x7f81dc06d330 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f81fc0c54e0 tx=0x7f81e4007910 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:14.321 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.318+0000 7f81f3fff640 1 -- 172.21.15.102:0/366249967 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f81fc0b2a90 con 0x7f81fc06c140 2023-10-14T09:38:14.510 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.508+0000 7f82012b4640 1 -- 172.21.15.102:0/366249967 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f81fc0b2a90 con 0x7f81fc06c140 2023-10-14T09:38:14.511 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.509+0000 7f81f3fff640 1 -- 172.21.15.102:0/366249967 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f81fc0b2a90 con 0x7f81fc06c140 2023-10-14T09:38:14.511 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2023-10-14T09:38:14.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.512+0000 7f82012b4640 1 -- 172.21.15.102:0/366249967 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f81dc06ae70 msgr2=0x7f81dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:14.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.512+0000 7f82012b4640 1 --2- 172.21.15.102:0/366249967 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f81dc06ae70 0x7f81dc06d330 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f81fc0c54e0 tx=0x7f81e4007910 comp rx=0 tx=0).stop 2023-10-14T09:38:14.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.512+0000 7f82012b4640 1 -- 172.21.15.102:0/366249967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81fc06c140 msgr2=0x7f81fc155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:14.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.512+0000 7f82012b4640 1 --2- 172.21.15.102:0/366249967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81fc06c140 0x7f81fc155fe0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f81ec000c00 tx=0x7f81ec0046c0 comp rx=0 tx=0).stop 2023-10-14T09:38:14.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.512+0000 7f82012b4640 1 -- 172.21.15.102:0/366249967 shutdown_connections 2023-10-14T09:38:14.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.512+0000 7f82012b4640 1 --2- 172.21.15.102:0/366249967 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f81dc06ae70 0x7f81dc06d330 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:14.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.512+0000 7f82012b4640 1 --2- 172.21.15.102:0/366249967 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f81fc159e90 0x7f81fc0c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:14.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.512+0000 7f82012b4640 1 --2- 172.21.15.102:0/366249967 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f81fc159ab0 0x7f81fc0b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:14.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.512+0000 7f82012b4640 1 --2- 172.21.15.102:0/366249967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81fc06c140 0x7f81fc155fe0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:14.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.512+0000 7f82012b4640 1 -- 172.21.15.102:0/366249967 >> 172.21.15.102:0/366249967 conn(0x7f81fc0ce9b0 msgr2=0x7f81fc0b0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:14.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.512+0000 7f82012b4640 1 -- 172.21.15.102:0/366249967 shutdown_connections 2023-10-14T09:38:14.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.512+0000 7f82012b4640 1 -- 172.21.15.102:0/366249967 wait complete. 2023-10-14T09:38:14.533 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T09:38:14.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.746+0000 7f6319e4f640 1 Processor -- start 2023-10-14T09:38:14.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.746+0000 7f6319e4f640 1 -- start start 2023-10-14T09:38:14.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.748+0000 7f6319e4f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f631415d150 0x7f63140ad350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:14.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.748+0000 7f6319e4f640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6314160b90 0x7f6314160fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:14.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.748+0000 7f6319e4f640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63140ac890 con 0x7f6314069da0 2023-10-14T09:38:14.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.748+0000 7f6319e4f640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f631415d530 con 0x7f631415d150 2023-10-14T09:38:14.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.748+0000 7f6319e4f640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6314161650 con 0x7f6314160b90 2023-10-14T09:38:14.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.748+0000 7f63137fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f631415d150 0x7f63140ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:14.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.748+0000 7f63137fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f631415d150 0x7f63140ad350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37508/0 (socket says 172.21.15.102:37508) 2023-10-14T09:38:14.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.748+0000 7f63137fe640 1 -- 172.21.15.102:0/2621647423 learned_addr learned my addr 172.21.15.102:0/2621647423 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:14.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.749+0000 7f6312ffd640 1 --2- 172.21.15.102:0/2621647423 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6314160b90 0x7f6314160fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:14.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.749+0000 7f63137fe640 1 -- 172.21.15.102:0/2621647423 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6314160b90 msgr2=0x7f6314160fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:14.753 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.749+0000 7f63137fe640 1 --2- 172.21.15.102:0/2621647423 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6314160b90 0x7f6314160fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:14.753 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.749+0000 7f63137fe640 1 -- 172.21.15.102:0/2621647423 >> v1:172.21.15.129:6789/0 conn(0x7f6314069da0 legacy=0x7f631406a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:14.753 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.749+0000 7f63137fe640 1 -- 172.21.15.102:0/2621647423 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6314161930 con 0x7f631415d150 2023-10-14T09:38:14.754 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.750+0000 7f63137fe640 1 --2- 172.21.15.102:0/2621647423 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f631415d150 0x7f63140ad350 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6304009e50 tx=0x7f630402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f5db205c336389 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:14.754 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.751+0000 7f63127fc640 1 -- 172.21.15.102:0/2621647423 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630402ca70 con 0x7f631415d150 2023-10-14T09:38:14.755 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.751+0000 7f63127fc640 1 -- 172.21.15.102:0/2621647423 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630402cbd0 con 0x7f631415d150 2023-10-14T09:38:14.755 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.751+0000 7f63127fc640 1 -- 172.21.15.102:0/2621647423 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63040343f0 con 0x7f631415d150 2023-10-14T09:38:14.755 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.751+0000 7f6319e4f640 1 -- 172.21.15.102:0/2621647423 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f631415d150 msgr2=0x7f63140ad350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:14.755 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.751+0000 7f6319e4f640 1 --2- 172.21.15.102:0/2621647423 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f631415d150 0x7f63140ad350 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6304009e50 tx=0x7f630402bed0 comp rx=0 tx=0).stop 2023-10-14T09:38:14.756 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.752+0000 7f6319e4f640 1 -- 172.21.15.102:0/2621647423 shutdown_connections 2023-10-14T09:38:14.756 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.752+0000 7f6319e4f640 1 --2- 172.21.15.102:0/2621647423 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6314160b90 0x7f6314160fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:14.756 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.752+0000 7f6319e4f640 1 --2- 172.21.15.102:0/2621647423 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f631415d150 0x7f63140ad350 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:14.756 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.752+0000 7f6319e4f640 1 -- 172.21.15.102:0/2621647423 >> 172.21.15.102:0/2621647423 conn(0x7f63140ce9b0 msgr2=0x7f63140cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:14.756 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.752+0000 7f6319e4f640 1 -- 172.21.15.102:0/2621647423 shutdown_connections 2023-10-14T09:38:14.756 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.752+0000 7f6319e4f640 1 -- 172.21.15.102:0/2621647423 wait complete. 2023-10-14T09:38:14.758 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.753+0000 7f6319e4f640 1 Processor -- start 2023-10-14T09:38:14.759 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.753+0000 7f6319e4f640 1 -- start start 2023-10-14T09:38:14.759 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.754+0000 7f6319e4f640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6314069da0 0x7f63140c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:14.759 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.754+0000 7f6319e4f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f631415d150 0x7f631415d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:14.759 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.754+0000 7f6319e4f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6314160b90 0x7f6314070860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:14.759 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.754+0000 7f6319e4f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63140ae9e0 con 0x7f631415d150 2023-10-14T09:38:14.759 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.754+0000 7f6319e4f640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631415dbb0 con 0x7f6314160b90 2023-10-14T09:38:14.760 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.754+0000 7f6319e4f640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f631415e990 con 0x7f6314069da0 2023-10-14T09:38:14.760 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.755+0000 7f6312ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f631415d150 0x7f631415d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:14.760 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.755+0000 7f6312ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f631415d150 0x7f631415d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37510/0 (socket says 172.21.15.102:37510) 2023-10-14T09:38:14.760 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.755+0000 7f6312ffd640 1 -- 172.21.15.102:0/2489403970 learned_addr learned my addr 172.21.15.102:0/2489403970 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:14.760 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.755+0000 7f6313fff640 1 --2- 172.21.15.102:0/2489403970 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6314160b90 0x7f6314070860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:14.761 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.755+0000 7f63137fe640 1 --2- 172.21.15.102:0/2489403970 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6314069da0 0x7f63140c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:14.761 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.755+0000 7f6312ffd640 1 -- 172.21.15.102:0/2489403970 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6314069da0 msgr2=0x7f63140c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:14.761 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.755+0000 7f6312ffd640 1 --2- 172.21.15.102:0/2489403970 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6314069da0 0x7f63140c46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:14.761 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.755+0000 7f6312ffd640 1 -- 172.21.15.102:0/2489403970 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6314160b90 msgr2=0x7f6314070860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:14.761 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.755+0000 7f6312ffd640 1 --2- 172.21.15.102:0/2489403970 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6314160b90 0x7f6314070860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:14.762 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.755+0000 7f6312ffd640 1 -- 172.21.15.102:0/2489403970 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6304009b30 con 0x7f631415d150 2023-10-14T09:38:14.762 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.756+0000 7f6312ffd640 1 --2- 172.21.15.102:0/2489403970 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f631415d150 0x7f631415d670 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f62fc00d800 tx=0x7f62fc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:14.762 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.756+0000 7f630bfff640 1 -- 172.21.15.102:0/2489403970 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc00b6c0 con 0x7f631415d150 2023-10-14T09:38:14.762 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.756+0000 7f630bfff640 1 -- 172.21.15.102:0/2489403970 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62fc00b820 con 0x7f631415d150 2023-10-14T09:38:14.762 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.756+0000 7f630bfff640 1 -- 172.21.15.102:0/2489403970 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc00bbb0 con 0x7f631415d150 2023-10-14T09:38:14.762 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.756+0000 7f6319e4f640 1 -- 172.21.15.102:0/2489403970 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f631415de10 con 0x7f631415d150 2023-10-14T09:38:14.763 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.756+0000 7f6319e4f640 1 -- 172.21.15.102:0/2489403970 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f631415e3d0 con 0x7f631415d150 2023-10-14T09:38:14.764 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.757+0000 7f6319e4f640 1 -- 172.21.15.102:0/2489403970 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f631404e160 con 0x7f631415d150 2023-10-14T09:38:14.764 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.758+0000 7f630bfff640 1 -- 172.21.15.102:0/2489403970 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f62fc00bd10 con 0x7f631415d150 2023-10-14T09:38:14.764 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.759+0000 7f630bfff640 1 --2- 172.21.15.102:0/2489403970 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f62f406ae70 0x7f62f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:14.764 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.759+0000 7f630bfff640 1 -- 172.21.15.102:0/2489403970 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f62fc089bd0 con 0x7f631415d150 2023-10-14T09:38:14.764 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.759+0000 7f63137fe640 1 --2- 172.21.15.102:0/2489403970 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f62f406ae70 0x7f62f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:14.765 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.760+0000 7f63137fe640 1 --2- 172.21.15.102:0/2489403970 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f62f406ae70 0x7f62f406d330 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6304035000 tx=0x7f6304030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:14.765 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.763+0000 7f630bfff640 1 -- 172.21.15.102:0/2489403970 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f62fc054c60 con 0x7f631415d150 2023-10-14T09:38:14.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.958+0000 7f6319e4f640 1 -- 172.21.15.102:0/2489403970 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f63140ade10 con 0x7f631415d150 2023-10-14T09:38:14.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.958+0000 7f630bfff640 1 -- 172.21.15.102:0/2489403970 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f62fc058280 con 0x7f631415d150 2023-10-14T09:38:14.960 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2023-10-14T09:38:14.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.961+0000 7f6319e4f640 1 -- 172.21.15.102:0/2489403970 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f62f406ae70 msgr2=0x7f62f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:14.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.961+0000 7f6319e4f640 1 --2- 172.21.15.102:0/2489403970 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f62f406ae70 0x7f62f406d330 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6304035000 tx=0x7f6304030000 comp rx=0 tx=0).stop 2023-10-14T09:38:14.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.961+0000 7f6319e4f640 1 -- 172.21.15.102:0/2489403970 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f631415d150 msgr2=0x7f631415d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:14.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.961+0000 7f6319e4f640 1 --2- 172.21.15.102:0/2489403970 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f631415d150 0x7f631415d670 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f62fc00d800 tx=0x7f62fc00dcc0 comp rx=0 tx=0).stop 2023-10-14T09:38:14.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.961+0000 7f6319e4f640 1 -- 172.21.15.102:0/2489403970 shutdown_connections 2023-10-14T09:38:14.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.961+0000 7f6319e4f640 1 --2- 172.21.15.102:0/2489403970 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f62f406ae70 0x7f62f406d330 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:14.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.961+0000 7f6319e4f640 1 --2- 172.21.15.102:0/2489403970 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6314160b90 0x7f6314070860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:14.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.961+0000 7f6319e4f640 1 --2- 172.21.15.102:0/2489403970 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f631415d150 0x7f631415d670 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:14.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.961+0000 7f6319e4f640 1 --2- 172.21.15.102:0/2489403970 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6314069da0 0x7f63140c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:14.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.961+0000 7f6319e4f640 1 -- 172.21.15.102:0/2489403970 >> 172.21.15.102:0/2489403970 conn(0x7f63140ce9b0 msgr2=0x7f63140ca440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:14.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.961+0000 7f6319e4f640 1 -- 172.21.15.102:0/2489403970 shutdown_connections 2023-10-14T09:38:14.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:14.961+0000 7f6319e4f640 1 -- 172.21.15.102:0/2489403970 wait complete. 2023-10-14T09:38:14.980 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:38:15.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.191+0000 7f6944dfc640 1 Processor -- start 2023-10-14T09:38:15.193 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.191+0000 7f6944dfc640 1 -- start start 2023-10-14T09:38:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.192+0000 7f6944dfc640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f694015aaa0 0x7f694015e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.192+0000 7f6944dfc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f694015ae80 0x7f69400cc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.192+0000 7f6944dfc640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f694015ed60 con 0x7f69400ccaa0 2023-10-14T09:38:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.192+0000 7f6944dfc640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f694006b810 con 0x7f694015ae80 2023-10-14T09:38:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.192+0000 7f6944dfc640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69400707e0 con 0x7f694015aaa0 2023-10-14T09:38:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.193+0000 7f6937fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f694015ae80 0x7f69400cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.193+0000 7f693ed9d640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f69400ccaa0 0x7f6940070f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:56940/0 (socket says 172.21.15.102:56940) 2023-10-14T09:38:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.193+0000 7f693ed9d640 1 -- 172.21.15.102:0/2634069168 learned_addr learned my addr 172.21.15.102:0/2634069168 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.193+0000 7f693e59c640 1 --2- 172.21.15.102:0/2634069168 >> v2:172.21.15.129:3300/0 conn(0x7f694015aaa0 0x7f694015e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.193+0000 7f6937fff640 1 -- 172.21.15.102:0/2634069168 >> v2:172.21.15.129:3300/0 conn(0x7f694015aaa0 msgr2=0x7f694015e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.193+0000 7f6937fff640 1 --2- 172.21.15.102:0/2634069168 >> v2:172.21.15.129:3300/0 conn(0x7f694015aaa0 0x7f694015e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.193+0000 7f6937fff640 1 -- 172.21.15.102:0/2634069168 >> v1:172.21.15.102:6789/0 conn(0x7f69400ccaa0 legacy=0x7f6940070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.193+0000 7f693dd9b640 1 -- 172.21.15.102:0/2634069168 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3819271829 0 0) 0x7f694015ed60 con 0x7f69400ccaa0 2023-10-14T09:38:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.193+0000 7f6937fff640 1 -- 172.21.15.102:0/2634069168 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f694015ef90 con 0x7f694015ae80 2023-10-14T09:38:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.194+0000 7f6937fff640 1 --2- 172.21.15.102:0/2634069168 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f694015ae80 0x7f69400cc560 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f69400cd990 tx=0x7f692802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c57c7a37c89b4ab server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.195+0000 7f693dd9b640 1 -- 172.21.15.102:0/2634069168 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6928031830 con 0x7f694015ae80 2023-10-14T09:38:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.195+0000 7f693dd9b640 1 -- 172.21.15.102:0/2634069168 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6928031990 con 0x7f694015ae80 2023-10-14T09:38:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.195+0000 7f693dd9b640 1 -- 172.21.15.102:0/2634069168 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6928031d20 con 0x7f694015ae80 2023-10-14T09:38:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.195+0000 7f6944dfc640 1 -- 172.21.15.102:0/2634069168 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f694015ae80 msgr2=0x7f69400cc560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.195+0000 7f6944dfc640 1 --2- 172.21.15.102:0/2634069168 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f694015ae80 0x7f69400cc560 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f69400cd990 tx=0x7f692802b8d0 comp rx=0 tx=0).stop 2023-10-14T09:38:15.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.195+0000 7f6944dfc640 1 -- 172.21.15.102:0/2634069168 shutdown_connections 2023-10-14T09:38:15.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.195+0000 7f6944dfc640 1 --2- 172.21.15.102:0/2634069168 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f694015ae80 0x7f69400cc560 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:15.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.195+0000 7f6944dfc640 1 --2- 172.21.15.102:0/2634069168 >> v2:172.21.15.129:3300/0 conn(0x7f694015aaa0 0x7f694015e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:15.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.195+0000 7f6944dfc640 1 -- 172.21.15.102:0/2634069168 >> 172.21.15.102:0/2634069168 conn(0x7f69400cb410 msgr2=0x7f69400cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:15.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.195+0000 7f6944dfc640 1 -- 172.21.15.102:0/2634069168 shutdown_connections 2023-10-14T09:38:15.201 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.195+0000 7f6944dfc640 1 -- 172.21.15.102:0/2634069168 wait complete. 2023-10-14T09:38:15.203 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.197+0000 7f6944dfc640 1 Processor -- start 2023-10-14T09:38:15.203 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.197+0000 7f6944dfc640 1 -- start start 2023-10-14T09:38:15.203 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.198+0000 7f6944dfc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69400ccaa0 0x7f69401e8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:15.203 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.198+0000 7f6944dfc640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f694015aaa0 0x7f6940157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:15.204 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.198+0000 7f6944dfc640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f694015ae80 0x7f69400c4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:15.204 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.198+0000 7f6944dfc640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694015c430 con 0x7f69400ccaa0 2023-10-14T09:38:15.204 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.198+0000 7f6944dfc640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69401e8ed0 con 0x7f694015aaa0 2023-10-14T09:38:15.204 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.198+0000 7f6944dfc640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f694015b7b0 con 0x7f694015ae80 2023-10-14T09:38:15.204 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.198+0000 7f693e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69400ccaa0 0x7f69401e8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:15.204 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.198+0000 7f693e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69400ccaa0 0x7f69401e8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37524/0 (socket says 172.21.15.102:37524) 2023-10-14T09:38:15.205 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.198+0000 7f693e59c640 1 -- 172.21.15.102:0/651501962 learned_addr learned my addr 172.21.15.102:0/651501962 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:15.205 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.199+0000 7f6937fff640 1 --2- 172.21.15.102:0/651501962 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f694015aaa0 0x7f6940157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:15.205 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.199+0000 7f693ed9d640 1 --2- 172.21.15.102:0/651501962 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f694015ae80 0x7f69400c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:15.205 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.199+0000 7f693e59c640 1 -- 172.21.15.102:0/651501962 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f694015ae80 msgr2=0x7f69400c4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:15.205 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.199+0000 7f693e59c640 1 --2- 172.21.15.102:0/651501962 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f694015ae80 0x7f69400c4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:15.206 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.199+0000 7f693e59c640 1 -- 172.21.15.102:0/651501962 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f694015aaa0 msgr2=0x7f6940157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:15.206 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.199+0000 7f693e59c640 1 --2- 172.21.15.102:0/651501962 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f694015aaa0 0x7f6940157050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:15.206 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.199+0000 7f693e59c640 1 -- 172.21.15.102:0/651501962 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6928009400 con 0x7f69400ccaa0 2023-10-14T09:38:15.206 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.199+0000 7f6937fff640 1 --2- 172.21.15.102:0/651501962 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f694015aaa0 0x7f6940157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:15.206 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.199+0000 7f693ed9d640 1 --2- 172.21.15.102:0/651501962 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f694015ae80 0x7f69400c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:15.207 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.199+0000 7f693e59c640 1 --2- 172.21.15.102:0/651501962 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69400ccaa0 0x7f69401e8990 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f693000c7f0 tx=0x7f693000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:15.207 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.199+0000 7f6936ffd640 1 -- 172.21.15.102:0/651501962 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6930004220 con 0x7f69400ccaa0 2023-10-14T09:38:15.207 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.199+0000 7f6936ffd640 1 -- 172.21.15.102:0/651501962 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69300043a0 con 0x7f69400ccaa0 2023-10-14T09:38:15.207 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.199+0000 7f6936ffd640 1 -- 172.21.15.102:0/651501962 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6930003850 con 0x7f69400ccaa0 2023-10-14T09:38:15.207 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.199+0000 7f6944dfc640 1 -- 172.21.15.102:0/651501962 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f694015ba90 con 0x7f69400ccaa0 2023-10-14T09:38:15.207 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.200+0000 7f6944dfc640 1 -- 172.21.15.102:0/651501962 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f694015c050 con 0x7f69400ccaa0 2023-10-14T09:38:15.208 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.201+0000 7f6944dfc640 1 -- 172.21.15.102:0/651501962 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f694004e160 con 0x7f69400ccaa0 2023-10-14T09:38:15.208 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.202+0000 7f6936ffd640 1 -- 172.21.15.102:0/651501962 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6930003bc0 con 0x7f69400ccaa0 2023-10-14T09:38:15.209 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.203+0000 7f6936ffd640 1 --2- 172.21.15.102:0/651501962 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f692006ae70 0x7f692006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:15.209 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.203+0000 7f6936ffd640 1 -- 172.21.15.102:0/651501962 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f6930089660 con 0x7f69400ccaa0 2023-10-14T09:38:15.209 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.203+0000 7f6937fff640 1 --2- 172.21.15.102:0/651501962 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f692006ae70 0x7f692006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:15.209 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.204+0000 7f6937fff640 1 --2- 172.21.15.102:0/651501962 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f692006ae70 0x7f692006d330 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6928036000 tx=0x7f692803c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:15.209 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.207+0000 7f6936ffd640 1 -- 172.21.15.102:0/651501962 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6930054670 con 0x7f69400ccaa0 2023-10-14T09:38:15.437 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.435+0000 7f6944dfc640 1 -- 172.21.15.102:0/651501962 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f69400cc540 con 0x7f69400ccaa0 2023-10-14T09:38:15.438 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.437+0000 7f6936ffd640 1 -- 172.21.15.102:0/651501962 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4916 (secure 0 0 0) 0x7f6930057c90 con 0x7f69400ccaa0 2023-10-14T09:38:15.439 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:38:15.439 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6835/3867702876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6833","nonce":3867702876},{"type":"v1","addr":"172.21.15.129:6835","nonce":3867702876}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6834/1559210030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":1559210030},{"type":"v1","addr":"172.21.15.129:6834","nonce":1559210030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1277026451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1277026451},{"type":"v1","addr":"172.21.15.102:6835","nonce":1277026451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T09:37:21.362625+0000","modified":"2023-10-14T09:37:24.408132+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6837/527707922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":527707922},{"type":"v1","addr":"172.21.15.102:6837","nonce":527707922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T09:38:15.439 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 8 2023-10-14T09:38:15.442 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.439+0000 7f6944dfc640 1 -- 172.21.15.102:0/651501962 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f692006ae70 msgr2=0x7f692006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:15.442 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.439+0000 7f6944dfc640 1 --2- 172.21.15.102:0/651501962 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f692006ae70 0x7f692006d330 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6928036000 tx=0x7f692803c040 comp rx=0 tx=0).stop 2023-10-14T09:38:15.442 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.439+0000 7f6944dfc640 1 -- 172.21.15.102:0/651501962 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69400ccaa0 msgr2=0x7f69401e8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:15.442 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.439+0000 7f6944dfc640 1 --2- 172.21.15.102:0/651501962 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69400ccaa0 0x7f69401e8990 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f693000c7f0 tx=0x7f693000ccb0 comp rx=0 tx=0).stop 2023-10-14T09:38:15.442 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.440+0000 7f6944dfc640 1 -- 172.21.15.102:0/651501962 shutdown_connections 2023-10-14T09:38:15.443 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.440+0000 7f6944dfc640 1 --2- 172.21.15.102:0/651501962 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f692006ae70 0x7f692006d330 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:15.443 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.440+0000 7f6944dfc640 1 --2- 172.21.15.102:0/651501962 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f694015ae80 0x7f69400c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:15.443 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.440+0000 7f6944dfc640 1 --2- 172.21.15.102:0/651501962 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f694015aaa0 0x7f6940157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:15.443 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.440+0000 7f6944dfc640 1 --2- 172.21.15.102:0/651501962 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69400ccaa0 0x7f69401e8990 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:15.443 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.440+0000 7f6944dfc640 1 -- 172.21.15.102:0/651501962 >> 172.21.15.102:0/651501962 conn(0x7f69400cb410 msgr2=0x7f69400b14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:15.444 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.440+0000 7f6944dfc640 1 -- 172.21.15.102:0/651501962 shutdown_connections 2023-10-14T09:38:15.444 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.440+0000 7f6944dfc640 1 -- 172.21.15.102:0/651501962 wait complete. 2023-10-14T09:38:15.461 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:38:15.674 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.672+0000 7f3990141640 1 Processor -- start 2023-10-14T09:38:15.674 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.672+0000 7f3990141640 1 -- start start 2023-10-14T09:38:15.675 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.674+0000 7f3990141640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f3988159f00 0x7f39880b0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:15.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.674+0000 7f3990141640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398806f7f0 con 0x7f3988159b20 2023-10-14T09:38:15.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.674+0000 7f3990141640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398806c5e0 con 0x7f398815d880 2023-10-14T09:38:15.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.674+0000 7f3990141640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f398806c8c0 con 0x7f3988159f00 2023-10-14T09:38:15.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.674+0000 7f398dedd640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f3988159b20 0x7f398806bbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:56944/0 (socket says 172.21.15.102:56944) 2023-10-14T09:38:15.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.674+0000 7f398dedd640 1 -- 172.21.15.102:0/2003932794 learned_addr learned my addr 172.21.15.102:0/2003932794 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:15.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.674+0000 7f398d6dc640 1 --2- 172.21.15.102:0/2003932794 >> v2:172.21.15.129:3300/0 conn(0x7f3988159f00 0x7f39880b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:15.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.674+0000 7f398cedb640 1 -- 172.21.15.102:0/2003932794 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2377401718 0 0) 0x7f398806f7f0 con 0x7f3988159b20 2023-10-14T09:38:15.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.674+0000 7f398cedb640 1 -- 172.21.15.102:0/2003932794 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3974005730 con 0x7f3988159b20 2023-10-14T09:38:15.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.675+0000 7f398cedb640 1 -- 172.21.15.102:0/2003932794 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2306976854 0 0) 0x7f3974005730 con 0x7f3988159b20 2023-10-14T09:38:15.680 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.675+0000 7f398cedb640 1 -- 172.21.15.102:0/2003932794 >> v2:172.21.15.129:3300/0 conn(0x7f3988159f00 msgr2=0x7f39880b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:15.680 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.675+0000 7f398cedb640 1 --2- 172.21.15.102:0/2003932794 >> v2:172.21.15.129:3300/0 conn(0x7f3988159f00 0x7f39880b0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:15.680 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.675+0000 7f398cedb640 1 -- 172.21.15.102:0/2003932794 >> v1:172.21.15.129:6789/0 conn(0x7f398815d880 legacy=0x7f398806fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:15.680 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.675+0000 7f398cedb640 1 -- 172.21.15.102:0/2003932794 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398806cba0 con 0x7f3988159b20 2023-10-14T09:38:15.680 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.675+0000 7f398cedb640 1 -- 172.21.15.102:0/2003932794 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4030661168 0 0) 0x7f3984001670 con 0x7f3988159b20 2023-10-14T09:38:15.681 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.675+0000 7f398cedb640 1 -- 172.21.15.102:0/2003932794 >> v1:172.21.15.102:6789/0 conn(0x7f3988159b20 legacy=0x7f398806bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:15.681 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.675+0000 7f398cedb640 1 --2- 172.21.15.102:0/2003932794 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3974005b80 0x7f3974005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:15.681 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.675+0000 7f398cedb640 1 --2- 172.21.15.102:0/2003932794 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f39740069d0 0x7f3974006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:15.681 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.675+0000 7f398cedb640 1 --2- 172.21.15.102:0/2003932794 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3974007390 0x7f397400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:15.681 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.675+0000 7f398cedb640 1 -- 172.21.15.102:0/2003932794 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398806c8c0 con 0x7f3974007390 2023-10-14T09:38:15.681 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.675+0000 7f398cedb640 1 -- 172.21.15.102:0/2003932794 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397400e2e0 con 0x7f39740069d0 2023-10-14T09:38:15.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.675+0000 7f398cedb640 1 -- 172.21.15.102:0/2003932794 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f397400e4a0 con 0x7f3974005b80 2023-10-14T09:38:15.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.675+0000 7f398e6de640 1 --2- 172.21.15.102:0/2003932794 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3974007390 0x7f397400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:15.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.676+0000 7f398d6dc640 1 --2- 172.21.15.102:0/2003932794 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f39740069d0 0x7f3974006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:15.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.676+0000 7f398dedd640 1 --2- 172.21.15.102:0/2003932794 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3974005b80 0x7f3974005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:15.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.676+0000 7f398e6de640 1 -- 172.21.15.102:0/2003932794 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3974005b80 msgr2=0x7f3974005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:15.683 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.676+0000 7f398e6de640 1 --2- 172.21.15.102:0/2003932794 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3974005b80 0x7f3974005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:15.683 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.676+0000 7f398e6de640 1 -- 172.21.15.102:0/2003932794 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f39740069d0 msgr2=0x7f3974006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:15.683 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.676+0000 7f398e6de640 1 --2- 172.21.15.102:0/2003932794 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f39740069d0 0x7f3974006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:15.683 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.676+0000 7f398e6de640 1 -- 172.21.15.102:0/2003932794 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3974005730 con 0x7f3974007390 2023-10-14T09:38:15.683 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.677+0000 7f398e6de640 1 -- 172.21.15.102:0/2003932794 reap_dead start 2023-10-14T09:38:15.684 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.677+0000 7f398e6de640 1 --2- 172.21.15.102:0/2003932794 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3974007390 0x7f397400db90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3980001e50 tx=0x7f3974007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36a0cc2712f3b39b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:15.684 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.677+0000 7f398cedb640 1 -- 172.21.15.102:0/2003932794 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3980003b70 con 0x7f3974007390 2023-10-14T09:38:15.684 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.677+0000 7f398cedb640 1 -- 172.21.15.102:0/2003932794 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3980003cf0 con 0x7f3974007390 2023-10-14T09:38:15.684 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.677+0000 7f398cedb640 1 -- 172.21.15.102:0/2003932794 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3980005310 con 0x7f3974007390 2023-10-14T09:38:15.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.678+0000 7f3990141640 1 -- 172.21.15.102:0/2003932794 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3974007390 msgr2=0x7f397400db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:15.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.678+0000 7f3990141640 1 --2- 172.21.15.102:0/2003932794 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3974007390 0x7f397400db90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3980001e50 tx=0x7f3974007a00 comp rx=0 tx=0).stop 2023-10-14T09:38:15.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.678+0000 7f3990141640 1 -- 172.21.15.102:0/2003932794 shutdown_connections 2023-10-14T09:38:15.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.678+0000 7f3990141640 1 --2- 172.21.15.102:0/2003932794 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3974007390 0x7f397400db90 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:15.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.678+0000 7f3990141640 1 -- 172.21.15.102:0/2003932794 >> 172.21.15.102:0/2003932794 conn(0x7f39880cb410 msgr2=0x7f39880cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:15.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.678+0000 7f3990141640 1 -- 172.21.15.102:0/2003932794 shutdown_connections 2023-10-14T09:38:15.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.678+0000 7f3990141640 1 -- 172.21.15.102:0/2003932794 wait complete. 2023-10-14T09:38:15.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.680+0000 7f3990141640 1 Processor -- start 2023-10-14T09:38:15.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.680+0000 7f3990141640 1 -- start start 2023-10-14T09:38:15.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.681+0000 7f3990141640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3974007390 0x7f3988149540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:15.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.681+0000 7f3990141640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f398815b360 0x7f398815b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:15.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.681+0000 7f3990141640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3988151910 0x7f3988151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:15.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.681+0000 7f3990141640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398815caa0 con 0x7f3988151910 2023-10-14T09:38:15.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.681+0000 7f3990141640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39881522d0 con 0x7f398815b360 2023-10-14T09:38:15.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.681+0000 7f3990141640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398815be20 con 0x7f3974007390 2023-10-14T09:38:15.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.681+0000 7f398e6de640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3988151910 0x7f3988151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:15.690 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.681+0000 7f398e6de640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3988151910 0x7f3988151d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37548/0 (socket says 172.21.15.102:37548) 2023-10-14T09:38:15.690 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.681+0000 7f398e6de640 1 -- 172.21.15.102:0/4201235025 learned_addr learned my addr 172.21.15.102:0/4201235025 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:15.690 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.682+0000 7f398e6de640 1 -- 172.21.15.102:0/4201235025 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3974007390 msgr2=0x7f3988149540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:15.690 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.682+0000 7f398e6de640 1 --2- 172.21.15.102:0/4201235025 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3974007390 0x7f3988149540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:15.690 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.682+0000 7f398e6de640 1 -- 172.21.15.102:0/4201235025 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f398815b360 msgr2=0x7f398815b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:15.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.682+0000 7f398e6de640 1 --2- 172.21.15.102:0/4201235025 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f398815b360 0x7f398815b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:15.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.682+0000 7f398e6de640 1 -- 172.21.15.102:0/4201235025 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398815c100 con 0x7f3988151910 2023-10-14T09:38:15.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.682+0000 7f398e6de640 1 --2- 172.21.15.102:0/4201235025 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3988151910 0x7f3988151d90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3980001f70 tx=0x7f39800014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:15.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.682+0000 7f397e7fc640 1 -- 172.21.15.102:0/4201235025 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3980006d50 con 0x7f3988151910 2023-10-14T09:38:15.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.682+0000 7f397e7fc640 1 -- 172.21.15.102:0/4201235025 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3980039480 con 0x7f3988151910 2023-10-14T09:38:15.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.682+0000 7f3990141640 1 -- 172.21.15.102:0/4201235025 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f398815c3e0 con 0x7f3988151910 2023-10-14T09:38:15.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.682+0000 7f397e7fc640 1 -- 172.21.15.102:0/4201235025 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3980039810 con 0x7f3988151910 2023-10-14T09:38:15.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.683+0000 7f3990141640 1 -- 172.21.15.102:0/4201235025 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3988149a80 con 0x7f3988151910 2023-10-14T09:38:15.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.684+0000 7f3990141640 1 -- 172.21.15.102:0/4201235025 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3988149c10 con 0x7f3988151910 2023-10-14T09:38:15.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.685+0000 7f397e7fc640 1 -- 172.21.15.102:0/4201235025 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3980039970 con 0x7f3988151910 2023-10-14T09:38:15.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.685+0000 7f397e7fc640 1 --2- 172.21.15.102:0/4201235025 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f396c06ae70 0x7f396c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:15.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.686+0000 7f397e7fc640 1 -- 172.21.15.102:0/4201235025 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f39800ab260 con 0x7f3988151910 2023-10-14T09:38:15.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.686+0000 7f398dedd640 1 --2- 172.21.15.102:0/4201235025 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f396c06ae70 0x7f396c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:15.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.686+0000 7f398dedd640 1 --2- 172.21.15.102:0/4201235025 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f396c06ae70 0x7f396c06d330 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3984005990 tx=0x7f3984000f30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:15.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.690+0000 7f397e7fc640 1 -- 172.21.15.102:0/4201235025 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3988149c10 con 0x7f3988151910 2023-10-14T09:38:15.881 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.880+0000 7f3990141640 1 -- 172.21.15.102:0/4201235025 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3988149c10 con 0x7f3988151910 2023-10-14T09:38:15.883 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.882+0000 7f397e7fc640 1 -- 172.21.15.102:0/4201235025 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16838 (secure 0 0 0) 0x7f3988149c10 con 0x7f3988151910 2023-10-14T09:38:15.884 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:38:15.884 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":24,"fsid":"8a6cd69d-7f5b-4f2a-806a-0176c10aed50","created":"2023-10-14T09:36:56.745172+0000","modified":"2023-10-14T09:38:03.788214+0000","last_up_change":"2023-10-14T09:37:09.791473+0000","last_in_change":"2023-10-14T09:37:00.547186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:37:09.952407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:37:19.560925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:37:20.363385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e5aef8f3-878f-482b-b522-9a5b958b90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6801","nonce":1727250718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6803","nonce":1727250718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6807","nonce":1727250718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6805","nonce":1727250718}]},"public_addr":"172.21.15.102:6801/1727250718","cluster_addr":"172.21.15.102:6803/1727250718","heartbeat_back_addr":"172.21.15.102:6807/1727250718","heartbeat_front_addr":"172.21.15.102:6805/1727250718","state":["exists","up"]},{"osd":1,"uuid":"4a8cf50e-387b-4d47-9588-bd22e375a9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6809","nonce":1095651107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6811","nonce":1095651107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6815","nonce":1095651107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6813","nonce":1095651107}]},"public_addr":"172.21.15.102:6809/1095651107","cluster_addr":"172.21.15.102:6811/1095651107","heartbeat_back_addr":"172.21.15.102:6815/1095651107","heartbeat_front_addr":"172.21.15.102:6813/1095651107","state":["exists","up"]},{"osd":2,"uuid":"009ef55f-8a63-4219-bacd-d7c7b4500867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6820","nonce":2198222556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6825","nonce":2198222556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6831","nonce":2198222556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6829","nonce":2198222556}]},"public_addr":"172.21.15.102:6820/2198222556","cluster_addr":"172.21.15.102:6825/2198222556","heartbeat_back_addr":"172.21.15.102:6831/2198222556","heartbeat_front_addr":"172.21.15.102:6829/2198222556","state":["exists","up"]},{"osd":3,"uuid":"f2110eae-2ff9-4ed9-93d6-bd2361618211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6818","nonce":654726740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6821","nonce":654726740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6827","nonce":654726740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6823","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6824","nonce":654726740}]},"public_addr":"172.21.15.102:6818/654726740","cluster_addr":"172.21.15.102:6821/654726740","heartbeat_back_addr":"172.21.15.102:6827/654726740","heartbeat_front_addr":"172.21.15.102:6824/654726740","state":["exists","up"]},{"osd":4,"uuid":"33f1ae34-3100-40f7-9cb8-0eca2b358693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6817","nonce":507586170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6819","nonce":507586170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6823","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6825","nonce":507586170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6821","nonce":507586170}]},"public_addr":"172.21.15.129:6817/507586170","cluster_addr":"172.21.15.129:6819/507586170","heartbeat_back_addr":"172.21.15.129:6825/507586170","heartbeat_front_addr":"172.21.15.129:6821/507586170","state":["exists","up"]},{"osd":5,"uuid":"fab2fc62-3f3e-450d-93e0-770f39e80710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6801","nonce":1913451073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6803","nonce":1913451073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6807","nonce":1913451073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6805","nonce":1913451073}]},"public_addr":"172.21.15.129:6801/1913451073","cluster_addr":"172.21.15.129:6803/1913451073","heartbeat_back_addr":"172.21.15.129:6807/1913451073","heartbeat_front_addr":"172.21.15.129:6805/1913451073","state":["exists","up"]},{"osd":6,"uuid":"d7cc1d69-92e7-4253-a127-cfc0444a4809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6809","nonce":2853291511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6811","nonce":2853291511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6815","nonce":2853291511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6813","nonce":2853291511}]},"public_addr":"172.21.15.129:6809/2853291511","cluster_addr":"172.21.15.129:6811/2853291511","heartbeat_back_addr":"172.21.15.129:6815/2853291511","heartbeat_front_addr":"172.21.15.129:6813/2853291511","state":["exists","up"]},{"osd":7,"uuid":"1e403de1-09e2-4370-b9a7-e790ac44bbee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6824","nonce":2933886914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6827","nonce":2933886914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6831","nonce":2933886914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6829","nonce":2933886914}]},"public_addr":"172.21.15.129:6824/2933886914","cluster_addr":"172.21.15.129:6827/2933886914","heartbeat_back_addr":"172.21.15.129:6831/2933886914","heartbeat_front_addr":"172.21.15.129:6829/2933886914","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.849661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.868113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.933488+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.891794+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.901861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.858750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.911712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.996765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:38:15.886 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.885+0000 7f3990141640 1 -- 172.21.15.102:0/4201235025 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f396c06ae70 msgr2=0x7f396c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:15.886 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.885+0000 7f3990141640 1 --2- 172.21.15.102:0/4201235025 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f396c06ae70 0x7f396c06d330 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3984005990 tx=0x7f3984000f30 comp rx=0 tx=0).stop 2023-10-14T09:38:15.887 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.885+0000 7f3990141640 1 -- 172.21.15.102:0/4201235025 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3988151910 msgr2=0x7f3988151d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:15.887 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.885+0000 7f3990141640 1 --2- 172.21.15.102:0/4201235025 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3988151910 0x7f3988151d90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3980001f70 tx=0x7f39800014a0 comp rx=0 tx=0).stop 2023-10-14T09:38:15.888 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.885+0000 7f3990141640 1 -- 172.21.15.102:0/4201235025 shutdown_connections 2023-10-14T09:38:15.888 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.885+0000 7f3990141640 1 --2- 172.21.15.102:0/4201235025 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f396c06ae70 0x7f396c06d330 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:15.888 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.885+0000 7f3990141640 1 --2- 172.21.15.102:0/4201235025 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3988151910 0x7f3988151d90 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:15.888 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.885+0000 7f3990141640 1 --2- 172.21.15.102:0/4201235025 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f398815b360 0x7f398815b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:15.888 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.885+0000 7f3990141640 1 --2- 172.21.15.102:0/4201235025 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3974007390 0x7f3988149540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:15.889 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.885+0000 7f3990141640 1 -- 172.21.15.102:0/4201235025 >> 172.21.15.102:0/4201235025 conn(0x7f39880cb410 msgr2=0x7f398806fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:15.889 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.885+0000 7f3990141640 1 -- 172.21.15.102:0/4201235025 shutdown_connections 2023-10-14T09:38:15.889 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:15.885+0000 7f3990141640 1 -- 172.21.15.102:0/4201235025 wait complete. 2023-10-14T09:38:15.905 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T09:38:15.905 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:38:16.110 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.108+0000 7f29e1ed0640 1 Processor -- start 2023-10-14T09:38:16.110 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.109+0000 7f29e1ed0640 1 -- start start 2023-10-14T09:38:16.112 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.110+0000 7f29e1ed0640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f29dc159b20 0x7f29dc06bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:16.112 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.110+0000 7f29e1ed0640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f29dc0b0b20 0x7f29dc06fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:16.112 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.110+0000 7f29e1ed0640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29dc06f7f0 con 0x7f29dc159f00 2023-10-14T09:38:16.112 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.110+0000 7f29e1ed0640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29dc06c5e0 con 0x7f29dc159b20 2023-10-14T09:38:16.112 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.110+0000 7f29e1ed0640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc06c8c0 con 0x7f29dc0b0b20 2023-10-14T09:38:16.113 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.111+0000 7f29db7fe640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f29dc159b20 0x7f29dc06bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:16.114 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.111+0000 7f29dbfff640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f29dc0b0b20 0x7f29dc06fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:16.114 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.111+0000 7f29dbfff640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f29dc0b0b20 0x7f29dc06fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.102:39292/0 (socket says 172.21.15.102:39292) 2023-10-14T09:38:16.114 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.111+0000 7f29dbfff640 1 -- 172.21.15.102:0/3876400197 learned_addr learned my addr 172.21.15.102:0/3876400197 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:16.114 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.112+0000 7f29db7fe640 1 -- 172.21.15.102:0/3876400197 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f29dc0b0b20 msgr2=0x7f29dc06fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:16.114 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.112+0000 7f29db7fe640 1 --2- 172.21.15.102:0/3876400197 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f29dc0b0b20 0x7f29dc06fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:16.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.112+0000 7f29db7fe640 1 -- 172.21.15.102:0/3876400197 >> v1:172.21.15.129:6789/0 conn(0x7f29dc159f00 legacy=0x7f29dc0b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:16.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.112+0000 7f29db7fe640 1 -- 172.21.15.102:0/3876400197 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29dc06cba0 con 0x7f29dc159b20 2023-10-14T09:38:16.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.112+0000 7f29dbfff640 1 --2- 172.21.15.102:0/3876400197 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f29dc0b0b20 0x7f29dc06fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:38:16.116 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.113+0000 7f29db7fe640 1 --2- 172.21.15.102:0/3876400197 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f29dc159b20 0x7f29dc06bbe0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f29c40097a0 tx=0x7f29c402b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=907c63926aeb1f99 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:16.116 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.113+0000 7f29da7fc640 1 -- 172.21.15.102:0/3876400197 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c402d040 con 0x7f29dc159b20 2023-10-14T09:38:16.116 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.114+0000 7f29da7fc640 1 -- 172.21.15.102:0/3876400197 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c4031810 con 0x7f29dc159b20 2023-10-14T09:38:16.117 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.114+0000 7f29da7fc640 1 -- 172.21.15.102:0/3876400197 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c4031ba0 con 0x7f29dc159b20 2023-10-14T09:38:16.117 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.114+0000 7f29e1ed0640 1 -- 172.21.15.102:0/3876400197 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f29dc159b20 msgr2=0x7f29dc06bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:16.117 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.114+0000 7f29e1ed0640 1 --2- 172.21.15.102:0/3876400197 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f29dc159b20 0x7f29dc06bbe0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f29c40097a0 tx=0x7f29c402b8b0 comp rx=0 tx=0).stop 2023-10-14T09:38:16.117 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.114+0000 7f29e1ed0640 1 -- 172.21.15.102:0/3876400197 shutdown_connections 2023-10-14T09:38:16.117 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.114+0000 7f29e1ed0640 1 --2- 172.21.15.102:0/3876400197 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f29dc0b0b20 0x7f29dc06fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:16.118 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.114+0000 7f29e1ed0640 1 --2- 172.21.15.102:0/3876400197 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f29dc159b20 0x7f29dc06bbe0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:16.118 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.114+0000 7f29e1ed0640 1 -- 172.21.15.102:0/3876400197 >> 172.21.15.102:0/3876400197 conn(0x7f29dc0cb410 msgr2=0x7f29dc0cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:16.118 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.114+0000 7f29e1ed0640 1 -- 172.21.15.102:0/3876400197 shutdown_connections 2023-10-14T09:38:16.118 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.114+0000 7f29e1ed0640 1 -- 172.21.15.102:0/3876400197 wait complete. 2023-10-14T09:38:16.119 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.116+0000 7f29e1ed0640 1 Processor -- start 2023-10-14T09:38:16.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.116+0000 7f29e1ed0640 1 -- start start 2023-10-14T09:38:16.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.117+0000 7f29e1ed0640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f29dc0b0b20 0x7f29dc14dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:16.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.117+0000 7f29e1ed0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29dc159b20 0x7f29dc0ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:16.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.117+0000 7f29e1ed0640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f29dc159f00 0x7f29dc0acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:16.121 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.117+0000 7f29e1ed0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc1f6d60 con 0x7f29dc159b20 2023-10-14T09:38:16.121 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.117+0000 7f29e1ed0640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc1f71f0 con 0x7f29dc159f00 2023-10-14T09:38:16.121 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.117+0000 7f29e1ed0640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc1f6430 con 0x7f29dc0b0b20 2023-10-14T09:38:16.121 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.117+0000 7f29daffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29dc159b20 0x7f29dc0ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:16.121 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.117+0000 7f29daffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29dc159b20 0x7f29dc0ac890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37564/0 (socket says 172.21.15.102:37564) 2023-10-14T09:38:16.121 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.117+0000 7f29daffd640 1 -- 172.21.15.102:0/3578720709 learned_addr learned my addr 172.21.15.102:0/3578720709 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:16.122 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.118+0000 7f29db7fe640 1 --2- 172.21.15.102:0/3578720709 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f29dc0b0b20 0x7f29dc14dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:16.122 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.118+0000 7f29dbfff640 1 --2- 172.21.15.102:0/3578720709 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f29dc159f00 0x7f29dc0acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:16.122 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.118+0000 7f29daffd640 1 -- 172.21.15.102:0/3578720709 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f29dc0b0b20 msgr2=0x7f29dc14dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:16.122 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.118+0000 7f29daffd640 1 --2- 172.21.15.102:0/3578720709 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f29dc0b0b20 0x7f29dc14dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:16.122 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.118+0000 7f29daffd640 1 -- 172.21.15.102:0/3578720709 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f29dc159f00 msgr2=0x7f29dc0acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:16.123 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.118+0000 7f29daffd640 1 --2- 172.21.15.102:0/3578720709 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f29dc159f00 0x7f29dc0acdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:16.123 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.118+0000 7f29daffd640 1 -- 172.21.15.102:0/3578720709 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d40094d0 con 0x7f29dc159b20 2023-10-14T09:38:16.124 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.118+0000 7f29daffd640 1 --2- 172.21.15.102:0/3578720709 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29dc159b20 0x7f29dc0ac890 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f29cc00c7a0 tx=0x7f29cc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:16.124 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.118+0000 7f29d3fff640 1 -- 172.21.15.102:0/3578720709 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc003b70 con 0x7f29dc159b20 2023-10-14T09:38:16.125 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.119+0000 7f29d3fff640 1 -- 172.21.15.102:0/3578720709 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29cc003cd0 con 0x7f29dc159b20 2023-10-14T09:38:16.125 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.119+0000 7f29d3fff640 1 -- 172.21.15.102:0/3578720709 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc00aa90 con 0x7f29dc159b20 2023-10-14T09:38:16.125 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.119+0000 7f29e1ed0640 1 -- 172.21.15.102:0/3578720709 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c4009400 con 0x7f29dc159b20 2023-10-14T09:38:16.125 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.119+0000 7f29e1ed0640 1 -- 172.21.15.102:0/3578720709 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29dc1f69f0 con 0x7f29dc159b20 2023-10-14T09:38:16.125 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.120+0000 7f29e1ed0640 1 -- 172.21.15.102:0/3578720709 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29dc04e160 con 0x7f29dc159b20 2023-10-14T09:38:16.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.121+0000 7f29d3fff640 1 -- 172.21.15.102:0/3578720709 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f29cc00abf0 con 0x7f29dc159b20 2023-10-14T09:38:16.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.122+0000 7f29d3fff640 1 --2- 172.21.15.102:0/3578720709 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f29bc06ae70 0x7f29bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:16.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.122+0000 7f29d3fff640 1 -- 172.21.15.102:0/3578720709 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f29cc089530 con 0x7f29dc159b20 2023-10-14T09:38:16.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.122+0000 7f29db7fe640 1 --2- 172.21.15.102:0/3578720709 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f29bc06ae70 0x7f29bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:16.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.123+0000 7f29db7fe640 1 --2- 172.21.15.102:0/3578720709 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f29bc06ae70 0x7f29bc06d330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f29c4036000 tx=0x7f29c403c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:16.127 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.126+0000 7f29d3fff640 1 -- 172.21.15.102:0/3578720709 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f29cc054550 con 0x7f29dc159b20 2023-10-14T09:38:16.337 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.335+0000 7f29e1ed0640 1 -- 172.21.15.102:0/3578720709 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29dc15e2d0 con 0x7f29dc159b20 2023-10-14T09:38:16.338 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.337+0000 7f29d3fff640 1 -- 172.21.15.102:0/3578720709 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4916 (secure 0 0 0) 0x7f29cc057b70 con 0x7f29dc159b20 2023-10-14T09:38:16.339 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:38:16.339 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6835/3867702876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6833","nonce":3867702876},{"type":"v1","addr":"172.21.15.129:6835","nonce":3867702876}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6834/1559210030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":1559210030},{"type":"v1","addr":"172.21.15.129:6834","nonce":1559210030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1277026451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1277026451},{"type":"v1","addr":"172.21.15.102:6835","nonce":1277026451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T09:37:21.362625+0000","modified":"2023-10-14T09:37:24.408132+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6837/527707922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":527707922},{"type":"v1","addr":"172.21.15.102:6837","nonce":527707922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T09:38:16.339 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 8 2023-10-14T09:38:16.341 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.339+0000 7f29e1ed0640 1 -- 172.21.15.102:0/3578720709 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f29bc06ae70 msgr2=0x7f29bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:16.341 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.339+0000 7f29e1ed0640 1 --2- 172.21.15.102:0/3578720709 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f29bc06ae70 0x7f29bc06d330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f29c4036000 tx=0x7f29c403c040 comp rx=0 tx=0).stop 2023-10-14T09:38:16.341 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.339+0000 7f29e1ed0640 1 -- 172.21.15.102:0/3578720709 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29dc159b20 msgr2=0x7f29dc0ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:16.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.339+0000 7f29e1ed0640 1 --2- 172.21.15.102:0/3578720709 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29dc159b20 0x7f29dc0ac890 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f29cc00c7a0 tx=0x7f29cc00cc60 comp rx=0 tx=0).stop 2023-10-14T09:38:16.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.339+0000 7f29e1ed0640 1 -- 172.21.15.102:0/3578720709 shutdown_connections 2023-10-14T09:38:16.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.339+0000 7f29e1ed0640 1 --2- 172.21.15.102:0/3578720709 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f29bc06ae70 0x7f29bc06d330 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:16.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.339+0000 7f29e1ed0640 1 --2- 172.21.15.102:0/3578720709 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f29dc159f00 0x7f29dc0acdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:16.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.339+0000 7f29e1ed0640 1 --2- 172.21.15.102:0/3578720709 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29dc159b20 0x7f29dc0ac890 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:16.343 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.339+0000 7f29e1ed0640 1 --2- 172.21.15.102:0/3578720709 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f29dc0b0b20 0x7f29dc14dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:16.343 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.339+0000 7f29e1ed0640 1 -- 172.21.15.102:0/3578720709 >> 172.21.15.102:0/3578720709 conn(0x7f29dc0cb410 msgr2=0x7f29dc0b0260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:16.343 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.339+0000 7f29e1ed0640 1 -- 172.21.15.102:0/3578720709 shutdown_connections 2023-10-14T09:38:16.343 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.339+0000 7f29e1ed0640 1 -- 172.21.15.102:0/3578720709 wait complete. 2023-10-14T09:38:16.359 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:38:16.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.564+0000 7f2d4d0c2640 1 Processor -- start 2023-10-14T09:38:16.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.564+0000 7f2d4d0c2640 1 -- start start 2023-10-14T09:38:16.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.566+0000 7f2d4d0c2640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2d480b0b20 0x7f2d481615f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:16.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.566+0000 7f2d4d0c2640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2d4815d3f0 0x7f2d4815d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:16.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.566+0000 7f2d4d0c2640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d4815e3e0 con 0x7f2d480cd0c0 2023-10-14T09:38:16.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.566+0000 7f2d4d0c2640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d480cd4a0 con 0x7f2d480b0b20 2023-10-14T09:38:16.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.566+0000 7f2d4d0c2640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4815e100 con 0x7f2d4815d3f0 2023-10-14T09:38:16.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.566+0000 7f2d3ffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2d480b0b20 0x7f2d481615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:16.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.566+0000 7f2d3ffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2d480b0b20 0x7f2d481615f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37572/0 (socket says 172.21.15.102:37572) 2023-10-14T09:38:16.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.566+0000 7f2d3ffff640 1 -- 172.21.15.102:0/3241377361 learned_addr learned my addr 172.21.15.102:0/3241377361 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:16.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.567+0000 7f2d4759e640 1 --2- 172.21.15.102:0/3241377361 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2d4815d3f0 0x7f2d4815d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:16.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.567+0000 7f2d3ffff640 1 -- 172.21.15.102:0/3241377361 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2d4815d3f0 msgr2=0x7f2d4815d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:16.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.567+0000 7f2d3ffff640 1 --2- 172.21.15.102:0/3241377361 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2d4815d3f0 0x7f2d4815d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:16.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.567+0000 7f2d3ffff640 1 -- 172.21.15.102:0/3241377361 >> v1:172.21.15.129:6789/0 conn(0x7f2d480cd0c0 legacy=0x7f2d480b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:16.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.567+0000 7f2d3ffff640 1 -- 172.21.15.102:0/3241377361 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d48160b10 con 0x7f2d480b0b20 2023-10-14T09:38:16.572 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.569+0000 7f2d3ffff640 1 --2- 172.21.15.102:0/3241377361 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d480b0b20 0x7f2d481615f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2d30009870 tx=0x7f2d3002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e64fba7d613776 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:16.572 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.569+0000 7f2d4659c640 1 -- 172.21.15.102:0/3241377361 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d30031640 con 0x7f2d480b0b20 2023-10-14T09:38:16.572 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.569+0000 7f2d4659c640 1 -- 172.21.15.102:0/3241377361 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d300317a0 con 0x7f2d480b0b20 2023-10-14T09:38:16.572 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.569+0000 7f2d4659c640 1 -- 172.21.15.102:0/3241377361 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d30031b30 con 0x7f2d480b0b20 2023-10-14T09:38:16.573 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.570+0000 7f2d4d0c2640 1 -- 172.21.15.102:0/3241377361 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d480b0b20 msgr2=0x7f2d481615f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:16.573 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.570+0000 7f2d4d0c2640 1 --2- 172.21.15.102:0/3241377361 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d480b0b20 0x7f2d481615f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2d30009870 tx=0x7f2d3002b8f0 comp rx=0 tx=0).stop 2023-10-14T09:38:16.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.570+0000 7f2d4d0c2640 1 -- 172.21.15.102:0/3241377361 shutdown_connections 2023-10-14T09:38:16.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.570+0000 7f2d4d0c2640 1 --2- 172.21.15.102:0/3241377361 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2d4815d3f0 0x7f2d4815d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:16.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.570+0000 7f2d4d0c2640 1 --2- 172.21.15.102:0/3241377361 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d480b0b20 0x7f2d481615f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:16.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.570+0000 7f2d4d0c2640 1 -- 172.21.15.102:0/3241377361 >> 172.21.15.102:0/3241377361 conn(0x7f2d480cb410 msgr2=0x7f2d480cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:16.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.570+0000 7f2d4d0c2640 1 -- 172.21.15.102:0/3241377361 shutdown_connections 2023-10-14T09:38:16.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.570+0000 7f2d4d0c2640 1 -- 172.21.15.102:0/3241377361 wait complete. 2023-10-14T09:38:16.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.572+0000 7f2d4d0c2640 1 Processor -- start 2023-10-14T09:38:16.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.572+0000 7f2d4d0c2640 1 -- start start 2023-10-14T09:38:16.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.573+0000 7f2d4d0c2640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2d480b0b20 0x7f2d481e6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:16.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.573+0000 7f2d4d0c2640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2d480cd0c0 0x7f2d48145fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:16.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.573+0000 7f2d4d0c2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d4815d3f0 0x7f2d480af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:16.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.573+0000 7f2d4d0c2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d480ae4c0 con 0x7f2d4815d3f0 2023-10-14T09:38:16.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.573+0000 7f2d4d0c2640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d480aed60 con 0x7f2d480b0b20 2023-10-14T09:38:16.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.573+0000 7f2d4d0c2640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d480b07c0 con 0x7f2d480cd0c0 2023-10-14T09:38:16.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.573+0000 7f2d4759e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d4815d3f0 0x7f2d480af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:16.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.573+0000 7f2d4759e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d4815d3f0 0x7f2d480af1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37578/0 (socket says 172.21.15.102:37578) 2023-10-14T09:38:16.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.573+0000 7f2d4759e640 1 -- 172.21.15.102:0/3512460802 learned_addr learned my addr 172.21.15.102:0/3512460802 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:16.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.573+0000 7f2d46d9d640 1 --2- 172.21.15.102:0/3512460802 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2d480b0b20 0x7f2d481e6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:16.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.573+0000 7f2d3ffff640 1 --2- 172.21.15.102:0/3512460802 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2d480cd0c0 0x7f2d48145fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:16.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.574+0000 7f2d4759e640 1 -- 172.21.15.102:0/3512460802 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2d480cd0c0 msgr2=0x7f2d48145fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:16.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.574+0000 7f2d4759e640 1 --2- 172.21.15.102:0/3512460802 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2d480cd0c0 0x7f2d48145fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:16.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.574+0000 7f2d4759e640 1 -- 172.21.15.102:0/3512460802 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2d480b0b20 msgr2=0x7f2d481e6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:16.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.574+0000 7f2d4759e640 1 --2- 172.21.15.102:0/3512460802 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2d480b0b20 0x7f2d481e6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:16.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.574+0000 7f2d4759e640 1 -- 172.21.15.102:0/3512460802 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d300094d0 con 0x7f2d4815d3f0 2023-10-14T09:38:16.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.574+0000 7f2d46d9d640 1 --2- 172.21.15.102:0/3512460802 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2d480b0b20 0x7f2d481e6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:16.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.574+0000 7f2d4759e640 1 --2- 172.21.15.102:0/3512460802 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d4815d3f0 0x7f2d480af1f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2d40007e40 tx=0x7f2d4000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:16.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.574+0000 7f2d3f7fe640 1 -- 172.21.15.102:0/3512460802 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d40014620 con 0x7f2d4815d3f0 2023-10-14T09:38:16.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.574+0000 7f2d3f7fe640 1 -- 172.21.15.102:0/3512460802 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4000ee90 con 0x7f2d4815d3f0 2023-10-14T09:38:16.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.574+0000 7f2d4d0c2640 1 -- 172.21.15.102:0/3512460802 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d480ae710 con 0x7f2d4815d3f0 2023-10-14T09:38:16.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.574+0000 7f2d3f7fe640 1 -- 172.21.15.102:0/3512460802 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d400149e0 con 0x7f2d4815d3f0 2023-10-14T09:38:16.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.574+0000 7f2d4d0c2640 1 -- 172.21.15.102:0/3512460802 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d48156ea0 con 0x7f2d4815d3f0 2023-10-14T09:38:16.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.575+0000 7f2d4d0c2640 1 -- 172.21.15.102:0/3512460802 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d480aeed0 con 0x7f2d4815d3f0 2023-10-14T09:38:16.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.576+0000 7f2d3f7fe640 1 -- 172.21.15.102:0/3512460802 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2d40014b40 con 0x7f2d4815d3f0 2023-10-14T09:38:16.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.577+0000 7f2d3f7fe640 1 --2- 172.21.15.102:0/3512460802 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2d2806aea0 0x7f2d2806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:16.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.577+0000 7f2d3f7fe640 1 -- 172.21.15.102:0/3512460802 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f2d4008a050 con 0x7f2d4815d3f0 2023-10-14T09:38:16.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.577+0000 7f2d46d9d640 1 --2- 172.21.15.102:0/3512460802 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2d2806aea0 0x7f2d2806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:16.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.578+0000 7f2d46d9d640 1 --2- 172.21.15.102:0/3512460802 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2d2806aea0 0x7f2d2806d360 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2d38000f60 tx=0x7f2d38009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:16.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.581+0000 7f2d3f7fe640 1 -- 172.21.15.102:0/3512460802 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2d40055070 con 0x7f2d4815d3f0 2023-10-14T09:38:16.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.808+0000 7f2d4d0c2640 1 -- 172.21.15.102:0/3512460802 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d4804e160 con 0x7f2d4815d3f0 2023-10-14T09:38:16.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.809+0000 7f2d3f7fe640 1 -- 172.21.15.102:0/3512460802 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4916 (secure 0 0 0) 0x7f2d40058690 con 0x7f2d4815d3f0 2023-10-14T09:38:16.811 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:38:16.811 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6835/3867702876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6833","nonce":3867702876},{"type":"v1","addr":"172.21.15.129:6835","nonce":3867702876}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6834/1559210030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":1559210030},{"type":"v1","addr":"172.21.15.129:6834","nonce":1559210030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1277026451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1277026451},{"type":"v1","addr":"172.21.15.102:6835","nonce":1277026451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T09:37:21.362625+0000","modified":"2023-10-14T09:37:24.408132+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6837/527707922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":527707922},{"type":"v1","addr":"172.21.15.102:6837","nonce":527707922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T09:38:16.812 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 8 2023-10-14T09:38:16.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.811+0000 7f2d4d0c2640 1 -- 172.21.15.102:0/3512460802 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2d2806aea0 msgr2=0x7f2d2806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:16.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.811+0000 7f2d4d0c2640 1 --2- 172.21.15.102:0/3512460802 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2d2806aea0 0x7f2d2806d360 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2d38000f60 tx=0x7f2d38009040 comp rx=0 tx=0).stop 2023-10-14T09:38:16.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.812+0000 7f2d4d0c2640 1 -- 172.21.15.102:0/3512460802 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d4815d3f0 msgr2=0x7f2d480af1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:16.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.812+0000 7f2d4d0c2640 1 --2- 172.21.15.102:0/3512460802 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d4815d3f0 0x7f2d480af1f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2d40007e40 tx=0x7f2d4000e4b0 comp rx=0 tx=0).stop 2023-10-14T09:38:16.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.812+0000 7f2d4d0c2640 1 -- 172.21.15.102:0/3512460802 shutdown_connections 2023-10-14T09:38:16.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.812+0000 7f2d4d0c2640 1 --2- 172.21.15.102:0/3512460802 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2d2806aea0 0x7f2d2806d360 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:16.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.812+0000 7f2d4d0c2640 1 --2- 172.21.15.102:0/3512460802 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d4815d3f0 0x7f2d480af1f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:16.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.812+0000 7f2d4d0c2640 1 --2- 172.21.15.102:0/3512460802 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2d480cd0c0 0x7f2d48145fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:16.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.812+0000 7f2d4d0c2640 1 --2- 172.21.15.102:0/3512460802 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2d480b0b20 0x7f2d481e6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:16.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.812+0000 7f2d4d0c2640 1 -- 172.21.15.102:0/3512460802 >> 172.21.15.102:0/3512460802 conn(0x7f2d480cb410 msgr2=0x7f2d4815cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:16.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.812+0000 7f2d4d0c2640 1 -- 172.21.15.102:0/3512460802 shutdown_connections 2023-10-14T09:38:16.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:16.812+0000 7f2d4d0c2640 1 -- 172.21.15.102:0/3512460802 wait complete. 2023-10-14T09:38:16.833 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:38:17.047 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.046+0000 7fb4f24b4640 1 Processor -- start 2023-10-14T09:38:17.048 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.046+0000 7fb4f24b4640 1 -- start start 2023-10-14T09:38:17.049 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.047+0000 7fb4f24b4640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb4ec070b60 0x7fb4ec15a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:17.049 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.047+0000 7fb4f24b4640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fb4ec06c100 0x7fb4ec06c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:17.050 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.047+0000 7fb4f24b4640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4ec15aef0 con 0x7fb4ec159950 2023-10-14T09:38:17.050 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.047+0000 7fb4f24b4640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4ec15e490 con 0x7fb4ec06c100 2023-10-14T09:38:17.050 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.047+0000 7fb4f24b4640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec15d910 con 0x7fb4ec070b60 2023-10-14T09:38:17.051 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.048+0000 7fb4f1cb3640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fb4ec06c100 0x7fb4ec06c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:17.051 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.048+0000 7fb4f1cb3640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fb4ec06c100 0x7fb4ec06c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.102:54592/0 (socket says 172.21.15.102:54592) 2023-10-14T09:38:17.051 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.048+0000 7fb4f1cb3640 1 -- 172.21.15.102:0/3638264219 learned_addr learned my addr 172.21.15.102:0/3638264219 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:17.051 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.048+0000 7fb4f0cb1640 1 --2- 172.21.15.102:0/3638264219 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb4ec070b60 0x7fb4ec15a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:17.052 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.049+0000 7fb4f1cb3640 1 -- 172.21.15.102:0/3638264219 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb4ec070b60 msgr2=0x7fb4ec15a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:17.052 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.049+0000 7fb4f1cb3640 1 --2- 172.21.15.102:0/3638264219 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb4ec070b60 0x7fb4ec15a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:17.052 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.049+0000 7fb4f1cb3640 1 -- 172.21.15.102:0/3638264219 >> v1:172.21.15.129:6789/0 conn(0x7fb4ec159950 legacy=0x7fb4ec070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:17.052 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.049+0000 7fb4f1cb3640 1 -- 172.21.15.102:0/3638264219 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ec15dbf0 con 0x7fb4ec06c100 2023-10-14T09:38:17.053 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.050+0000 7fb4f1cb3640 1 --2- 172.21.15.102:0/3638264219 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb4ec06c100 0x7fb4ec06c550 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4009e50 tx=0x7fb4e402bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff6273af33ac1754 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:17.053 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.051+0000 7fb4e3fff640 1 -- 172.21.15.102:0/3638264219 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e402ca70 con 0x7fb4ec06c100 2023-10-14T09:38:17.054 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.051+0000 7fb4e3fff640 1 -- 172.21.15.102:0/3638264219 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e402cbd0 con 0x7fb4ec06c100 2023-10-14T09:38:17.054 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.051+0000 7fb4e3fff640 1 -- 172.21.15.102:0/3638264219 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e40343f0 con 0x7fb4ec06c100 2023-10-14T09:38:17.054 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.051+0000 7fb4f24b4640 1 -- 172.21.15.102:0/3638264219 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb4ec06c100 msgr2=0x7fb4ec06c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:17.054 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.051+0000 7fb4f24b4640 1 --2- 172.21.15.102:0/3638264219 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb4ec06c100 0x7fb4ec06c550 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4009e50 tx=0x7fb4e402bed0 comp rx=0 tx=0).stop 2023-10-14T09:38:17.054 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.051+0000 7fb4f24b4640 1 -- 172.21.15.102:0/3638264219 shutdown_connections 2023-10-14T09:38:17.055 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.051+0000 7fb4f24b4640 1 --2- 172.21.15.102:0/3638264219 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb4ec06c100 0x7fb4ec06c550 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:17.055 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.051+0000 7fb4f24b4640 1 --2- 172.21.15.102:0/3638264219 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb4ec070b60 0x7fb4ec15a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:17.055 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.051+0000 7fb4f24b4640 1 -- 172.21.15.102:0/3638264219 >> 172.21.15.102:0/3638264219 conn(0x7fb4ec0ce6a0 msgr2=0x7fb4ec0ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:17.055 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.051+0000 7fb4f24b4640 1 -- 172.21.15.102:0/3638264219 shutdown_connections 2023-10-14T09:38:17.055 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.051+0000 7fb4f24b4640 1 -- 172.21.15.102:0/3638264219 wait complete. 2023-10-14T09:38:17.057 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.053+0000 7fb4f24b4640 1 Processor -- start 2023-10-14T09:38:17.058 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.053+0000 7fb4f24b4640 1 -- start start 2023-10-14T09:38:17.058 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.054+0000 7fb4f24b4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb4ec06c100 0x7fb4ec157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:17.058 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.054+0000 7fb4f24b4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb4ec070b60 0x7fb4ec0c7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:17.058 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.054+0000 7fb4f24b4640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb4ec159950 0x7fb4ec0c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:17.058 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.054+0000 7fb4f24b4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec157a40 con 0x7fb4ec070b60 2023-10-14T09:38:17.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.054+0000 7fb4f24b4640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec0c85c0 con 0x7fb4ec06c100 2023-10-14T09:38:17.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.054+0000 7fb4f24b4640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec0c82e0 con 0x7fb4ec159950 2023-10-14T09:38:17.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.055+0000 7fb4f0cb1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb4ec070b60 0x7fb4ec0c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:17.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.055+0000 7fb4f0cb1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb4ec070b60 0x7fb4ec0c7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37586/0 (socket says 172.21.15.102:37586) 2023-10-14T09:38:17.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.055+0000 7fb4f0cb1640 1 -- 172.21.15.102:0/1463668241 learned_addr learned my addr 172.21.15.102:0/1463668241 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:17.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.055+0000 7fb4f14b2640 1 --2- 172.21.15.102:0/1463668241 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb4ec06c100 0x7fb4ec157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:17.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.055+0000 7fb4f1cb3640 1 --2- 172.21.15.102:0/1463668241 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb4ec159950 0x7fb4ec0c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:17.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.055+0000 7fb4f0cb1640 1 -- 172.21.15.102:0/1463668241 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb4ec159950 msgr2=0x7fb4ec0c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:17.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.055+0000 7fb4f0cb1640 1 --2- 172.21.15.102:0/1463668241 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb4ec159950 0x7fb4ec0c7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:17.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.055+0000 7fb4f0cb1640 1 -- 172.21.15.102:0/1463668241 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb4ec06c100 msgr2=0x7fb4ec157500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:17.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.055+0000 7fb4f0cb1640 1 --2- 172.21.15.102:0/1463668241 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb4ec06c100 0x7fb4ec157500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:17.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.055+0000 7fb4f0cb1640 1 -- 172.21.15.102:0/1463668241 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e4009b30 con 0x7fb4ec070b60 2023-10-14T09:38:17.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.055+0000 7fb4f14b2640 1 --2- 172.21.15.102:0/1463668241 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb4ec06c100 0x7fb4ec157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:17.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.056+0000 7fb4f0cb1640 1 --2- 172.21.15.102:0/1463668241 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb4ec070b60 0x7fb4ec0c7780 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc00e9b0 tx=0x7fb4dc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:17.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.056+0000 7fb4e1ffb640 1 -- 172.21.15.102:0/1463668241 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc009670 con 0x7fb4ec070b60 2023-10-14T09:38:17.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.056+0000 7fb4e1ffb640 1 -- 172.21.15.102:0/1463668241 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4dc00c9a0 con 0x7fb4ec070b60 2023-10-14T09:38:17.062 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.056+0000 7fb4f24b4640 1 -- 172.21.15.102:0/1463668241 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4ec0c4110 con 0x7fb4ec070b60 2023-10-14T09:38:17.062 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.056+0000 7fb4e1ffb640 1 -- 172.21.15.102:0/1463668241 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc00cd50 con 0x7fb4ec070b60 2023-10-14T09:38:17.062 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.056+0000 7fb4f24b4640 1 -- 172.21.15.102:0/1463668241 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4ec0c46d0 con 0x7fb4ec070b60 2023-10-14T09:38:17.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.057+0000 7fb4f24b4640 1 -- 172.21.15.102:0/1463668241 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4ec04e9b0 con 0x7fb4ec070b60 2023-10-14T09:38:17.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.058+0000 7fb4e1ffb640 1 -- 172.21.15.102:0/1463668241 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb4dc013470 con 0x7fb4ec070b60 2023-10-14T09:38:17.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.059+0000 7fb4e1ffb640 1 --2- 172.21.15.102:0/1463668241 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fb4d006ae70 0x7fb4d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:17.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.059+0000 7fb4e1ffb640 1 -- 172.21.15.102:0/1463668241 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fb4dc089960 con 0x7fb4ec070b60 2023-10-14T09:38:17.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.059+0000 7fb4f14b2640 1 --2- 172.21.15.102:0/1463668241 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fb4d006ae70 0x7fb4d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:17.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.060+0000 7fb4f14b2640 1 --2- 172.21.15.102:0/1463668241 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fb4d006ae70 0x7fb4d006d330 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8000f60 tx=0x7fb4e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:17.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.063+0000 7fb4e1ffb640 1 -- 172.21.15.102:0/1463668241 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb4dc054970 con 0x7fb4ec070b60 2023-10-14T09:38:17.257 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.255+0000 7fb4f24b4640 1 -- 172.21.15.102:0/1463668241 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4ec0b4620 con 0x7fb4ec070b60 2023-10-14T09:38:17.259 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.257+0000 7fb4e1ffb640 1 -- 172.21.15.102:0/1463668241 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16838 (secure 0 0 0) 0x7fb4dc017090 con 0x7fb4ec070b60 2023-10-14T09:38:17.260 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:38:17.260 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":24,"fsid":"8a6cd69d-7f5b-4f2a-806a-0176c10aed50","created":"2023-10-14T09:36:56.745172+0000","modified":"2023-10-14T09:38:03.788214+0000","last_up_change":"2023-10-14T09:37:09.791473+0000","last_in_change":"2023-10-14T09:37:00.547186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:37:09.952407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:37:19.560925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:37:20.363385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e5aef8f3-878f-482b-b522-9a5b958b90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6801","nonce":1727250718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6803","nonce":1727250718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6807","nonce":1727250718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6805","nonce":1727250718}]},"public_addr":"172.21.15.102:6801/1727250718","cluster_addr":"172.21.15.102:6803/1727250718","heartbeat_back_addr":"172.21.15.102:6807/1727250718","heartbeat_front_addr":"172.21.15.102:6805/1727250718","state":["exists","up"]},{"osd":1,"uuid":"4a8cf50e-387b-4d47-9588-bd22e375a9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6809","nonce":1095651107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6811","nonce":1095651107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6815","nonce":1095651107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6813","nonce":1095651107}]},"public_addr":"172.21.15.102:6809/1095651107","cluster_addr":"172.21.15.102:6811/1095651107","heartbeat_back_addr":"172.21.15.102:6815/1095651107","heartbeat_front_addr":"172.21.15.102:6813/1095651107","state":["exists","up"]},{"osd":2,"uuid":"009ef55f-8a63-4219-bacd-d7c7b4500867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6820","nonce":2198222556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6825","nonce":2198222556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6831","nonce":2198222556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6829","nonce":2198222556}]},"public_addr":"172.21.15.102:6820/2198222556","cluster_addr":"172.21.15.102:6825/2198222556","heartbeat_back_addr":"172.21.15.102:6831/2198222556","heartbeat_front_addr":"172.21.15.102:6829/2198222556","state":["exists","up"]},{"osd":3,"uuid":"f2110eae-2ff9-4ed9-93d6-bd2361618211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6818","nonce":654726740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6821","nonce":654726740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6827","nonce":654726740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6823","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6824","nonce":654726740}]},"public_addr":"172.21.15.102:6818/654726740","cluster_addr":"172.21.15.102:6821/654726740","heartbeat_back_addr":"172.21.15.102:6827/654726740","heartbeat_front_addr":"172.21.15.102:6824/654726740","state":["exists","up"]},{"osd":4,"uuid":"33f1ae34-3100-40f7-9cb8-0eca2b358693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6817","nonce":507586170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6819","nonce":507586170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6823","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6825","nonce":507586170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6821","nonce":507586170}]},"public_addr":"172.21.15.129:6817/507586170","cluster_addr":"172.21.15.129:6819/507586170","heartbeat_back_addr":"172.21.15.129:6825/507586170","heartbeat_front_addr":"172.21.15.129:6821/507586170","state":["exists","up"]},{"osd":5,"uuid":"fab2fc62-3f3e-450d-93e0-770f39e80710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6801","nonce":1913451073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6803","nonce":1913451073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6807","nonce":1913451073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6805","nonce":1913451073}]},"public_addr":"172.21.15.129:6801/1913451073","cluster_addr":"172.21.15.129:6803/1913451073","heartbeat_back_addr":"172.21.15.129:6807/1913451073","heartbeat_front_addr":"172.21.15.129:6805/1913451073","state":["exists","up"]},{"osd":6,"uuid":"d7cc1d69-92e7-4253-a127-cfc0444a4809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6809","nonce":2853291511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6811","nonce":2853291511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6815","nonce":2853291511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6813","nonce":2853291511}]},"public_addr":"172.21.15.129:6809/2853291511","cluster_addr":"172.21.15.129:6811/2853291511","heartbeat_back_addr":"172.21.15.129:6815/2853291511","heartbeat_front_addr":"172.21.15.129:6813/2853291511","state":["exists","up"]},{"osd":7,"uuid":"1e403de1-09e2-4370-b9a7-e790ac44bbee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6824","nonce":2933886914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6827","nonce":2933886914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6831","nonce":2933886914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6829","nonce":2933886914}]},"public_addr":"172.21.15.129:6824/2933886914","cluster_addr":"172.21.15.129:6827/2933886914","heartbeat_back_addr":"172.21.15.129:6831/2933886914","heartbeat_front_addr":"172.21.15.129:6829/2933886914","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.849661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.868113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.933488+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.891794+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.901861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.858750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.911712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.996765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:38:17.262 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.260+0000 7fb4f24b4640 1 -- 172.21.15.102:0/1463668241 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fb4d006ae70 msgr2=0x7fb4d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:17.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.260+0000 7fb4f24b4640 1 --2- 172.21.15.102:0/1463668241 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fb4d006ae70 0x7fb4d006d330 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8000f60 tx=0x7fb4e8009040 comp rx=0 tx=0).stop 2023-10-14T09:38:17.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.260+0000 7fb4f24b4640 1 -- 172.21.15.102:0/1463668241 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb4ec070b60 msgr2=0x7fb4ec0c7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:17.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.260+0000 7fb4f24b4640 1 --2- 172.21.15.102:0/1463668241 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb4ec070b60 0x7fb4ec0c7780 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc00e9b0 tx=0x7fb4dc00ee70 comp rx=0 tx=0).stop 2023-10-14T09:38:17.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.260+0000 7fb4f24b4640 1 -- 172.21.15.102:0/1463668241 shutdown_connections 2023-10-14T09:38:17.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.260+0000 7fb4f24b4640 1 --2- 172.21.15.102:0/1463668241 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fb4d006ae70 0x7fb4d006d330 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:17.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.260+0000 7fb4f24b4640 1 --2- 172.21.15.102:0/1463668241 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb4ec159950 0x7fb4ec0c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:17.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.260+0000 7fb4f24b4640 1 --2- 172.21.15.102:0/1463668241 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb4ec070b60 0x7fb4ec0c7780 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:17.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.260+0000 7fb4f24b4640 1 --2- 172.21.15.102:0/1463668241 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb4ec06c100 0x7fb4ec157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:17.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.260+0000 7fb4f24b4640 1 -- 172.21.15.102:0/1463668241 >> 172.21.15.102:0/1463668241 conn(0x7fb4ec0ce6a0 msgr2=0x7fb4ec06c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:17.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.261+0000 7fb4f24b4640 1 -- 172.21.15.102:0/1463668241 shutdown_connections 2023-10-14T09:38:17.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.261+0000 7fb4f24b4640 1 -- 172.21.15.102:0/1463668241 wait complete. 2023-10-14T09:38:17.282 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-14T09:38:17.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.492+0000 7fb5a59b6640 1 Processor -- start 2023-10-14T09:38:17.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.493+0000 7fb5a59b6640 1 -- start start 2023-10-14T09:38:17.496 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.494+0000 7fb5a59b6640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb5a006a4b0 0x7fb5a00ca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:17.497 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.494+0000 7fb5a59b6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb5a00c9ca0 0x7fb5a00ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:17.497 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.494+0000 7fb5a59b6640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5a00cb030 con 0x7fb5a015ad70 2023-10-14T09:38:17.497 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.494+0000 7fb5a59b6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5a00cae30 con 0x7fb5a00c9ca0 2023-10-14T09:38:17.497 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.494+0000 7fb5a59b6640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a00c91c0 con 0x7fb5a006a4b0 2023-10-14T09:38:17.497 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.494+0000 7fb59f7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb5a00c9ca0 0x7fb5a00ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:17.497 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.494+0000 7fb59f7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb5a00c9ca0 0x7fb5a00ca8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37592/0 (socket says 172.21.15.102:37592) 2023-10-14T09:38:17.498 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.494+0000 7fb59f7fe640 1 -- 172.21.15.102:0/157919560 learned_addr learned my addr 172.21.15.102:0/157919560 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:17.498 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.495+0000 7fb59e7fc640 1 --2- 172.21.15.102:0/157919560 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb5a006a4b0 0x7fb5a00ca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:17.498 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.495+0000 7fb59f7fe640 1 -- 172.21.15.102:0/157919560 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb5a006a4b0 msgr2=0x7fb5a00ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:17.498 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.495+0000 7fb59f7fe640 1 --2- 172.21.15.102:0/157919560 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb5a006a4b0 0x7fb5a00ca3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:17.498 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.495+0000 7fb59f7fe640 1 -- 172.21.15.102:0/157919560 >> v1:172.21.15.129:6789/0 conn(0x7fb5a015ad70 legacy=0x7fb5a0069da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:17.499 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.495+0000 7fb59f7fe640 1 -- 172.21.15.102:0/157919560 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a00c94a0 con 0x7fb5a00c9ca0 2023-10-14T09:38:17.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.496+0000 7fb59f7fe640 1 --2- 172.21.15.102:0/157919560 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5a00c9ca0 0x7fb5a00ca8f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb598009870 tx=0x7fb59802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5f10432ccd3c580 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:17.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.496+0000 7fb59dffb640 1 -- 172.21.15.102:0/157919560 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb598031640 con 0x7fb5a00c9ca0 2023-10-14T09:38:17.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.496+0000 7fb59dffb640 1 -- 172.21.15.102:0/157919560 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5980317a0 con 0x7fb5a00c9ca0 2023-10-14T09:38:17.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.496+0000 7fb59dffb640 1 -- 172.21.15.102:0/157919560 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb598031b30 con 0x7fb5a00c9ca0 2023-10-14T09:38:17.501 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.497+0000 7fb5a59b6640 1 -- 172.21.15.102:0/157919560 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5a00c9ca0 msgr2=0x7fb5a00ca8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:17.501 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.497+0000 7fb5a59b6640 1 --2- 172.21.15.102:0/157919560 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5a00c9ca0 0x7fb5a00ca8f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb598009870 tx=0x7fb59802b8f0 comp rx=0 tx=0).stop 2023-10-14T09:38:17.501 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.497+0000 7fb5a59b6640 1 -- 172.21.15.102:0/157919560 shutdown_connections 2023-10-14T09:38:17.501 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.497+0000 7fb5a59b6640 1 --2- 172.21.15.102:0/157919560 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5a00c9ca0 0x7fb5a00ca8f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:17.501 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.497+0000 7fb5a59b6640 1 --2- 172.21.15.102:0/157919560 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb5a006a4b0 0x7fb5a00ca3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:17.501 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.497+0000 7fb5a59b6640 1 -- 172.21.15.102:0/157919560 >> 172.21.15.102:0/157919560 conn(0x7fb5a00ce9b0 msgr2=0x7fb5a00cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:17.502 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.497+0000 7fb5a59b6640 1 -- 172.21.15.102:0/157919560 shutdown_connections 2023-10-14T09:38:17.502 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.497+0000 7fb5a59b6640 1 -- 172.21.15.102:0/157919560 wait complete. 2023-10-14T09:38:17.504 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.499+0000 7fb5a59b6640 1 Processor -- start 2023-10-14T09:38:17.504 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.499+0000 7fb5a59b6640 1 -- start start 2023-10-14T09:38:17.504 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.500+0000 7fb5a59b6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5a006a4b0 0x7fb5a0158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:17.504 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.500+0000 7fb5a59b6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb5a00c9ca0 0x7fb5a014afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:17.504 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.500+0000 7fb5a59b6640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb5a015ad70 0x7fb5a00c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:17.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.500+0000 7fb5a59b6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a00c7ea0 con 0x7fb5a006a4b0 2023-10-14T09:38:17.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.500+0000 7fb5a59b6640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a00c7010 con 0x7fb5a00c9ca0 2023-10-14T09:38:17.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.500+0000 7fb5a59b6640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a00c7290 con 0x7fb5a015ad70 2023-10-14T09:38:17.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.500+0000 7fb59effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5a006a4b0 0x7fb5a0158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:17.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.500+0000 7fb59effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5a006a4b0 0x7fb5a0158210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37608/0 (socket says 172.21.15.102:37608) 2023-10-14T09:38:17.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.500+0000 7fb59effd640 1 -- 172.21.15.102:0/508247689 learned_addr learned my addr 172.21.15.102:0/508247689 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:17.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.500+0000 7fb59effd640 1 -- 172.21.15.102:0/508247689 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb5a015ad70 msgr2=0x7fb5a00c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:17.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.500+0000 7fb59effd640 1 --2- 172.21.15.102:0/508247689 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb5a015ad70 0x7fb5a00c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:17.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.500+0000 7fb59effd640 1 -- 172.21.15.102:0/508247689 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb5a00c9ca0 msgr2=0x7fb5a014afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:17.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.500+0000 7fb59effd640 1 --2- 172.21.15.102:0/508247689 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb5a00c9ca0 0x7fb5a014afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:17.507 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.500+0000 7fb59effd640 1 -- 172.21.15.102:0/508247689 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5980094d0 con 0x7fb5a006a4b0 2023-10-14T09:38:17.507 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.501+0000 7fb59effd640 1 --2- 172.21.15.102:0/508247689 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5a006a4b0 0x7fb5a0158210 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb59000ba50 tx=0x7fb59000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:17.507 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.501+0000 7fb597fff640 1 -- 172.21.15.102:0/508247689 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59000cbe0 con 0x7fb5a006a4b0 2023-10-14T09:38:17.507 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.501+0000 7fb597fff640 1 -- 172.21.15.102:0/508247689 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59000cd80 con 0x7fb5a006a4b0 2023-10-14T09:38:17.507 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.501+0000 7fb5a59b6640 1 -- 172.21.15.102:0/508247689 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5a00c7570 con 0x7fb5a006a4b0 2023-10-14T09:38:17.507 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.501+0000 7fb597fff640 1 -- 172.21.15.102:0/508247689 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb590014680 con 0x7fb5a006a4b0 2023-10-14T09:38:17.508 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.501+0000 7fb5a59b6640 1 -- 172.21.15.102:0/508247689 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5a00c7b30 con 0x7fb5a006a4b0 2023-10-14T09:38:17.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.502+0000 7fb5a59b6640 1 -- 172.21.15.102:0/508247689 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5a004e160 con 0x7fb5a006a4b0 2023-10-14T09:38:17.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.503+0000 7fb597fff640 1 -- 172.21.15.102:0/508247689 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb5900147e0 con 0x7fb5a006a4b0 2023-10-14T09:38:17.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.505+0000 7fb597fff640 1 --2- 172.21.15.102:0/508247689 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fb58006ae70 0x7fb58006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:17.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.505+0000 7fb597fff640 1 -- 172.21.15.102:0/508247689 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fb590089600 con 0x7fb5a006a4b0 2023-10-14T09:38:17.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.505+0000 7fb59e7fc640 1 --2- 172.21.15.102:0/508247689 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fb58006ae70 0x7fb58006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:17.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.506+0000 7fb59e7fc640 1 --2- 172.21.15.102:0/508247689 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fb58006ae70 0x7fb58006d330 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb5a015a1d0 tx=0x7fb588008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:17.511 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.509+0000 7fb597fff640 1 -- 172.21.15.102:0/508247689 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb590054630 con 0x7fb5a006a4b0 2023-10-14T09:38:17.735 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.733+0000 7fb5a59b6640 1 -- 172.21.15.102:0/508247689 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb5a00736e0 con 0x7fb5a006a4b0 2023-10-14T09:38:17.736 INFO:tasks.ceph.mon.a.smithi102.stderr:2023-10-14T09:38:17.734+0000 7fa4a69ab640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T09:38:17.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.738+0000 7fb597fff640 1 -- 172.21.15.102:0/508247689 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb590057c50 con 0x7fb5a006a4b0 2023-10-14T09:38:17.740 INFO:teuthology.orchestra.run.smithi102.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T09:38:17.743 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.741+0000 7fb5a59b6640 1 -- 172.21.15.102:0/508247689 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fb58006ae70 msgr2=0x7fb58006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:17.743 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.741+0000 7fb5a59b6640 1 --2- 172.21.15.102:0/508247689 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fb58006ae70 0x7fb58006d330 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb5a015a1d0 tx=0x7fb588008040 comp rx=0 tx=0).stop 2023-10-14T09:38:17.743 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.741+0000 7fb5a59b6640 1 -- 172.21.15.102:0/508247689 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5a006a4b0 msgr2=0x7fb5a0158210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:17.743 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.741+0000 7fb5a59b6640 1 --2- 172.21.15.102:0/508247689 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5a006a4b0 0x7fb5a0158210 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb59000ba50 tx=0x7fb59000bf10 comp rx=0 tx=0).stop 2023-10-14T09:38:17.744 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.742+0000 7fb5a59b6640 1 -- 172.21.15.102:0/508247689 shutdown_connections 2023-10-14T09:38:17.744 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.742+0000 7fb5a59b6640 1 --2- 172.21.15.102:0/508247689 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fb58006ae70 0x7fb58006d330 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:17.744 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.742+0000 7fb5a59b6640 1 --2- 172.21.15.102:0/508247689 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb5a015ad70 0x7fb5a00c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:17.744 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.742+0000 7fb5a59b6640 1 --2- 172.21.15.102:0/508247689 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb5a00c9ca0 0x7fb5a014afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:17.745 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.742+0000 7fb5a59b6640 1 --2- 172.21.15.102:0/508247689 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5a006a4b0 0x7fb5a0158210 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:17.745 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.742+0000 7fb5a59b6640 1 -- 172.21.15.102:0/508247689 >> 172.21.15.102:0/508247689 conn(0x7fb5a00ce9b0 msgr2=0x7fb5a006b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:17.745 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.742+0000 7fb5a59b6640 1 -- 172.21.15.102:0/508247689 shutdown_connections 2023-10-14T09:38:17.745 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.742+0000 7fb5a59b6640 1 -- 172.21.15.102:0/508247689 wait complete. 2023-10-14T09:38:17.765 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-14T09:38:17.814 INFO:tasks.ceph.mds.c.smithi102.stdout:starting mds.c at 2023-10-14T09:38:17.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.955+0000 7f3dbde56640 1 Processor -- start 2023-10-14T09:38:17.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.955+0000 7f3dbde56640 1 -- start start 2023-10-14T09:38:17.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.957+0000 7f3dbde56640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3db81618b0 0x7f3db8065ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:17.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.957+0000 7f3dbde56640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3db8065ff0 0x7f3db80ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:17.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.957+0000 7f3dbde56640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3db8066420 con 0x7f3db815d330 2023-10-14T09:38:17.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.957+0000 7f3dbde56640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3db806b1e0 con 0x7f3db8065ff0 2023-10-14T09:38:17.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.957+0000 7f3dbde56640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db806cee0 con 0x7f3db81618b0 2023-10-14T09:38:17.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.957+0000 7f3db7fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3db8065ff0 0x7f3db80ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:17.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.958+0000 7f3db7fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3db8065ff0 0x7f3db80ce9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37628/0 (socket says 172.21.15.102:37628) 2023-10-14T09:38:17.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.958+0000 7f3db7fff640 1 -- 172.21.15.102:0/463599900 learned_addr learned my addr 172.21.15.102:0/463599900 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:17.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.958+0000 7f3daffff640 1 --2- 172.21.15.102:0/463599900 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3db81618b0 0x7f3db8065ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:17.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.958+0000 7f3db7fff640 1 -- 172.21.15.102:0/463599900 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3db81618b0 msgr2=0x7f3db8065ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:17.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.958+0000 7f3db7fff640 1 --2- 172.21.15.102:0/463599900 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3db81618b0 0x7f3db8065ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:17.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.958+0000 7f3db7fff640 1 -- 172.21.15.102:0/463599900 >> v1:172.21.15.129:6789/0 conn(0x7f3db815d330 legacy=0x7f3db806c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:17.962 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.958+0000 7f3db7fff640 1 -- 172.21.15.102:0/463599900 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db80d0890 con 0x7f3db8065ff0 2023-10-14T09:38:17.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.959+0000 7f3db7fff640 1 --2- 172.21.15.102:0/463599900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3db8065ff0 0x7f3db80ce9b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3db0009e50 tx=0x7f3db002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f06594e97894d41 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:17.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.959+0000 7f3db6ffd640 1 -- 172.21.15.102:0/463599900 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db002c9e0 con 0x7f3db8065ff0 2023-10-14T09:38:17.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.960+0000 7f3db6ffd640 1 -- 172.21.15.102:0/463599900 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db002cb40 con 0x7f3db8065ff0 2023-10-14T09:38:17.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.960+0000 7f3db6ffd640 1 -- 172.21.15.102:0/463599900 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db00343f0 con 0x7f3db8065ff0 2023-10-14T09:38:17.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.960+0000 7f3dbde56640 1 -- 172.21.15.102:0/463599900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3db8065ff0 msgr2=0x7f3db80ce9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:17.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.960+0000 7f3dbde56640 1 --2- 172.21.15.102:0/463599900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3db8065ff0 0x7f3db80ce9b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3db0009e50 tx=0x7f3db002be40 comp rx=0 tx=0).stop 2023-10-14T09:38:17.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.960+0000 7f3dbde56640 1 -- 172.21.15.102:0/463599900 shutdown_connections 2023-10-14T09:38:17.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.960+0000 7f3dbde56640 1 --2- 172.21.15.102:0/463599900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3db8065ff0 0x7f3db80ce9b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:17.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.960+0000 7f3dbde56640 1 --2- 172.21.15.102:0/463599900 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3db81618b0 0x7f3db8065ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:17.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.960+0000 7f3dbde56640 1 -- 172.21.15.102:0/463599900 >> 172.21.15.102:0/463599900 conn(0x7f3db80d0ab0 msgr2=0x7f3db80d0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:17.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.961+0000 7f3dbde56640 1 -- 172.21.15.102:0/463599900 shutdown_connections 2023-10-14T09:38:17.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.961+0000 7f3dbde56640 1 -- 172.21.15.102:0/463599900 wait complete. 2023-10-14T09:38:17.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.963+0000 7f3dbde56640 1 Processor -- start 2023-10-14T09:38:17.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.963+0000 7f3dbde56640 1 -- start start 2023-10-14T09:38:17.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.964+0000 7f3dbde56640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3db8065ff0 0x7f3db80c4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:17.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.964+0000 7f3dbde56640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3db815d330 0x7f3db8158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:17.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.964+0000 7f3dbde56640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3db81618b0 0x7f3db81597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:17.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.964+0000 7f3dbde56640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db80af7b0 con 0x7f3db815d330 2023-10-14T09:38:17.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.964+0000 7f3dbde56640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db80c4a70 con 0x7f3db8065ff0 2023-10-14T09:38:17.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.964+0000 7f3dbde56640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db80ca530 con 0x7f3db81618b0 2023-10-14T09:38:17.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.964+0000 7f3daffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3db815d330 0x7f3db8158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:17.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.964+0000 7f3daffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3db815d330 0x7f3db8158fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37640/0 (socket says 172.21.15.102:37640) 2023-10-14T09:38:17.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.964+0000 7f3daffff640 1 -- 172.21.15.102:0/114847139 learned_addr learned my addr 172.21.15.102:0/114847139 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:17.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.964+0000 7f3db77fe640 1 --2- 172.21.15.102:0/114847139 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3db8065ff0 0x7f3db80c4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:17.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.965+0000 7f3daffff640 1 -- 172.21.15.102:0/114847139 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3db81618b0 msgr2=0x7f3db81597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:17.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.965+0000 7f3daffff640 1 --2- 172.21.15.102:0/114847139 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3db81618b0 0x7f3db81597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:17.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.965+0000 7f3daffff640 1 -- 172.21.15.102:0/114847139 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3db8065ff0 msgr2=0x7f3db80c4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:17.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.965+0000 7f3daffff640 1 --2- 172.21.15.102:0/114847139 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3db8065ff0 0x7f3db80c4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:17.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.965+0000 7f3daffff640 1 -- 172.21.15.102:0/114847139 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db0009b30 con 0x7f3db815d330 2023-10-14T09:38:17.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.965+0000 7f3db77fe640 1 --2- 172.21.15.102:0/114847139 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3db8065ff0 0x7f3db80c4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:17.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.965+0000 7f3daffff640 1 --2- 172.21.15.102:0/114847139 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3db815d330 0x7f3db8158fd0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3da000d5f0 tx=0x7f3da000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:17.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.965+0000 7f3db4ff9640 1 -- 172.21.15.102:0/114847139 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da00125f0 con 0x7f3db815d330 2023-10-14T09:38:17.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.965+0000 7f3db4ff9640 1 -- 172.21.15.102:0/114847139 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da0012750 con 0x7f3db815d330 2023-10-14T09:38:17.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.965+0000 7f3db4ff9640 1 -- 172.21.15.102:0/114847139 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da0012b00 con 0x7f3db815d330 2023-10-14T09:38:17.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.965+0000 7f3dbde56640 1 -- 172.21.15.102:0/114847139 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3db80ca7d0 con 0x7f3db815d330 2023-10-14T09:38:17.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.965+0000 7f3dbde56640 1 -- 172.21.15.102:0/114847139 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3db80adb60 con 0x7f3db815d330 2023-10-14T09:38:17.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.967+0000 7f3dbde56640 1 -- 172.21.15.102:0/114847139 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3db80af330 con 0x7f3db815d330 2023-10-14T09:38:17.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.968+0000 7f3db4ff9640 1 -- 172.21.15.102:0/114847139 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3da0012c60 con 0x7f3db815d330 2023-10-14T09:38:17.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.968+0000 7f3db4ff9640 1 --2- 172.21.15.102:0/114847139 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f3d9806ae70 0x7f3d9806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:17.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.968+0000 7f3db4ff9640 1 -- 172.21.15.102:0/114847139 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f3da0089b60 con 0x7f3db815d330 2023-10-14T09:38:17.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.969+0000 7f3db77fe640 1 --2- 172.21.15.102:0/114847139 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f3d9806ae70 0x7f3d9806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:17.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.969+0000 7f3db77fe640 1 --2- 172.21.15.102:0/114847139 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f3d9806ae70 0x7f3d9806d330 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3db80c81f0 tx=0x7f3da8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:17.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:17.974+0000 7f3db4ff9640 1 -- 172.21.15.102:0/114847139 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3db80af330 con 0x7f3db815d330 2023-10-14T09:38:18.203 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.201+0000 7f3dbde56640 1 -- 172.21.15.102:0/114847139 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3db80ad9c0 con 0x7f3db815d330 2023-10-14T09:38:18.743 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.741+0000 7f3db4ff9640 1 -- 172.21.15.102:0/114847139 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3db80ad9c0 con 0x7f3db815d330 2023-10-14T09:38:18.747 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.745+0000 7f3dbde56640 1 -- 172.21.15.102:0/114847139 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f3d9806ae70 msgr2=0x7f3d9806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:18.747 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.745+0000 7f3dbde56640 1 --2- 172.21.15.102:0/114847139 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f3d9806ae70 0x7f3d9806d330 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3db80c81f0 tx=0x7f3da8008040 comp rx=0 tx=0).stop 2023-10-14T09:38:18.747 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.745+0000 7f3dbde56640 1 -- 172.21.15.102:0/114847139 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3db815d330 msgr2=0x7f3db8158fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:18.747 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.745+0000 7f3dbde56640 1 --2- 172.21.15.102:0/114847139 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3db815d330 0x7f3db8158fd0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3da000d5f0 tx=0x7f3da000dab0 comp rx=0 tx=0).stop 2023-10-14T09:38:18.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.745+0000 7f3dbde56640 1 -- 172.21.15.102:0/114847139 shutdown_connections 2023-10-14T09:38:18.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.745+0000 7f3dbde56640 1 --2- 172.21.15.102:0/114847139 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f3d9806ae70 0x7f3d9806d330 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:18.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.745+0000 7f3dbde56640 1 --2- 172.21.15.102:0/114847139 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3db81618b0 0x7f3db81597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:18.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.745+0000 7f3dbde56640 1 --2- 172.21.15.102:0/114847139 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3db815d330 0x7f3db8158fd0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:18.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.745+0000 7f3dbde56640 1 --2- 172.21.15.102:0/114847139 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3db8065ff0 0x7f3db80c4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:18.749 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.745+0000 7f3dbde56640 1 -- 172.21.15.102:0/114847139 >> 172.21.15.102:0/114847139 conn(0x7f3db80d0ab0 msgr2=0x7f3db815c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:18.749 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.745+0000 7f3dbde56640 1 -- 172.21.15.102:0/114847139 shutdown_connections 2023-10-14T09:38:18.749 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.745+0000 7f3dbde56640 1 -- 172.21.15.102:0/114847139 wait complete. 2023-10-14T09:38:18.768 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-14T09:38:18.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.987+0000 7ff45759e640 1 Processor -- start 2023-10-14T09:38:18.990 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.988+0000 7ff45759e640 1 -- start start 2023-10-14T09:38:18.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.989+0000 7ff45759e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff4580ad970 0x7ff4580cca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:18.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.989+0000 7ff45759e640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7ff4580ccfb0 0x7ff4580cd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:18.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.989+0000 7ff45759e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff45815b9d0 con 0x7ff45806c040 2023-10-14T09:38:18.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.989+0000 7ff45759e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff45815bcb0 con 0x7ff4580ad970 2023-10-14T09:38:18.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.989+0000 7ff45759e640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff45815bf90 con 0x7ff4580ccfb0 2023-10-14T09:38:18.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.989+0000 7ff45659c640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7ff45806c040 0x7ff45806c420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:56946/0 (socket says 172.21.15.102:56946) 2023-10-14T09:38:18.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.989+0000 7ff44ffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff4580ad970 0x7ff4580cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:18.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.989+0000 7ff45659c640 1 -- 172.21.15.102:0/4093550438 learned_addr learned my addr 172.21.15.102:0/4093550438 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:18.994 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.990+0000 7ff44ffff640 1 -- 172.21.15.102:0/4093550438 >> v2:172.21.15.129:3300/0 conn(0x7ff4580ccfb0 msgr2=0x7ff4580cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:18.994 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.990+0000 7ff44ffff640 1 --2- 172.21.15.102:0/4093550438 >> v2:172.21.15.129:3300/0 conn(0x7ff4580ccfb0 0x7ff4580cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:18.995 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.990+0000 7ff44ffff640 1 -- 172.21.15.102:0/4093550438 >> v1:172.21.15.102:6789/0 conn(0x7ff45806c040 legacy=0x7ff45806c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:18.995 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.990+0000 7ff44ffff640 1 -- 172.21.15.102:0/4093550438 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4580cc270 con 0x7ff4580ad970 2023-10-14T09:38:18.995 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.990+0000 7ff455d9b640 1 -- 172.21.15.102:0/4093550438 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2184226946 0 0) 0x7ff45815b9d0 con 0x7ff45806c040 2023-10-14T09:38:18.995 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.991+0000 7ff44ffff640 1 --2- 172.21.15.102:0/4093550438 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4580ad970 0x7ff4580cca70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff4400097a0 tx=0x7ff44002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d7ad746c1adaa8b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:18.995 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.991+0000 7ff455d9b640 1 -- 172.21.15.102:0/4093550438 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff440031830 con 0x7ff4580ad970 2023-10-14T09:38:18.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.991+0000 7ff455d9b640 1 -- 172.21.15.102:0/4093550438 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff440031990 con 0x7ff4580ad970 2023-10-14T09:38:18.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.991+0000 7ff455d9b640 1 -- 172.21.15.102:0/4093550438 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff440031d20 con 0x7ff4580ad970 2023-10-14T09:38:18.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.992+0000 7ff45759e640 1 -- 172.21.15.102:0/4093550438 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4580ad970 msgr2=0x7ff4580cca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:18.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.992+0000 7ff45759e640 1 --2- 172.21.15.102:0/4093550438 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4580ad970 0x7ff4580cca70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff4400097a0 tx=0x7ff44002b8d0 comp rx=0 tx=0).stop 2023-10-14T09:38:18.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.992+0000 7ff45759e640 1 -- 172.21.15.102:0/4093550438 shutdown_connections 2023-10-14T09:38:18.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.992+0000 7ff45759e640 1 --2- 172.21.15.102:0/4093550438 >> v2:172.21.15.129:3300/0 conn(0x7ff4580ccfb0 0x7ff4580cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:18.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.992+0000 7ff45759e640 1 --2- 172.21.15.102:0/4093550438 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4580ad970 0x7ff4580cca70 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:18.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.992+0000 7ff45759e640 1 -- 172.21.15.102:0/4093550438 >> 172.21.15.102:0/4093550438 conn(0x7ff4580ce6a0 msgr2=0x7ff4580ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:18.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.992+0000 7ff45759e640 1 -- 172.21.15.102:0/4093550438 shutdown_connections 2023-10-14T09:38:18.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.992+0000 7ff45759e640 1 -- 172.21.15.102:0/4093550438 wait complete. 2023-10-14T09:38:18.999 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.994+0000 7ff45759e640 1 Processor -- start 2023-10-14T09:38:19.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.994+0000 7ff45759e640 1 -- start start 2023-10-14T09:38:19.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.995+0000 7ff45759e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff45806c040 0x7ff4580b20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:19.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.995+0000 7ff45759e640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff4580ad970 0x7ff458152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:19.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.995+0000 7ff45759e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4580ccfb0 0x7ff4580c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:19.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.995+0000 7ff45759e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff458152c70 con 0x7ff4580ccfb0 2023-10-14T09:38:19.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.995+0000 7ff45759e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4580c7770 con 0x7ff45806c040 2023-10-14T09:38:19.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.995+0000 7ff45759e640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4580c6b60 con 0x7ff4580ad970 2023-10-14T09:38:19.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.995+0000 7ff456d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4580ccfb0 0x7ff4580c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:19.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.995+0000 7ff456d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4580ccfb0 0x7ff4580c7c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37656/0 (socket says 172.21.15.102:37656) 2023-10-14T09:38:19.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.995+0000 7ff456d9d640 1 -- 172.21.15.102:0/992853829 learned_addr learned my addr 172.21.15.102:0/992853829 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:19.002 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.995+0000 7ff45659c640 1 --2- 172.21.15.102:0/992853829 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff45806c040 0x7ff4580b20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:19.002 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.995+0000 7ff456d9d640 1 -- 172.21.15.102:0/992853829 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff4580ad970 msgr2=0x7ff458152730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:19.002 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.995+0000 7ff44ffff640 1 --2- 172.21.15.102:0/992853829 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff4580ad970 0x7ff458152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:19.002 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.995+0000 7ff456d9d640 1 --2- 172.21.15.102:0/992853829 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff4580ad970 0x7ff458152730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:19.002 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.995+0000 7ff456d9d640 1 -- 172.21.15.102:0/992853829 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff45806c040 msgr2=0x7ff4580b20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:19.003 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.995+0000 7ff456d9d640 1 --2- 172.21.15.102:0/992853829 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff45806c040 0x7ff4580b20d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:19.003 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.995+0000 7ff456d9d640 1 -- 172.21.15.102:0/992853829 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff440009400 con 0x7ff4580ccfb0 2023-10-14T09:38:19.003 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.996+0000 7ff456d9d640 1 --2- 172.21.15.102:0/992853829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4580ccfb0 0x7ff4580c7c00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff45000b970 tx=0x7ff45000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:19.003 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.996+0000 7ff44effd640 1 -- 172.21.15.102:0/992853829 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45000cb40 con 0x7ff4580ccfb0 2023-10-14T09:38:19.003 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.996+0000 7ff44effd640 1 -- 172.21.15.102:0/992853829 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff45000ccc0 con 0x7ff4580ccfb0 2023-10-14T09:38:19.003 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.996+0000 7ff44effd640 1 -- 172.21.15.102:0/992853829 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff450014680 con 0x7ff4580ccfb0 2023-10-14T09:38:19.004 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.996+0000 7ff45759e640 1 -- 172.21.15.102:0/992853829 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4580c6e40 con 0x7ff4580ccfb0 2023-10-14T09:38:19.004 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.996+0000 7ff45759e640 1 -- 172.21.15.102:0/992853829 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4580c7400 con 0x7ff4580ccfb0 2023-10-14T09:38:19.004 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.997+0000 7ff45759e640 1 -- 172.21.15.102:0/992853829 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff45806b330 con 0x7ff4580ccfb0 2023-10-14T09:38:19.005 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.998+0000 7ff44effd640 1 -- 172.21.15.102:0/992853829 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff45001d3b0 con 0x7ff4580ccfb0 2023-10-14T09:38:19.005 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.999+0000 7ff44effd640 1 --2- 172.21.15.102:0/992853829 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff43806ae70 0x7ff43806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:19.005 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.999+0000 7ff44effd640 1 -- 172.21.15.102:0/992853829 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5940+0+0 (secure 0 0 0) 0x7ff4500897d0 con 0x7ff4580ccfb0 2023-10-14T09:38:19.006 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:18.999+0000 7ff45659c640 1 --2- 172.21.15.102:0/992853829 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff43806ae70 0x7ff43806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:19.006 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:19.000+0000 7ff45659c640 1 --2- 172.21.15.102:0/992853829 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff43806ae70 0x7ff43806d330 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff448007fd0 tx=0x7ff448009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:19.006 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:19.003+0000 7ff44effd640 1 -- 172.21.15.102:0/992853829 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff450054660 con 0x7ff4580ccfb0 2023-10-14T09:38:19.188 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:19.186+0000 7ff45759e640 1 -- 172.21.15.102:0/992853829 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff45804e9b0 con 0x7ff4580ccfb0 2023-10-14T09:38:19.916 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:19.914+0000 7ff44effd640 1 -- 172.21.15.102:0/992853829 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff4500190d0 con 0x7ff4580ccfb0 2023-10-14T09:38:19.916 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'cephfs_metadata' removed 2023-10-14T09:38:19.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:19.917+0000 7ff45759e640 1 -- 172.21.15.102:0/992853829 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff43806ae70 msgr2=0x7ff43806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:19.920 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:19.917+0000 7ff45759e640 1 --2- 172.21.15.102:0/992853829 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff43806ae70 0x7ff43806d330 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff448007fd0 tx=0x7ff448009040 comp rx=0 tx=0).stop 2023-10-14T09:38:19.920 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:19.917+0000 7ff45759e640 1 -- 172.21.15.102:0/992853829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4580ccfb0 msgr2=0x7ff4580c7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:19.920 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:19.917+0000 7ff45759e640 1 --2- 172.21.15.102:0/992853829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4580ccfb0 0x7ff4580c7c00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff45000b970 tx=0x7ff45000be30 comp rx=0 tx=0).stop 2023-10-14T09:38:19.920 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:19.918+0000 7ff45759e640 1 -- 172.21.15.102:0/992853829 shutdown_connections 2023-10-14T09:38:19.920 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:19.918+0000 7ff45759e640 1 --2- 172.21.15.102:0/992853829 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff43806ae70 0x7ff43806d330 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:19.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:19.918+0000 7ff45759e640 1 --2- 172.21.15.102:0/992853829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4580ccfb0 0x7ff4580c7c00 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:19.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:19.918+0000 7ff45759e640 1 --2- 172.21.15.102:0/992853829 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff4580ad970 0x7ff458152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:19.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:19.918+0000 7ff45759e640 1 --2- 172.21.15.102:0/992853829 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff45806c040 0x7ff4580b20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:19.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:19.918+0000 7ff45759e640 1 -- 172.21.15.102:0/992853829 >> 172.21.15.102:0/992853829 conn(0x7ff4580ce6a0 msgr2=0x7ff45806f700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:19.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:19.918+0000 7ff45759e640 1 -- 172.21.15.102:0/992853829 shutdown_connections 2023-10-14T09:38:19.922 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:19.918+0000 7ff45759e640 1 -- 172.21.15.102:0/992853829 wait complete. 2023-10-14T09:38:19.942 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-14T09:38:20.161 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.159+0000 7f4537fff640 1 Processor -- start 2023-10-14T09:38:20.161 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.159+0000 7f4537fff640 1 -- start start 2023-10-14T09:38:20.162 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.160+0000 7f4537fff640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4538153740 0x7f453815a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:20.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.160+0000 7f4537fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f45380adbe0 0x7f45380ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:20.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.160+0000 7f4537fff640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45380cd4a0 con 0x7f45380ccb00 2023-10-14T09:38:20.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.160+0000 7f4537fff640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f453815ac60 con 0x7f45380adbe0 2023-10-14T09:38:20.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.160+0000 7f4537fff640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4538070030 con 0x7f4538153740 2023-10-14T09:38:20.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.161+0000 7f45367fc640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f45380ccb00 0x7f45380ad4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:56956/0 (socket says 172.21.15.102:56956) 2023-10-14T09:38:20.164 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.161+0000 7f45367fc640 1 -- 172.21.15.102:0/2909355144 learned_addr learned my addr 172.21.15.102:0/2909355144 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:20.164 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.161+0000 7f45377fe640 1 --2- 172.21.15.102:0/2909355144 >> v2:172.21.15.102:3300/0 conn(0x7f45380adbe0 0x7f45380ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:20.165 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.161+0000 7f4536ffd640 1 --2- 172.21.15.102:0/2909355144 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4538153740 0x7f453815a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:20.166 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.161+0000 7f4535ffb640 1 -- 172.21.15.102:0/2909355144 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1673509496 0 0) 0x7f45380cd4a0 con 0x7f45380ccb00 2023-10-14T09:38:20.166 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.161+0000 7f4535ffb640 1 -- 172.21.15.102:0/2909355144 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4524003520 con 0x7f45380ccb00 2023-10-14T09:38:20.166 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.161+0000 7f45377fe640 1 -- 172.21.15.102:0/2909355144 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4538153740 msgr2=0x7f453815a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:20.166 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.161+0000 7f45377fe640 1 --2- 172.21.15.102:0/2909355144 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4538153740 0x7f453815a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:20.166 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.161+0000 7f45377fe640 1 -- 172.21.15.102:0/2909355144 >> v1:172.21.15.102:6789/0 conn(0x7f45380ccb00 legacy=0x7f45380ad4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:20.167 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.161+0000 7f45377fe640 1 -- 172.21.15.102:0/2909355144 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4538070310 con 0x7f45380adbe0 2023-10-14T09:38:20.167 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.161+0000 7f4536ffd640 1 --2- 172.21.15.102:0/2909355144 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4538153740 0x7f453815a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:20.167 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.162+0000 7f45377fe640 1 --2- 172.21.15.102:0/2909355144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f45380adbe0 0x7f45380ccf60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4530009d90 tx=0x7f453002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa91b2787c75137d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:20.167 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.163+0000 7f4535ffb640 1 -- 172.21.15.102:0/2909355144 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453002cbd0 con 0x7f45380adbe0 2023-10-14T09:38:20.167 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.163+0000 7f4535ffb640 1 -- 172.21.15.102:0/2909355144 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453002cd30 con 0x7f45380adbe0 2023-10-14T09:38:20.168 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.163+0000 7f4535ffb640 1 -- 172.21.15.102:0/2909355144 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453002cea0 con 0x7f45380adbe0 2023-10-14T09:38:20.168 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.163+0000 7f4537fff640 1 -- 172.21.15.102:0/2909355144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f45380adbe0 msgr2=0x7f45380ccf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:20.168 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.163+0000 7f4537fff640 1 --2- 172.21.15.102:0/2909355144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f45380adbe0 0x7f45380ccf60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4530009d90 tx=0x7f453002be20 comp rx=0 tx=0).stop 2023-10-14T09:38:20.168 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.163+0000 7f4537fff640 1 -- 172.21.15.102:0/2909355144 shutdown_connections 2023-10-14T09:38:20.168 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.163+0000 7f4537fff640 1 --2- 172.21.15.102:0/2909355144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f45380adbe0 0x7f45380ccf60 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:20.169 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.163+0000 7f4537fff640 1 --2- 172.21.15.102:0/2909355144 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4538153740 0x7f453815a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:20.169 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.163+0000 7f4537fff640 1 -- 172.21.15.102:0/2909355144 >> 172.21.15.102:0/2909355144 conn(0x7f45380ce6a0 msgr2=0x7f45380ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:20.169 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.164+0000 7f4537fff640 1 -- 172.21.15.102:0/2909355144 shutdown_connections 2023-10-14T09:38:20.169 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.164+0000 7f4537fff640 1 -- 172.21.15.102:0/2909355144 wait complete. 2023-10-14T09:38:20.171 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.165+0000 7f4537fff640 1 Processor -- start 2023-10-14T09:38:20.171 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.165+0000 7f4537fff640 1 -- start start 2023-10-14T09:38:20.171 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.166+0000 7f4537fff640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f45380adbe0 0x7f45381520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:20.172 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.166+0000 7f4537fff640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f45380ccb00 0x7f45380b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:20.172 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.166+0000 7f4537fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4538153740 0x7f45381e19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:20.172 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.166+0000 7f4537fff640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45380b3650 con 0x7f4538153740 2023-10-14T09:38:20.172 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.166+0000 7f4537fff640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45380b3930 con 0x7f45380adbe0 2023-10-14T09:38:20.172 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.166+0000 7f4537fff640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45380b3c10 con 0x7f45380ccb00 2023-10-14T09:38:20.172 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.166+0000 7f45377fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4538153740 0x7f45381e19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:20.173 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.167+0000 7f45377fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4538153740 0x7f45381e19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37672/0 (socket says 172.21.15.102:37672) 2023-10-14T09:38:20.173 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.167+0000 7f45377fe640 1 -- 172.21.15.102:0/1845384584 learned_addr learned my addr 172.21.15.102:0/1845384584 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:20.173 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.167+0000 7f45377fe640 1 -- 172.21.15.102:0/1845384584 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f45380ccb00 msgr2=0x7f45380b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:20.173 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.167+0000 7f45377fe640 1 --2- 172.21.15.102:0/1845384584 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f45380ccb00 0x7f45380b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:20.173 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.167+0000 7f45377fe640 1 -- 172.21.15.102:0/1845384584 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f45380adbe0 msgr2=0x7f45381520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:20.174 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.167+0000 7f45377fe640 1 --2- 172.21.15.102:0/1845384584 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f45380adbe0 0x7f45381520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:20.174 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.167+0000 7f45377fe640 1 -- 172.21.15.102:0/1845384584 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4530009a70 con 0x7f4538153740 2023-10-14T09:38:20.174 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.167+0000 7f45377fe640 1 --2- 172.21.15.102:0/1845384584 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4538153740 0x7f45381e19f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4530009d90 tx=0x7f4530004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:20.174 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.168+0000 7f452f7fe640 1 -- 172.21.15.102:0/1845384584 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453002cea0 con 0x7f4538153740 2023-10-14T09:38:20.174 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.168+0000 7f452f7fe640 1 -- 172.21.15.102:0/1845384584 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4530040650 con 0x7f4538153740 2023-10-14T09:38:20.175 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.168+0000 7f452f7fe640 1 -- 172.21.15.102:0/1845384584 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4530040a00 con 0x7f4538153740 2023-10-14T09:38:20.175 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.168+0000 7f4537fff640 1 -- 172.21.15.102:0/1845384584 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f453813f300 con 0x7f4538153740 2023-10-14T09:38:20.175 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.168+0000 7f4537fff640 1 -- 172.21.15.102:0/1845384584 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4538152600 con 0x7f4538153740 2023-10-14T09:38:20.175 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.169+0000 7f4537fff640 1 -- 172.21.15.102:0/1845384584 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f453813f820 con 0x7f4538153740 2023-10-14T09:38:20.176 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.170+0000 7f452f7fe640 1 -- 172.21.15.102:0/1845384584 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4530040b60 con 0x7f4538153740 2023-10-14T09:38:20.176 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.171+0000 7f452f7fe640 1 --2- 172.21.15.102:0/1845384584 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f451806aea0 0x7f451806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:20.177 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.171+0000 7f452f7fe640 1 -- 172.21.15.102:0/1845384584 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5502+0+0 (secure 0 0 0) 0x7f45300abee0 con 0x7f4538153740 2023-10-14T09:38:20.177 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.171+0000 7f4536ffd640 1 --2- 172.21.15.102:0/1845384584 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f451806aea0 0x7f451806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:20.177 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.171+0000 7f4536ffd640 1 --2- 172.21.15.102:0/1845384584 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f451806aea0 0x7f451806d360 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4528006fd0 tx=0x7f4528008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:20.177 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.175+0000 7f452f7fe640 1 -- 172.21.15.102:0/1845384584 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f453813f820 con 0x7f4538153740 2023-10-14T09:38:20.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.362+0000 7f4537fff640 1 -- 172.21.15.102:0/1845384584 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f453813f820 con 0x7f4538153740 2023-10-14T09:38:20.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.925+0000 7f452f7fe640 1 -- 172.21.15.102:0/1845384584 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7f453813f820 con 0x7f4538153740 2023-10-14T09:38:20.927 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'cephfs_data' removed 2023-10-14T09:38:20.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.931+0000 7f4537fff640 1 -- 172.21.15.102:0/1845384584 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f451806aea0 msgr2=0x7f451806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:20.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.931+0000 7f4537fff640 1 --2- 172.21.15.102:0/1845384584 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f451806aea0 0x7f451806d360 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4528006fd0 tx=0x7f4528008040 comp rx=0 tx=0).stop 2023-10-14T09:38:20.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.931+0000 7f4537fff640 1 -- 172.21.15.102:0/1845384584 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4538153740 msgr2=0x7f45381e19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:20.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.931+0000 7f4537fff640 1 --2- 172.21.15.102:0/1845384584 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4538153740 0x7f45381e19f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4530009d90 tx=0x7f4530004a40 comp rx=0 tx=0).stop 2023-10-14T09:38:20.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.931+0000 7f4537fff640 1 -- 172.21.15.102:0/1845384584 shutdown_connections 2023-10-14T09:38:20.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.931+0000 7f4537fff640 1 --2- 172.21.15.102:0/1845384584 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f451806aea0 0x7f451806d360 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:20.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.931+0000 7f4537fff640 1 --2- 172.21.15.102:0/1845384584 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4538153740 0x7f45381e19f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:20.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.931+0000 7f4537fff640 1 --2- 172.21.15.102:0/1845384584 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f45380ccb00 0x7f45380b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:20.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.931+0000 7f4537fff640 1 --2- 172.21.15.102:0/1845384584 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f45380adbe0 0x7f45381520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:20.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.931+0000 7f4537fff640 1 -- 172.21.15.102:0/1845384584 >> 172.21.15.102:0/1845384584 conn(0x7f45380ce6a0 msgr2=0x7f45380ceb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:20.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.932+0000 7f4537fff640 1 -- 172.21.15.102:0/1845384584 shutdown_connections 2023-10-14T09:38:20.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:20.932+0000 7f4537fff640 1 -- 172.21.15.102:0/1845384584 wait complete. 2023-10-14T09:38:20.958 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T09:38:20.958 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-14T09:38:20.959 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T09:38:20.959 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:38:20.959 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T09:38:20.959 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-14T09:38:20.960 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T09:38:20.960 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:38:20.960 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T09:38:20.960 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-14T09:38:20.961 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T09:38:20.961 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:38:20.961 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T09:38:20.961 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-14T09:38:20.962 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T09:38:20.962 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:38:20.976 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T09:38:20.976 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T09:38:20.978 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T09:38:20.979 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T09:38:20.982 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T09:38:20.982 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T09:38:20.988 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T09:38:20.988 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T09:38:21.029 INFO:tasks.ceph.mds.a:Started 2023-10-14T09:38:21.029 DEBUG:teuthology.parallel:result is None 2023-10-14T09:38:21.036 INFO:tasks.ceph.mds.b:Started 2023-10-14T09:38:21.037 DEBUG:teuthology.parallel:result is None 2023-10-14T09:38:21.037 INFO:tasks.ceph.mds.c:Started 2023-10-14T09:38:21.038 DEBUG:teuthology.parallel:result is None 2023-10-14T09:38:21.044 INFO:tasks.ceph.mds.d:Started 2023-10-14T09:38:21.044 DEBUG:teuthology.parallel:result is None 2023-10-14T09:38:21.045 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-14T09:38:21.186 INFO:tasks.ceph.mds.a.smithi102.stdout:starting mds.a at 2023-10-14T09:38:21.188 INFO:tasks.ceph.mds.c.smithi102.stdout:starting mds.c at 2023-10-14T09:38:21.205 INFO:tasks.ceph.mds.b.smithi129.stdout:starting mds.b at 2023-10-14T09:38:21.206 INFO:tasks.ceph.mds.d.smithi129.stdout:starting mds.d at 2023-10-14T09:38:21.232 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.230+0000 7fd6e0f9e640 1 Processor -- start 2023-10-14T09:38:21.232 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.230+0000 7fd6e0f9e640 1 -- start start 2023-10-14T09:38:21.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.231+0000 7fd6e0f9e640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd6dc070830 0x7fd6dc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:21.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.231+0000 7fd6e0f9e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd6dc0cf5f0 0x7fd6dc06c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:21.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.232+0000 7fd6e0f9e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6dc161740 con 0x7fd6dc070c10 2023-10-14T09:38:21.235 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.232+0000 7fd6e0f9e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6dc06c680 con 0x7fd6dc0cf5f0 2023-10-14T09:38:21.235 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.232+0000 7fd6e0f9e640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc06b0f0 con 0x7fd6dc070830 2023-10-14T09:38:21.235 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.232+0000 7fd6d3fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd6dc0cf5f0 0x7fd6dc06c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:21.235 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.232+0000 7fd6d3fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd6dc0cf5f0 0x7fd6dc06c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37710/0 (socket says 172.21.15.102:37710) 2023-10-14T09:38:21.235 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.232+0000 7fd6d3fff640 1 -- 172.21.15.102:0/3351971591 learned_addr learned my addr 172.21.15.102:0/3351971591 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:21.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.232+0000 7fd6dad9d640 1 --1- 172.21.15.102:0/3351971591 >> v1:172.21.15.102:6789/0 conn(0x7fd6dc070c10 0x7fd6dc0cd690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:56972/0 (socket says 172.21.15.102:56972) 2023-10-14T09:38:21.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.232+0000 7fd6da59c640 1 --2- 172.21.15.102:0/3351971591 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd6dc070830 0x7fd6dc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:21.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.232+0000 7fd6d3fff640 1 -- 172.21.15.102:0/3351971591 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd6dc070830 msgr2=0x7fd6dc06d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:21.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.232+0000 7fd6d3fff640 1 --2- 172.21.15.102:0/3351971591 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd6dc070830 0x7fd6dc06d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:21.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.232+0000 7fd6d3fff640 1 -- 172.21.15.102:0/3351971591 >> v1:172.21.15.102:6789/0 conn(0x7fd6dc070c10 legacy=0x7fd6dc0cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:21.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.232+0000 7fd6d3fff640 1 -- 172.21.15.102:0/3351971591 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6dc1619b0 con 0x7fd6dc0cf5f0 2023-10-14T09:38:21.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.232+0000 7fd6d9d9b640 1 -- 172.21.15.102:0/3351971591 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3495294317 0 0) 0x7fd6dc161740 con 0x7fd6dc070c10 2023-10-14T09:38:21.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.234+0000 7fd6d3fff640 1 --2- 172.21.15.102:0/3351971591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6dc0cf5f0 0x7fd6dc06c140 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4009870 tx=0x7fd6c402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93bcec4161843285 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:21.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.234+0000 7fd6d9d9b640 1 -- 172.21.15.102:0/3351971591 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c40317c0 con 0x7fd6dc0cf5f0 2023-10-14T09:38:21.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.234+0000 7fd6d9d9b640 1 -- 172.21.15.102:0/3351971591 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c4031920 con 0x7fd6dc0cf5f0 2023-10-14T09:38:21.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.234+0000 7fd6d9d9b640 1 -- 172.21.15.102:0/3351971591 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4031cb0 con 0x7fd6dc0cf5f0 2023-10-14T09:38:21.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.234+0000 7fd6e0f9e640 1 -- 172.21.15.102:0/3351971591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6dc0cf5f0 msgr2=0x7fd6dc06c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:21.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.234+0000 7fd6e0f9e640 1 --2- 172.21.15.102:0/3351971591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6dc0cf5f0 0x7fd6dc06c140 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4009870 tx=0x7fd6c402b860 comp rx=0 tx=0).stop 2023-10-14T09:38:21.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.235+0000 7fd6e0f9e640 1 -- 172.21.15.102:0/3351971591 shutdown_connections 2023-10-14T09:38:21.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.235+0000 7fd6e0f9e640 1 --2- 172.21.15.102:0/3351971591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6dc0cf5f0 0x7fd6dc06c140 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:21.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.235+0000 7fd6e0f9e640 1 --2- 172.21.15.102:0/3351971591 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd6dc070830 0x7fd6dc06d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:21.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.235+0000 7fd6e0f9e640 1 -- 172.21.15.102:0/3351971591 >> 172.21.15.102:0/3351971591 conn(0x7fd6dc0cfac0 msgr2=0x7fd6dc0cfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:21.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.235+0000 7fd6e0f9e640 1 -- 172.21.15.102:0/3351971591 shutdown_connections 2023-10-14T09:38:21.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.235+0000 7fd6e0f9e640 1 -- 172.21.15.102:0/3351971591 wait complete. 2023-10-14T09:38:21.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.236+0000 7fd6e0f9e640 1 Processor -- start 2023-10-14T09:38:21.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.236+0000 7fd6e0f9e640 1 -- start start 2023-10-14T09:38:21.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.237+0000 7fd6e0f9e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd6dc070830 0x7fd6dc153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:21.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.237+0000 7fd6e0f9e640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd6dc070c10 0x7fd6dc0b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:21.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.237+0000 7fd6e0f9e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6dc0cf5f0 0x7fd6dc0c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:21.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.237+0000 7fd6e0f9e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc0b4d80 con 0x7fd6dc0cf5f0 2023-10-14T09:38:21.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.237+0000 7fd6e0f9e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc0b4100 con 0x7fd6dc070830 2023-10-14T09:38:21.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.237+0000 7fd6e0f9e640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc0b43e0 con 0x7fd6dc070c10 2023-10-14T09:38:21.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.238+0000 7fd6dad9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6dc0cf5f0 0x7fd6dc0c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:21.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.238+0000 7fd6dad9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6dc0cf5f0 0x7fd6dc0c5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37726/0 (socket says 172.21.15.102:37726) 2023-10-14T09:38:21.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.238+0000 7fd6dad9d640 1 -- 172.21.15.102:0/1539565145 learned_addr learned my addr 172.21.15.102:0/1539565145 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:21.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.238+0000 7fd6da59c640 1 --2- 172.21.15.102:0/1539565145 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd6dc070830 0x7fd6dc153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:21.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.238+0000 7fd6d3fff640 1 --2- 172.21.15.102:0/1539565145 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd6dc070c10 0x7fd6dc0b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:21.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.238+0000 7fd6dad9d640 1 -- 172.21.15.102:0/1539565145 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd6dc070c10 msgr2=0x7fd6dc0b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:21.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.238+0000 7fd6dad9d640 1 --2- 172.21.15.102:0/1539565145 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd6dc070c10 0x7fd6dc0b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:21.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.238+0000 7fd6dad9d640 1 -- 172.21.15.102:0/1539565145 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd6dc070830 msgr2=0x7fd6dc153b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:21.247 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.238+0000 7fd6dad9d640 1 --2- 172.21.15.102:0/1539565145 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd6dc070830 0x7fd6dc153b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:21.247 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.238+0000 7fd6dad9d640 1 -- 172.21.15.102:0/1539565145 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c40094d0 con 0x7fd6dc0cf5f0 2023-10-14T09:38:21.247 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.238+0000 7fd6dad9d640 1 --2- 172.21.15.102:0/1539565145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6dc0cf5f0 0x7fd6dc0c5ea0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd6d400c7a0 tx=0x7fd6d400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:21.247 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.239+0000 7fd6d2ffd640 1 -- 172.21.15.102:0/1539565145 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d400a640 con 0x7fd6dc0cf5f0 2023-10-14T09:38:21.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.239+0000 7fd6d2ffd640 1 -- 172.21.15.102:0/1539565145 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d400a7a0 con 0x7fd6dc0cf5f0 2023-10-14T09:38:21.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.239+0000 7fd6d2ffd640 1 -- 172.21.15.102:0/1539565145 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d400abd0 con 0x7fd6dc0cf5f0 2023-10-14T09:38:21.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.239+0000 7fd6e0f9e640 1 -- 172.21.15.102:0/1539565145 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6dc0b46c0 con 0x7fd6dc0cf5f0 2023-10-14T09:38:21.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.239+0000 7fd6e0f9e640 1 -- 172.21.15.102:0/1539565145 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6dc15f3b0 con 0x7fd6dc0cf5f0 2023-10-14T09:38:21.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.240+0000 7fd6e0f9e640 1 -- 172.21.15.102:0/1539565145 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6dc0b4ec0 con 0x7fd6dc0cf5f0 2023-10-14T09:38:21.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.241+0000 7fd6d2ffd640 1 -- 172.21.15.102:0/1539565145 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd6d400ad30 con 0x7fd6dc0cf5f0 2023-10-14T09:38:21.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.242+0000 7fd6d2ffd640 1 --2- 172.21.15.102:0/1539565145 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd6bc06ae70 0x7fd6bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:21.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.242+0000 7fd6d2ffd640 1 -- 172.21.15.102:0/1539565145 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd6d4088800 con 0x7fd6dc0cf5f0 2023-10-14T09:38:21.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.243+0000 7fd6da59c640 1 --2- 172.21.15.102:0/1539565145 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd6bc06ae70 0x7fd6bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:21.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.243+0000 7fd6da59c640 1 --2- 172.21.15.102:0/1539565145 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd6bc06ae70 0x7fd6bc06d330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc009b40 tx=0x7fd6cc009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:21.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.247+0000 7fd6d2ffd640 1 -- 172.21.15.102:0/1539565145 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd6dc0b4ec0 con 0x7fd6dc0cf5f0 2023-10-14T09:38:21.455 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:21.453+0000 7fd6e0f9e640 1 -- 172.21.15.102:0/1539565145 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd6dc0b4ec0 con 0x7fd6dc0cf5f0 2023-10-14T09:38:22.786 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:22.784+0000 7fd6d2ffd640 1 -- 172.21.15.102:0/1539565145 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd6dc0b4ec0 con 0x7fd6dc0cf5f0 2023-10-14T09:38:22.787 INFO:teuthology.orchestra.run.smithi102.stderr: removed all blocklist entries 2023-10-14T09:38:22.791 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:22.788+0000 7fd6e0f9e640 1 -- 172.21.15.102:0/1539565145 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd6bc06ae70 msgr2=0x7fd6bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:22.791 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:22.788+0000 7fd6e0f9e640 1 --2- 172.21.15.102:0/1539565145 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd6bc06ae70 0x7fd6bc06d330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc009b40 tx=0x7fd6cc009190 comp rx=0 tx=0).stop 2023-10-14T09:38:22.791 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:22.788+0000 7fd6e0f9e640 1 -- 172.21.15.102:0/1539565145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6dc0cf5f0 msgr2=0x7fd6dc0c5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:22.792 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:22.788+0000 7fd6e0f9e640 1 --2- 172.21.15.102:0/1539565145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6dc0cf5f0 0x7fd6dc0c5ea0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd6d400c7a0 tx=0x7fd6d400cc60 comp rx=0 tx=0).stop 2023-10-14T09:38:22.792 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:22.788+0000 7fd6e0f9e640 1 -- 172.21.15.102:0/1539565145 shutdown_connections 2023-10-14T09:38:22.792 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:22.788+0000 7fd6e0f9e640 1 --2- 172.21.15.102:0/1539565145 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd6bc06ae70 0x7fd6bc06d330 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:22.793 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:22.788+0000 7fd6e0f9e640 1 --2- 172.21.15.102:0/1539565145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6dc0cf5f0 0x7fd6dc0c5ea0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:22.793 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:22.788+0000 7fd6e0f9e640 1 --2- 172.21.15.102:0/1539565145 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd6dc070c10 0x7fd6dc0b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:22.793 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:22.788+0000 7fd6e0f9e640 1 --2- 172.21.15.102:0/1539565145 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd6dc070830 0x7fd6dc153b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:22.794 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:22.788+0000 7fd6e0f9e640 1 -- 172.21.15.102:0/1539565145 >> 172.21.15.102:0/1539565145 conn(0x7fd6dc0cfac0 msgr2=0x7fd6dc160930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:22.794 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:22.788+0000 7fd6e0f9e640 1 -- 172.21.15.102:0/1539565145 shutdown_connections 2023-10-14T09:38:22.795 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:22.788+0000 7fd6e0f9e640 1 -- 172.21.15.102:0/1539565145 wait complete. 2023-10-14T09:38:22.809 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-14T09:38:23.024 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.022+0000 7f4f16246640 1 Processor -- start 2023-10-14T09:38:23.024 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.022+0000 7f4f16246640 1 -- start start 2023-10-14T09:38:23.026 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.023+0000 7f4f16246640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4f1015ae80 0x7f4f1015e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:23.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.023+0000 7f4f16246640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4f100ce390 0x7f4f10070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:23.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.024+0000 7f4f16246640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f1015ed60 con 0x7f4f1015aaa0 2023-10-14T09:38:23.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.024+0000 7f4f16246640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f1006b810 con 0x7f4f1015ae80 2023-10-14T09:38:23.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.024+0000 7f4f16246640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f100707e0 con 0x7f4f100ce390 2023-10-14T09:38:23.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.024+0000 7f4f07fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4f1015ae80 0x7f4f1015e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:23.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.024+0000 7f4f0f7fe640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f4f1015aaa0 0x7f4f100cc560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:35196/0 (socket says 172.21.15.102:35196) 2023-10-14T09:38:23.029 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.024+0000 7f4f07fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4f1015ae80 0x7f4f1015e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52338/0 (socket says 172.21.15.102:52338) 2023-10-14T09:38:23.029 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.024+0000 7f4f0f7fe640 1 -- 172.21.15.102:0/1921662973 learned_addr learned my addr 172.21.15.102:0/1921662973 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:23.029 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.024+0000 7f4f07fff640 1 -- 172.21.15.102:0/1921662973 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4f100ce390 msgr2=0x7f4f10070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:23.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.024+0000 7f4f07fff640 1 --2- 172.21.15.102:0/1921662973 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4f100ce390 0x7f4f10070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:23.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.024+0000 7f4f07fff640 1 -- 172.21.15.102:0/1921662973 >> v1:172.21.15.102:6789/0 conn(0x7f4f1015aaa0 legacy=0x7f4f100cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:23.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.024+0000 7f4f07fff640 1 -- 172.21.15.102:0/1921662973 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1015ef90 con 0x7f4f1015ae80 2023-10-14T09:38:23.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.025+0000 7f4f07fff640 1 --2- 172.21.15.102:0/1921662973 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f1015ae80 0x7f4f1015e820 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4ef80097a0 tx=0x7f4ef802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc0596a7d5f2dae server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:23.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.026+0000 7f4f0effd640 1 -- 172.21.15.102:0/1921662973 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef802d040 con 0x7f4f1015ae80 2023-10-14T09:38:23.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.026+0000 7f4f0effd640 1 -- 172.21.15.102:0/1921662973 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef8031810 con 0x7f4f1015ae80 2023-10-14T09:38:23.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.026+0000 7f4f0effd640 1 -- 172.21.15.102:0/1921662973 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef8031ba0 con 0x7f4f1015ae80 2023-10-14T09:38:23.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.026+0000 7f4f16246640 1 -- 172.21.15.102:0/1921662973 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f1015ae80 msgr2=0x7f4f1015e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:23.037 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.026+0000 7f4f16246640 1 --2- 172.21.15.102:0/1921662973 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f1015ae80 0x7f4f1015e820 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4ef80097a0 tx=0x7f4ef802b8b0 comp rx=0 tx=0).stop 2023-10-14T09:38:23.037 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.027+0000 7f4f16246640 1 -- 172.21.15.102:0/1921662973 shutdown_connections 2023-10-14T09:38:23.037 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.027+0000 7f4f16246640 1 --2- 172.21.15.102:0/1921662973 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4f100ce390 0x7f4f10070f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:23.037 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.027+0000 7f4f16246640 1 --2- 172.21.15.102:0/1921662973 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f1015ae80 0x7f4f1015e820 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:23.037 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.027+0000 7f4f16246640 1 -- 172.21.15.102:0/1921662973 >> 172.21.15.102:0/1921662973 conn(0x7f4f100cb410 msgr2=0x7f4f100cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:23.037 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.027+0000 7f4f16246640 1 -- 172.21.15.102:0/1921662973 shutdown_connections 2023-10-14T09:38:23.038 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.027+0000 7f4f16246640 1 -- 172.21.15.102:0/1921662973 wait complete. 2023-10-14T09:38:23.038 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.028+0000 7f4f16246640 1 Processor -- start 2023-10-14T09:38:23.038 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.028+0000 7f4f16246640 1 -- start start 2023-10-14T09:38:23.038 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.029+0000 7f4f16246640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4f100ce390 0x7f4f100c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:23.038 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.029+0000 7f4f16246640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4f1015aaa0 0x7f4f100c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:23.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.029+0000 7f4f16246640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f1015ae80 0x7f4f1014f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:23.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.029+0000 7f4f16246640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f100c6130 con 0x7f4f1015ae80 2023-10-14T09:38:23.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.029+0000 7f4f16246640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f100c2b80 con 0x7f4f100ce390 2023-10-14T09:38:23.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.029+0000 7f4f16246640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f100c2e60 con 0x7f4f1015aaa0 2023-10-14T09:38:23.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.030+0000 7f4f0ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f1015ae80 0x7f4f1014f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:23.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.030+0000 7f4f0ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f1015ae80 0x7f4f1014f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52348/0 (socket says 172.21.15.102:52348) 2023-10-14T09:38:23.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.030+0000 7f4f0ffff640 1 -- 172.21.15.102:0/1234144219 learned_addr learned my addr 172.21.15.102:0/1234144219 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:23.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.030+0000 7f4f0ffff640 1 -- 172.21.15.102:0/1234144219 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4f1015aaa0 msgr2=0x7f4f100c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:23.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.030+0000 7f4f0ffff640 1 --2- 172.21.15.102:0/1234144219 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4f1015aaa0 0x7f4f100c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:23.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.030+0000 7f4f0ffff640 1 -- 172.21.15.102:0/1234144219 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4f100ce390 msgr2=0x7f4f100c24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:23.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.030+0000 7f4f0ffff640 1 --2- 172.21.15.102:0/1234144219 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4f100ce390 0x7f4f100c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:23.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.030+0000 7f4f0ffff640 1 -- 172.21.15.102:0/1234144219 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef8009400 con 0x7f4f1015ae80 2023-10-14T09:38:23.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.030+0000 7f4f0ffff640 1 --2- 172.21.15.102:0/1234144219 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f1015ae80 0x7f4f1014f130 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4f0800b970 tx=0x7f4f0800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:23.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.031+0000 7f4f0cff9640 1 -- 172.21.15.102:0/1234144219 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0800cb40 con 0x7f4f1015ae80 2023-10-14T09:38:23.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.031+0000 7f4f0cff9640 1 -- 172.21.15.102:0/1234144219 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0800ccc0 con 0x7f4f1015ae80 2023-10-14T09:38:23.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.031+0000 7f4f0cff9640 1 -- 172.21.15.102:0/1234144219 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f08014680 con 0x7f4f1015ae80 2023-10-14T09:38:23.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.031+0000 7f4f16246640 1 -- 172.21.15.102:0/1234144219 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f100c3140 con 0x7f4f1015ae80 2023-10-14T09:38:23.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.031+0000 7f4f16246640 1 -- 172.21.15.102:0/1234144219 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f100c3700 con 0x7f4f1015ae80 2023-10-14T09:38:23.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.032+0000 7f4f16246640 1 -- 172.21.15.102:0/1234144219 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f100c3920 con 0x7f4f1015ae80 2023-10-14T09:38:23.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.033+0000 7f4f0cff9640 1 -- 172.21.15.102:0/1234144219 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4f0801d3b0 con 0x7f4f1015ae80 2023-10-14T09:38:23.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.034+0000 7f4f0cff9640 1 --2- 172.21.15.102:0/1234144219 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4ef006ae70 0x7f4ef006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:23.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.034+0000 7f4f0cff9640 1 -- 172.21.15.102:0/1234144219 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4f08089260 con 0x7f4f1015ae80 2023-10-14T09:38:23.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.034+0000 7f4f0f7fe640 1 --2- 172.21.15.102:0/1234144219 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4ef006ae70 0x7f4ef006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:23.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.035+0000 7f4f0f7fe640 1 --2- 172.21.15.102:0/1234144219 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4ef006ae70 0x7f4ef006d330 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4f00005880 tx=0x7f4f00007a00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:23.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.039+0000 7f4f0cff9640 1 -- 172.21.15.102:0/1234144219 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4f08054660 con 0x7f4f1015ae80 2023-10-14T09:38:23.296 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.295+0000 7f4f16246640 1 -- 172.21.15.102:0/1234144219 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4f1004e160 con 0x7f4f1015ae80 2023-10-14T09:38:23.297 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.295+0000 7f4f0cff9640 1 -- 172.21.15.102:0/1234144219 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f4f08057c80 con 0x7f4f1015ae80 2023-10-14T09:38:23.298 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:38:23.298 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-10-14T09:38:23.298 INFO:teuthology.orchestra.run.smithi102.stdout: "auth_dump": [ 2023-10-14T09:38:23.298 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-10-14T09:38:23.299 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "mds.a", 2023-10-14T09:38:23.299 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQAEYSplQ3HFOhAAIRR1X2bfpcQHFqjJNFhepw==", 2023-10-14T09:38:23.299 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-10-14T09:38:23.299 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": "allow", 2023-10-14T09:38:23.299 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow *", 2023-10-14T09:38:23.300 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow *", 2023-10-14T09:38:23.300 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2023-10-14T09:38:23.300 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-10-14T09:38:23.300 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-10-14T09:38:23.300 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-10-14T09:38:23.300 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "mds.b", 2023-10-14T09:38:23.301 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQAFYSpljhZ0IBAAQ4kXIcEZ5AtZuNHZSodoSQ==", 2023-10-14T09:38:23.301 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-10-14T09:38:23.301 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": "allow", 2023-10-14T09:38:23.301 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow *", 2023-10-14T09:38:23.301 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow *", 2023-10-14T09:38:23.302 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2023-10-14T09:38:23.302 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-10-14T09:38:23.302 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-10-14T09:38:23.302 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-10-14T09:38:23.302 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "mds.c", 2023-10-14T09:38:23.302 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQAFYSpl0zxRDxAAYz/YthZ+SlPxOnZ3gQS6kQ==", 2023-10-14T09:38:23.303 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-10-14T09:38:23.303 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": "allow", 2023-10-14T09:38:23.303 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow *", 2023-10-14T09:38:23.303 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow *", 2023-10-14T09:38:23.303 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2023-10-14T09:38:23.304 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-10-14T09:38:23.304 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-10-14T09:38:23.304 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-10-14T09:38:23.304 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "mds.d", 2023-10-14T09:38:23.304 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQAFYSpl3zL4MBAAIgqLiZjASG93lFjjm+InWQ==", 2023-10-14T09:38:23.304 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-10-14T09:38:23.305 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": "allow", 2023-10-14T09:38:23.305 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow *", 2023-10-14T09:38:23.305 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow *", 2023-10-14T09:38:23.305 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2023-10-14T09:38:23.305 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-10-14T09:38:23.305 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-10-14T09:38:23.306 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-10-14T09:38:23.306 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "osd.0", 2023-10-14T09:38:23.306 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQAKYSplgQULJhAASp0Qj9mUparApl5+14q7Gw==", 2023-10-14T09:38:23.306 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-10-14T09:38:23.306 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow profile osd", 2023-10-14T09:38:23.307 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile osd", 2023-10-14T09:38:23.307 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2023-10-14T09:38:23.307 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-10-14T09:38:23.307 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-10-14T09:38:23.307 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-10-14T09:38:23.307 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "osd.1", 2023-10-14T09:38:23.308 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQAOYSplo1RTAxAAuFOjANTkprmGZQdj1dGg7A==", 2023-10-14T09:38:23.308 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-10-14T09:38:23.308 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow profile osd", 2023-10-14T09:38:23.308 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile osd", 2023-10-14T09:38:23.308 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2023-10-14T09:38:23.309 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-10-14T09:38:23.309 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-10-14T09:38:23.309 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-10-14T09:38:23.309 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "osd.2", 2023-10-14T09:38:23.309 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQARYSplPdUqHBAA98qjri5P8qRC2smxLbYXEQ==", 2023-10-14T09:38:23.310 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-10-14T09:38:23.310 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow profile osd", 2023-10-14T09:38:23.310 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile osd", 2023-10-14T09:38:23.310 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2023-10-14T09:38:23.310 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-10-14T09:38:23.311 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-10-14T09:38:23.311 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-10-14T09:38:23.311 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "osd.3", 2023-10-14T09:38:23.311 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQAUYSpl4sStNBAAALRjxGly0rb1CJssfJVlwQ==", 2023-10-14T09:38:23.311 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-10-14T09:38:23.311 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow profile osd", 2023-10-14T09:38:23.312 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile osd", 2023-10-14T09:38:23.312 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2023-10-14T09:38:23.312 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-10-14T09:38:23.312 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-10-14T09:38:23.312 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-10-14T09:38:23.312 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "osd.4", 2023-10-14T09:38:23.313 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQAcYSpl0V6VABAAFUyoKPsp29P+aJS9jH7kQw==", 2023-10-14T09:38:23.313 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-10-14T09:38:23.313 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow profile osd", 2023-10-14T09:38:23.313 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile osd", 2023-10-14T09:38:23.313 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2023-10-14T09:38:23.313 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-10-14T09:38:23.314 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-10-14T09:38:23.314 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-10-14T09:38:23.314 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "osd.5", 2023-10-14T09:38:23.314 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQAfYSplGGb2GRAAajGsic4HZGXeM79Evmi73A==", 2023-10-14T09:38:23.314 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-10-14T09:38:23.315 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow profile osd", 2023-10-14T09:38:23.315 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile osd", 2023-10-14T09:38:23.315 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2023-10-14T09:38:23.315 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-10-14T09:38:23.315 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-10-14T09:38:23.315 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-10-14T09:38:23.316 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "osd.6", 2023-10-14T09:38:23.316 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQAiYSplFT8bIxAAJ5vVKfGwmUIRmE2dt/5dcg==", 2023-10-14T09:38:23.316 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-10-14T09:38:23.316 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow profile osd", 2023-10-14T09:38:23.316 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile osd", 2023-10-14T09:38:23.317 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2023-10-14T09:38:23.317 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-10-14T09:38:23.317 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-10-14T09:38:23.317 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-10-14T09:38:23.317 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "osd.7", 2023-10-14T09:38:23.318 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQAlYSplj79nLBAAK4kcWMbaehTiIAxhP+TXcQ==", 2023-10-14T09:38:23.318 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-10-14T09:38:23.318 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow profile osd", 2023-10-14T09:38:23.318 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile osd", 2023-10-14T09:38:23.318 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2023-10-14T09:38:23.319 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-10-14T09:38:23.319 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-10-14T09:38:23.319 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-10-14T09:38:23.319 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "client.0", 2023-10-14T09:38:23.319 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQAGYSpl2DQTAxAAccp2NglfLx6Vx/BGxH6+fA==", 2023-10-14T09:38:23.319 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-10-14T09:38:23.320 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": "allow", 2023-10-14T09:38:23.320 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow r", 2023-10-14T09:38:23.320 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow rw", 2023-10-14T09:38:23.320 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow rwx" 2023-10-14T09:38:23.320 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-10-14T09:38:23.321 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-10-14T09:38:23.321 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-10-14T09:38:23.321 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "client.1", 2023-10-14T09:38:23.321 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQAGYSplX8rGGBAASDrk/eBr51LDoFC7ZRhq8A==", 2023-10-14T09:38:23.321 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-10-14T09:38:23.321 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": "allow", 2023-10-14T09:38:23.322 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow r", 2023-10-14T09:38:23.322 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow rw", 2023-10-14T09:38:23.322 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow rwx" 2023-10-14T09:38:23.322 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-10-14T09:38:23.322 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-10-14T09:38:23.322 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-10-14T09:38:23.323 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "client.2", 2023-10-14T09:38:23.323 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQAGYSpl5m1SDRAAHmjaIyVqYyjfkMRSur+d9g==", 2023-10-14T09:38:23.323 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-10-14T09:38:23.323 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": "allow", 2023-10-14T09:38:23.323 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow r", 2023-10-14T09:38:23.323 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow rw", 2023-10-14T09:38:23.324 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow rwx" 2023-10-14T09:38:23.324 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-10-14T09:38:23.324 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-10-14T09:38:23.324 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-10-14T09:38:23.324 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "client.3", 2023-10-14T09:38:23.324 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQAGYSpl3eFCJBAASpqlOy0ZdrRMDab2hUmAbg==", 2023-10-14T09:38:23.325 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-10-14T09:38:23.325 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": "allow", 2023-10-14T09:38:23.325 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow r", 2023-10-14T09:38:23.325 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow rw", 2023-10-14T09:38:23.325 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow rwx" 2023-10-14T09:38:23.326 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-10-14T09:38:23.326 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-10-14T09:38:23.326 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-10-14T09:38:23.326 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "client.admin", 2023-10-14T09:38:23.326 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQADYSplLzkbLBAAr7bipNQsJZK1POpkIdXnJg==", 2023-10-14T09:38:23.326 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-10-14T09:38:23.327 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": "allow *", 2023-10-14T09:38:23.327 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow *", 2023-10-14T09:38:23.327 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow *", 2023-10-14T09:38:23.327 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2023-10-14T09:38:23.327 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-10-14T09:38:23.328 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-10-14T09:38:23.328 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-10-14T09:38:23.328 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "client.bootstrap-mds", 2023-10-14T09:38:23.328 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQA4YSplhIh9LBAAtsNEQGtUlyBhc1u8zjv9WA==", 2023-10-14T09:38:23.328 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-10-14T09:38:23.328 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile bootstrap-mds" 2023-10-14T09:38:23.329 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-10-14T09:38:23.329 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-10-14T09:38:23.329 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-10-14T09:38:23.329 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "client.bootstrap-mgr", 2023-10-14T09:38:23.329 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQA4YSplnaR9LBAA5P94mGVY6mAYu0FIgjawkA==", 2023-10-14T09:38:23.329 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-10-14T09:38:23.330 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-14T09:38:23.330 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-10-14T09:38:23.330 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-10-14T09:38:23.330 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-10-14T09:38:23.330 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "client.bootstrap-osd", 2023-10-14T09:38:23.331 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQA4YSplY7x9LBAA4qZ/QYtIQ8buN7hTL0t0VQ==", 2023-10-14T09:38:23.331 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-10-14T09:38:23.331 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile bootstrap-osd" 2023-10-14T09:38:23.331 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-10-14T09:38:23.331 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-10-14T09:38:23.331 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-10-14T09:38:23.332 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "client.bootstrap-rbd", 2023-10-14T09:38:23.332 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQA4YSplitN9LBAA+g0vc0R0vXPYNY7wU8YWog==", 2023-10-14T09:38:23.332 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-10-14T09:38:23.332 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-14T09:38:23.332 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-10-14T09:38:23.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-10-14T09:38:23.333 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-10-14T09:38:23.333 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-14T09:38:23.333 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQA4YSplvPJ9LBAATLel8S/42K0RIa6G6NcmAg==", 2023-10-14T09:38:23.333 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-10-14T09:38:23.333 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-14T09:38:23.334 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-10-14T09:38:23.334 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-10-14T09:38:23.334 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-10-14T09:38:23.334 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "client.bootstrap-rgw", 2023-10-14T09:38:23.334 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQA4YSplJhB+LBAAhV8Hd6yBAln9/JawVewPAA==", 2023-10-14T09:38:23.334 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-10-14T09:38:23.335 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-14T09:38:23.335 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-10-14T09:38:23.335 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-10-14T09:38:23.335 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-10-14T09:38:23.335 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "mgr.x", 2023-10-14T09:38:23.335 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQAEYSplgpm9LhAAgjpiQgywz13WKbx0sW/17A==", 2023-10-14T09:38:23.336 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-10-14T09:38:23.336 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": "allow *", 2023-10-14T09:38:23.336 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile mgr", 2023-10-14T09:38:23.336 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2023-10-14T09:38:23.336 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-10-14T09:38:23.336 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-10-14T09:38:23.337 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-10-14T09:38:23.337 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "mgr.y", 2023-10-14T09:38:23.337 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQAEYSplTJdoIhAAmvARMsPFNrkxMpLN6yAdow==", 2023-10-14T09:38:23.337 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-10-14T09:38:23.337 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": "allow *", 2023-10-14T09:38:23.338 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile mgr", 2023-10-14T09:38:23.338 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2023-10-14T09:38:23.338 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-10-14T09:38:23.338 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-10-14T09:38:23.338 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-10-14T09:38:23.339 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-10-14T09:38:23.340 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.298+0000 7f4f16246640 1 -- 172.21.15.102:0/1234144219 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4ef006ae70 msgr2=0x7f4ef006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:23.340 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.298+0000 7f4f16246640 1 --2- 172.21.15.102:0/1234144219 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4ef006ae70 0x7f4ef006d330 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4f00005880 tx=0x7f4f00007a00 comp rx=0 tx=0).stop 2023-10-14T09:38:23.340 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.298+0000 7f4f16246640 1 -- 172.21.15.102:0/1234144219 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f1015ae80 msgr2=0x7f4f1014f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:23.340 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.298+0000 7f4f16246640 1 --2- 172.21.15.102:0/1234144219 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f1015ae80 0x7f4f1014f130 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4f0800b970 tx=0x7f4f0800be30 comp rx=0 tx=0).stop 2023-10-14T09:38:23.340 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.298+0000 7f4f16246640 1 -- 172.21.15.102:0/1234144219 shutdown_connections 2023-10-14T09:38:23.341 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.298+0000 7f4f16246640 1 --2- 172.21.15.102:0/1234144219 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4ef006ae70 0x7f4ef006d330 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:23.341 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.298+0000 7f4f16246640 1 --2- 172.21.15.102:0/1234144219 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f1015ae80 0x7f4f1014f130 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:23.341 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.298+0000 7f4f16246640 1 --2- 172.21.15.102:0/1234144219 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4f1015aaa0 0x7f4f100c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:23.341 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.298+0000 7f4f16246640 1 --2- 172.21.15.102:0/1234144219 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4f100ce390 0x7f4f100c24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:23.341 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.298+0000 7f4f16246640 1 -- 172.21.15.102:0/1234144219 >> 172.21.15.102:0/1234144219 conn(0x7f4f100cb410 msgr2=0x7f4f100b2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:23.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.298+0000 7f4f16246640 1 -- 172.21.15.102:0/1234144219 shutdown_connections 2023-10-14T09:38:23.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.298+0000 7f4f16246640 1 -- 172.21.15.102:0/1234144219 wait complete. 2023-10-14T09:38:23.342 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-14T09:38:23.563 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.561+0000 7f5a07fff640 1 Processor -- start 2023-10-14T09:38:23.563 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.561+0000 7f5a07fff640 1 -- start start 2023-10-14T09:38:23.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.563+0000 7f5a07fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5a08159950 0x7f5a0815a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:23.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.563+0000 7f5a07fff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f5a08070450 0x7f5a080708e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:23.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.563+0000 7f5a07fff640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5a0806c100 0x7f5a0806c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:23.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.563+0000 7f5a07fff640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a08070e20 con 0x7f5a08159950 2023-10-14T09:38:23.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.563+0000 7f5a07fff640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a0815e490 con 0x7f5a08070450 2023-10-14T09:38:23.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.563+0000 7f5a07fff640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0815aef0 con 0x7f5a0806c100 2023-10-14T09:38:23.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.563+0000 7f5a06ffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5a08159950 0x7f5a0815a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:23.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.563+0000 7f5a06ffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5a08159950 0x7f5a0815a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52358/0 (socket says 172.21.15.102:52358) 2023-10-14T09:38:23.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.563+0000 7f5a06ffd640 1 -- 172.21.15.102:0/1343421947 learned_addr learned my addr 172.21.15.102:0/1343421947 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:23.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.563+0000 7f59fe7fc640 1 --2- 172.21.15.102:0/1343421947 >> v2:172.21.15.129:3300/0 conn(0x7f5a08070450 0x7f5a080708e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:23.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.563+0000 7f5a06ffd640 1 -- 172.21.15.102:0/1343421947 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5a0806c100 msgr2=0x7f5a0806c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:23.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.563+0000 7f5a06ffd640 1 --2- 172.21.15.102:0/1343421947 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5a0806c100 0x7f5a0806c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:23.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.563+0000 7f5a06ffd640 1 -- 172.21.15.102:0/1343421947 >> v2:172.21.15.129:3300/0 conn(0x7f5a08070450 msgr2=0x7f5a080708e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:23.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.563+0000 7f5a06ffd640 1 --2- 172.21.15.102:0/1343421947 >> v2:172.21.15.129:3300/0 conn(0x7f5a08070450 0x7f5a080708e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:23.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.563+0000 7f5a06ffd640 1 -- 172.21.15.102:0/1343421947 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a0815d910 con 0x7f5a08159950 2023-10-14T09:38:23.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.564+0000 7f59fe7fc640 1 --2- 172.21.15.102:0/1343421947 >> v2:172.21.15.129:3300/0 conn(0x7f5a08070450 0x7f5a080708e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:23.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.565+0000 7f5a06ffd640 1 --2- 172.21.15.102:0/1343421947 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a08159950 0x7f5a0815a9b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5a080cab70 tx=0x7f59f802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f7c1bd91c20bb52 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:23.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.565+0000 7f5a067fc640 1 -- 172.21.15.102:0/1343421947 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f80317c0 con 0x7f5a08159950 2023-10-14T09:38:23.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.565+0000 7f5a067fc640 1 -- 172.21.15.102:0/1343421947 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f8031920 con 0x7f5a08159950 2023-10-14T09:38:23.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.565+0000 7f5a067fc640 1 -- 172.21.15.102:0/1343421947 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f8031cb0 con 0x7f5a08159950 2023-10-14T09:38:23.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.566+0000 7f5a07fff640 1 -- 172.21.15.102:0/1343421947 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a08159950 msgr2=0x7f5a0815a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:23.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.566+0000 7f5a07fff640 1 --2- 172.21.15.102:0/1343421947 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a08159950 0x7f5a0815a9b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5a080cab70 tx=0x7f59f802b860 comp rx=0 tx=0).stop 2023-10-14T09:38:23.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.566+0000 7f5a07fff640 1 -- 172.21.15.102:0/1343421947 shutdown_connections 2023-10-14T09:38:23.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.566+0000 7f5a07fff640 1 --2- 172.21.15.102:0/1343421947 >> v2:172.21.15.129:3300/0 conn(0x7f5a08070450 0x7f5a080708e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:23.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.566+0000 7f5a07fff640 1 --2- 172.21.15.102:0/1343421947 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5a0806c100 0x7f5a0806c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:23.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.566+0000 7f5a07fff640 1 --2- 172.21.15.102:0/1343421947 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a08159950 0x7f5a0815a9b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:23.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.566+0000 7f5a07fff640 1 -- 172.21.15.102:0/1343421947 >> 172.21.15.102:0/1343421947 conn(0x7f5a080ce6a0 msgr2=0x7f5a080ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:23.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.566+0000 7f5a07fff640 1 -- 172.21.15.102:0/1343421947 shutdown_connections 2023-10-14T09:38:23.572 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.566+0000 7f5a07fff640 1 -- 172.21.15.102:0/1343421947 wait complete. 2023-10-14T09:38:23.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.568+0000 7f5a07fff640 1 Processor -- start 2023-10-14T09:38:23.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.568+0000 7f5a07fff640 1 -- start start 2023-10-14T09:38:23.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.569+0000 7f5a07fff640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5a0806c100 0x7f5a080c7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:23.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.569+0000 7f5a07fff640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5a08070450 0x7f5a08167560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:23.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.569+0000 7f5a07fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a08159950 0x7f5a080c5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:23.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.569+0000 7f5a07fff640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a080c6bd0 con 0x7f5a08159950 2023-10-14T09:38:23.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.569+0000 7f5a07fff640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a080c5fc0 con 0x7f5a0806c100 2023-10-14T09:38:23.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.569+0000 7f5a07fff640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a080c62a0 con 0x7f5a08070450 2023-10-14T09:38:23.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.569+0000 7f5a077fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a08159950 0x7f5a080c5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:23.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.570+0000 7f5a077fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a08159950 0x7f5a080c5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52370/0 (socket says 172.21.15.102:52370) 2023-10-14T09:38:23.576 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.570+0000 7f5a077fe640 1 -- 172.21.15.102:0/1803881732 learned_addr learned my addr 172.21.15.102:0/1803881732 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:23.576 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.570+0000 7f59fe7fc640 1 --2- 172.21.15.102:0/1803881732 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5a08070450 0x7f5a08167560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:23.576 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.570+0000 7f5a06ffd640 1 --2- 172.21.15.102:0/1803881732 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5a0806c100 0x7f5a080c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:23.576 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.570+0000 7f5a077fe640 1 -- 172.21.15.102:0/1803881732 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5a08070450 msgr2=0x7f5a08167560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:23.576 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.570+0000 7f5a077fe640 1 --2- 172.21.15.102:0/1803881732 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5a08070450 0x7f5a08167560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:23.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.570+0000 7f5a077fe640 1 -- 172.21.15.102:0/1803881732 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5a0806c100 msgr2=0x7f5a080c7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:23.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.570+0000 7f5a077fe640 1 --2- 172.21.15.102:0/1803881732 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5a0806c100 0x7f5a080c7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:23.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.570+0000 7f5a077fe640 1 -- 172.21.15.102:0/1803881732 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f80094d0 con 0x7f5a08159950 2023-10-14T09:38:23.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.570+0000 7f5a077fe640 1 --2- 172.21.15.102:0/1803881732 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a08159950 0x7f5a080c5770 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5a0000b970 tx=0x7f5a0000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:23.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.570+0000 7f59fffff640 1 -- 172.21.15.102:0/1803881732 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0000cb40 con 0x7f5a08159950 2023-10-14T09:38:23.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.571+0000 7f59fffff640 1 -- 172.21.15.102:0/1803881732 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0000ccc0 con 0x7f5a08159950 2023-10-14T09:38:23.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.571+0000 7f59fffff640 1 -- 172.21.15.102:0/1803881732 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a00014680 con 0x7f5a08159950 2023-10-14T09:38:23.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.571+0000 7f5a07fff640 1 -- 172.21.15.102:0/1803881732 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a080c6580 con 0x7f5a08159950 2023-10-14T09:38:23.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.571+0000 7f5a07fff640 1 -- 172.21.15.102:0/1803881732 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a080c5cb0 con 0x7f5a08159950 2023-10-14T09:38:23.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.572+0000 7f5a07fff640 1 -- 172.21.15.102:0/1803881732 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a080c6d40 con 0x7f5a08159950 2023-10-14T09:38:23.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.573+0000 7f59fffff640 1 -- 172.21.15.102:0/1803881732 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5a0001d3b0 con 0x7f5a08159950 2023-10-14T09:38:23.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.574+0000 7f59fffff640 1 --2- 172.21.15.102:0/1803881732 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f59e806ae70 0x7f59e806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:23.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.574+0000 7f59fffff640 1 -- 172.21.15.102:0/1803881732 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5a00089270 con 0x7f5a08159950 2023-10-14T09:38:23.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.574+0000 7f5a06ffd640 1 --2- 172.21.15.102:0/1803881732 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f59e806ae70 0x7f59e806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:23.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.575+0000 7f5a06ffd640 1 --2- 172.21.15.102:0/1803881732 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f59e806ae70 0x7f59e806d330 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f59f8036000 tx=0x7f59f803d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:23.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.579+0000 7f59fffff640 1 -- 172.21.15.102:0/1803881732 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5a00054660 con 0x7f5a08159950 2023-10-14T09:38:23.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.843+0000 7f5a07fff640 1 -- 172.21.15.102:0/1803881732 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f5a0804e9b0 con 0x7f5a08159950 2023-10-14T09:38:23.848 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.847+0000 7f59fffff640 1 -- 172.21.15.102:0/1803881732 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5a00057c80 con 0x7f5a08159950 2023-10-14T09:38:23.851 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.849+0000 7f5a07fff640 1 -- 172.21.15.102:0/1803881732 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f59e806ae70 msgr2=0x7f59e806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:23.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.849+0000 7f5a07fff640 1 --2- 172.21.15.102:0/1803881732 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f59e806ae70 0x7f59e806d330 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f59f8036000 tx=0x7f59f803d040 comp rx=0 tx=0).stop 2023-10-14T09:38:23.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.849+0000 7f5a07fff640 1 -- 172.21.15.102:0/1803881732 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a08159950 msgr2=0x7f5a080c5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:23.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.849+0000 7f5a07fff640 1 --2- 172.21.15.102:0/1803881732 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a08159950 0x7f5a080c5770 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5a0000b970 tx=0x7f5a0000be30 comp rx=0 tx=0).stop 2023-10-14T09:38:23.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.849+0000 7f5a07fff640 1 -- 172.21.15.102:0/1803881732 shutdown_connections 2023-10-14T09:38:23.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.849+0000 7f5a07fff640 1 --2- 172.21.15.102:0/1803881732 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f59e806ae70 0x7f59e806d330 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:23.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.849+0000 7f5a07fff640 1 --2- 172.21.15.102:0/1803881732 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a08159950 0x7f5a080c5770 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:23.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.849+0000 7f5a07fff640 1 --2- 172.21.15.102:0/1803881732 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5a08070450 0x7f5a08167560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:23.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.849+0000 7f5a07fff640 1 --2- 172.21.15.102:0/1803881732 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5a0806c100 0x7f5a080c7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:23.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.849+0000 7f5a07fff640 1 -- 172.21.15.102:0/1803881732 >> 172.21.15.102:0/1803881732 conn(0x7f5a080ce6a0 msgr2=0x7f5a0815d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:23.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.850+0000 7f5a07fff640 1 -- 172.21.15.102:0/1803881732 shutdown_connections 2023-10-14T09:38:23.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:23.850+0000 7f5a07fff640 1 -- 172.21.15.102:0/1803881732 wait complete. 2023-10-14T09:38:23.870 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-14T09:38:24.079 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.077+0000 7fe5e96d0640 1 Processor -- start 2023-10-14T09:38:24.079 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.078+0000 7fe5e96d0640 1 -- start start 2023-10-14T09:38:24.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.079+0000 7fe5e96d0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe5e406a4b0 0x7fe5e40ca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:24.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.079+0000 7fe5e96d0640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fe5e40c9ca0 0x7fe5e40ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:24.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.079+0000 7fe5e96d0640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5e40cb030 con 0x7fe5e415ad70 2023-10-14T09:38:24.083 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.079+0000 7fe5e96d0640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5e40cae30 con 0x7fe5e406a4b0 2023-10-14T09:38:24.083 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.079+0000 7fe5e96d0640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5e40c91c0 con 0x7fe5e40c9ca0 2023-10-14T09:38:24.083 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.080+0000 7fe5da7fc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe5e406a4b0 0x7fe5e40ca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:24.083 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.080+0000 7fe5da7fc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe5e406a4b0 0x7fe5e40ca3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52382/0 (socket says 172.21.15.102:52382) 2023-10-14T09:38:24.083 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.080+0000 7fe5da7fc640 1 -- 172.21.15.102:0/3278232894 learned_addr learned my addr 172.21.15.102:0/3278232894 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:24.084 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.080+0000 7fe5e37fe640 1 --2- 172.21.15.102:0/3278232894 >> v2:172.21.15.129:3300/0 conn(0x7fe5e40c9ca0 0x7fe5e40ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:24.084 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.080+0000 7fe5da7fc640 1 -- 172.21.15.102:0/3278232894 >> v2:172.21.15.129:3300/0 conn(0x7fe5e40c9ca0 msgr2=0x7fe5e40ca8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:24.084 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.080+0000 7fe5da7fc640 1 --2- 172.21.15.102:0/3278232894 >> v2:172.21.15.129:3300/0 conn(0x7fe5e40c9ca0 0x7fe5e40ca8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:24.084 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.080+0000 7fe5da7fc640 1 -- 172.21.15.102:0/3278232894 >> v1:172.21.15.129:6789/0 conn(0x7fe5e415ad70 legacy=0x7fe5e4069da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:24.084 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.080+0000 7fe5da7fc640 1 -- 172.21.15.102:0/3278232894 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e40c94a0 con 0x7fe5e406a4b0 2023-10-14T09:38:24.086 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.081+0000 7fe5da7fc640 1 --2- 172.21.15.102:0/3278232894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5e406a4b0 0x7fe5e40ca3b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe5e406f270 tx=0x7fe5cc02b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bee13b126e74d2d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:24.086 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.082+0000 7fe5e27fc640 1 -- 172.21.15.102:0/3278232894 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc031890 con 0x7fe5e406a4b0 2023-10-14T09:38:24.086 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.082+0000 7fe5e27fc640 1 -- 172.21.15.102:0/3278232894 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5cc0319f0 con 0x7fe5e406a4b0 2023-10-14T09:38:24.086 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.082+0000 7fe5e27fc640 1 -- 172.21.15.102:0/3278232894 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc031d80 con 0x7fe5e406a4b0 2023-10-14T09:38:24.087 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.082+0000 7fe5e96d0640 1 -- 172.21.15.102:0/3278232894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5e406a4b0 msgr2=0x7fe5e40ca3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:24.087 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.082+0000 7fe5e96d0640 1 --2- 172.21.15.102:0/3278232894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5e406a4b0 0x7fe5e40ca3b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe5e406f270 tx=0x7fe5cc02b930 comp rx=0 tx=0).stop 2023-10-14T09:38:24.087 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.082+0000 7fe5e96d0640 1 -- 172.21.15.102:0/3278232894 shutdown_connections 2023-10-14T09:38:24.087 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.082+0000 7fe5e96d0640 1 --2- 172.21.15.102:0/3278232894 >> v2:172.21.15.129:3300/0 conn(0x7fe5e40c9ca0 0x7fe5e40ca8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:24.087 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.082+0000 7fe5e96d0640 1 --2- 172.21.15.102:0/3278232894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5e406a4b0 0x7fe5e40ca3b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:24.088 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.082+0000 7fe5e96d0640 1 -- 172.21.15.102:0/3278232894 >> 172.21.15.102:0/3278232894 conn(0x7fe5e40ce9b0 msgr2=0x7fe5e40cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:24.088 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.082+0000 7fe5e96d0640 1 -- 172.21.15.102:0/3278232894 shutdown_connections 2023-10-14T09:38:24.088 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.082+0000 7fe5e96d0640 1 -- 172.21.15.102:0/3278232894 wait complete. 2023-10-14T09:38:24.088 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.084+0000 7fe5e96d0640 1 Processor -- start 2023-10-14T09:38:24.088 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.084+0000 7fe5e96d0640 1 -- start start 2023-10-14T09:38:24.091 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.085+0000 7fe5e96d0640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe5e406a4b0 0x7fe5e40a8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:24.091 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.085+0000 7fe5e96d0640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe5e40c9ca0 0x7fe5e4159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:24.091 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.085+0000 7fe5e96d0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5e415ad70 0x7fe5e40c4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:24.091 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.085+0000 7fe5e96d0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e40c6bb0 con 0x7fe5e415ad70 2023-10-14T09:38:24.092 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.085+0000 7fe5e96d0640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e41f0040 con 0x7fe5e406a4b0 2023-10-14T09:38:24.092 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.085+0000 7fe5e96d0640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e40c6dc0 con 0x7fe5e40c9ca0 2023-10-14T09:38:24.092 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.085+0000 7fe5e37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5e415ad70 0x7fe5e40c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:24.092 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.085+0000 7fe5e37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5e415ad70 0x7fe5e40c4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52390/0 (socket says 172.21.15.102:52390) 2023-10-14T09:38:24.092 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.085+0000 7fe5e37fe640 1 -- 172.21.15.102:0/3414532429 learned_addr learned my addr 172.21.15.102:0/3414532429 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:24.092 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.086+0000 7fe5e2ffd640 1 --2- 172.21.15.102:0/3414532429 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe5e406a4b0 0x7fe5e40a8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:24.093 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.086+0000 7fe5da7fc640 1 --2- 172.21.15.102:0/3414532429 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe5e40c9ca0 0x7fe5e4159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:24.093 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.086+0000 7fe5e37fe640 1 -- 172.21.15.102:0/3414532429 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe5e40c9ca0 msgr2=0x7fe5e4159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:24.093 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.086+0000 7fe5e37fe640 1 --2- 172.21.15.102:0/3414532429 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe5e40c9ca0 0x7fe5e4159080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:24.093 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.086+0000 7fe5e37fe640 1 -- 172.21.15.102:0/3414532429 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe5e406a4b0 msgr2=0x7fe5e40a8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:24.093 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.086+0000 7fe5e37fe640 1 --2- 172.21.15.102:0/3414532429 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe5e406a4b0 0x7fe5e40a8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:24.094 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.086+0000 7fe5e37fe640 1 -- 172.21.15.102:0/3414532429 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5cc0094d0 con 0x7fe5e415ad70 2023-10-14T09:38:24.094 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.086+0000 7fe5da7fc640 1 --2- 172.21.15.102:0/3414532429 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe5e40c9ca0 0x7fe5e4159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:24.094 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.086+0000 7fe5e37fe640 1 --2- 172.21.15.102:0/3414532429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5e415ad70 0x7fe5e40c4670 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc00cd70 tx=0x7fe5dc00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:24.094 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.086+0000 7fe5dbfff640 1 -- 172.21.15.102:0/3414532429 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5dc003b90 con 0x7fe5e415ad70 2023-10-14T09:38:24.094 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.086+0000 7fe5dbfff640 1 -- 172.21.15.102:0/3414532429 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5dc003cf0 con 0x7fe5e415ad70 2023-10-14T09:38:24.095 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.086+0000 7fe5e96d0640 1 -- 172.21.15.102:0/3414532429 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5e40c70a0 con 0x7fe5e415ad70 2023-10-14T09:38:24.095 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.086+0000 7fe5dbfff640 1 -- 172.21.15.102:0/3414532429 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5dc004240 con 0x7fe5e415ad70 2023-10-14T09:38:24.095 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.087+0000 7fe5e96d0640 1 -- 172.21.15.102:0/3414532429 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5e40c7660 con 0x7fe5e415ad70 2023-10-14T09:38:24.095 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.088+0000 7fe5e96d0640 1 -- 172.21.15.102:0/3414532429 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5e404e160 con 0x7fe5e415ad70 2023-10-14T09:38:24.095 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.089+0000 7fe5dbfff640 1 -- 172.21.15.102:0/3414532429 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe5dc0043a0 con 0x7fe5e415ad70 2023-10-14T09:38:24.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.090+0000 7fe5dbfff640 1 --2- 172.21.15.102:0/3414532429 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe5c406ae70 0x7fe5c406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:24.097 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.090+0000 7fe5dbfff640 1 -- 172.21.15.102:0/3414532429 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe5dc012070 con 0x7fe5e415ad70 2023-10-14T09:38:24.097 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.090+0000 7fe5e2ffd640 1 --2- 172.21.15.102:0/3414532429 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe5c406ae70 0x7fe5c406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:24.097 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.091+0000 7fe5e2ffd640 1 --2- 172.21.15.102:0/3414532429 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe5c406ae70 0x7fe5c406d330 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe5d4006fd0 tx=0x7fe5d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:24.097 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.094+0000 7fe5dbfff640 1 -- 172.21.15.102:0/3414532429 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe5dc0550b0 con 0x7fe5e415ad70 2023-10-14T09:38:24.350 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.349+0000 7fe5e96d0640 1 -- 172.21.15.102:0/3414532429 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fe5e40b2d60 con 0x7fe5e415ad70 2023-10-14T09:38:24.355 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.353+0000 7fe5dbfff640 1 -- 172.21.15.102:0/3414532429 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe5dc0586d0 con 0x7fe5e415ad70 2023-10-14T09:38:24.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.356+0000 7fe5e96d0640 1 -- 172.21.15.102:0/3414532429 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe5c406ae70 msgr2=0x7fe5c406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:24.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.356+0000 7fe5e96d0640 1 --2- 172.21.15.102:0/3414532429 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe5c406ae70 0x7fe5c406d330 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe5d4006fd0 tx=0x7fe5d4008040 comp rx=0 tx=0).stop 2023-10-14T09:38:24.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.356+0000 7fe5e96d0640 1 -- 172.21.15.102:0/3414532429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5e415ad70 msgr2=0x7fe5e40c4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:24.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.356+0000 7fe5e96d0640 1 --2- 172.21.15.102:0/3414532429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5e415ad70 0x7fe5e40c4670 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc00cd70 tx=0x7fe5dc00a660 comp rx=0 tx=0).stop 2023-10-14T09:38:24.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.356+0000 7fe5e96d0640 1 -- 172.21.15.102:0/3414532429 shutdown_connections 2023-10-14T09:38:24.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.356+0000 7fe5e96d0640 1 --2- 172.21.15.102:0/3414532429 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe5c406ae70 0x7fe5c406d330 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:24.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.356+0000 7fe5e96d0640 1 --2- 172.21.15.102:0/3414532429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5e415ad70 0x7fe5e40c4670 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:24.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.356+0000 7fe5e96d0640 1 --2- 172.21.15.102:0/3414532429 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe5e40c9ca0 0x7fe5e4159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:24.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.356+0000 7fe5e96d0640 1 --2- 172.21.15.102:0/3414532429 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe5e406a4b0 0x7fe5e40a8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:24.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.356+0000 7fe5e96d0640 1 -- 172.21.15.102:0/3414532429 >> 172.21.15.102:0/3414532429 conn(0x7fe5e40ce9b0 msgr2=0x7fe5e406b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:24.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.356+0000 7fe5e96d0640 1 -- 172.21.15.102:0/3414532429 shutdown_connections 2023-10-14T09:38:24.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.356+0000 7fe5e96d0640 1 -- 172.21.15.102:0/3414532429 wait complete. 2023-10-14T09:38:24.375 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-14T09:38:24.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.577+0000 7f7852cc9640 1 Processor -- start 2023-10-14T09:38:24.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.578+0000 7f7852cc9640 1 -- start start 2023-10-14T09:38:24.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.579+0000 7f7852cc9640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f784c15cef0 0x7f784c0ad2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:24.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.579+0000 7f7852cc9640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f784c070530 con 0x7f784c0ccd30 2023-10-14T09:38:24.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.579+0000 7f7852cc9640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f784c070810 con 0x7f784c0adc00 2023-10-14T09:38:24.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.579+0000 7f7852cc9640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f784c0711b0 con 0x7f784c15cef0 2023-10-14T09:38:24.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.580+0000 7f7851266640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f784c0ccd30 0x7f784c06b4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:35202/0 (socket says 172.21.15.102:35202) 2023-10-14T09:38:24.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.580+0000 7f7851266640 1 -- 172.21.15.102:0/3711254255 learned_addr learned my addr 172.21.15.102:0/3711254255 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:24.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.580+0000 7f7850a65640 1 --2- 172.21.15.102:0/3711254255 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f784c15cef0 0x7f784c0ad2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:24.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.580+0000 7f784b7fe640 1 -- 172.21.15.102:0/3711254255 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1869640112 0 0) 0x7f784c070530 con 0x7f784c0ccd30 2023-10-14T09:38:24.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.580+0000 7f784b7fe640 1 -- 172.21.15.102:0/3711254255 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f783c003520 con 0x7f784c0ccd30 2023-10-14T09:38:24.586 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.580+0000 7f784b7fe640 1 -- 172.21.15.102:0/3711254255 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2433478261 0 0) 0x7f783c003520 con 0x7f784c0ccd30 2023-10-14T09:38:24.587 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.580+0000 7f784b7fe640 1 -- 172.21.15.102:0/3711254255 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f784c15cef0 msgr2=0x7f784c0ad2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:24.587 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.580+0000 7f784b7fe640 1 --2- 172.21.15.102:0/3711254255 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f784c15cef0 0x7f784c0ad2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:24.587 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.580+0000 7f784b7fe640 1 -- 172.21.15.102:0/3711254255 >> v1:172.21.15.129:6789/0 conn(0x7f784c0adc00 legacy=0x7f784c0cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:24.587 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.580+0000 7f784b7fe640 1 -- 172.21.15.102:0/3711254255 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f784c070af0 con 0x7f784c0ccd30 2023-10-14T09:38:24.587 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.580+0000 7f784b7fe640 1 -- 172.21.15.102:0/3711254255 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4030661168 0 0) 0x7f78440019f0 con 0x7f784c0ccd30 2023-10-14T09:38:24.588 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.581+0000 7f784b7fe640 1 -- 172.21.15.102:0/3711254255 >> v1:172.21.15.102:6789/0 conn(0x7f784c0ccd30 legacy=0x7f784c06b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:24.588 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.581+0000 7f784b7fe640 1 --2- 172.21.15.102:0/3711254255 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f783c0039a0 0x7f783c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:24.588 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.581+0000 7f784b7fe640 1 --2- 172.21.15.102:0/3711254255 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f783c0047c0 0x7f783c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:24.588 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.581+0000 7f784b7fe640 1 --2- 172.21.15.102:0/3711254255 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f784c15cef0 0x7f783c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:24.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.581+0000 7f784b7fe640 1 -- 172.21.15.102:0/3711254255 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784c0711b0 con 0x7f783c0047c0 2023-10-14T09:38:24.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.581+0000 7f784b7fe640 1 -- 172.21.15.102:0/3711254255 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783c00bb10 con 0x7f783c0039a0 2023-10-14T09:38:24.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.581+0000 7f784b7fe640 1 -- 172.21.15.102:0/3711254255 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f783c00bcd0 con 0x7f784c15cef0 2023-10-14T09:38:24.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.581+0000 7f784bfff640 1 --2- 172.21.15.102:0/3711254255 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f783c0047c0 0x7f783c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:24.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.581+0000 7f7850a65640 1 --2- 172.21.15.102:0/3711254255 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f783c0039a0 0x7f783c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:24.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.581+0000 7f7851266640 1 --2- 172.21.15.102:0/3711254255 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f784c15cef0 0x7f783c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:24.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.581+0000 7f784bfff640 1 -- 172.21.15.102:0/3711254255 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f784c15cef0 msgr2=0x7f783c005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:24.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.581+0000 7f784bfff640 1 --2- 172.21.15.102:0/3711254255 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f784c15cef0 0x7f783c005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:24.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.581+0000 7f784bfff640 1 -- 172.21.15.102:0/3711254255 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f783c0039a0 msgr2=0x7f783c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:24.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.581+0000 7f784bfff640 1 --2- 172.21.15.102:0/3711254255 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f783c0039a0 0x7f783c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:24.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.581+0000 7f784bfff640 1 -- 172.21.15.102:0/3711254255 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f783c003520 con 0x7f783c0047c0 2023-10-14T09:38:24.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.583+0000 7f784bfff640 1 --2- 172.21.15.102:0/3711254255 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f783c0047c0 0x7f783c004c40 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7838001750 tx=0x7f783c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=544534bf46009ae5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:24.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.583+0000 7f784b7fe640 1 -- 172.21.15.102:0/3711254255 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78380052d0 con 0x7f783c0047c0 2023-10-14T09:38:24.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.583+0000 7f784b7fe640 1 -- 172.21.15.102:0/3711254255 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783802e050 con 0x7f783c0047c0 2023-10-14T09:38:24.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.583+0000 7f784b7fe640 1 -- 172.21.15.102:0/3711254255 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78380035f0 con 0x7f783c0047c0 2023-10-14T09:38:24.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.583+0000 7f7852cc9640 1 -- 172.21.15.102:0/3711254255 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f783c0047c0 msgr2=0x7f783c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:24.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.583+0000 7f7852cc9640 1 --2- 172.21.15.102:0/3711254255 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f783c0047c0 0x7f783c004c40 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7838001750 tx=0x7f783c0057f0 comp rx=0 tx=0).stop 2023-10-14T09:38:24.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.583+0000 7f7851266640 1 -- 172.21.15.102:0/3711254255 reap_dead start 2023-10-14T09:38:24.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.584+0000 7f7852cc9640 1 -- 172.21.15.102:0/3711254255 shutdown_connections 2023-10-14T09:38:24.593 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.584+0000 7f7852cc9640 1 -- 172.21.15.102:0/3711254255 >> 172.21.15.102:0/3711254255 conn(0x7f784c0ce840 msgr2=0x7f784c0cec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:24.593 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.584+0000 7f7852cc9640 1 -- 172.21.15.102:0/3711254255 shutdown_connections 2023-10-14T09:38:24.593 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.584+0000 7f7852cc9640 1 -- 172.21.15.102:0/3711254255 wait complete. 2023-10-14T09:38:24.596 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.585+0000 7f7852cc9640 1 Processor -- start 2023-10-14T09:38:24.596 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.586+0000 7f7852cc9640 1 -- start start 2023-10-14T09:38:24.596 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.586+0000 7f7852cc9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f783c0047c0 0x7f784c0c5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:24.596 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.586+0000 7f7852cc9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f784c0c2490 0x7f784c0b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:24.597 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.587+0000 7f7852cc9640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f784c1f5720 0x7f784c1f5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:24.597 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.587+0000 7f7852cc9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784c0b43a0 con 0x7f783c0047c0 2023-10-14T09:38:24.597 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.587+0000 7f7852cc9640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784c1f60e0 con 0x7f784c0c2490 2023-10-14T09:38:24.597 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.587+0000 7f7852cc9640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f784c1f2020 con 0x7f784c1f5720 2023-10-14T09:38:24.597 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.587+0000 7f7850a65640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f783c0047c0 0x7f784c0c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:24.598 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.587+0000 7f7850a65640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f783c0047c0 0x7f784c0c5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52408/0 (socket says 172.21.15.102:52408) 2023-10-14T09:38:24.598 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.587+0000 7f7850a65640 1 -- 172.21.15.102:0/1734577844 learned_addr learned my addr 172.21.15.102:0/1734577844 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:24.598 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.587+0000 7f7850a65640 1 -- 172.21.15.102:0/1734577844 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f784c1f5720 msgr2=0x7f784c1f5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:24.598 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.587+0000 7f7850a65640 1 --2- 172.21.15.102:0/1734577844 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f784c1f5720 0x7f784c1f5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:24.598 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.587+0000 7f7850a65640 1 -- 172.21.15.102:0/1734577844 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f784c0c2490 msgr2=0x7f784c0b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:24.599 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.587+0000 7f7850a65640 1 --2- 172.21.15.102:0/1734577844 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f784c0c2490 0x7f784c0b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:24.599 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.587+0000 7f7850a65640 1 -- 172.21.15.102:0/1734577844 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f784c0c4ec0 con 0x7f783c0047c0 2023-10-14T09:38:24.599 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.587+0000 7f7850a65640 1 --2- 172.21.15.102:0/1734577844 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f783c0047c0 0x7f784c0c5350 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7840011600 tx=0x7f7840011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:24.599 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.588+0000 7f78497fa640 1 -- 172.21.15.102:0/1734577844 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7840015870 con 0x7f783c0047c0 2023-10-14T09:38:24.599 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.588+0000 7f78497fa640 1 -- 172.21.15.102:0/1734577844 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78400159d0 con 0x7f783c0047c0 2023-10-14T09:38:24.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.588+0000 7f78497fa640 1 -- 172.21.15.102:0/1734577844 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7840015d40 con 0x7f783c0047c0 2023-10-14T09:38:24.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.588+0000 7f7852cc9640 1 -- 172.21.15.102:0/1734577844 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f784c0c2910 con 0x7f783c0047c0 2023-10-14T09:38:24.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.588+0000 7f7852cc9640 1 -- 172.21.15.102:0/1734577844 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f784c0b1a30 con 0x7f783c0047c0 2023-10-14T09:38:24.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.589+0000 7f7852cc9640 1 -- 172.21.15.102:0/1734577844 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f784c0cb9d0 con 0x7f783c0047c0 2023-10-14T09:38:24.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.590+0000 7f78497fa640 1 -- 172.21.15.102:0/1734577844 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f784000f450 con 0x7f783c0047c0 2023-10-14T09:38:24.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.591+0000 7f78497fa640 1 --2- 172.21.15.102:0/1734577844 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f783006ae70 0x7f783006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:24.601 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.591+0000 7f78497fa640 1 -- 172.21.15.102:0/1734577844 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7840089690 con 0x7f783c0047c0 2023-10-14T09:38:24.601 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.592+0000 7f784bfff640 1 --2- 172.21.15.102:0/1734577844 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f783006ae70 0x7f783006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:24.601 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.592+0000 7f784bfff640 1 --2- 172.21.15.102:0/1734577844 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f783006ae70 0x7f783006d330 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7838001750 tx=0x7f783802f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:24.602 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.596+0000 7f78497fa640 1 -- 172.21.15.102:0/1734577844 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7840054b20 con 0x7f783c0047c0 2023-10-14T09:38:24.857 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.855+0000 7f7852cc9640 1 -- 172.21.15.102:0/1734577844 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f784c070da0 con 0x7f783c0047c0 2023-10-14T09:38:24.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.860+0000 7f78497fa640 1 -- 172.21.15.102:0/1734577844 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7840058140 con 0x7f783c0047c0 2023-10-14T09:38:24.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.863+0000 7f7852cc9640 1 -- 172.21.15.102:0/1734577844 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f783006ae70 msgr2=0x7f783006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:24.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.863+0000 7f7852cc9640 1 --2- 172.21.15.102:0/1734577844 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f783006ae70 0x7f783006d330 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7838001750 tx=0x7f783802f000 comp rx=0 tx=0).stop 2023-10-14T09:38:24.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.863+0000 7f7852cc9640 1 -- 172.21.15.102:0/1734577844 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f783c0047c0 msgr2=0x7f784c0c5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:24.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.863+0000 7f7852cc9640 1 --2- 172.21.15.102:0/1734577844 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f783c0047c0 0x7f784c0c5350 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7840011600 tx=0x7f7840011ac0 comp rx=0 tx=0).stop 2023-10-14T09:38:24.866 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.863+0000 7f7852cc9640 1 -- 172.21.15.102:0/1734577844 shutdown_connections 2023-10-14T09:38:24.866 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.863+0000 7f7852cc9640 1 --2- 172.21.15.102:0/1734577844 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f783006ae70 0x7f783006d330 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:24.866 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.863+0000 7f7852cc9640 1 --2- 172.21.15.102:0/1734577844 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f784c1f5720 0x7f784c1f5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:24.866 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.863+0000 7f7852cc9640 1 --2- 172.21.15.102:0/1734577844 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f784c0c2490 0x7f784c0b3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:24.866 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.863+0000 7f7852cc9640 1 --2- 172.21.15.102:0/1734577844 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f783c0047c0 0x7f784c0c5350 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:24.867 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.863+0000 7f7852cc9640 1 -- 172.21.15.102:0/1734577844 >> 172.21.15.102:0/1734577844 conn(0x7f784c0ce840 msgr2=0x7f784c0cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:24.867 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.863+0000 7f7852cc9640 1 -- 172.21.15.102:0/1734577844 shutdown_connections 2023-10-14T09:38:24.867 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:24.863+0000 7f7852cc9640 1 -- 172.21.15.102:0/1734577844 wait complete. 2023-10-14T09:38:24.882 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-14T09:38:25.098 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.096+0000 7fd30cb4e640 1 Processor -- start 2023-10-14T09:38:25.098 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.096+0000 7fd30cb4e640 1 -- start start 2023-10-14T09:38:25.099 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.098+0000 7fd30cb4e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd308159e90 0x7fd3080ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:25.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.098+0000 7fd30cb4e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd308070360 con 0x7fd308159ab0 2023-10-14T09:38:25.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.098+0000 7fd30cb4e640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3080cd1f0 con 0x7fd30806c140 2023-10-14T09:38:25.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.098+0000 7fd30cb4e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd30815d890 con 0x7fd308159e90 2023-10-14T09:38:25.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.098+0000 7fd2fffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd308159e90 0x7fd3080ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:25.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.098+0000 7fd30659c640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fd308159ab0 0x7fd30806fc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:35216/0 (socket says 172.21.15.102:35216) 2023-10-14T09:38:25.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.098+0000 7fd30659c640 1 -- 172.21.15.102:0/1619291423 learned_addr learned my addr 172.21.15.102:0/1619291423 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:25.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.098+0000 7fd305d9b640 1 -- 172.21.15.102:0/1619291423 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3101084469 0 0) 0x7fd308070360 con 0x7fd308159ab0 2023-10-14T09:38:25.102 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.099+0000 7fd305d9b640 1 -- 172.21.15.102:0/1619291423 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2f4003520 con 0x7fd308159ab0 2023-10-14T09:38:25.102 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.099+0000 7fd2fffff640 1 -- 172.21.15.102:0/1619291423 >> v1:172.21.15.129:6789/0 conn(0x7fd30806c140 legacy=0x7fd30815dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:25.102 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.099+0000 7fd2fffff640 1 -- 172.21.15.102:0/1619291423 >> v1:172.21.15.102:6789/0 conn(0x7fd308159ab0 legacy=0x7fd30806fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:25.102 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.099+0000 7fd2fffff640 1 -- 172.21.15.102:0/1619291423 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3080cd4d0 con 0x7fd308159e90 2023-10-14T09:38:25.102 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.100+0000 7fd2fffff640 1 --2- 172.21.15.102:0/1619291423 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd308159e90 0x7fd3080ce370 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd2f00097a0 tx=0x7fd2f002b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee2dcfaeca885c09 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:25.103 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.100+0000 7fd305d9b640 1 -- 172.21.15.102:0/1619291423 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f002f050 con 0x7fd308159e90 2023-10-14T09:38:25.104 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.100+0000 7fd305d9b640 1 -- 172.21.15.102:0/1619291423 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f0031700 con 0x7fd308159e90 2023-10-14T09:38:25.104 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.100+0000 7fd305d9b640 1 -- 172.21.15.102:0/1619291423 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f0031a70 con 0x7fd308159e90 2023-10-14T09:38:25.104 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.101+0000 7fd30cb4e640 1 -- 172.21.15.102:0/1619291423 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd308159e90 msgr2=0x7fd3080ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:25.104 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.101+0000 7fd30cb4e640 1 --2- 172.21.15.102:0/1619291423 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd308159e90 0x7fd3080ce370 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd2f00097a0 tx=0x7fd2f002b7a0 comp rx=0 tx=0).stop 2023-10-14T09:38:25.104 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.101+0000 7fd30cb4e640 1 -- 172.21.15.102:0/1619291423 shutdown_connections 2023-10-14T09:38:25.105 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.101+0000 7fd30cb4e640 1 --2- 172.21.15.102:0/1619291423 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd308159e90 0x7fd3080ce370 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:25.105 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.101+0000 7fd30cb4e640 1 -- 172.21.15.102:0/1619291423 >> 172.21.15.102:0/1619291423 conn(0x7fd3080ce9b0 msgr2=0x7fd3080cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:25.105 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.101+0000 7fd30cb4e640 1 -- 172.21.15.102:0/1619291423 shutdown_connections 2023-10-14T09:38:25.105 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.101+0000 7fd30cb4e640 1 -- 172.21.15.102:0/1619291423 wait complete. 2023-10-14T09:38:25.107 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.103+0000 7fd30cb4e640 1 Processor -- start 2023-10-14T09:38:25.107 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.103+0000 7fd30cb4e640 1 -- start start 2023-10-14T09:38:25.107 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.104+0000 7fd30cb4e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd30806c140 0x7fd30815a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:25.108 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.104+0000 7fd30cb4e640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd308159ab0 0x7fd308144eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:25.108 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.104+0000 7fd30cb4e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd308159e90 0x7fd3080c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:25.108 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.104+0000 7fd30cb4e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3081453f0 con 0x7fd30806c140 2023-10-14T09:38:25.108 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.104+0000 7fd30cb4e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3080c19f0 con 0x7fd308159e90 2023-10-14T09:38:25.108 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.104+0000 7fd30cb4e640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd30815c7f0 con 0x7fd308159ab0 2023-10-14T09:38:25.109 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.104+0000 7fd30659c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd30806c140 0x7fd30815a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:25.109 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.104+0000 7fd30659c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd30806c140 0x7fd30815a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52430/0 (socket says 172.21.15.102:52430) 2023-10-14T09:38:25.109 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.104+0000 7fd30659c640 1 -- 172.21.15.102:0/2393008861 learned_addr learned my addr 172.21.15.102:0/2393008861 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:25.109 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.104+0000 7fd30659c640 1 -- 172.21.15.102:0/2393008861 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd308159ab0 msgr2=0x7fd308144eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:25.109 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.104+0000 7fd30659c640 1 --2- 172.21.15.102:0/2393008861 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd308159ab0 0x7fd308144eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:25.109 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.104+0000 7fd30659c640 1 -- 172.21.15.102:0/2393008861 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd308159e90 msgr2=0x7fd3080c4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:25.110 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.104+0000 7fd306d9d640 1 --2- 172.21.15.102:0/2393008861 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd308159e90 0x7fd3080c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:25.110 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.104+0000 7fd30659c640 1 --2- 172.21.15.102:0/2393008861 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd308159e90 0x7fd3080c4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:25.110 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.104+0000 7fd30659c640 1 -- 172.21.15.102:0/2393008861 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f0009400 con 0x7fd30806c140 2023-10-14T09:38:25.110 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.105+0000 7fd30659c640 1 --2- 172.21.15.102:0/2393008861 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd30806c140 0x7fd30815a3a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd2f800c430 tx=0x7fd2f800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:25.110 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.105+0000 7fd2feffd640 1 -- 172.21.15.102:0/2393008861 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8005ce0 con 0x7fd30806c140 2023-10-14T09:38:25.113 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.105+0000 7fd2feffd640 1 -- 172.21.15.102:0/2393008861 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f8005e40 con 0x7fd30806c140 2023-10-14T09:38:25.113 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.105+0000 7fd30cb4e640 1 -- 172.21.15.102:0/2393008861 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd30815cad0 con 0x7fd30806c140 2023-10-14T09:38:25.113 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.105+0000 7fd2feffd640 1 -- 172.21.15.102:0/2393008861 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f80072f0 con 0x7fd30806c140 2023-10-14T09:38:25.113 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.105+0000 7fd30cb4e640 1 -- 172.21.15.102:0/2393008861 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd30815d090 con 0x7fd30806c140 2023-10-14T09:38:25.114 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.106+0000 7fd30cb4e640 1 -- 172.21.15.102:0/2393008861 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd30804e160 con 0x7fd30806c140 2023-10-14T09:38:25.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.107+0000 7fd2feffd640 1 -- 172.21.15.102:0/2393008861 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd2f8007450 con 0x7fd30806c140 2023-10-14T09:38:25.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.108+0000 7fd2feffd640 1 --2- 172.21.15.102:0/2393008861 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd2e806ae70 0x7fd2e806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:25.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.108+0000 7fd2feffd640 1 -- 172.21.15.102:0/2393008861 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd2f8088a30 con 0x7fd30806c140 2023-10-14T09:38:25.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.108+0000 7fd2fffff640 1 --2- 172.21.15.102:0/2393008861 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd2e806ae70 0x7fd2e806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:25.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.109+0000 7fd2fffff640 1 --2- 172.21.15.102:0/2393008861 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd2e806ae70 0x7fd2e806d330 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0035000 tx=0x7fd2f0030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:25.116 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.113+0000 7fd2feffd640 1 -- 172.21.15.102:0/2393008861 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd2f8053d90 con 0x7fd30806c140 2023-10-14T09:38:25.379 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.377+0000 7fd30cb4e640 1 -- 172.21.15.102:0/2393008861 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fd3080ccb60 con 0x7fd30806c140 2023-10-14T09:38:25.382 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.380+0000 7fd2feffd640 1 -- 172.21.15.102:0/2393008861 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd2f8017020 con 0x7fd30806c140 2023-10-14T09:38:25.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.383+0000 7fd30cb4e640 1 -- 172.21.15.102:0/2393008861 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd2e806ae70 msgr2=0x7fd2e806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:25.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.383+0000 7fd30cb4e640 1 --2- 172.21.15.102:0/2393008861 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd2e806ae70 0x7fd2e806d330 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0035000 tx=0x7fd2f0030000 comp rx=0 tx=0).stop 2023-10-14T09:38:25.386 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.383+0000 7fd30cb4e640 1 -- 172.21.15.102:0/2393008861 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd30806c140 msgr2=0x7fd30815a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:25.386 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.383+0000 7fd30cb4e640 1 --2- 172.21.15.102:0/2393008861 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd30806c140 0x7fd30815a3a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd2f800c430 tx=0x7fd2f800c8f0 comp rx=0 tx=0).stop 2023-10-14T09:38:25.386 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.383+0000 7fd30cb4e640 1 -- 172.21.15.102:0/2393008861 shutdown_connections 2023-10-14T09:38:25.386 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.383+0000 7fd30cb4e640 1 --2- 172.21.15.102:0/2393008861 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fd2e806ae70 0x7fd2e806d330 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:25.386 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.383+0000 7fd30cb4e640 1 --2- 172.21.15.102:0/2393008861 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd308159e90 0x7fd3080c4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:25.387 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.383+0000 7fd30cb4e640 1 --2- 172.21.15.102:0/2393008861 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd308159ab0 0x7fd308144eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:25.387 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.383+0000 7fd30cb4e640 1 --2- 172.21.15.102:0/2393008861 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd30806c140 0x7fd30815a3a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:25.387 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.383+0000 7fd30cb4e640 1 -- 172.21.15.102:0/2393008861 >> 172.21.15.102:0/2393008861 conn(0x7fd3080ce9b0 msgr2=0x7fd30806b030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:25.387 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.383+0000 7fd30cb4e640 1 -- 172.21.15.102:0/2393008861 shutdown_connections 2023-10-14T09:38:25.387 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.384+0000 7fd30cb4e640 1 -- 172.21.15.102:0/2393008861 wait complete. 2023-10-14T09:38:25.404 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-14T09:38:25.603 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.601+0000 7f23da615640 1 Processor -- start 2023-10-14T09:38:25.603 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.602+0000 7f23da615640 1 -- start start 2023-10-14T09:38:25.606 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.603+0000 7f23da615640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f23d415d330 0x7f23d41618b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:25.606 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.603+0000 7f23da615640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f23d406c7d0 0x7f23d4065ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:25.606 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.603+0000 7f23da615640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d40d0890 con 0x7f23d406cc80 2023-10-14T09:38:25.606 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.603+0000 7f23da615640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d406b1e0 con 0x7f23d406c7d0 2023-10-14T09:38:25.606 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.603+0000 7f23da615640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d40d05b0 con 0x7f23d415d330 2023-10-14T09:38:25.607 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.603+0000 7f23d37fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f23d406c7d0 0x7f23d4065ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:25.607 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.604+0000 7f23d37fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f23d406c7d0 0x7f23d4065ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52434/0 (socket says 172.21.15.102:52434) 2023-10-14T09:38:25.607 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.604+0000 7f23d37fe640 1 -- 172.21.15.102:0/3128073982 learned_addr learned my addr 172.21.15.102:0/3128073982 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:25.607 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.604+0000 7f23d3fff640 1 --2- 172.21.15.102:0/3128073982 >> v2:172.21.15.129:3300/0 conn(0x7f23d415d330 0x7f23d41618b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:25.607 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.604+0000 7f23d37fe640 1 -- 172.21.15.102:0/3128073982 >> v2:172.21.15.129:3300/0 conn(0x7f23d415d330 msgr2=0x7f23d41618b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:25.608 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.604+0000 7f23d37fe640 1 --2- 172.21.15.102:0/3128073982 >> v2:172.21.15.129:3300/0 conn(0x7f23d415d330 0x7f23d41618b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:25.608 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.604+0000 7f23d37fe640 1 -- 172.21.15.102:0/3128073982 >> v1:172.21.15.129:6789/0 conn(0x7f23d406cc80 legacy=0x7f23d40ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:25.608 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.604+0000 7f23d37fe640 1 -- 172.21.15.102:0/3128073982 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d4160dd0 con 0x7f23d406c7d0 2023-10-14T09:38:25.609 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.605+0000 7f23d37fe640 1 --2- 172.21.15.102:0/3128073982 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23d406c7d0 0x7f23d4065ab0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f23d40744f0 tx=0x7f23bc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a69ff2790352ba15 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:25.609 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.605+0000 7f23d2ffd640 1 -- 172.21.15.102:0/3128073982 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23bc0317e0 con 0x7f23d406c7d0 2023-10-14T09:38:25.609 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.606+0000 7f23d2ffd640 1 -- 172.21.15.102:0/3128073982 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23bc031940 con 0x7f23d406c7d0 2023-10-14T09:38:25.609 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.606+0000 7f23d2ffd640 1 -- 172.21.15.102:0/3128073982 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23bc031cd0 con 0x7f23d406c7d0 2023-10-14T09:38:25.610 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.606+0000 7f23da615640 1 -- 172.21.15.102:0/3128073982 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23d406c7d0 msgr2=0x7f23d4065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:25.610 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.606+0000 7f23da615640 1 --2- 172.21.15.102:0/3128073982 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23d406c7d0 0x7f23d4065ab0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f23d40744f0 tx=0x7f23bc02b880 comp rx=0 tx=0).stop 2023-10-14T09:38:25.610 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.606+0000 7f23da615640 1 -- 172.21.15.102:0/3128073982 shutdown_connections 2023-10-14T09:38:25.610 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.606+0000 7f23da615640 1 --2- 172.21.15.102:0/3128073982 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23d406c7d0 0x7f23d4065ab0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:25.611 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.606+0000 7f23da615640 1 --2- 172.21.15.102:0/3128073982 >> v2:172.21.15.129:3300/0 conn(0x7f23d415d330 0x7f23d41618b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:25.611 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.606+0000 7f23da615640 1 -- 172.21.15.102:0/3128073982 >> 172.21.15.102:0/3128073982 conn(0x7f23d40d0ab0 msgr2=0x7f23d40d0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:25.611 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.606+0000 7f23da615640 1 -- 172.21.15.102:0/3128073982 shutdown_connections 2023-10-14T09:38:25.611 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.606+0000 7f23da615640 1 -- 172.21.15.102:0/3128073982 wait complete. 2023-10-14T09:38:25.613 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.608+0000 7f23da615640 1 Processor -- start 2023-10-14T09:38:25.613 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.609+0000 7f23da615640 1 -- start start 2023-10-14T09:38:25.613 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.610+0000 7f23da615640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23d406c7d0 0x7f23d415d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:25.613 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.610+0000 7f23da615640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f23d406cc80 0x7f23d41f2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:25.614 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.610+0000 7f23da615640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f23d415d330 0x7f23d41f2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:25.614 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.610+0000 7f23da615640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d4159040 con 0x7f23d406c7d0 2023-10-14T09:38:25.614 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.610+0000 7f23da615640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d415e0b0 con 0x7f23d415d330 2023-10-14T09:38:25.614 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.610+0000 7f23da615640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d415e390 con 0x7f23d406cc80 2023-10-14T09:38:25.614 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.610+0000 7f23d3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23d406c7d0 0x7f23d415d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:25.615 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.610+0000 7f23d3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23d406c7d0 0x7f23d415d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52444/0 (socket says 172.21.15.102:52444) 2023-10-14T09:38:25.615 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.610+0000 7f23d3fff640 1 -- 172.21.15.102:0/1567176268 learned_addr learned my addr 172.21.15.102:0/1567176268 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:25.615 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.610+0000 7f23d8bb2640 1 --2- 172.21.15.102:0/1567176268 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f23d415d330 0x7f23d41f2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:25.615 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.610+0000 7f23d37fe640 1 --2- 172.21.15.102:0/1567176268 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f23d406cc80 0x7f23d41f2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:25.615 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.610+0000 7f23d3fff640 1 -- 172.21.15.102:0/1567176268 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f23d406cc80 msgr2=0x7f23d41f2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:25.616 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.610+0000 7f23d3fff640 1 --2- 172.21.15.102:0/1567176268 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f23d406cc80 0x7f23d41f2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:25.616 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.610+0000 7f23d3fff640 1 -- 172.21.15.102:0/1567176268 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f23d415d330 msgr2=0x7f23d41f2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:25.616 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.610+0000 7f23d3fff640 1 --2- 172.21.15.102:0/1567176268 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f23d415d330 0x7f23d41f2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:25.616 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.611+0000 7f23d3fff640 1 -- 172.21.15.102:0/1567176268 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23bc0094d0 con 0x7f23d406c7d0 2023-10-14T09:38:25.616 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.611+0000 7f23d8bb2640 1 --2- 172.21.15.102:0/1567176268 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f23d415d330 0x7f23d41f2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:25.617 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.611+0000 7f23d3fff640 1 --2- 172.21.15.102:0/1567176268 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23d406c7d0 0x7f23d415d710 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f23c400ce10 tx=0x7f23c400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:25.617 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.611+0000 7f23d0ff9640 1 -- 172.21.15.102:0/1567176268 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c4003b90 con 0x7f23d406c7d0 2023-10-14T09:38:25.617 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.611+0000 7f23d0ff9640 1 -- 172.21.15.102:0/1567176268 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c4003cf0 con 0x7f23d406c7d0 2023-10-14T09:38:25.617 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.611+0000 7f23da615640 1 -- 172.21.15.102:0/1567176268 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d415e670 con 0x7f23d406c7d0 2023-10-14T09:38:25.617 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.611+0000 7f23d0ff9640 1 -- 172.21.15.102:0/1567176268 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c4003ea0 con 0x7f23d406c7d0 2023-10-14T09:38:25.618 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.611+0000 7f23da615640 1 -- 172.21.15.102:0/1567176268 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d415ec30 con 0x7f23d406c7d0 2023-10-14T09:38:25.619 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.612+0000 7f23da615640 1 -- 172.21.15.102:0/1567176268 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d404e160 con 0x7f23d406c7d0 2023-10-14T09:38:25.619 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.613+0000 7f23d0ff9640 1 -- 172.21.15.102:0/1567176268 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f23c4004240 con 0x7f23d406c7d0 2023-10-14T09:38:25.619 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.614+0000 7f23d0ff9640 1 --2- 172.21.15.102:0/1567176268 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f23b406ae70 0x7f23b406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:25.619 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.614+0000 7f23d0ff9640 1 -- 172.21.15.102:0/1567176268 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f23c4012070 con 0x7f23d406c7d0 2023-10-14T09:38:25.619 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.614+0000 7f23d37fe640 1 --2- 172.21.15.102:0/1567176268 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f23b406ae70 0x7f23b406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:25.620 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.615+0000 7f23d37fe640 1 --2- 172.21.15.102:0/1567176268 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f23b406ae70 0x7f23b406d330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f23bc036000 tx=0x7f23bc03d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:25.620 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.618+0000 7f23d0ff9640 1 -- 172.21.15.102:0/1567176268 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f23c40550e0 con 0x7f23d406c7d0 2023-10-14T09:38:25.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.861+0000 7f23da615640 1 -- 172.21.15.102:0/1567176268 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f23d406f3a0 con 0x7f23d406c7d0 2023-10-14T09:38:25.866 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.865+0000 7f23d0ff9640 1 -- 172.21.15.102:0/1567176268 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7f23c4058700 con 0x7f23d406c7d0 2023-10-14T09:38:25.869 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.867+0000 7f23da615640 1 -- 172.21.15.102:0/1567176268 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f23b406ae70 msgr2=0x7f23b406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:25.869 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.867+0000 7f23da615640 1 --2- 172.21.15.102:0/1567176268 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f23b406ae70 0x7f23b406d330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f23bc036000 tx=0x7f23bc03d040 comp rx=0 tx=0).stop 2023-10-14T09:38:25.870 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.867+0000 7f23da615640 1 -- 172.21.15.102:0/1567176268 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23d406c7d0 msgr2=0x7f23d415d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:25.870 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.867+0000 7f23da615640 1 --2- 172.21.15.102:0/1567176268 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23d406c7d0 0x7f23d415d710 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f23c400ce10 tx=0x7f23c400a660 comp rx=0 tx=0).stop 2023-10-14T09:38:25.870 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.867+0000 7f23da615640 1 -- 172.21.15.102:0/1567176268 shutdown_connections 2023-10-14T09:38:25.870 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.867+0000 7f23da615640 1 --2- 172.21.15.102:0/1567176268 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f23b406ae70 0x7f23b406d330 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:25.870 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.867+0000 7f23da615640 1 --2- 172.21.15.102:0/1567176268 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f23d415d330 0x7f23d41f2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:25.871 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.867+0000 7f23da615640 1 --2- 172.21.15.102:0/1567176268 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f23d406cc80 0x7f23d41f2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:25.871 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.867+0000 7f23da615640 1 --2- 172.21.15.102:0/1567176268 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23d406c7d0 0x7f23d415d710 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:25.871 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.867+0000 7f23da615640 1 -- 172.21.15.102:0/1567176268 >> 172.21.15.102:0/1567176268 conn(0x7f23d40d0ab0 msgr2=0x7f23d40cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:25.871 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.867+0000 7f23da615640 1 -- 172.21.15.102:0/1567176268 shutdown_connections 2023-10-14T09:38:25.871 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:25.868+0000 7f23da615640 1 -- 172.21.15.102:0/1567176268 wait complete. 2023-10-14T09:38:25.885 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-14T09:38:26.088 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.086+0000 7f4a5e632640 1 Processor -- start 2023-10-14T09:38:26.089 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.087+0000 7f4a5e632640 1 -- start start 2023-10-14T09:38:26.090 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.088+0000 7f4a5e632640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f4a580caa80 0x7f4a58069da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:26.090 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.088+0000 7f4a5e632640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4a5806a2e0 0x7f4a581650d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:26.091 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.088+0000 7f4a5e632640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a5806a730 con 0x7f4a580addb0 2023-10-14T09:38:26.091 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.088+0000 7f4a5e632640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a58161a50 con 0x7f4a580caa80 2023-10-14T09:38:26.091 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.088+0000 7f4a5e632640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a580caef0 con 0x7f4a5806a2e0 2023-10-14T09:38:26.092 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.089+0000 7f4a577fe640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f4a580caa80 0x7f4a58069da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:26.092 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.089+0000 7f4a577fe640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f4a580caa80 0x7f4a58069da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.102:52910/0 (socket says 172.21.15.102:52910) 2023-10-14T09:38:26.093 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.089+0000 7f4a5cbcf640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4a5806a2e0 0x7f4a581650d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:26.093 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.089+0000 7f4a577fe640 1 -- 172.21.15.102:0/608651887 learned_addr learned my addr 172.21.15.102:0/608651887 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:26.093 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.089+0000 7f4a57fff640 1 --1- 172.21.15.102:0/608651887 >> v1:172.21.15.129:6789/0 conn(0x7f4a580addb0 0x7f4a580c9000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.102:48282/0 (socket says 172.21.15.102:48282) 2023-10-14T09:38:26.093 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.090+0000 7f4a577fe640 1 -- 172.21.15.102:0/608651887 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4a5806a2e0 msgr2=0x7f4a581650d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:26.094 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.090+0000 7f4a577fe640 1 --2- 172.21.15.102:0/608651887 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4a5806a2e0 0x7f4a581650d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:26.094 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.090+0000 7f4a577fe640 1 -- 172.21.15.102:0/608651887 >> v1:172.21.15.129:6789/0 conn(0x7f4a580addb0 legacy=0x7f4a580c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:26.094 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.090+0000 7f4a577fe640 1 -- 172.21.15.102:0/608651887 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a580cb140 con 0x7f4a580caa80 2023-10-14T09:38:26.095 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.091+0000 7f4a577fe640 1 --2- 172.21.15.102:0/608651887 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4a580caa80 0x7f4a58069da0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4a48009e50 tx=0x7f4a4802bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2617b95f26b7dcd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:26.095 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.091+0000 7f4a56ffd640 1 -- 172.21.15.102:0/608651887 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4802cb00 con 0x7f4a580caa80 2023-10-14T09:38:26.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.091+0000 7f4a56ffd640 1 -- 172.21.15.102:0/608651887 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4802cc60 con 0x7f4a580caa80 2023-10-14T09:38:26.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.091+0000 7f4a56ffd640 1 -- 172.21.15.102:0/608651887 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a480343f0 con 0x7f4a580caa80 2023-10-14T09:38:26.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.092+0000 7f4a5e632640 1 -- 172.21.15.102:0/608651887 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4a580caa80 msgr2=0x7f4a58069da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:26.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.092+0000 7f4a5e632640 1 --2- 172.21.15.102:0/608651887 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4a580caa80 0x7f4a58069da0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4a48009e50 tx=0x7f4a4802bf60 comp rx=0 tx=0).stop 2023-10-14T09:38:26.097 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.092+0000 7f4a5e632640 1 -- 172.21.15.102:0/608651887 shutdown_connections 2023-10-14T09:38:26.097 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.092+0000 7f4a5e632640 1 --2- 172.21.15.102:0/608651887 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4a5806a2e0 0x7f4a581650d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:26.097 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.092+0000 7f4a5e632640 1 --2- 172.21.15.102:0/608651887 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4a580caa80 0x7f4a58069da0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:26.097 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.092+0000 7f4a5e632640 1 -- 172.21.15.102:0/608651887 >> 172.21.15.102:0/608651887 conn(0x7f4a580ce9b0 msgr2=0x7f4a580cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:26.097 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.092+0000 7f4a5e632640 1 -- 172.21.15.102:0/608651887 shutdown_connections 2023-10-14T09:38:26.098 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.092+0000 7f4a5e632640 1 -- 172.21.15.102:0/608651887 wait complete. 2023-10-14T09:38:26.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.094+0000 7f4a5e632640 1 Processor -- start 2023-10-14T09:38:26.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.095+0000 7f4a5e632640 1 -- start start 2023-10-14T09:38:26.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.096+0000 7f4a5e632640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4a5806a2e0 0x7f4a580b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:26.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.096+0000 7f4a5e632640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4a580addb0 0x7f4a58154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:26.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.096+0000 7f4a5e632640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a580caa80 0x7f4a581f6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:26.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.096+0000 7f4a5e632640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a581552c0 con 0x7f4a580caa80 2023-10-14T09:38:26.102 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.096+0000 7f4a5e632640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5815c600 con 0x7f4a580addb0 2023-10-14T09:38:26.102 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.096+0000 7f4a5e632640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5815d2c0 con 0x7f4a5806a2e0 2023-10-14T09:38:26.102 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.096+0000 7f4a5cbcf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a580caa80 0x7f4a581f6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:26.102 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.096+0000 7f4a5cbcf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a580caa80 0x7f4a581f6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52452/0 (socket says 172.21.15.102:52452) 2023-10-14T09:38:26.103 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.096+0000 7f4a5cbcf640 1 -- 172.21.15.102:0/769616847 learned_addr learned my addr 172.21.15.102:0/769616847 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:26.103 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.096+0000 7f4a577fe640 1 --2- 172.21.15.102:0/769616847 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4a580addb0 0x7f4a58154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:26.103 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.096+0000 7f4a57fff640 1 --2- 172.21.15.102:0/769616847 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4a5806a2e0 0x7f4a580b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:26.103 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.097+0000 7f4a5cbcf640 1 -- 172.21.15.102:0/769616847 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4a5806a2e0 msgr2=0x7f4a580b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:26.103 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.097+0000 7f4a5cbcf640 1 --2- 172.21.15.102:0/769616847 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4a5806a2e0 0x7f4a580b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:26.104 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.097+0000 7f4a5cbcf640 1 -- 172.21.15.102:0/769616847 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4a580addb0 msgr2=0x7f4a58154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:26.104 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.097+0000 7f4a5cbcf640 1 --2- 172.21.15.102:0/769616847 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4a580addb0 0x7f4a58154d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:26.104 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.097+0000 7f4a5cbcf640 1 -- 172.21.15.102:0/769616847 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a48009b30 con 0x7f4a580caa80 2023-10-14T09:38:26.104 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.097+0000 7f4a57fff640 1 --2- 172.21.15.102:0/769616847 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4a5806a2e0 0x7f4a580b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:26.105 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.097+0000 7f4a577fe640 1 --2- 172.21.15.102:0/769616847 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4a580addb0 0x7f4a58154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:26.105 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.097+0000 7f4a5cbcf640 1 --2- 172.21.15.102:0/769616847 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a580caa80 0x7f4a581f6e10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000e930 tx=0x7f4a5000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:26.105 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.097+0000 7f4a54ff9640 1 -- 172.21.15.102:0/769616847 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a50009690 con 0x7f4a580caa80 2023-10-14T09:38:26.105 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.097+0000 7f4a54ff9640 1 -- 172.21.15.102:0/769616847 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a5000c980 con 0x7f4a580caa80 2023-10-14T09:38:26.105 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.097+0000 7f4a54ff9640 1 -- 172.21.15.102:0/769616847 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5000cd30 con 0x7f4a580caa80 2023-10-14T09:38:26.106 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.097+0000 7f4a5e632640 1 -- 172.21.15.102:0/769616847 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a5815d5a0 con 0x7f4a580caa80 2023-10-14T09:38:26.106 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.097+0000 7f4a5e632640 1 -- 172.21.15.102:0/769616847 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a5815db60 con 0x7f4a580caa80 2023-10-14T09:38:26.106 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.099+0000 7f4a5e632640 1 -- 172.21.15.102:0/769616847 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a5815dd50 con 0x7f4a580caa80 2023-10-14T09:38:26.107 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.100+0000 7f4a54ff9640 1 -- 172.21.15.102:0/769616847 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4a50013470 con 0x7f4a580caa80 2023-10-14T09:38:26.107 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.100+0000 7f4a54ff9640 1 --2- 172.21.15.102:0/769616847 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4a3806ae70 0x7f4a3806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:26.108 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.101+0000 7f4a54ff9640 1 -- 172.21.15.102:0/769616847 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4a500894d0 con 0x7f4a580caa80 2023-10-14T09:38:26.108 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.101+0000 7f4a57fff640 1 --2- 172.21.15.102:0/769616847 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4a3806ae70 0x7f4a3806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:26.108 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.101+0000 7f4a57fff640 1 --2- 172.21.15.102:0/769616847 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4a3806ae70 0x7f4a3806d330 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4a40000f60 tx=0x7f4a40009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:26.108 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.105+0000 7f4a54ff9640 1 -- 172.21.15.102:0/769616847 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4a50054990 con 0x7f4a580caa80 2023-10-14T09:38:26.344 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.342+0000 7f4a5e632640 1 -- 172.21.15.102:0/769616847 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f4a5804e160 con 0x7f4a580caa80 2023-10-14T09:38:26.349 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.347+0000 7f4a54ff9640 1 -- 172.21.15.102:0/769616847 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4a50089030 con 0x7f4a580caa80 2023-10-14T09:38:26.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.349+0000 7f4a5e632640 1 -- 172.21.15.102:0/769616847 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4a3806ae70 msgr2=0x7f4a3806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:26.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.349+0000 7f4a5e632640 1 --2- 172.21.15.102:0/769616847 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4a3806ae70 0x7f4a3806d330 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4a40000f60 tx=0x7f4a40009040 comp rx=0 tx=0).stop 2023-10-14T09:38:26.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.349+0000 7f4a5e632640 1 -- 172.21.15.102:0/769616847 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a580caa80 msgr2=0x7f4a581f6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:26.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.349+0000 7f4a5e632640 1 --2- 172.21.15.102:0/769616847 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a580caa80 0x7f4a581f6e10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000e930 tx=0x7f4a5000edf0 comp rx=0 tx=0).stop 2023-10-14T09:38:26.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.350+0000 7f4a5e632640 1 -- 172.21.15.102:0/769616847 shutdown_connections 2023-10-14T09:38:26.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.350+0000 7f4a5e632640 1 --2- 172.21.15.102:0/769616847 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4a3806ae70 0x7f4a3806d330 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:26.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.350+0000 7f4a5e632640 1 --2- 172.21.15.102:0/769616847 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a580caa80 0x7f4a581f6e10 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:26.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.350+0000 7f4a5e632640 1 --2- 172.21.15.102:0/769616847 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4a580addb0 0x7f4a58154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:26.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.350+0000 7f4a5e632640 1 --2- 172.21.15.102:0/769616847 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4a5806a2e0 0x7f4a580b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:26.354 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.350+0000 7f4a5e632640 1 -- 172.21.15.102:0/769616847 >> 172.21.15.102:0/769616847 conn(0x7f4a580ce9b0 msgr2=0x7f4a58072e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:26.354 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.350+0000 7f4a5e632640 1 -- 172.21.15.102:0/769616847 shutdown_connections 2023-10-14T09:38:26.354 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.350+0000 7f4a5e632640 1 -- 172.21.15.102:0/769616847 wait complete. 2023-10-14T09:38:26.368 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:38:26.572 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.570+0000 7f35a9c26640 1 Processor -- start 2023-10-14T09:38:26.572 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.570+0000 7f35a9c26640 1 -- start start 2023-10-14T09:38:26.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.571+0000 7f35a9c26640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f35a4159b20 0x7f35a406bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:26.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.571+0000 7f35a9c26640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f35a4159f00 0x7f35a40b0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:26.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.571+0000 7f35a9c26640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f35a406c120 0x7f35a40b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:26.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.571+0000 7f35a9c26640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a406f7f0 con 0x7f35a4159b20 2023-10-14T09:38:26.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.571+0000 7f35a9c26640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a406c5e0 con 0x7f35a4159f00 2023-10-14T09:38:26.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.571+0000 7f35a9c26640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a406c8c0 con 0x7f35a406c120 2023-10-14T09:38:26.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.572+0000 7f35a37fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f35a4159b20 0x7f35a406bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:26.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.572+0000 7f35a37fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f35a4159b20 0x7f35a406bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52462/0 (socket says 172.21.15.102:52462) 2023-10-14T09:38:26.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.572+0000 7f35a37fe640 1 -- 172.21.15.102:0/580712892 learned_addr learned my addr 172.21.15.102:0/580712892 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:26.576 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.572+0000 7f35a37fe640 1 -- 172.21.15.102:0/580712892 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f35a406c120 msgr2=0x7f35a40b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:26.576 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.572+0000 7f35a37fe640 1 --2- 172.21.15.102:0/580712892 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f35a406c120 0x7f35a40b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:26.576 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.572+0000 7f35a37fe640 1 -- 172.21.15.102:0/580712892 >> v2:172.21.15.129:3300/0 conn(0x7f35a4159f00 msgr2=0x7f35a40b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:26.576 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.572+0000 7f35a37fe640 1 --2- 172.21.15.102:0/580712892 >> v2:172.21.15.129:3300/0 conn(0x7f35a4159f00 0x7f35a40b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:26.576 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.572+0000 7f35a37fe640 1 -- 172.21.15.102:0/580712892 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a406cba0 con 0x7f35a4159b20 2023-10-14T09:38:26.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.573+0000 7f35a37fe640 1 --2- 172.21.15.102:0/580712892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35a4159b20 0x7f35a406bbe0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f35a415d770 tx=0x7f359402b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d54adeb2f79d641 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:26.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.574+0000 7f35a2ffd640 1 -- 172.21.15.102:0/580712892 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3594031880 con 0x7f35a4159b20 2023-10-14T09:38:26.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.574+0000 7f35a2ffd640 1 -- 172.21.15.102:0/580712892 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35940319e0 con 0x7f35a4159b20 2023-10-14T09:38:26.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.574+0000 7f35a2ffd640 1 -- 172.21.15.102:0/580712892 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3594031d70 con 0x7f35a4159b20 2023-10-14T09:38:26.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.574+0000 7f35a9c26640 1 -- 172.21.15.102:0/580712892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35a4159b20 msgr2=0x7f35a406bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:26.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.574+0000 7f35a9c26640 1 --2- 172.21.15.102:0/580712892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35a4159b20 0x7f35a406bbe0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f35a415d770 tx=0x7f359402b920 comp rx=0 tx=0).stop 2023-10-14T09:38:26.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.574+0000 7f35a9c26640 1 -- 172.21.15.102:0/580712892 shutdown_connections 2023-10-14T09:38:26.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.574+0000 7f35a9c26640 1 --2- 172.21.15.102:0/580712892 >> v2:172.21.15.129:3300/0 conn(0x7f35a4159f00 0x7f35a40b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:26.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.574+0000 7f35a9c26640 1 --2- 172.21.15.102:0/580712892 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f35a406c120 0x7f35a40b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:26.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.574+0000 7f35a9c26640 1 --2- 172.21.15.102:0/580712892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35a4159b20 0x7f35a406bbe0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:26.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.574+0000 7f35a9c26640 1 -- 172.21.15.102:0/580712892 >> 172.21.15.102:0/580712892 conn(0x7f35a40cb410 msgr2=0x7f35a40cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:26.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.574+0000 7f35a9c26640 1 -- 172.21.15.102:0/580712892 shutdown_connections 2023-10-14T09:38:26.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.575+0000 7f35a9c26640 1 -- 172.21.15.102:0/580712892 wait complete. 2023-10-14T09:38:26.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.576+0000 7f35a9c26640 1 Processor -- start 2023-10-14T09:38:26.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.577+0000 7f35a9c26640 1 -- start start 2023-10-14T09:38:26.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.578+0000 7f35a9c26640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f35a406c120 0x7f35a414d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:26.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.578+0000 7f35a9c26640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35a4159b20 0x7f35a40c7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:26.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.578+0000 7f35a9c26640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f35a4159f00 0x7f35a40c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:26.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.578+0000 7f35a9c26640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a414da70 con 0x7f35a4159b20 2023-10-14T09:38:26.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.578+0000 7f35a9c26640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a40c24c0 con 0x7f35a406c120 2023-10-14T09:38:26.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.578+0000 7f35a9c26640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a40c27a0 con 0x7f35a4159f00 2023-10-14T09:38:26.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.578+0000 7f359bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35a4159b20 0x7f35a40c7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:26.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.578+0000 7f359bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35a4159b20 0x7f35a40c7910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52470/0 (socket says 172.21.15.102:52470) 2023-10-14T09:38:26.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.578+0000 7f359bfff640 1 -- 172.21.15.102:0/181339805 learned_addr learned my addr 172.21.15.102:0/181339805 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:26.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.578+0000 7f35a37fe640 1 --2- 172.21.15.102:0/181339805 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f35a406c120 0x7f35a414d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:26.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.578+0000 7f35a3fff640 1 --2- 172.21.15.102:0/181339805 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f35a4159f00 0x7f35a40c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:26.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.579+0000 7f359bfff640 1 -- 172.21.15.102:0/181339805 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f35a4159f00 msgr2=0x7f35a40c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:26.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.579+0000 7f359bfff640 1 --2- 172.21.15.102:0/181339805 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f35a4159f00 0x7f35a40c7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:26.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.579+0000 7f359bfff640 1 -- 172.21.15.102:0/181339805 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f35a406c120 msgr2=0x7f35a414d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:26.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.579+0000 7f359bfff640 1 --2- 172.21.15.102:0/181339805 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f35a406c120 0x7f35a414d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:26.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.579+0000 7f359bfff640 1 -- 172.21.15.102:0/181339805 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35940094d0 con 0x7f35a4159b20 2023-10-14T09:38:26.586 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.579+0000 7f359bfff640 1 --2- 172.21.15.102:0/181339805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35a4159b20 0x7f35a40c7910 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f358c00b450 tx=0x7f358c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:26.586 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.579+0000 7f35a0ff9640 1 -- 172.21.15.102:0/181339805 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c011890 con 0x7f35a4159b20 2023-10-14T09:38:26.586 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.579+0000 7f35a0ff9640 1 -- 172.21.15.102:0/181339805 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358c0119f0 con 0x7f35a4159b20 2023-10-14T09:38:26.586 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.579+0000 7f35a0ff9640 1 -- 172.21.15.102:0/181339805 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c011da0 con 0x7f35a4159b20 2023-10-14T09:38:26.586 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.579+0000 7f35a9c26640 1 -- 172.21.15.102:0/181339805 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a40c2a80 con 0x7f35a4159b20 2023-10-14T09:38:26.587 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.579+0000 7f35a9c26640 1 -- 172.21.15.102:0/181339805 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a40c3040 con 0x7f35a4159b20 2023-10-14T09:38:26.587 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.580+0000 7f35a9c26640 1 -- 172.21.15.102:0/181339805 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a404e160 con 0x7f35a4159b20 2023-10-14T09:38:26.588 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.581+0000 7f35a0ff9640 1 -- 172.21.15.102:0/181339805 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f358c01a400 con 0x7f35a4159b20 2023-10-14T09:38:26.588 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.582+0000 7f35a0ff9640 1 --2- 172.21.15.102:0/181339805 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f358406ae70 0x7f358406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:26.588 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.582+0000 7f35a0ff9640 1 -- 172.21.15.102:0/181339805 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f358c089600 con 0x7f35a4159b20 2023-10-14T09:38:26.588 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.583+0000 7f35a37fe640 1 --2- 172.21.15.102:0/181339805 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f358406ae70 0x7f358406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:26.588 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.583+0000 7f35a37fe640 1 --2- 172.21.15.102:0/181339805 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f358406ae70 0x7f358406d330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3594036000 tx=0x7f359403c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:26.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.586+0000 7f35a0ff9640 1 -- 172.21.15.102:0/181339805 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f358c054a90 con 0x7f35a4159b20 2023-10-14T09:38:26.780 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.778+0000 7f35a9c26640 1 -- 172.21.15.102:0/181339805 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35a40b10b0 con 0x7f35a4159b20 2023-10-14T09:38:26.781 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.779+0000 7f35a0ff9640 1 -- 172.21.15.102:0/181339805 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+12893 (secure 0 0 0) 0x7f358c015090 con 0x7f35a4159b20 2023-10-14T09:38:26.781 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:38:26.781 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":32,"fsid":"8a6cd69d-7f5b-4f2a-806a-0176c10aed50","created":"2023-10-14T09:36:56.745172+0000","modified":"2023-10-14T09:38:22.776149+0000","last_up_change":"2023-10-14T09:37:09.791473+0000","last_in_change":"2023-10-14T09:37:00.547186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:37:09.952407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e5aef8f3-878f-482b-b522-9a5b958b90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6801","nonce":1727250718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6803","nonce":1727250718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6807","nonce":1727250718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6805","nonce":1727250718}]},"public_addr":"172.21.15.102:6801/1727250718","cluster_addr":"172.21.15.102:6803/1727250718","heartbeat_back_addr":"172.21.15.102:6807/1727250718","heartbeat_front_addr":"172.21.15.102:6805/1727250718","state":["exists","up"]},{"osd":1,"uuid":"4a8cf50e-387b-4d47-9588-bd22e375a9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6809","nonce":1095651107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6811","nonce":1095651107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6815","nonce":1095651107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6813","nonce":1095651107}]},"public_addr":"172.21.15.102:6809/1095651107","cluster_addr":"172.21.15.102:6811/1095651107","heartbeat_back_addr":"172.21.15.102:6815/1095651107","heartbeat_front_addr":"172.21.15.102:6813/1095651107","state":["exists","up"]},{"osd":2,"uuid":"009ef55f-8a63-4219-bacd-d7c7b4500867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6820","nonce":2198222556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6825","nonce":2198222556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6831","nonce":2198222556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6829","nonce":2198222556}]},"public_addr":"172.21.15.102:6820/2198222556","cluster_addr":"172.21.15.102:6825/2198222556","heartbeat_back_addr":"172.21.15.102:6831/2198222556","heartbeat_front_addr":"172.21.15.102:6829/2198222556","state":["exists","up"]},{"osd":3,"uuid":"f2110eae-2ff9-4ed9-93d6-bd2361618211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6818","nonce":654726740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6821","nonce":654726740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6827","nonce":654726740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6823","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6824","nonce":654726740}]},"public_addr":"172.21.15.102:6818/654726740","cluster_addr":"172.21.15.102:6821/654726740","heartbeat_back_addr":"172.21.15.102:6827/654726740","heartbeat_front_addr":"172.21.15.102:6824/654726740","state":["exists","up"]},{"osd":4,"uuid":"33f1ae34-3100-40f7-9cb8-0eca2b358693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6817","nonce":507586170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6819","nonce":507586170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6823","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6825","nonce":507586170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6821","nonce":507586170}]},"public_addr":"172.21.15.129:6817/507586170","cluster_addr":"172.21.15.129:6819/507586170","heartbeat_back_addr":"172.21.15.129:6825/507586170","heartbeat_front_addr":"172.21.15.129:6821/507586170","state":["exists","up"]},{"osd":5,"uuid":"fab2fc62-3f3e-450d-93e0-770f39e80710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6801","nonce":1913451073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6803","nonce":1913451073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6807","nonce":1913451073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6805","nonce":1913451073}]},"public_addr":"172.21.15.129:6801/1913451073","cluster_addr":"172.21.15.129:6803/1913451073","heartbeat_back_addr":"172.21.15.129:6807/1913451073","heartbeat_front_addr":"172.21.15.129:6805/1913451073","state":["exists","up"]},{"osd":6,"uuid":"d7cc1d69-92e7-4253-a127-cfc0444a4809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6809","nonce":2853291511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6811","nonce":2853291511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6815","nonce":2853291511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6813","nonce":2853291511}]},"public_addr":"172.21.15.129:6809/2853291511","cluster_addr":"172.21.15.129:6811/2853291511","heartbeat_back_addr":"172.21.15.129:6815/2853291511","heartbeat_front_addr":"172.21.15.129:6813/2853291511","state":["exists","up"]},{"osd":7,"uuid":"1e403de1-09e2-4370-b9a7-e790ac44bbee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6824","nonce":2933886914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6827","nonce":2933886914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6831","nonce":2933886914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6829","nonce":2933886914}]},"public_addr":"172.21.15.129:6824/2933886914","cluster_addr":"172.21.15.129:6827/2933886914","heartbeat_back_addr":"172.21.15.129:6831/2933886914","heartbeat_front_addr":"172.21.15.129:6829/2933886914","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.849661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.868113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.933488+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.891794+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.901861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.858750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.911712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.996765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:38:26.784 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.782+0000 7f35a9c26640 1 -- 172.21.15.102:0/181339805 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f358406ae70 msgr2=0x7f358406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:26.784 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.782+0000 7f35a9c26640 1 --2- 172.21.15.102:0/181339805 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f358406ae70 0x7f358406d330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3594036000 tx=0x7f359403c040 comp rx=0 tx=0).stop 2023-10-14T09:38:26.784 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.782+0000 7f35a9c26640 1 -- 172.21.15.102:0/181339805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35a4159b20 msgr2=0x7f35a40c7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:26.784 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.782+0000 7f35a9c26640 1 --2- 172.21.15.102:0/181339805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35a4159b20 0x7f35a40c7910 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f358c00b450 tx=0x7f358c00b910 comp rx=0 tx=0).stop 2023-10-14T09:38:26.784 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.782+0000 7f35a9c26640 1 -- 172.21.15.102:0/181339805 shutdown_connections 2023-10-14T09:38:26.785 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.782+0000 7f35a9c26640 1 --2- 172.21.15.102:0/181339805 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f358406ae70 0x7f358406d330 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:26.785 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.782+0000 7f35a9c26640 1 --2- 172.21.15.102:0/181339805 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f35a4159f00 0x7f35a40c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:26.785 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.782+0000 7f35a9c26640 1 --2- 172.21.15.102:0/181339805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35a4159b20 0x7f35a40c7910 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:26.785 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.782+0000 7f35a9c26640 1 --2- 172.21.15.102:0/181339805 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f35a406c120 0x7f35a414d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:26.785 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.782+0000 7f35a9c26640 1 -- 172.21.15.102:0/181339805 >> 172.21.15.102:0/181339805 conn(0x7f35a40cb410 msgr2=0x7f35a40ce870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:26.786 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.782+0000 7f35a9c26640 1 -- 172.21.15.102:0/181339805 shutdown_connections 2023-10-14T09:38:26.786 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:26.782+0000 7f35a9c26640 1 -- 172.21.15.102:0/181339805 wait complete. 2023-10-14T09:38:26.803 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T09:37:09.952407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T09:38:26.804 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T09:38:27.026 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.024+0000 7f3f495b6640 1 Processor -- start 2023-10-14T09:38:27.026 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.024+0000 7f3f495b6640 1 -- start start 2023-10-14T09:38:27.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.026+0000 7f3f495b6640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f3f4406a4b0 0x7f3f4416c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:27.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.026+0000 7f3f495b6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f440caef0 con 0x7f3f440addb0 2023-10-14T09:38:27.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.026+0000 7f3f495b6640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f440cb140 con 0x7f3f440caa80 2023-10-14T09:38:27.029 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.026+0000 7f3f495b6640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f44161a50 con 0x7f3f4406a4b0 2023-10-14T09:38:27.029 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.026+0000 7f3f42ffd640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f3f440addb0 0x7f3f440c9000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:35230/0 (socket says 172.21.15.102:35230) 2023-10-14T09:38:27.029 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.026+0000 7f3f42ffd640 1 -- 172.21.15.102:0/3328877998 learned_addr learned my addr 172.21.15.102:0/3328877998 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:27.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.027+0000 7f3f437fe640 1 --2- 172.21.15.102:0/3328877998 >> v2:172.21.15.129:3300/0 conn(0x7f3f4406a4b0 0x7f3f4416c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:27.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.027+0000 7f3f427fc640 1 -- 172.21.15.102:0/3328877998 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1015716363 0 0) 0x7f3f440caef0 con 0x7f3f440addb0 2023-10-14T09:38:27.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.027+0000 7f3f427fc640 1 -- 172.21.15.102:0/3328877998 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f30003520 con 0x7f3f440addb0 2023-10-14T09:38:27.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.027+0000 7f3f427fc640 1 -- 172.21.15.102:0/3328877998 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2853475032 0 0) 0x7f3f30003520 con 0x7f3f440addb0 2023-10-14T09:38:27.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.027+0000 7f3f427fc640 1 -- 172.21.15.102:0/3328877998 >> v2:172.21.15.129:3300/0 conn(0x7f3f4406a4b0 msgr2=0x7f3f4416c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:27.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.027+0000 7f3f427fc640 1 --2- 172.21.15.102:0/3328877998 >> v2:172.21.15.129:3300/0 conn(0x7f3f4406a4b0 0x7f3f4416c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:27.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.027+0000 7f3f427fc640 1 -- 172.21.15.102:0/3328877998 >> v1:172.21.15.129:6789/0 conn(0x7f3f440caa80 legacy=0x7f3f44069da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:27.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.027+0000 7f3f427fc640 1 -- 172.21.15.102:0/3328877998 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4406b030 con 0x7f3f440addb0 2023-10-14T09:38:27.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.027+0000 7f3f427fc640 1 -- 172.21.15.102:0/3328877998 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4030661168 0 0) 0x7f3f34001670 con 0x7f3f440addb0 2023-10-14T09:38:27.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.027+0000 7f3f427fc640 1 -- 172.21.15.102:0/3328877998 >> v1:172.21.15.102:6789/0 conn(0x7f3f440addb0 legacy=0x7f3f440c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:27.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.027+0000 7f3f427fc640 1 --2- 172.21.15.102:0/3328877998 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f300039c0 0x7f3f30003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:27.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.028+0000 7f3f427fc640 1 --2- 172.21.15.102:0/3328877998 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3f300047c0 0x7f3f30004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:27.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.028+0000 7f3f427fc640 1 --2- 172.21.15.102:0/3328877998 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3f30005180 0x7f3f3000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:27.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.028+0000 7f3f427fc640 1 -- 172.21.15.102:0/3328877998 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f44161a50 con 0x7f3f300039c0 2023-10-14T09:38:27.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.028+0000 7f3f427fc640 1 -- 172.21.15.102:0/3328877998 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3000c080 con 0x7f3f30005180 2023-10-14T09:38:27.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.028+0000 7f3f427fc640 1 -- 172.21.15.102:0/3328877998 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3000c240 con 0x7f3f300047c0 2023-10-14T09:38:27.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.028+0000 7f3f42ffd640 1 --2- 172.21.15.102:0/3328877998 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f300039c0 0x7f3f30003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:27.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.028+0000 7f3f437fe640 1 --2- 172.21.15.102:0/3328877998 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3f30005180 0x7f3f3000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:27.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.028+0000 7f3f3a7fc640 1 --2- 172.21.15.102:0/3328877998 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3f300047c0 0x7f3f30004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:27.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.029+0000 7f3f42ffd640 1 -- 172.21.15.102:0/3328877998 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3f300047c0 msgr2=0x7f3f30004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:27.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.029+0000 7f3f42ffd640 1 --2- 172.21.15.102:0/3328877998 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3f300047c0 0x7f3f30004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:27.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.029+0000 7f3f42ffd640 1 -- 172.21.15.102:0/3328877998 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3f30005180 msgr2=0x7f3f3000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:27.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.029+0000 7f3f42ffd640 1 --2- 172.21.15.102:0/3328877998 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3f30005180 0x7f3f3000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:27.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.029+0000 7f3f437fe640 1 -- 172.21.15.102:0/3328877998 reap_dead start 2023-10-14T09:38:27.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.029+0000 7f3f42ffd640 1 -- 172.21.15.102:0/3328877998 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f30003520 con 0x7f3f300039c0 2023-10-14T09:38:27.038 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.030+0000 7f3f42ffd640 1 --2- 172.21.15.102:0/3328877998 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f300039c0 0x7f3f30003de0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3f3400c0e0 tx=0x7f3f300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fae296c878c8bb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:27.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.030+0000 7f3f427fc640 1 -- 172.21.15.102:0/3328877998 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f34005ad0 con 0x7f3f300039c0 2023-10-14T09:38:27.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.030+0000 7f3f427fc640 1 -- 172.21.15.102:0/3328877998 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f34005c50 con 0x7f3f300039c0 2023-10-14T09:38:27.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.030+0000 7f3f427fc640 1 -- 172.21.15.102:0/3328877998 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f34007070 con 0x7f3f300039c0 2023-10-14T09:38:27.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.031+0000 7f3f495b6640 1 -- 172.21.15.102:0/3328877998 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f300039c0 msgr2=0x7f3f30003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:27.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.031+0000 7f3f495b6640 1 --2- 172.21.15.102:0/3328877998 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f300039c0 0x7f3f30003de0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3f3400c0e0 tx=0x7f3f300057f0 comp rx=0 tx=0).stop 2023-10-14T09:38:27.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.031+0000 7f3f495b6640 1 -- 172.21.15.102:0/3328877998 shutdown_connections 2023-10-14T09:38:27.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.031+0000 7f3f495b6640 1 --2- 172.21.15.102:0/3328877998 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f300039c0 0x7f3f30003de0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:27.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.031+0000 7f3f495b6640 1 -- 172.21.15.102:0/3328877998 >> 172.21.15.102:0/3328877998 conn(0x7f3f440ce9b0 msgr2=0x7f3f440cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:27.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.031+0000 7f3f495b6640 1 -- 172.21.15.102:0/3328877998 shutdown_connections 2023-10-14T09:38:27.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.031+0000 7f3f495b6640 1 -- 172.21.15.102:0/3328877998 wait complete. 2023-10-14T09:38:27.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.033+0000 7f3f495b6640 1 Processor -- start 2023-10-14T09:38:27.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.033+0000 7f3f495b6640 1 -- start start 2023-10-14T09:38:27.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.034+0000 7f3f495b6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3f300039c0 0x7f3f440c7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:27.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.034+0000 7f3f495b6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f440c86a0 0x7f3f44162fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:27.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.035+0000 7f3f495b6640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3f4415dd80 0x7f3f4406f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:27.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.035+0000 7f3f495b6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f441634e0 con 0x7f3f440c86a0 2023-10-14T09:38:27.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.035+0000 7f3f495b6640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f440c8b20 con 0x7f3f300039c0 2023-10-14T09:38:27.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.035+0000 7f3f495b6640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4415e750 con 0x7f3f4415dd80 2023-10-14T09:38:27.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.035+0000 7f3f3a7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f440c86a0 0x7f3f44162fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:27.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.035+0000 7f3f3a7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f440c86a0 0x7f3f44162fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52492/0 (socket says 172.21.15.102:52492) 2023-10-14T09:38:27.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.035+0000 7f3f3a7fc640 1 -- 172.21.15.102:0/390637158 learned_addr learned my addr 172.21.15.102:0/390637158 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:27.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.035+0000 7f3f42ffd640 1 --2- 172.21.15.102:0/390637158 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3f300039c0 0x7f3f440c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:27.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.035+0000 7f3f3a7fc640 1 -- 172.21.15.102:0/390637158 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3f4415dd80 msgr2=0x7f3f4406f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:27.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.035+0000 7f3f437fe640 1 --2- 172.21.15.102:0/390637158 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3f4415dd80 0x7f3f4406f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:27.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.035+0000 7f3f3a7fc640 1 --2- 172.21.15.102:0/390637158 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3f4415dd80 0x7f3f4406f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:27.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.035+0000 7f3f3a7fc640 1 -- 172.21.15.102:0/390637158 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3f300039c0 msgr2=0x7f3f440c7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:27.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.035+0000 7f3f3a7fc640 1 --2- 172.21.15.102:0/390637158 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3f300039c0 0x7f3f440c7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:27.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.035+0000 7f3f3a7fc640 1 -- 172.21.15.102:0/390637158 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f440c7600 con 0x7f3f440c86a0 2023-10-14T09:38:27.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.035+0000 7f3f42ffd640 1 --2- 172.21.15.102:0/390637158 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3f300039c0 0x7f3f440c7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:27.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.035+0000 7f3f437fe640 1 --2- 172.21.15.102:0/390637158 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3f4415dd80 0x7f3f4406f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:27.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.036+0000 7f3f3a7fc640 1 --2- 172.21.15.102:0/390637158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f440c86a0 0x7f3f44162fa0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c00e480 tx=0x7f3f2c00e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:27.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.036+0000 7f3f3bfff640 1 -- 172.21.15.102:0/390637158 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c0052e0 con 0x7f3f440c86a0 2023-10-14T09:38:27.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.036+0000 7f3f3bfff640 1 -- 172.21.15.102:0/390637158 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2c005440 con 0x7f3f440c86a0 2023-10-14T09:38:27.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.036+0000 7f3f3bfff640 1 -- 172.21.15.102:0/390637158 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c003810 con 0x7f3f440c86a0 2023-10-14T09:38:27.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.036+0000 7f3f495b6640 1 -- 172.21.15.102:0/390637158 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f440c78e0 con 0x7f3f440c86a0 2023-10-14T09:38:27.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.036+0000 7f3f495b6640 1 -- 172.21.15.102:0/390637158 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f440c7ea0 con 0x7f3f440c86a0 2023-10-14T09:38:27.046 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.038+0000 7f3f495b6640 1 -- 172.21.15.102:0/390637158 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f4404e160 con 0x7f3f440c86a0 2023-10-14T09:38:27.047 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.038+0000 7f3f3bfff640 1 -- 172.21.15.102:0/390637158 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3f2c003970 con 0x7f3f440c86a0 2023-10-14T09:38:27.047 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.039+0000 7f3f3bfff640 1 --2- 172.21.15.102:0/390637158 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f3f2406ae70 0x7f3f2406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:27.047 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.039+0000 7f3f3bfff640 1 -- 172.21.15.102:0/390637158 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3f2c088ff0 con 0x7f3f440c86a0 2023-10-14T09:38:27.047 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.040+0000 7f3f42ffd640 1 --2- 172.21.15.102:0/390637158 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f3f2406ae70 0x7f3f2406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:27.047 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.041+0000 7f3f42ffd640 1 --2- 172.21.15.102:0/390637158 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f3f2406ae70 0x7f3f2406d330 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3f34034000 tx=0x7f3f34009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:27.048 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.044+0000 7f3f3bfff640 1 -- 172.21.15.102:0/390637158 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3f2c054480 con 0x7f3f440c86a0 2023-10-14T09:38:27.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.235+0000 7f3f495b6640 1 -- 172.21.15.102:0/390637158 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3f4406c5b0 con 0x7f3f440c86a0 2023-10-14T09:38:27.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.236+0000 7f3f3bfff640 1 -- 172.21.15.102:0/390637158 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3f2c057aa0 con 0x7f3f440c86a0 2023-10-14T09:38:27.238 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2023-10-14T09:38:27.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.239+0000 7f3f495b6640 1 -- 172.21.15.102:0/390637158 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f3f2406ae70 msgr2=0x7f3f2406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:27.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.239+0000 7f3f495b6640 1 --2- 172.21.15.102:0/390637158 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f3f2406ae70 0x7f3f2406d330 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3f34034000 tx=0x7f3f34009030 comp rx=0 tx=0).stop 2023-10-14T09:38:27.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.239+0000 7f3f495b6640 1 -- 172.21.15.102:0/390637158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f440c86a0 msgr2=0x7f3f44162fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:27.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.239+0000 7f3f495b6640 1 --2- 172.21.15.102:0/390637158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f440c86a0 0x7f3f44162fa0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c00e480 tx=0x7f3f2c00e940 comp rx=0 tx=0).stop 2023-10-14T09:38:27.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.239+0000 7f3f495b6640 1 -- 172.21.15.102:0/390637158 shutdown_connections 2023-10-14T09:38:27.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.239+0000 7f3f495b6640 1 --2- 172.21.15.102:0/390637158 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f3f2406ae70 0x7f3f2406d330 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:27.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.239+0000 7f3f495b6640 1 --2- 172.21.15.102:0/390637158 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3f4415dd80 0x7f3f4406f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:27.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.239+0000 7f3f495b6640 1 --2- 172.21.15.102:0/390637158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f440c86a0 0x7f3f44162fa0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:27.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.239+0000 7f3f495b6640 1 --2- 172.21.15.102:0/390637158 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3f300039c0 0x7f3f440c7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:27.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.239+0000 7f3f495b6640 1 -- 172.21.15.102:0/390637158 >> 172.21.15.102:0/390637158 conn(0x7f3f440ce9b0 msgr2=0x7f3f440c8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:27.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.240+0000 7f3f495b6640 1 -- 172.21.15.102:0/390637158 shutdown_connections 2023-10-14T09:38:27.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.240+0000 7f3f495b6640 1 -- 172.21.15.102:0/390637158 wait complete. 2023-10-14T09:38:27.259 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T09:38:27.461 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.459+0000 7fa98d2d7640 1 Processor -- start 2023-10-14T09:38:27.461 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.459+0000 7fa98d2d7640 1 -- start start 2023-10-14T09:38:27.462 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.460+0000 7fa98d2d7640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa98815aaa0 0x7fa98815e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:27.463 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.460+0000 7fa98d2d7640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa98815ae80 0x7fa9880cc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:27.463 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.461+0000 7fa98d2d7640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa98815ed60 con 0x7fa9880ccaa0 2023-10-14T09:38:27.463 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.461+0000 7fa98d2d7640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa98806b810 con 0x7fa98815ae80 2023-10-14T09:38:27.463 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.461+0000 7fa98d2d7640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9880707e0 con 0x7fa98815aaa0 2023-10-14T09:38:27.463 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.461+0000 7fa9867fc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa98815ae80 0x7fa9880cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:27.464 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.461+0000 7fa9867fc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa98815ae80 0x7fa9880cc560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52506/0 (socket says 172.21.15.102:52506) 2023-10-14T09:38:27.464 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.461+0000 7fa9867fc640 1 -- 172.21.15.102:0/2892585951 learned_addr learned my addr 172.21.15.102:0/2892585951 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:27.465 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.461+0000 7fa986ffd640 1 --2- 172.21.15.102:0/2892585951 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa98815aaa0 0x7fa98815e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:27.466 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.461+0000 7fa9867fc640 1 -- 172.21.15.102:0/2892585951 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa98815aaa0 msgr2=0x7fa98815e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:27.466 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.461+0000 7fa9867fc640 1 --2- 172.21.15.102:0/2892585951 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa98815aaa0 0x7fa98815e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:27.466 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.461+0000 7fa9867fc640 1 -- 172.21.15.102:0/2892585951 >> v1:172.21.15.129:6789/0 conn(0x7fa9880ccaa0 legacy=0x7fa988070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:27.466 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.461+0000 7fa9867fc640 1 -- 172.21.15.102:0/2892585951 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98815ef90 con 0x7fa98815ae80 2023-10-14T09:38:27.466 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.463+0000 7fa9867fc640 1 --2- 172.21.15.102:0/2892585951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa98815ae80 0x7fa9880cc560 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa970009e50 tx=0x7fa97002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f64e0e19241133 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:27.467 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.463+0000 7fa985ffb640 1 -- 172.21.15.102:0/2892585951 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97002ca70 con 0x7fa98815ae80 2023-10-14T09:38:27.467 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.463+0000 7fa985ffb640 1 -- 172.21.15.102:0/2892585951 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97002cbd0 con 0x7fa98815ae80 2023-10-14T09:38:27.467 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.463+0000 7fa985ffb640 1 -- 172.21.15.102:0/2892585951 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9700343f0 con 0x7fa98815ae80 2023-10-14T09:38:27.467 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.464+0000 7fa98d2d7640 1 -- 172.21.15.102:0/2892585951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa98815ae80 msgr2=0x7fa9880cc560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:27.467 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.464+0000 7fa98d2d7640 1 --2- 172.21.15.102:0/2892585951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa98815ae80 0x7fa9880cc560 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa970009e50 tx=0x7fa97002bed0 comp rx=0 tx=0).stop 2023-10-14T09:38:27.467 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.464+0000 7fa98d2d7640 1 -- 172.21.15.102:0/2892585951 shutdown_connections 2023-10-14T09:38:27.468 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.464+0000 7fa98d2d7640 1 --2- 172.21.15.102:0/2892585951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa98815ae80 0x7fa9880cc560 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:27.468 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.464+0000 7fa98d2d7640 1 --2- 172.21.15.102:0/2892585951 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa98815aaa0 0x7fa98815e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:27.468 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.464+0000 7fa98d2d7640 1 -- 172.21.15.102:0/2892585951 >> 172.21.15.102:0/2892585951 conn(0x7fa9880cb410 msgr2=0x7fa9880cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:27.468 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.464+0000 7fa98d2d7640 1 -- 172.21.15.102:0/2892585951 shutdown_connections 2023-10-14T09:38:27.469 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.464+0000 7fa98d2d7640 1 -- 172.21.15.102:0/2892585951 wait complete. 2023-10-14T09:38:27.470 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.465+0000 7fa98d2d7640 1 Processor -- start 2023-10-14T09:38:27.471 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.466+0000 7fa98d2d7640 1 -- start start 2023-10-14T09:38:27.471 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.466+0000 7fa98d2d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9880ccaa0 0x7fa9880c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:27.471 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.466+0000 7fa98d2d7640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa98815aaa0 0x7fa98815bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:27.471 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.466+0000 7fa98d2d7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa98815ae80 0x7fa9881597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:27.471 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.466+0000 7fa98d2d7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98815cfb0 con 0x7fa9880ccaa0 2023-10-14T09:38:27.472 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.466+0000 7fa98d2d7640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98815c710 con 0x7fa98815ae80 2023-10-14T09:38:27.472 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.466+0000 7fa98d2d7640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98815c9f0 con 0x7fa98815aaa0 2023-10-14T09:38:27.472 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.467+0000 7fa986ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9880ccaa0 0x7fa9880c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:27.472 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.467+0000 7fa986ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9880ccaa0 0x7fa9880c7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52508/0 (socket says 172.21.15.102:52508) 2023-10-14T09:38:27.472 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.467+0000 7fa986ffd640 1 -- 172.21.15.102:0/366195468 learned_addr learned my addr 172.21.15.102:0/366195468 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:27.473 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.467+0000 7fa986ffd640 1 -- 172.21.15.102:0/366195468 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa98815aaa0 msgr2=0x7fa98815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:27.473 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.467+0000 7fa986ffd640 1 --2- 172.21.15.102:0/366195468 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa98815aaa0 0x7fa98815bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:27.473 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.467+0000 7fa986ffd640 1 -- 172.21.15.102:0/366195468 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa98815ae80 msgr2=0x7fa9881597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:27.473 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.467+0000 7fa986ffd640 1 --2- 172.21.15.102:0/366195468 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa98815ae80 0x7fa9881597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:27.473 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.467+0000 7fa986ffd640 1 -- 172.21.15.102:0/366195468 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa970009b30 con 0x7fa9880ccaa0 2023-10-14T09:38:27.474 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.467+0000 7fa986ffd640 1 --2- 172.21.15.102:0/366195468 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9880ccaa0 0x7fa9880c7cb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa97800d800 tx=0x7fa97800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:27.474 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.468+0000 7fa97f7fe640 1 -- 172.21.15.102:0/366195468 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97800b6c0 con 0x7fa9880ccaa0 2023-10-14T09:38:27.474 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.468+0000 7fa97f7fe640 1 -- 172.21.15.102:0/366195468 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97800b820 con 0x7fa9880ccaa0 2023-10-14T09:38:27.474 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.468+0000 7fa97f7fe640 1 -- 172.21.15.102:0/366195468 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97800bbb0 con 0x7fa9880ccaa0 2023-10-14T09:38:27.474 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.468+0000 7fa98d2d7640 1 -- 172.21.15.102:0/366195468 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa98815ccd0 con 0x7fa9880ccaa0 2023-10-14T09:38:27.475 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.468+0000 7fa98d2d7640 1 -- 172.21.15.102:0/366195468 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9880c81f0 con 0x7fa9880ccaa0 2023-10-14T09:38:27.475 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.469+0000 7fa98d2d7640 1 -- 172.21.15.102:0/366195468 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9880c83b0 con 0x7fa9880ccaa0 2023-10-14T09:38:27.476 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.470+0000 7fa97f7fe640 1 -- 172.21.15.102:0/366195468 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa97800bd10 con 0x7fa9880ccaa0 2023-10-14T09:38:27.476 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.470+0000 7fa97f7fe640 1 --2- 172.21.15.102:0/366195468 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa96806aec0 0x7fa96806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:27.476 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.471+0000 7fa97f7fe640 1 -- 172.21.15.102:0/366195468 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa978089880 con 0x7fa9880ccaa0 2023-10-14T09:38:27.476 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.471+0000 7fa9867fc640 1 --2- 172.21.15.102:0/366195468 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa96806aec0 0x7fa96806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:27.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.472+0000 7fa9867fc640 1 --2- 172.21.15.102:0/366195468 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa96806aec0 0x7fa96806d380 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa970035000 tx=0x7fa97002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:27.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.475+0000 7fa97f7fe640 1 -- 172.21.15.102:0/366195468 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa978054c60 con 0x7fa9880ccaa0 2023-10-14T09:38:27.667 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.666+0000 7fa98d2d7640 1 -- 172.21.15.102:0/366195468 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa9880c5a40 con 0x7fa9880ccaa0 2023-10-14T09:38:27.668 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.666+0000 7fa97f7fe640 1 -- 172.21.15.102:0/366195468 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v32) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa978058280 con 0x7fa9880ccaa0 2023-10-14T09:38:27.668 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:38:27.669 INFO:teuthology.orchestra.run.smithi102.stdout:[ 2023-10-14T09:38:27.669 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-10-14T09:38:27.669 INFO:teuthology.orchestra.run.smithi102.stdout: "poolnum": 1, 2023-10-14T09:38:27.669 INFO:teuthology.orchestra.run.smithi102.stdout: "poolname": ".mgr" 2023-10-14T09:38:27.669 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-10-14T09:38:27.670 INFO:teuthology.orchestra.run.smithi102.stdout:] 2023-10-14T09:38:27.671 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.668+0000 7fa98d2d7640 1 -- 172.21.15.102:0/366195468 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa96806aec0 msgr2=0x7fa96806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:27.671 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.668+0000 7fa98d2d7640 1 --2- 172.21.15.102:0/366195468 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa96806aec0 0x7fa96806d380 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa970035000 tx=0x7fa97002e000 comp rx=0 tx=0).stop 2023-10-14T09:38:27.671 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.669+0000 7fa98d2d7640 1 -- 172.21.15.102:0/366195468 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9880ccaa0 msgr2=0x7fa9880c7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:27.671 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.669+0000 7fa98d2d7640 1 --2- 172.21.15.102:0/366195468 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9880ccaa0 0x7fa9880c7cb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa97800d800 tx=0x7fa97800dcc0 comp rx=0 tx=0).stop 2023-10-14T09:38:27.671 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.669+0000 7fa98d2d7640 1 -- 172.21.15.102:0/366195468 shutdown_connections 2023-10-14T09:38:27.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.669+0000 7fa98d2d7640 1 --2- 172.21.15.102:0/366195468 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa96806aec0 0x7fa96806d380 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:27.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.669+0000 7fa98d2d7640 1 --2- 172.21.15.102:0/366195468 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa98815ae80 0x7fa9881597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:27.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.669+0000 7fa98d2d7640 1 --2- 172.21.15.102:0/366195468 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa98815aaa0 0x7fa98815bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:27.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.669+0000 7fa98d2d7640 1 --2- 172.21.15.102:0/366195468 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9880ccaa0 0x7fa9880c7cb0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:27.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.669+0000 7fa98d2d7640 1 -- 172.21.15.102:0/366195468 >> 172.21.15.102:0/366195468 conn(0x7fa9880cb410 msgr2=0x7fa988070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:27.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.669+0000 7fa98d2d7640 1 -- 172.21.15.102:0/366195468 shutdown_connections 2023-10-14T09:38:27.673 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.669+0000 7fa98d2d7640 1 -- 172.21.15.102:0/366195468 wait complete. 2023-10-14T09:38:27.686 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'testcephfs1' 2023-10-14T09:38:27.687 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create testcephfs1_metadata --pg_num_min 64 2023-10-14T09:38:27.876 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.874+0000 7ff385452640 1 Processor -- start 2023-10-14T09:38:27.876 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.874+0000 7ff385452640 1 -- start start 2023-10-14T09:38:27.878 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.876+0000 7ff385452640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff3801599c0 0x7ff3800c9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:27.878 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.876+0000 7ff385452640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7ff380159da0 0x7ff38015d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:27.878 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.876+0000 7ff385452640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff3800cce20 0x7ff38006c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:27.878 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.876+0000 7ff385452640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff38015dd10 con 0x7ff3800cce20 2023-10-14T09:38:27.879 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.876+0000 7ff385452640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff38015dfb0 con 0x7ff380159da0 2023-10-14T09:38:27.879 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.876+0000 7ff385452640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff38015e290 con 0x7ff3801599c0 2023-10-14T09:38:27.879 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.876+0000 7ff37f7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff3800cce20 0x7ff38006c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:27.879 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.876+0000 7ff37f7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff3800cce20 0x7ff38006c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52518/0 (socket says 172.21.15.102:52518) 2023-10-14T09:38:27.879 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.876+0000 7ff37f7fe640 1 -- 172.21.15.102:0/3679326289 learned_addr learned my addr 172.21.15.102:0/3679326289 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:27.881 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.876+0000 7ff3767fc640 1 --2- 172.21.15.102:0/3679326289 >> v2:172.21.15.129:3300/0 conn(0x7ff380159da0 0x7ff38015d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:27.881 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.877+0000 7ff37effd640 1 --2- 172.21.15.102:0/3679326289 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff3801599c0 0x7ff3800c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:27.881 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.877+0000 7ff37f7fe640 1 -- 172.21.15.102:0/3679326289 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff3801599c0 msgr2=0x7ff3800c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:27.882 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.877+0000 7ff37f7fe640 1 --2- 172.21.15.102:0/3679326289 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff3801599c0 0x7ff3800c9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:27.882 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.877+0000 7ff37f7fe640 1 -- 172.21.15.102:0/3679326289 >> v2:172.21.15.129:3300/0 conn(0x7ff380159da0 msgr2=0x7ff38015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:27.882 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.877+0000 7ff37f7fe640 1 --2- 172.21.15.102:0/3679326289 >> v2:172.21.15.129:3300/0 conn(0x7ff380159da0 0x7ff38015d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:27.882 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.877+0000 7ff37f7fe640 1 -- 172.21.15.102:0/3679326289 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff38015e570 con 0x7ff3800cce20 2023-10-14T09:38:27.882 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.878+0000 7ff37f7fe640 1 --2- 172.21.15.102:0/3679326289 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3800cce20 0x7ff38006c0d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff38006d640 tx=0x7ff37802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba1b65e451122da4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:27.883 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.878+0000 7ff37e7fc640 1 -- 172.21.15.102:0/3679326289 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff378031870 con 0x7ff3800cce20 2023-10-14T09:38:27.883 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.878+0000 7ff37e7fc640 1 -- 172.21.15.102:0/3679326289 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3780319d0 con 0x7ff3800cce20 2023-10-14T09:38:27.883 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.878+0000 7ff37e7fc640 1 -- 172.21.15.102:0/3679326289 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff378031d60 con 0x7ff3800cce20 2023-10-14T09:38:27.883 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.879+0000 7ff385452640 1 -- 172.21.15.102:0/3679326289 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3800cce20 msgr2=0x7ff38006c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:27.883 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.879+0000 7ff385452640 1 --2- 172.21.15.102:0/3679326289 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3800cce20 0x7ff38006c0d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff38006d640 tx=0x7ff37802b910 comp rx=0 tx=0).stop 2023-10-14T09:38:27.883 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.879+0000 7ff385452640 1 -- 172.21.15.102:0/3679326289 shutdown_connections 2023-10-14T09:38:27.884 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.879+0000 7ff385452640 1 --2- 172.21.15.102:0/3679326289 >> v2:172.21.15.129:3300/0 conn(0x7ff380159da0 0x7ff38015d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:27.884 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.879+0000 7ff385452640 1 --2- 172.21.15.102:0/3679326289 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3800cce20 0x7ff38006c0d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:27.884 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.879+0000 7ff385452640 1 --2- 172.21.15.102:0/3679326289 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff3801599c0 0x7ff3800c9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:27.884 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.879+0000 7ff385452640 1 -- 172.21.15.102:0/3679326289 >> 172.21.15.102:0/3679326289 conn(0x7ff3800cb360 msgr2=0x7ff3800cb740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:27.884 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.879+0000 7ff385452640 1 -- 172.21.15.102:0/3679326289 shutdown_connections 2023-10-14T09:38:27.885 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.879+0000 7ff385452640 1 -- 172.21.15.102:0/3679326289 wait complete. 2023-10-14T09:38:27.887 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.880+0000 7ff385452640 1 Processor -- start 2023-10-14T09:38:27.887 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.881+0000 7ff385452640 1 -- start start 2023-10-14T09:38:27.887 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.882+0000 7ff385452640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff3800cce20 0x7ff3801559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:27.887 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.882+0000 7ff385452640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3801599c0 0x7ff3800c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:27.887 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.882+0000 7ff385452640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff380159da0 0x7ff3800b1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:27.888 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.882+0000 7ff385452640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3801f0270 con 0x7ff3801599c0 2023-10-14T09:38:27.888 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.882+0000 7ff385452640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3800c52c0 con 0x7ff3800cce20 2023-10-14T09:38:27.888 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.882+0000 7ff385452640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff380156380 con 0x7ff380159da0 2023-10-14T09:38:27.888 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.882+0000 7ff3767fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3801599c0 0x7ff3800c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:27.888 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.882+0000 7ff3767fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3801599c0 0x7ff3800c4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52530/0 (socket says 172.21.15.102:52530) 2023-10-14T09:38:27.889 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.882+0000 7ff3767fc640 1 -- 172.21.15.102:0/1559977453 learned_addr learned my addr 172.21.15.102:0/1559977453 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:27.889 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.882+0000 7ff3767fc640 1 -- 172.21.15.102:0/1559977453 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff380159da0 msgr2=0x7ff3800b1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:27.889 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.882+0000 7ff3767fc640 1 --2- 172.21.15.102:0/1559977453 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff380159da0 0x7ff3800b1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:27.889 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.882+0000 7ff3767fc640 1 -- 172.21.15.102:0/1559977453 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff3800cce20 msgr2=0x7ff3801559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:27.889 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.882+0000 7ff37effd640 1 --2- 172.21.15.102:0/1559977453 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff3800cce20 0x7ff3801559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:27.889 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.882+0000 7ff3767fc640 1 --2- 172.21.15.102:0/1559977453 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff3800cce20 0x7ff3801559a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:27.890 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.882+0000 7ff3767fc640 1 -- 172.21.15.102:0/1559977453 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3780094d0 con 0x7ff3801599c0 2023-10-14T09:38:27.890 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.882+0000 7ff37effd640 1 --2- 172.21.15.102:0/1559977453 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff3800cce20 0x7ff3801559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:27.890 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.883+0000 7ff3767fc640 1 --2- 172.21.15.102:0/1559977453 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3801599c0 0x7ff3800c4d80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff36800d800 tx=0x7ff36800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:27.890 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.883+0000 7ff377fff640 1 -- 172.21.15.102:0/1559977453 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36800b6c0 con 0x7ff3801599c0 2023-10-14T09:38:27.890 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.883+0000 7ff377fff640 1 -- 172.21.15.102:0/1559977453 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36800b820 con 0x7ff3801599c0 2023-10-14T09:38:27.890 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.883+0000 7ff377fff640 1 -- 172.21.15.102:0/1559977453 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36800bbb0 con 0x7ff3801599c0 2023-10-14T09:38:27.891 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.883+0000 7ff385452640 1 -- 172.21.15.102:0/1559977453 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff38015c270 con 0x7ff3801599c0 2023-10-14T09:38:27.891 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.883+0000 7ff385452640 1 -- 172.21.15.102:0/1559977453 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff38015b4b0 con 0x7ff3801599c0 2023-10-14T09:38:27.891 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.884+0000 7ff385452640 1 -- 172.21.15.102:0/1559977453 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3800caed0 con 0x7ff3801599c0 2023-10-14T09:38:27.891 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.885+0000 7ff377fff640 1 -- 172.21.15.102:0/1559977453 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff36800bd10 con 0x7ff3801599c0 2023-10-14T09:38:27.892 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.886+0000 7ff377fff640 1 --2- 172.21.15.102:0/1559977453 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff36006ae70 0x7ff36006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:27.892 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.886+0000 7ff377fff640 1 -- 172.21.15.102:0/1559977453 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff3680897c0 con 0x7ff3801599c0 2023-10-14T09:38:27.893 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.886+0000 7ff37effd640 1 --2- 172.21.15.102:0/1559977453 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff36006ae70 0x7ff36006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:27.893 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.887+0000 7ff37effd640 1 --2- 172.21.15.102:0/1559977453 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff36006ae70 0x7ff36006d330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff3800cc1e0 tx=0x7ff37000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:27.893 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:27.890+0000 7ff377fff640 1 -- 172.21.15.102:0/1559977453 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff368054bc0 con 0x7ff3801599c0 2023-10-14T09:38:28.083 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:28.081+0000 7ff385452640 1 -- 172.21.15.102:0/1559977453 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "testcephfs1_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff38004e160 con 0x7ff3801599c0 2023-10-14T09:38:28.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:28.978+0000 7ff377fff640 1 -- 172.21.15.102:0/1559977453 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "testcephfs1_metadata", "pg_num_min": 64}]=0 pool 'testcephfs1_metadata' created v33) v1 ==== 148+0+0 (secure 0 0 0) 0x7ff3680581e0 con 0x7ff3801599c0 2023-10-14T09:38:28.980 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'testcephfs1_metadata' created 2023-10-14T09:38:28.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:28.982+0000 7ff385452640 1 -- 172.21.15.102:0/1559977453 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff36006ae70 msgr2=0x7ff36006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:28.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:28.982+0000 7ff385452640 1 --2- 172.21.15.102:0/1559977453 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff36006ae70 0x7ff36006d330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff3800cc1e0 tx=0x7ff37000b040 comp rx=0 tx=0).stop 2023-10-14T09:38:28.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:28.982+0000 7ff385452640 1 -- 172.21.15.102:0/1559977453 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3801599c0 msgr2=0x7ff3800c4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:28.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:28.982+0000 7ff385452640 1 --2- 172.21.15.102:0/1559977453 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3801599c0 0x7ff3800c4d80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff36800d800 tx=0x7ff36800dcc0 comp rx=0 tx=0).stop 2023-10-14T09:38:28.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:28.982+0000 7ff385452640 1 -- 172.21.15.102:0/1559977453 shutdown_connections 2023-10-14T09:38:28.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:28.982+0000 7ff385452640 1 --2- 172.21.15.102:0/1559977453 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff36006ae70 0x7ff36006d330 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:28.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:28.982+0000 7ff385452640 1 --2- 172.21.15.102:0/1559977453 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff380159da0 0x7ff3800b1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:28.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:28.982+0000 7ff385452640 1 --2- 172.21.15.102:0/1559977453 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3801599c0 0x7ff3800c4d80 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:28.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:28.982+0000 7ff385452640 1 --2- 172.21.15.102:0/1559977453 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff3800cce20 0x7ff3801559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:28.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:28.982+0000 7ff385452640 1 -- 172.21.15.102:0/1559977453 >> 172.21.15.102:0/1559977453 conn(0x7ff3800cb360 msgr2=0x7ff3800cb740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:28.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:28.982+0000 7ff385452640 1 -- 172.21.15.102:0/1559977453 shutdown_connections 2023-10-14T09:38:28.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:28.982+0000 7ff385452640 1 -- 172.21.15.102:0/1559977453 wait complete. 2023-10-14T09:38:29.007 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create testcephfs1_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T09:38:29.219 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.217+0000 7f6c7ecb4640 1 Processor -- start 2023-10-14T09:38:29.219 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.217+0000 7f6c7ecb4640 1 -- start start 2023-10-14T09:38:29.221 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.219+0000 7f6c7ecb4640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6c7806b4c0 0x7f6c780ae170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:29.221 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.219+0000 7f6c7ecb4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c7806e170 con 0x7f6c78160800 2023-10-14T09:38:29.221 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.219+0000 7f6c7ecb4640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c780cd460 con 0x7f6c78160420 2023-10-14T09:38:29.221 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.219+0000 7f6c7ecb4640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7806e3c0 con 0x7f6c7806b4c0 2023-10-14T09:38:29.222 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.219+0000 7f6c7d251640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f6c78160800 0x7f6c78070cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:35244/0 (socket says 172.21.15.102:35244) 2023-10-14T09:38:29.222 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.219+0000 7f6c7d251640 1 -- 172.21.15.102:0/3618678343 learned_addr learned my addr 172.21.15.102:0/3618678343 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:29.224 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.220+0000 7f6c77fff640 1 --2- 172.21.15.102:0/3618678343 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6c7806b4c0 0x7f6c780ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:29.224 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.220+0000 7f6c777fe640 1 -- 172.21.15.102:0/3618678343 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 36305792 0 0) 0x7f6c7806e170 con 0x7f6c78160800 2023-10-14T09:38:29.224 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.220+0000 7f6c777fe640 1 -- 172.21.15.102:0/3618678343 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c68003520 con 0x7f6c78160800 2023-10-14T09:38:29.225 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.220+0000 7f6c777fe640 1 -- 172.21.15.102:0/3618678343 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2322914004 0 0) 0x7f6c68003520 con 0x7f6c78160800 2023-10-14T09:38:29.225 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.220+0000 7f6c777fe640 1 -- 172.21.15.102:0/3618678343 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6c7806b4c0 msgr2=0x7f6c780ae170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:29.225 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.220+0000 7f6c777fe640 1 --2- 172.21.15.102:0/3618678343 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6c7806b4c0 0x7f6c780ae170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:29.225 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.220+0000 7f6c777fe640 1 -- 172.21.15.102:0/3618678343 >> v1:172.21.15.129:6789/0 conn(0x7f6c78160420 legacy=0x7f6c7806adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:29.225 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.220+0000 7f6c777fe640 1 -- 172.21.15.102:0/3618678343 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7806e6a0 con 0x7f6c78160800 2023-10-14T09:38:29.226 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.220+0000 7f6c777fe640 1 -- 172.21.15.102:0/3618678343 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4030661168 0 0) 0x7f6c70001670 con 0x7f6c78160800 2023-10-14T09:38:29.226 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.220+0000 7f6c777fe640 1 -- 172.21.15.102:0/3618678343 >> v1:172.21.15.102:6789/0 conn(0x7f6c78160800 legacy=0x7f6c78070cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:29.226 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.220+0000 7f6c777fe640 1 --2- 172.21.15.102:0/3618678343 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c680039a0 0x7f6c68003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:29.226 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.220+0000 7f6c777fe640 1 --2- 172.21.15.102:0/3618678343 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6c680047c0 0x7f6c68004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:29.226 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.220+0000 7f6c777fe640 1 --2- 172.21.15.102:0/3618678343 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6c680051d0 0x7f6c6800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:29.227 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.220+0000 7f6c777fe640 1 -- 172.21.15.102:0/3618678343 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7806e3c0 con 0x7f6c680039a0 2023-10-14T09:38:29.227 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.220+0000 7f6c777fe640 1 -- 172.21.15.102:0/3618678343 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6800c080 con 0x7f6c680047c0 2023-10-14T09:38:29.227 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.220+0000 7f6c777fe640 1 -- 172.21.15.102:0/3618678343 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6800c240 con 0x7f6c680051d0 2023-10-14T09:38:29.227 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.220+0000 7f6c77fff640 1 --2- 172.21.15.102:0/3618678343 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6c7806b4c0 0x7f6c780ae170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:38:29.227 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.221+0000 7f6c7ca50640 1 --2- 172.21.15.102:0/3618678343 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c680039a0 0x7f6c68003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:29.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.221+0000 7f6c7ca50640 1 -- 172.21.15.102:0/3618678343 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6c680051d0 msgr2=0x7f6c6800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:29.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.221+0000 7f6c7ca50640 1 --2- 172.21.15.102:0/3618678343 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6c680051d0 0x7f6c6800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:29.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.221+0000 7f6c7ca50640 1 -- 172.21.15.102:0/3618678343 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6c680047c0 msgr2=0x7f6c68004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:29.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.221+0000 7f6c7ca50640 1 --2- 172.21.15.102:0/3618678343 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6c680047c0 0x7f6c68004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:29.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.221+0000 7f6c7ca50640 1 -- 172.21.15.102:0/3618678343 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c68003520 con 0x7f6c680039a0 2023-10-14T09:38:29.229 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.222+0000 7f6c7ca50640 1 --2- 172.21.15.102:0/3618678343 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c680039a0 0x7f6c68003dc0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c001e50 tx=0x7f6c680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b89487675c55cb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:29.229 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.222+0000 7f6c777fe640 1 -- 172.21.15.102:0/3618678343 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c003b70 con 0x7f6c680039a0 2023-10-14T09:38:29.229 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.222+0000 7f6c777fe640 1 -- 172.21.15.102:0/3618678343 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6c003cd0 con 0x7f6c680039a0 2023-10-14T09:38:29.229 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.222+0000 7f6c777fe640 1 -- 172.21.15.102:0/3618678343 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c005310 con 0x7f6c680039a0 2023-10-14T09:38:29.232 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.223+0000 7f6c7ecb4640 1 -- 172.21.15.102:0/3618678343 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c680039a0 msgr2=0x7f6c68003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:29.232 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.223+0000 7f6c7ecb4640 1 --2- 172.21.15.102:0/3618678343 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c680039a0 0x7f6c68003dc0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c001e50 tx=0x7f6c680057f0 comp rx=0 tx=0).stop 2023-10-14T09:38:29.232 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.223+0000 7f6c7d251640 1 -- 172.21.15.102:0/3618678343 reap_dead start 2023-10-14T09:38:29.232 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.223+0000 7f6c7ecb4640 1 -- 172.21.15.102:0/3618678343 shutdown_connections 2023-10-14T09:38:29.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.223+0000 7f6c7ecb4640 1 -- 172.21.15.102:0/3618678343 >> 172.21.15.102:0/3618678343 conn(0x7f6c780b0d30 msgr2=0x7f6c780b1140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:29.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.223+0000 7f6c7ecb4640 1 -- 172.21.15.102:0/3618678343 shutdown_connections 2023-10-14T09:38:29.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.223+0000 7f6c7ecb4640 1 -- 172.21.15.102:0/3618678343 wait complete. 2023-10-14T09:38:29.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.225+0000 7f6c7ecb4640 1 Processor -- start 2023-10-14T09:38:29.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.225+0000 7f6c7ecb4640 1 -- start start 2023-10-14T09:38:29.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.226+0000 7f6c7ecb4640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6c680039a0 0x7f6c7809f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:29.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.226+0000 7f6c7ecb4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6c78159d50 0x7f6c780b4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:29.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.226+0000 7f6c7ecb4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c781f5e80 0x7f6c781f6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:29.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.226+0000 7f6c7ecb4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c781f6840 con 0x7f6c781f5e80 2023-10-14T09:38:29.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.226+0000 7f6c7ecb4640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c780b4f80 con 0x7f6c78159d50 2023-10-14T09:38:29.235 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.226+0000 7f6c7ecb4640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c780c91d0 con 0x7f6c680039a0 2023-10-14T09:38:29.235 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.226+0000 7f6c7d251640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c781f5e80 0x7f6c781f6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:29.235 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.226+0000 7f6c7d251640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c781f5e80 0x7f6c781f6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52536/0 (socket says 172.21.15.102:52536) 2023-10-14T09:38:29.235 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.226+0000 7f6c7d251640 1 -- 172.21.15.102:0/462654086 learned_addr learned my addr 172.21.15.102:0/462654086 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:29.235 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.226+0000 7f6c77fff640 1 --2- 172.21.15.102:0/462654086 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6c78159d50 0x7f6c780b4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:29.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.227+0000 7f6c7ca50640 1 --2- 172.21.15.102:0/462654086 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6c680039a0 0x7f6c7809f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:29.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.227+0000 7f6c7d251640 1 -- 172.21.15.102:0/462654086 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6c680039a0 msgr2=0x7f6c7809f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:29.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.227+0000 7f6c7d251640 1 --2- 172.21.15.102:0/462654086 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6c680039a0 0x7f6c7809f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:29.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.227+0000 7f6c7d251640 1 -- 172.21.15.102:0/462654086 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6c78159d50 msgr2=0x7f6c780b4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:29.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.227+0000 7f6c7d251640 1 --2- 172.21.15.102:0/462654086 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6c78159d50 0x7f6c780b4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:29.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.227+0000 7f6c7d251640 1 -- 172.21.15.102:0/462654086 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c780c94b0 con 0x7f6c781f5e80 2023-10-14T09:38:29.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.227+0000 7f6c7d251640 1 --2- 172.21.15.102:0/462654086 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c781f5e80 0x7f6c781f6300 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6c780aec30 tx=0x7f6c7000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:29.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.227+0000 7f6c757fa640 1 -- 172.21.15.102:0/462654086 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c70007440 con 0x7f6c781f5e80 2023-10-14T09:38:29.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.227+0000 7f6c757fa640 1 -- 172.21.15.102:0/462654086 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c700075c0 con 0x7f6c781f5e80 2023-10-14T09:38:29.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.227+0000 7f6c7ecb4640 1 -- 172.21.15.102:0/462654086 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c7809ee10 con 0x7f6c781f5e80 2023-10-14T09:38:29.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.227+0000 7f6c757fa640 1 -- 172.21.15.102:0/462654086 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c70004a20 con 0x7f6c781f5e80 2023-10-14T09:38:29.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.227+0000 7f6c7ecb4640 1 -- 172.21.15.102:0/462654086 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7809f3d0 con 0x7f6c781f5e80 2023-10-14T09:38:29.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.228+0000 7f6c7ecb4640 1 -- 172.21.15.102:0/462654086 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c7809f5f0 con 0x7f6c781f5e80 2023-10-14T09:38:29.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.230+0000 7f6c757fa640 1 -- 172.21.15.102:0/462654086 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6c70004b80 con 0x7f6c781f5e80 2023-10-14T09:38:29.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.231+0000 7f6c757fa640 1 --2- 172.21.15.102:0/462654086 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f6c5c06ae70 0x7f6c5c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:29.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.232+0000 7f6c757fa640 1 -- 172.21.15.102:0/462654086 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5232+0+0 (secure 0 0 0) 0x7f6c70088db0 con 0x7f6c781f5e80 2023-10-14T09:38:29.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.232+0000 7f6c7ca50640 1 --2- 172.21.15.102:0/462654086 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f6c5c06ae70 0x7f6c5c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:29.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.232+0000 7f6c7ca50640 1 --2- 172.21.15.102:0/462654086 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f6c5c06ae70 0x7f6c5c06d330 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c034000 tx=0x7f6c6c009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:29.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.235+0000 7f6c757fa640 1 -- 172.21.15.102:0/462654086 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6c70054040 con 0x7f6c781f5e80 2023-10-14T09:38:29.424 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.422+0000 7f6c7ecb4640 1 -- 172.21.15.102:0/462654086 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "testcephfs1_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6c7804e160 con 0x7f6c781f5e80 2023-10-14T09:38:29.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.994+0000 7f6c757fa640 1 -- 172.21.15.102:0/462654086 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "testcephfs1_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'testcephfs1_data' created v34) v1 ==== 180+0+0 (secure 0 0 0) 0x7f6c70057660 con 0x7f6c781f5e80 2023-10-14T09:38:29.996 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'testcephfs1_data' created 2023-10-14T09:38:30.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.997+0000 7f6c7ecb4640 1 -- 172.21.15.102:0/462654086 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f6c5c06ae70 msgr2=0x7f6c5c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:30.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.997+0000 7f6c7ecb4640 1 --2- 172.21.15.102:0/462654086 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f6c5c06ae70 0x7f6c5c06d330 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c034000 tx=0x7f6c6c009030 comp rx=0 tx=0).stop 2023-10-14T09:38:30.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.997+0000 7f6c7ecb4640 1 -- 172.21.15.102:0/462654086 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c781f5e80 msgr2=0x7f6c781f6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:30.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.997+0000 7f6c7ecb4640 1 --2- 172.21.15.102:0/462654086 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c781f5e80 0x7f6c781f6300 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6c780aec30 tx=0x7f6c7000c960 comp rx=0 tx=0).stop 2023-10-14T09:38:30.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.998+0000 7f6c7ecb4640 1 -- 172.21.15.102:0/462654086 shutdown_connections 2023-10-14T09:38:30.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.998+0000 7f6c7ecb4640 1 --2- 172.21.15.102:0/462654086 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f6c5c06ae70 0x7f6c5c06d330 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:30.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.998+0000 7f6c7ecb4640 1 --2- 172.21.15.102:0/462654086 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c781f5e80 0x7f6c781f6300 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:30.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.998+0000 7f6c7ecb4640 1 --2- 172.21.15.102:0/462654086 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6c78159d50 0x7f6c780b4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:30.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.998+0000 7f6c7ecb4640 1 --2- 172.21.15.102:0/462654086 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6c680039a0 0x7f6c7809f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:30.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.998+0000 7f6c7ecb4640 1 -- 172.21.15.102:0/462654086 >> 172.21.15.102:0/462654086 conn(0x7f6c780b0d30 msgr2=0x7f6c7806a690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:30.002 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.998+0000 7f6c7ecb4640 1 -- 172.21.15.102:0/462654086 shutdown_connections 2023-10-14T09:38:30.002 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:29.998+0000 7f6c7ecb4640 1 -- 172.21.15.102:0/462654086 wait complete. 2023-10-14T09:38:30.031 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new testcephfs1 testcephfs1_metadata testcephfs1_data 2023-10-14T09:38:30.217 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.215+0000 7f110876e640 1 Processor -- start 2023-10-14T09:38:30.217 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.215+0000 7f110876e640 1 -- start start 2023-10-14T09:38:30.219 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.217+0000 7f110876e640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f110015ae10 0x7f11000ca590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:30.219 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.217+0000 7f110876e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f110006d570 0x7f11000caad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:30.219 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.217+0000 7f110876e640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f110015b1f0 con 0x7f11000cf330 2023-10-14T09:38:30.220 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.217+0000 7f110876e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f110006f650 con 0x7f110006d570 2023-10-14T09:38:30.220 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.217+0000 7f110876e640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f110006bb70 con 0x7f110015ae10 2023-10-14T09:38:30.220 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.217+0000 7f1105d09640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f110006d570 0x7f11000caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:30.220 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.217+0000 7f1105d09640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f110006d570 0x7f11000caad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52552/0 (socket says 172.21.15.102:52552) 2023-10-14T09:38:30.220 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.217+0000 7f1105d09640 1 -- 172.21.15.102:0/880703099 learned_addr learned my addr 172.21.15.102:0/880703099 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:30.221 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.218+0000 7f110650a640 1 --2- 172.21.15.102:0/880703099 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f110015ae10 0x7f11000ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:30.222 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.218+0000 7f1105d09640 1 -- 172.21.15.102:0/880703099 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f110015ae10 msgr2=0x7f11000ca590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:30.222 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.218+0000 7f1105d09640 1 --2- 172.21.15.102:0/880703099 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f110015ae10 0x7f11000ca590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:30.223 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.218+0000 7f1105d09640 1 -- 172.21.15.102:0/880703099 >> v1:172.21.15.129:6789/0 conn(0x7f11000cf330 legacy=0x7f110006c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:30.223 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.218+0000 7f1105d09640 1 -- 172.21.15.102:0/880703099 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11000b4190 con 0x7f110006d570 2023-10-14T09:38:30.223 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.219+0000 7f1105d09640 1 --2- 172.21.15.102:0/880703099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f110006d570 0x7f11000caad0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f10f0009870 tx=0x7f10f002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3d68c1ce5ba6f1b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:30.223 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.220+0000 7f1105508640 1 -- 172.21.15.102:0/880703099 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f0031640 con 0x7f110006d570 2023-10-14T09:38:30.223 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.220+0000 7f1105508640 1 -- 172.21.15.102:0/880703099 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f00317a0 con 0x7f110006d570 2023-10-14T09:38:30.223 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.220+0000 7f1105508640 1 -- 172.21.15.102:0/880703099 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f0031b30 con 0x7f110006d570 2023-10-14T09:38:30.224 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.220+0000 7f110876e640 1 -- 172.21.15.102:0/880703099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f110006d570 msgr2=0x7f11000caad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:30.224 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.220+0000 7f110876e640 1 --2- 172.21.15.102:0/880703099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f110006d570 0x7f11000caad0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f10f0009870 tx=0x7f10f002b8f0 comp rx=0 tx=0).stop 2023-10-14T09:38:30.224 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.220+0000 7f110876e640 1 -- 172.21.15.102:0/880703099 shutdown_connections 2023-10-14T09:38:30.224 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.220+0000 7f110876e640 1 --2- 172.21.15.102:0/880703099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f110006d570 0x7f11000caad0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:30.224 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.220+0000 7f110876e640 1 --2- 172.21.15.102:0/880703099 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f110015ae10 0x7f11000ca590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:30.225 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.220+0000 7f110876e640 1 -- 172.21.15.102:0/880703099 >> 172.21.15.102:0/880703099 conn(0x7f11000ce840 msgr2=0x7f11000cec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:30.225 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.220+0000 7f110876e640 1 -- 172.21.15.102:0/880703099 shutdown_connections 2023-10-14T09:38:30.225 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.220+0000 7f110876e640 1 -- 172.21.15.102:0/880703099 wait complete. 2023-10-14T09:38:30.227 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.222+0000 7f110876e640 1 Processor -- start 2023-10-14T09:38:30.227 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.222+0000 7f110876e640 1 -- start start 2023-10-14T09:38:30.227 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.223+0000 7f110876e640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f110006d570 0x7f11000c2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:30.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.223+0000 7f110876e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f11000cf330 0x7f1100155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:30.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.223+0000 7f110876e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f110015ae10 0x7f1100158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:30.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.223+0000 7f110876e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11000c4a50 con 0x7f110015ae10 2023-10-14T09:38:30.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.223+0000 7f110876e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11000c3dd0 con 0x7f11000cf330 2023-10-14T09:38:30.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.223+0000 7f110876e640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11000c40b0 con 0x7f110006d570 2023-10-14T09:38:30.229 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.224+0000 7f1106d0b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f110015ae10 0x7f1100158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:30.229 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.224+0000 7f1106d0b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f110015ae10 0x7f1100158760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52568/0 (socket says 172.21.15.102:52568) 2023-10-14T09:38:30.229 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.224+0000 7f1106d0b640 1 -- 172.21.15.102:0/166669098 learned_addr learned my addr 172.21.15.102:0/166669098 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:30.229 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.224+0000 7f110650a640 1 --2- 172.21.15.102:0/166669098 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f110006d570 0x7f11000c2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:30.229 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.224+0000 7f1105d09640 1 --2- 172.21.15.102:0/166669098 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f11000cf330 0x7f1100155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:30.229 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.224+0000 7f1106d0b640 1 -- 172.21.15.102:0/166669098 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f110006d570 msgr2=0x7f11000c2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:30.230 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.224+0000 7f1106d0b640 1 --2- 172.21.15.102:0/166669098 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f110006d570 0x7f11000c2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:30.230 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.224+0000 7f1106d0b640 1 -- 172.21.15.102:0/166669098 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f11000cf330 msgr2=0x7f1100155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:30.230 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.224+0000 7f1106d0b640 1 --2- 172.21.15.102:0/166669098 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f11000cf330 0x7f1100155320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:30.230 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.224+0000 7f1106d0b640 1 -- 172.21.15.102:0/166669098 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f00094d0 con 0x7f110015ae10 2023-10-14T09:38:30.230 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.224+0000 7f1106d0b640 1 --2- 172.21.15.102:0/166669098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f110015ae10 0x7f1100158760 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f10f800b9e0 tx=0x7f10f800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:30.231 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.224+0000 7f10f6ffd640 1 -- 172.21.15.102:0/166669098 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f8003b70 con 0x7f110015ae10 2023-10-14T09:38:30.231 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.225+0000 7f10f6ffd640 1 -- 172.21.15.102:0/166669098 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f8003cd0 con 0x7f110015ae10 2023-10-14T09:38:30.231 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.225+0000 7f10f6ffd640 1 -- 172.21.15.102:0/166669098 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f800cae0 con 0x7f110015ae10 2023-10-14T09:38:30.231 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.225+0000 7f110876e640 1 -- 172.21.15.102:0/166669098 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11000c4390 con 0x7f110015ae10 2023-10-14T09:38:30.231 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.225+0000 7f110876e640 1 -- 172.21.15.102:0/166669098 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11000c33b0 con 0x7f110015ae10 2023-10-14T09:38:30.232 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.226+0000 7f110876e640 1 -- 172.21.15.102:0/166669098 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11000c4b90 con 0x7f110015ae10 2023-10-14T09:38:30.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.227+0000 7f10f6ffd640 1 -- 172.21.15.102:0/166669098 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f10f800cc40 con 0x7f110015ae10 2023-10-14T09:38:30.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.228+0000 7f10f6ffd640 1 --2- 172.21.15.102:0/166669098 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f10e406ae70 0x7f10e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:30.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.228+0000 7f10f6ffd640 1 -- 172.21.15.102:0/166669098 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5619+0+0 (secure 0 0 0) 0x7f10f80891d0 con 0x7f110015ae10 2023-10-14T09:38:30.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.228+0000 7f110650a640 1 --2- 172.21.15.102:0/166669098 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f10e406ae70 0x7f10e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:30.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.229+0000 7f110650a640 1 --2- 172.21.15.102:0/166669098 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f10e406ae70 0x7f10e406d330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f10fc006fd0 tx=0x7f10fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:30.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.233+0000 7f10f6ffd640 1 -- 172.21.15.102:0/166669098 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f11000c4b90 con 0x7f110015ae10 2023-10-14T09:38:30.450 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:30.448+0000 7f110876e640 1 -- 172.21.15.102:0/166669098 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "testcephfs1", "metadata": "testcephfs1_metadata", "data": "testcephfs1_data"} v 0) v1 -- 0x7f11000c4b90 con 0x7f110015ae10 2023-10-14T09:38:31.014 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.007+0000 7f10f6ffd640 1 -- 172.21.15.102:0/166669098 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "testcephfs1", "metadata": "testcephfs1_metadata", "data": "testcephfs1_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 187+0+0 (secure 0 0 0) 0x7f11000c4b90 con 0x7f110015ae10 2023-10-14T09:38:31.015 INFO:teuthology.orchestra.run.smithi102.stderr:new fs with metadata pool 4 and data pool 5 2023-10-14T09:38:31.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.017+0000 7f110876e640 1 -- 172.21.15.102:0/166669098 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f10e406ae70 msgr2=0x7f10e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:31.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.017+0000 7f110876e640 1 --2- 172.21.15.102:0/166669098 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f10e406ae70 0x7f10e406d330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f10fc006fd0 tx=0x7f10fc008040 comp rx=0 tx=0).stop 2023-10-14T09:38:31.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.017+0000 7f110876e640 1 -- 172.21.15.102:0/166669098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f110015ae10 msgr2=0x7f1100158760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:31.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.017+0000 7f110876e640 1 --2- 172.21.15.102:0/166669098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f110015ae10 0x7f1100158760 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f10f800b9e0 tx=0x7f10f800bea0 comp rx=0 tx=0).stop 2023-10-14T09:38:31.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.017+0000 7f110876e640 1 -- 172.21.15.102:0/166669098 shutdown_connections 2023-10-14T09:38:31.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.017+0000 7f110876e640 1 --2- 172.21.15.102:0/166669098 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f10e406ae70 0x7f10e406d330 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:31.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.017+0000 7f110876e640 1 --2- 172.21.15.102:0/166669098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f110015ae10 0x7f1100158760 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:31.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.017+0000 7f110876e640 1 --2- 172.21.15.102:0/166669098 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f11000cf330 0x7f1100155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:31.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.017+0000 7f110876e640 1 --2- 172.21.15.102:0/166669098 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f110006d570 0x7f11000c2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:31.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.017+0000 7f110876e640 1 -- 172.21.15.102:0/166669098 >> 172.21.15.102:0/166669098 conn(0x7f11000ce840 msgr2=0x7f11000ccb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:31.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.018+0000 7f110876e640 1 -- 172.21.15.102:0/166669098 shutdown_connections 2023-10-14T09:38:31.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.019+0000 7f110876e640 1 -- 172.21.15.102:0/166669098 wait complete. 2023-10-14T09:38:31.053 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:38:31.231 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.230+0000 7f861281a640 1 Processor -- start 2023-10-14T09:38:31.232 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.230+0000 7f861281a640 1 -- start start 2023-10-14T09:38:31.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.231+0000 7f861281a640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f860c0ce390 0x7f860c15e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:31.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.231+0000 7f861281a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f860c15ed60 con 0x7f860c15aaa0 2023-10-14T09:38:31.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.231+0000 7f861281a640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f860c0707e0 con 0x7f860c15ae80 2023-10-14T09:38:31.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.231+0000 7f861281a640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f860c06b810 con 0x7f860c0ce390 2023-10-14T09:38:31.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.232+0000 7f860bfff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f860c15aaa0 0x7f860c0cc560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:35248/0 (socket says 172.21.15.102:35248) 2023-10-14T09:38:31.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.232+0000 7f860bfff640 1 -- 172.21.15.102:0/1601569775 learned_addr learned my addr 172.21.15.102:0/1601569775 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:31.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.232+0000 7f860b7fe640 1 -- 172.21.15.102:0/1601569775 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 86095220 0 0) 0x7f860c15ed60 con 0x7f860c15aaa0 2023-10-14T09:38:31.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.232+0000 7f860b7fe640 1 -- 172.21.15.102:0/1601569775 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85f8003520 con 0x7f860c15aaa0 2023-10-14T09:38:31.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.232+0000 7f8610db7640 1 --2- 172.21.15.102:0/1601569775 >> v2:172.21.15.129:3300/0 conn(0x7f860c0ce390 0x7f860c15e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:31.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.232+0000 7f860b7fe640 1 -- 172.21.15.102:0/1601569775 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1525166489 0 0) 0x7f85f8003520 con 0x7f860c15aaa0 2023-10-14T09:38:31.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.232+0000 7f860b7fe640 1 -- 172.21.15.102:0/1601569775 >> v2:172.21.15.129:3300/0 conn(0x7f860c0ce390 msgr2=0x7f860c15e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:31.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.232+0000 7f860b7fe640 1 --2- 172.21.15.102:0/1601569775 >> v2:172.21.15.129:3300/0 conn(0x7f860c0ce390 0x7f860c15e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:31.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.232+0000 7f860b7fe640 1 -- 172.21.15.102:0/1601569775 >> v1:172.21.15.129:6789/0 conn(0x7f860c15ae80 legacy=0x7f860c070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:31.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.232+0000 7f860b7fe640 1 -- 172.21.15.102:0/1601569775 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860c15ef90 con 0x7f860c15aaa0 2023-10-14T09:38:31.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.232+0000 7f860b7fe640 1 -- 172.21.15.102:0/1601569775 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4030661168 0 0) 0x7f85fc001670 con 0x7f860c15aaa0 2023-10-14T09:38:31.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.232+0000 7f860b7fe640 1 -- 172.21.15.102:0/1601569775 >> v1:172.21.15.102:6789/0 conn(0x7f860c15aaa0 legacy=0x7f860c0cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:31.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.232+0000 7f860b7fe640 1 --2- 172.21.15.102:0/1601569775 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f80039c0 0x7f85f8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:31.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.232+0000 7f860b7fe640 1 --2- 172.21.15.102:0/1601569775 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f85f80047c0 0x7f85f8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:31.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.233+0000 7f860b7fe640 1 --2- 172.21.15.102:0/1601569775 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f85f80051d0 0x7f85f800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:31.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.233+0000 7f860b7fe640 1 -- 172.21.15.102:0/1601569775 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c06b810 con 0x7f85f80039c0 2023-10-14T09:38:31.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.233+0000 7f860b7fe640 1 -- 172.21.15.102:0/1601569775 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f800c100 con 0x7f85f80051d0 2023-10-14T09:38:31.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.233+0000 7f860b7fe640 1 -- 172.21.15.102:0/1601569775 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f800c2c0 con 0x7f85f80047c0 2023-10-14T09:38:31.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.233+0000 7f860bfff640 1 --2- 172.21.15.102:0/1601569775 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f80039c0 0x7f85f8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:31.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.233+0000 7f860bfff640 1 -- 172.21.15.102:0/1601569775 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f85f80047c0 msgr2=0x7f85f8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:31.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.233+0000 7f860bfff640 1 --2- 172.21.15.102:0/1601569775 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f85f80047c0 0x7f85f8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:31.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.233+0000 7f860bfff640 1 -- 172.21.15.102:0/1601569775 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f85f80051d0 msgr2=0x7f85f800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:31.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.233+0000 7f860bfff640 1 --2- 172.21.15.102:0/1601569775 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f85f80051d0 0x7f85f800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:31.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.233+0000 7f860bfff640 1 -- 172.21.15.102:0/1601569775 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f8003520 con 0x7f85f80039c0 2023-10-14T09:38:31.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.233+0000 7f8610db7640 1 -- 172.21.15.102:0/1601569775 reap_dead start 2023-10-14T09:38:31.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.234+0000 7f860bfff640 1 --2- 172.21.15.102:0/1601569775 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f80039c0 0x7f85f8003dc0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f85fc007fd0 tx=0x7f85f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec55c2ab336b8afc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:31.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.234+0000 7f860b7fe640 1 -- 172.21.15.102:0/1601569775 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85fc005ad0 con 0x7f85f80039c0 2023-10-14T09:38:31.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.234+0000 7f860b7fe640 1 -- 172.21.15.102:0/1601569775 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85fc005c30 con 0x7f85f80039c0 2023-10-14T09:38:31.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.234+0000 7f860b7fe640 1 -- 172.21.15.102:0/1601569775 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85fc02c7c0 con 0x7f85f80039c0 2023-10-14T09:38:31.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.235+0000 7f861281a640 1 -- 172.21.15.102:0/1601569775 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f80039c0 msgr2=0x7f85f8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:31.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.235+0000 7f861281a640 1 --2- 172.21.15.102:0/1601569775 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f80039c0 0x7f85f8003dc0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f85fc007fd0 tx=0x7f85f80057f0 comp rx=0 tx=0).stop 2023-10-14T09:38:31.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.235+0000 7f861281a640 1 -- 172.21.15.102:0/1601569775 shutdown_connections 2023-10-14T09:38:31.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.235+0000 7f861281a640 1 --2- 172.21.15.102:0/1601569775 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f80039c0 0x7f85f8003dc0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:31.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.235+0000 7f861281a640 1 -- 172.21.15.102:0/1601569775 >> 172.21.15.102:0/1601569775 conn(0x7f860c0cb410 msgr2=0x7f860c0cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:31.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.235+0000 7f861281a640 1 -- 172.21.15.102:0/1601569775 shutdown_connections 2023-10-14T09:38:31.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.235+0000 7f861281a640 1 -- 172.21.15.102:0/1601569775 wait complete. 2023-10-14T09:38:31.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.237+0000 7f861281a640 1 Processor -- start 2023-10-14T09:38:31.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.237+0000 7f861281a640 1 -- start start 2023-10-14T09:38:31.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.238+0000 7f861281a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f80039c0 0x7f860c0c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:31.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.238+0000 7f861281a640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f860c1f3790 0x7f860c1f54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:31.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.238+0000 7f861281a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f860c0c24c0 0x7f860c0b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:31.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.238+0000 7f861281a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c1f5a00 con 0x7f85f80039c0 2023-10-14T09:38:31.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.238+0000 7f861281a640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c0c3550 con 0x7f860c0c24c0 2023-10-14T09:38:31.247 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.238+0000 7f861281a640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860c1f3bd0 con 0x7f860c1f3790 2023-10-14T09:38:31.247 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.238+0000 7f860bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f80039c0 0x7f860c0c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:31.247 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.238+0000 7f860bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f80039c0 0x7f860c0c45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52576/0 (socket says 172.21.15.102:52576) 2023-10-14T09:38:31.247 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.238+0000 7f860bfff640 1 -- 172.21.15.102:0/1266770349 learned_addr learned my addr 172.21.15.102:0/1266770349 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:31.247 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.239+0000 7f86037fe640 1 --2- 172.21.15.102:0/1266770349 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f860c1f3790 0x7f860c1f54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:31.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.239+0000 7f860bfff640 1 -- 172.21.15.102:0/1266770349 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f860c1f3790 msgr2=0x7f860c1f54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:31.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.239+0000 7f860bfff640 1 --2- 172.21.15.102:0/1266770349 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f860c1f3790 0x7f860c1f54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:31.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.239+0000 7f860bfff640 1 -- 172.21.15.102:0/1266770349 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f860c0c24c0 msgr2=0x7f860c0b2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:31.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.239+0000 7f8610db7640 1 --2- 172.21.15.102:0/1266770349 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f860c0c24c0 0x7f860c0b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:31.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.239+0000 7f860bfff640 1 --2- 172.21.15.102:0/1266770349 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f860c0c24c0 0x7f860c0b2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:31.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.239+0000 7f860bfff640 1 -- 172.21.15.102:0/1266770349 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860c0c2cb0 con 0x7f85f80039c0 2023-10-14T09:38:31.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.239+0000 7f86037fe640 1 --2- 172.21.15.102:0/1266770349 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f860c1f3790 0x7f860c1f54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:31.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.239+0000 7f860bfff640 1 --2- 172.21.15.102:0/1266770349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f80039c0 0x7f860c0c45d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f85fc02c360 tx=0x7f860c15f830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:31.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.239+0000 7f86097fa640 1 -- 172.21.15.102:0/1266770349 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85fc03c070 con 0x7f85f80039c0 2023-10-14T09:38:31.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.239+0000 7f86097fa640 1 -- 172.21.15.102:0/1266770349 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85fc02c9d0 con 0x7f85f80039c0 2023-10-14T09:38:31.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.239+0000 7f861281a640 1 -- 172.21.15.102:0/1266770349 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f860c0c2f90 con 0x7f85f80039c0 2023-10-14T09:38:31.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.239+0000 7f86097fa640 1 -- 172.21.15.102:0/1266770349 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85fc02cd80 con 0x7f85f80039c0 2023-10-14T09:38:31.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.239+0000 7f861281a640 1 -- 172.21.15.102:0/1266770349 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f860c15b3c0 con 0x7f85f80039c0 2023-10-14T09:38:31.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.241+0000 7f861281a640 1 -- 172.21.15.102:0/1266770349 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f860c04e160 con 0x7f85f80039c0 2023-10-14T09:38:31.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.241+0000 7f86097fa640 1 -- 172.21.15.102:0/1266770349 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f85fc032070 con 0x7f85f80039c0 2023-10-14T09:38:31.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.243+0000 7f86097fa640 1 --2- 172.21.15.102:0/1266770349 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f85ec06aea0 0x7f85ec06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:31.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.243+0000 7f86097fa640 1 -- 172.21.15.102:0/1266770349 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f85fc0aa510 con 0x7f85f80039c0 2023-10-14T09:38:31.251 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.243+0000 7f86037fe640 1 --2- 172.21.15.102:0/1266770349 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f85ec06aea0 0x7f85ec06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:31.251 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.244+0000 7f86037fe640 1 --2- 172.21.15.102:0/1266770349 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f85ec06aea0 0x7f85ec06d360 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f860c0b04c0 tx=0x7f85f4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:31.251 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.247+0000 7f86097fa640 1 -- 172.21.15.102:0/1266770349 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f85fc075630 con 0x7f85f80039c0 2023-10-14T09:38:31.431 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.429+0000 7f861281a640 1 -- 172.21.15.102:0/1266770349 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f860c0cdc60 con 0x7f85f80039c0 2023-10-14T09:38:31.434 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.432+0000 7f86097fa640 1 -- 172.21.15.102:0/1266770349 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16638 (secure 0 0 0) 0x7f85fc078c50 con 0x7f85f80039c0 2023-10-14T09:38:31.435 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:38:31.435 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":35,"fsid":"8a6cd69d-7f5b-4f2a-806a-0176c10aed50","created":"2023-10-14T09:36:56.745172+0000","modified":"2023-10-14T09:38:30.450367+0000","last_up_change":"2023-10-14T09:37:09.791473+0000","last_in_change":"2023-10-14T09:37:00.547186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:37:09.952407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T09:38:28.133199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_data","create_time":"2023-10-14T09:38:29.466239+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e5aef8f3-878f-482b-b522-9a5b958b90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6801","nonce":1727250718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6803","nonce":1727250718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6807","nonce":1727250718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6805","nonce":1727250718}]},"public_addr":"172.21.15.102:6801/1727250718","cluster_addr":"172.21.15.102:6803/1727250718","heartbeat_back_addr":"172.21.15.102:6807/1727250718","heartbeat_front_addr":"172.21.15.102:6805/1727250718","state":["exists","up"]},{"osd":1,"uuid":"4a8cf50e-387b-4d47-9588-bd22e375a9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6809","nonce":1095651107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6811","nonce":1095651107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6815","nonce":1095651107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6813","nonce":1095651107}]},"public_addr":"172.21.15.102:6809/1095651107","cluster_addr":"172.21.15.102:6811/1095651107","heartbeat_back_addr":"172.21.15.102:6815/1095651107","heartbeat_front_addr":"172.21.15.102:6813/1095651107","state":["exists","up"]},{"osd":2,"uuid":"009ef55f-8a63-4219-bacd-d7c7b4500867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6820","nonce":2198222556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6825","nonce":2198222556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6831","nonce":2198222556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6829","nonce":2198222556}]},"public_addr":"172.21.15.102:6820/2198222556","cluster_addr":"172.21.15.102:6825/2198222556","heartbeat_back_addr":"172.21.15.102:6831/2198222556","heartbeat_front_addr":"172.21.15.102:6829/2198222556","state":["exists","up"]},{"osd":3,"uuid":"f2110eae-2ff9-4ed9-93d6-bd2361618211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6818","nonce":654726740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6821","nonce":654726740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6827","nonce":654726740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6823","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6824","nonce":654726740}]},"public_addr":"172.21.15.102:6818/654726740","cluster_addr":"172.21.15.102:6821/654726740","heartbeat_back_addr":"172.21.15.102:6827/654726740","heartbeat_front_addr":"172.21.15.102:6824/654726740","state":["exists","up"]},{"osd":4,"uuid":"33f1ae34-3100-40f7-9cb8-0eca2b358693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6817","nonce":507586170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6819","nonce":507586170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6823","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6825","nonce":507586170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6821","nonce":507586170}]},"public_addr":"172.21.15.129:6817/507586170","cluster_addr":"172.21.15.129:6819/507586170","heartbeat_back_addr":"172.21.15.129:6825/507586170","heartbeat_front_addr":"172.21.15.129:6821/507586170","state":["exists","up"]},{"osd":5,"uuid":"fab2fc62-3f3e-450d-93e0-770f39e80710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6801","nonce":1913451073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6803","nonce":1913451073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6807","nonce":1913451073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6805","nonce":1913451073}]},"public_addr":"172.21.15.129:6801/1913451073","cluster_addr":"172.21.15.129:6803/1913451073","heartbeat_back_addr":"172.21.15.129:6807/1913451073","heartbeat_front_addr":"172.21.15.129:6805/1913451073","state":["exists","up"]},{"osd":6,"uuid":"d7cc1d69-92e7-4253-a127-cfc0444a4809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6809","nonce":2853291511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6811","nonce":2853291511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6815","nonce":2853291511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6813","nonce":2853291511}]},"public_addr":"172.21.15.129:6809/2853291511","cluster_addr":"172.21.15.129:6811/2853291511","heartbeat_back_addr":"172.21.15.129:6815/2853291511","heartbeat_front_addr":"172.21.15.129:6813/2853291511","state":["exists","up"]},{"osd":7,"uuid":"1e403de1-09e2-4370-b9a7-e790ac44bbee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6824","nonce":2933886914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6827","nonce":2933886914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6831","nonce":2933886914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6829","nonce":2933886914}]},"public_addr":"172.21.15.129:6824/2933886914","cluster_addr":"172.21.15.129:6827/2933886914","heartbeat_back_addr":"172.21.15.129:6831/2933886914","heartbeat_front_addr":"172.21.15.129:6829/2933886914","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.849661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.868113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.933488+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.891794+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.901861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.858750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.911712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.996765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:38:31.437 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.435+0000 7f861281a640 1 -- 172.21.15.102:0/1266770349 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f85ec06aea0 msgr2=0x7f85ec06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:31.437 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.435+0000 7f861281a640 1 --2- 172.21.15.102:0/1266770349 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f85ec06aea0 0x7f85ec06d360 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f860c0b04c0 tx=0x7f85f4009040 comp rx=0 tx=0).stop 2023-10-14T09:38:31.437 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.435+0000 7f861281a640 1 -- 172.21.15.102:0/1266770349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f80039c0 msgr2=0x7f860c0c45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:31.438 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.435+0000 7f861281a640 1 --2- 172.21.15.102:0/1266770349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f80039c0 0x7f860c0c45d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f85fc02c360 tx=0x7f860c15f830 comp rx=0 tx=0).stop 2023-10-14T09:38:31.438 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.435+0000 7f861281a640 1 -- 172.21.15.102:0/1266770349 shutdown_connections 2023-10-14T09:38:31.438 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.435+0000 7f861281a640 1 --2- 172.21.15.102:0/1266770349 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f85ec06aea0 0x7f85ec06d360 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:31.438 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.435+0000 7f861281a640 1 --2- 172.21.15.102:0/1266770349 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f860c0c24c0 0x7f860c0b2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:31.439 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.435+0000 7f861281a640 1 --2- 172.21.15.102:0/1266770349 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f860c1f3790 0x7f860c1f54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:31.439 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.435+0000 7f861281a640 1 --2- 172.21.15.102:0/1266770349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f80039c0 0x7f860c0c45d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:31.439 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.435+0000 7f861281a640 1 -- 172.21.15.102:0/1266770349 >> 172.21.15.102:0/1266770349 conn(0x7f860c0cb410 msgr2=0x7f860c158800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:31.439 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.435+0000 7f861281a640 1 -- 172.21.15.102:0/1266770349 shutdown_connections 2023-10-14T09:38:31.439 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.435+0000 7f861281a640 1 -- 172.21.15.102:0/1266770349 wait complete. 2023-10-14T09:38:31.453 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:38:31.580 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T09:38:31.587 DEBUG:teuthology.orchestra.run.smithi129:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T09:38:31.658 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.657+0000 7f3e4836e640 1 Processor -- start 2023-10-14T09:38:31.659 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.657+0000 7f3e4836e640 1 -- start start 2023-10-14T09:38:31.660 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.658+0000 7f3e4836e640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f3e4015aaa0 0x7f3e4015e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:31.660 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.659+0000 7f3e4836e640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3e400ce390 0x7f3e40070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:31.661 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.659+0000 7f3e4836e640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e4015ed60 con 0x7f3e4015ae80 2023-10-14T09:38:31.661 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.659+0000 7f3e4836e640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e4006b810 con 0x7f3e4015aaa0 2023-10-14T09:38:31.661 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.659+0000 7f3e4836e640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e400707e0 con 0x7f3e400ce390 2023-10-14T09:38:31.662 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.659+0000 7f3e4610a640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f3e4015aaa0 0x7f3e4015e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:31.662 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.659+0000 7f3e4610a640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f3e4015aaa0 0x7f3e4015e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.102:53062/0 (socket says 172.21.15.102:53062) 2023-10-14T09:38:31.662 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.659+0000 7f3e4610a640 1 -- 172.21.15.102:0/1832218520 learned_addr learned my addr 172.21.15.102:0/1832218520 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:31.663 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.659+0000 7f3e4690b640 1 --2- 172.21.15.102:0/1832218520 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3e400ce390 0x7f3e40070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:31.663 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.660+0000 7f3e4610a640 1 -- 172.21.15.102:0/1832218520 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3e400ce390 msgr2=0x7f3e40070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:31.663 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.660+0000 7f3e4610a640 1 --2- 172.21.15.102:0/1832218520 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3e400ce390 0x7f3e40070f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:31.663 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.660+0000 7f3e4610a640 1 -- 172.21.15.102:0/1832218520 >> v1:172.21.15.129:6789/0 conn(0x7f3e4015ae80 legacy=0x7f3e400cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:31.663 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.660+0000 7f3e4610a640 1 -- 172.21.15.102:0/1832218520 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4015ef90 con 0x7f3e4015aaa0 2023-10-14T09:38:31.664 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.661+0000 7f3e4610a640 1 --2- 172.21.15.102:0/1832218520 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3e4015aaa0 0x7f3e4015e820 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c009870 tx=0x7f3e3c02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9705f965b691488 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:31.665 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.661+0000 7f3e45108640 1 -- 172.21.15.102:0/1832218520 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c030840 con 0x7f3e4015aaa0 2023-10-14T09:38:31.665 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.661+0000 7f3e45108640 1 -- 172.21.15.102:0/1832218520 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3c0309a0 con 0x7f3e4015aaa0 2023-10-14T09:38:31.665 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.661+0000 7f3e45108640 1 -- 172.21.15.102:0/1832218520 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c030d30 con 0x7f3e4015aaa0 2023-10-14T09:38:31.665 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.662+0000 7f3e4836e640 1 -- 172.21.15.102:0/1832218520 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3e4015aaa0 msgr2=0x7f3e4015e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:31.665 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.662+0000 7f3e4836e640 1 --2- 172.21.15.102:0/1832218520 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3e4015aaa0 0x7f3e4015e820 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c009870 tx=0x7f3e3c02b980 comp rx=0 tx=0).stop 2023-10-14T09:38:31.666 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.662+0000 7f3e4836e640 1 -- 172.21.15.102:0/1832218520 shutdown_connections 2023-10-14T09:38:31.666 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.662+0000 7f3e4836e640 1 --2- 172.21.15.102:0/1832218520 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3e400ce390 0x7f3e40070f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:31.666 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.662+0000 7f3e4836e640 1 --2- 172.21.15.102:0/1832218520 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3e4015aaa0 0x7f3e4015e820 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:31.666 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.662+0000 7f3e4836e640 1 -- 172.21.15.102:0/1832218520 >> 172.21.15.102:0/1832218520 conn(0x7f3e400cb410 msgr2=0x7f3e400cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:31.666 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.662+0000 7f3e4836e640 1 -- 172.21.15.102:0/1832218520 shutdown_connections 2023-10-14T09:38:31.667 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.662+0000 7f3e4836e640 1 -- 172.21.15.102:0/1832218520 wait complete. 2023-10-14T09:38:31.668 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.663+0000 7f3e4836e640 1 Processor -- start 2023-10-14T09:38:31.668 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.664+0000 7f3e4836e640 1 -- start start 2023-10-14T09:38:31.669 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.664+0000 7f3e4836e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3e400ce390 0x7f3e40155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:31.669 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.665+0000 7f3e4836e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e4015aaa0 0x7f3e400ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:31.669 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.665+0000 7f3e4836e640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3e4015ae80 0x7f3e400acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:31.669 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.665+0000 7f3e4836e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e401f3640 con 0x7f3e4015aaa0 2023-10-14T09:38:31.670 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.665+0000 7f3e4836e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e400c9160 con 0x7f3e400ce390 2023-10-14T09:38:31.670 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.665+0000 7f3e4836e640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e400c9440 con 0x7f3e4015ae80 2023-10-14T09:38:31.670 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.665+0000 7f3e45909640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e4015aaa0 0x7f3e400ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:31.670 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.665+0000 7f3e45909640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e4015aaa0 0x7f3e400ac890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52592/0 (socket says 172.21.15.102:52592) 2023-10-14T09:38:31.670 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.665+0000 7f3e45909640 1 -- 172.21.15.102:0/1342384063 learned_addr learned my addr 172.21.15.102:0/1342384063 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:31.670 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.665+0000 7f3e4610a640 1 --2- 172.21.15.102:0/1342384063 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3e400ce390 0x7f3e40155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:31.671 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.665+0000 7f3e4690b640 1 --2- 172.21.15.102:0/1342384063 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3e4015ae80 0x7f3e400acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:31.671 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.665+0000 7f3e45909640 1 -- 172.21.15.102:0/1342384063 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3e4015ae80 msgr2=0x7f3e400acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:31.671 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.665+0000 7f3e45909640 1 --2- 172.21.15.102:0/1342384063 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3e4015ae80 0x7f3e400acdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:31.671 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.665+0000 7f3e45909640 1 -- 172.21.15.102:0/1342384063 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3e400ce390 msgr2=0x7f3e40155f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:31.671 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.665+0000 7f3e45909640 1 --2- 172.21.15.102:0/1342384063 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3e400ce390 0x7f3e40155f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:31.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.665+0000 7f3e45909640 1 -- 172.21.15.102:0/1342384063 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3c0094d0 con 0x7f3e4015aaa0 2023-10-14T09:38:31.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.666+0000 7f3e45909640 1 --2- 172.21.15.102:0/1342384063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e4015aaa0 0x7f3e400ac890 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3e3000c3c0 tx=0x7f3e3000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:31.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.666+0000 7f3e36ffd640 1 -- 172.21.15.102:0/1342384063 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e300052d0 con 0x7f3e4015aaa0 2023-10-14T09:38:31.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.666+0000 7f3e36ffd640 1 -- 172.21.15.102:0/1342384063 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e30005430 con 0x7f3e4015aaa0 2023-10-14T09:38:31.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.666+0000 7f3e36ffd640 1 -- 172.21.15.102:0/1342384063 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e30003850 con 0x7f3e4015aaa0 2023-10-14T09:38:31.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.666+0000 7f3e4836e640 1 -- 172.21.15.102:0/1342384063 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e400c9720 con 0x7f3e4015aaa0 2023-10-14T09:38:31.673 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.666+0000 7f3e4836e640 1 -- 172.21.15.102:0/1342384063 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e401f2a80 con 0x7f3e4015aaa0 2023-10-14T09:38:31.674 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.667+0000 7f3e4836e640 1 -- 172.21.15.102:0/1342384063 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e4004e160 con 0x7f3e4015aaa0 2023-10-14T09:38:31.674 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.668+0000 7f3e36ffd640 1 -- 172.21.15.102:0/1342384063 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3e300039b0 con 0x7f3e4015aaa0 2023-10-14T09:38:31.674 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.670+0000 7f3e36ffd640 1 --2- 172.21.15.102:0/1342384063 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f3e2406ae70 0x7f3e2406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:31.674 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.670+0000 7f3e36ffd640 1 -- 172.21.15.102:0/1342384063 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f3e30088a40 con 0x7f3e4015aaa0 2023-10-14T09:38:31.674 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.670+0000 7f3e4610a640 1 --2- 172.21.15.102:0/1342384063 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f3e2406ae70 0x7f3e2406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:31.675 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.671+0000 7f3e4610a640 1 --2- 172.21.15.102:0/1342384063 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f3e2406ae70 0x7f3e2406d330 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c036000 tx=0x7f3e3c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:31.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.674+0000 7f3e36ffd640 1 -- 172.21.15.102:0/1342384063 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3e3008ae60 con 0x7f3e4015aaa0 2023-10-14T09:38:31.856 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.855+0000 7f3e4836e640 1 -- 172.21.15.102:0/1342384063 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e400cdc60 con 0x7f3e4015aaa0 2023-10-14T09:38:31.859 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.857+0000 7f3e36ffd640 1 -- 172.21.15.102:0/1342384063 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16638 (secure 0 0 0) 0x7f3e30017090 con 0x7f3e4015aaa0 2023-10-14T09:38:31.860 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:38:31.860 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":35,"fsid":"8a6cd69d-7f5b-4f2a-806a-0176c10aed50","created":"2023-10-14T09:36:56.745172+0000","modified":"2023-10-14T09:38:30.450367+0000","last_up_change":"2023-10-14T09:37:09.791473+0000","last_in_change":"2023-10-14T09:37:00.547186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:37:09.952407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T09:38:28.133199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_data","create_time":"2023-10-14T09:38:29.466239+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e5aef8f3-878f-482b-b522-9a5b958b90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6801","nonce":1727250718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6803","nonce":1727250718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6807","nonce":1727250718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6805","nonce":1727250718}]},"public_addr":"172.21.15.102:6801/1727250718","cluster_addr":"172.21.15.102:6803/1727250718","heartbeat_back_addr":"172.21.15.102:6807/1727250718","heartbeat_front_addr":"172.21.15.102:6805/1727250718","state":["exists","up"]},{"osd":1,"uuid":"4a8cf50e-387b-4d47-9588-bd22e375a9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6809","nonce":1095651107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6811","nonce":1095651107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6815","nonce":1095651107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6813","nonce":1095651107}]},"public_addr":"172.21.15.102:6809/1095651107","cluster_addr":"172.21.15.102:6811/1095651107","heartbeat_back_addr":"172.21.15.102:6815/1095651107","heartbeat_front_addr":"172.21.15.102:6813/1095651107","state":["exists","up"]},{"osd":2,"uuid":"009ef55f-8a63-4219-bacd-d7c7b4500867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6820","nonce":2198222556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6825","nonce":2198222556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6831","nonce":2198222556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6829","nonce":2198222556}]},"public_addr":"172.21.15.102:6820/2198222556","cluster_addr":"172.21.15.102:6825/2198222556","heartbeat_back_addr":"172.21.15.102:6831/2198222556","heartbeat_front_addr":"172.21.15.102:6829/2198222556","state":["exists","up"]},{"osd":3,"uuid":"f2110eae-2ff9-4ed9-93d6-bd2361618211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6818","nonce":654726740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6821","nonce":654726740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6827","nonce":654726740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6823","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6824","nonce":654726740}]},"public_addr":"172.21.15.102:6818/654726740","cluster_addr":"172.21.15.102:6821/654726740","heartbeat_back_addr":"172.21.15.102:6827/654726740","heartbeat_front_addr":"172.21.15.102:6824/654726740","state":["exists","up"]},{"osd":4,"uuid":"33f1ae34-3100-40f7-9cb8-0eca2b358693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6817","nonce":507586170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6819","nonce":507586170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6823","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6825","nonce":507586170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6821","nonce":507586170}]},"public_addr":"172.21.15.129:6817/507586170","cluster_addr":"172.21.15.129:6819/507586170","heartbeat_back_addr":"172.21.15.129:6825/507586170","heartbeat_front_addr":"172.21.15.129:6821/507586170","state":["exists","up"]},{"osd":5,"uuid":"fab2fc62-3f3e-450d-93e0-770f39e80710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6801","nonce":1913451073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6803","nonce":1913451073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6807","nonce":1913451073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6805","nonce":1913451073}]},"public_addr":"172.21.15.129:6801/1913451073","cluster_addr":"172.21.15.129:6803/1913451073","heartbeat_back_addr":"172.21.15.129:6807/1913451073","heartbeat_front_addr":"172.21.15.129:6805/1913451073","state":["exists","up"]},{"osd":6,"uuid":"d7cc1d69-92e7-4253-a127-cfc0444a4809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6809","nonce":2853291511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6811","nonce":2853291511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6815","nonce":2853291511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6813","nonce":2853291511}]},"public_addr":"172.21.15.129:6809/2853291511","cluster_addr":"172.21.15.129:6811/2853291511","heartbeat_back_addr":"172.21.15.129:6815/2853291511","heartbeat_front_addr":"172.21.15.129:6813/2853291511","state":["exists","up"]},{"osd":7,"uuid":"1e403de1-09e2-4370-b9a7-e790ac44bbee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6824","nonce":2933886914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6827","nonce":2933886914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6831","nonce":2933886914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6829","nonce":2933886914}]},"public_addr":"172.21.15.129:6824/2933886914","cluster_addr":"172.21.15.129:6827/2933886914","heartbeat_back_addr":"172.21.15.129:6831/2933886914","heartbeat_front_addr":"172.21.15.129:6829/2933886914","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.849661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.868113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.933488+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.891794+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.901861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.858750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.911712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.996765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:38:31.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.860+0000 7f3e4836e640 1 -- 172.21.15.102:0/1342384063 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f3e2406ae70 msgr2=0x7f3e2406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:31.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.860+0000 7f3e4836e640 1 --2- 172.21.15.102:0/1342384063 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f3e2406ae70 0x7f3e2406d330 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c036000 tx=0x7f3e3c008030 comp rx=0 tx=0).stop 2023-10-14T09:38:31.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.860+0000 7f3e4836e640 1 -- 172.21.15.102:0/1342384063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e4015aaa0 msgr2=0x7f3e400ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:31.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.860+0000 7f3e4836e640 1 --2- 172.21.15.102:0/1342384063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e4015aaa0 0x7f3e400ac890 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3e3000c3c0 tx=0x7f3e3000c880 comp rx=0 tx=0).stop 2023-10-14T09:38:31.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.860+0000 7f3e4836e640 1 -- 172.21.15.102:0/1342384063 shutdown_connections 2023-10-14T09:38:31.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.860+0000 7f3e4836e640 1 --2- 172.21.15.102:0/1342384063 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f3e2406ae70 0x7f3e2406d330 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:31.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.860+0000 7f3e4836e640 1 --2- 172.21.15.102:0/1342384063 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3e4015ae80 0x7f3e400acdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:31.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.860+0000 7f3e4836e640 1 --2- 172.21.15.102:0/1342384063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e4015aaa0 0x7f3e400ac890 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:31.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.860+0000 7f3e4836e640 1 --2- 172.21.15.102:0/1342384063 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3e400ce390 0x7f3e40155f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:31.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.860+0000 7f3e4836e640 1 -- 172.21.15.102:0/1342384063 >> 172.21.15.102:0/1342384063 conn(0x7f3e400cb410 msgr2=0x7f3e40159380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:31.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.860+0000 7f3e4836e640 1 -- 172.21.15.102:0/1342384063 shutdown_connections 2023-10-14T09:38:31.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:31.860+0000 7f3e4836e640 1 -- 172.21.15.102:0/1342384063 wait complete. 2023-10-14T09:38:31.880 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set testcephfs1 standby_count_wanted 0 2023-10-14T09:38:31.945 INFO:tasks.ceph.mds.b.smithi129.stderr:2023-10-14T09:38:31.943+0000 7f1ffa327640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T09:38:32.093 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.092+0000 7fa117316640 1 Processor -- start 2023-10-14T09:38:32.094 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.092+0000 7fa117316640 1 -- start start 2023-10-14T09:38:32.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.093+0000 7fa117316640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fa1100caac0 0x7fa1100ad4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:32.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.093+0000 7fa117316640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1100cb030 con 0x7fa11006a4b0 2023-10-14T09:38:32.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.093+0000 7fa117316640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1100c91c0 con 0x7fa11015ad70 2023-10-14T09:38:32.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.093+0000 7fa117316640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1100c94a0 con 0x7fa1100caac0 2023-10-14T09:38:32.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.094+0000 7fa1148b1640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fa11006a4b0 0x7fa1100ca3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55582/0 (socket says 172.21.15.102:55582) 2023-10-14T09:38:32.097 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.094+0000 7fa1148b1640 1 -- 172.21.15.102:0/3710941486 learned_addr learned my addr 172.21.15.102:0/3710941486 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:32.097 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.094+0000 7fa1158b3640 1 --2- 172.21.15.102:0/3710941486 >> v2:172.21.15.129:3300/0 conn(0x7fa1100caac0 0x7fa1100ad4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:32.097 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.094+0000 7fa103fff640 1 -- 172.21.15.102:0/3710941486 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3972935772 0 0) 0x7fa1100cb030 con 0x7fa11006a4b0 2023-10-14T09:38:32.097 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.094+0000 7fa103fff640 1 -- 172.21.15.102:0/3710941486 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0fc003520 con 0x7fa11006a4b0 2023-10-14T09:38:32.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.095+0000 7fa103fff640 1 -- 172.21.15.102:0/3710941486 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 863113621 0 0) 0x7fa0fc003520 con 0x7fa11006a4b0 2023-10-14T09:38:32.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.095+0000 7fa103fff640 1 -- 172.21.15.102:0/3710941486 >> v2:172.21.15.129:3300/0 conn(0x7fa1100caac0 msgr2=0x7fa1100ad4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:32.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.095+0000 7fa103fff640 1 --2- 172.21.15.102:0/3710941486 >> v2:172.21.15.129:3300/0 conn(0x7fa1100caac0 0x7fa1100ad4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:32.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.095+0000 7fa103fff640 1 -- 172.21.15.102:0/3710941486 >> v1:172.21.15.129:6789/0 conn(0x7fa11015ad70 legacy=0x7fa110069da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:32.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.095+0000 7fa103fff640 1 -- 172.21.15.102:0/3710941486 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1100c9780 con 0x7fa11006a4b0 2023-10-14T09:38:32.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.095+0000 7fa103fff640 1 -- 172.21.15.102:0/3710941486 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4030661168 0 0) 0x7fa104001670 con 0x7fa11006a4b0 2023-10-14T09:38:32.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.095+0000 7fa103fff640 1 -- 172.21.15.102:0/3710941486 >> v1:172.21.15.102:6789/0 conn(0x7fa11006a4b0 legacy=0x7fa1100ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:32.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.095+0000 7fa103fff640 1 --2- 172.21.15.102:0/3710941486 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa0fc0039c0 0x7fa0fc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:32.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.095+0000 7fa103fff640 1 --2- 172.21.15.102:0/3710941486 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa0fc0047c0 0x7fa0fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:32.102 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.095+0000 7fa103fff640 1 --2- 172.21.15.102:0/3710941486 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa0fc005180 0x7fa0fc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:32.102 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.095+0000 7fa103fff640 1 -- 172.21.15.102:0/3710941486 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1100c94a0 con 0x7fa0fc0047c0 2023-10-14T09:38:32.102 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.095+0000 7fa103fff640 1 -- 172.21.15.102:0/3710941486 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0fc00c080 con 0x7fa0fc005180 2023-10-14T09:38:32.102 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.095+0000 7fa103fff640 1 -- 172.21.15.102:0/3710941486 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0fc00c240 con 0x7fa0fc0039c0 2023-10-14T09:38:32.102 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.095+0000 7fa1148b1640 1 --2- 172.21.15.102:0/3710941486 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa0fc0047c0 0x7fa0fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:32.103 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.095+0000 7fa1158b3640 1 --2- 172.21.15.102:0/3710941486 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa0fc005180 0x7fa0fc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:32.103 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.095+0000 7fa1150b2640 1 --2- 172.21.15.102:0/3710941486 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa0fc0039c0 0x7fa0fc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:32.103 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.095+0000 7fa1148b1640 1 -- 172.21.15.102:0/3710941486 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa0fc0039c0 msgr2=0x7fa0fc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:32.103 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.096+0000 7fa1148b1640 1 --2- 172.21.15.102:0/3710941486 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa0fc0039c0 0x7fa0fc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:32.103 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.096+0000 7fa1148b1640 1 -- 172.21.15.102:0/3710941486 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa0fc005180 msgr2=0x7fa0fc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:32.104 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.096+0000 7fa1148b1640 1 --2- 172.21.15.102:0/3710941486 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa0fc005180 0x7fa0fc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:32.104 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.096+0000 7fa1148b1640 1 -- 172.21.15.102:0/3710941486 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0fc003520 con 0x7fa0fc0047c0 2023-10-14T09:38:32.104 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.096+0000 7fa1150b2640 1 --2- 172.21.15.102:0/3710941486 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa0fc0039c0 0x7fa0fc003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:32.104 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.096+0000 7fa1158b3640 1 --2- 172.21.15.102:0/3710941486 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa0fc005180 0x7fa0fc00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:32.104 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.096+0000 7fa1158b3640 1 -- 172.21.15.102:0/3710941486 reap_dead start 2023-10-14T09:38:32.105 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.097+0000 7fa1148b1640 1 --2- 172.21.15.102:0/3710941486 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa0fc0047c0 0x7fa0fc004c40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa10400c0e0 tx=0x7fa0fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4878021c5bfda52 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:32.105 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.097+0000 7fa103fff640 1 -- 172.21.15.102:0/3710941486 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa104005ad0 con 0x7fa0fc0047c0 2023-10-14T09:38:32.105 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.097+0000 7fa103fff640 1 -- 172.21.15.102:0/3710941486 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa104005c30 con 0x7fa0fc0047c0 2023-10-14T09:38:32.105 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.097+0000 7fa103fff640 1 -- 172.21.15.102:0/3710941486 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10402ca30 con 0x7fa0fc0047c0 2023-10-14T09:38:32.105 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.097+0000 7fa117316640 1 -- 172.21.15.102:0/3710941486 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa0fc0047c0 msgr2=0x7fa0fc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:32.105 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.097+0000 7fa117316640 1 --2- 172.21.15.102:0/3710941486 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa0fc0047c0 0x7fa0fc004c40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa10400c0e0 tx=0x7fa0fc0057f0 comp rx=0 tx=0).stop 2023-10-14T09:38:32.106 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.097+0000 7fa117316640 1 -- 172.21.15.102:0/3710941486 shutdown_connections 2023-10-14T09:38:32.106 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.097+0000 7fa117316640 1 --2- 172.21.15.102:0/3710941486 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa0fc0047c0 0x7fa0fc004c40 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:32.106 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.097+0000 7fa117316640 1 -- 172.21.15.102:0/3710941486 >> 172.21.15.102:0/3710941486 conn(0x7fa1100ce9b0 msgr2=0x7fa1100cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:32.106 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.097+0000 7fa117316640 1 -- 172.21.15.102:0/3710941486 shutdown_connections 2023-10-14T09:38:32.106 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.098+0000 7fa117316640 1 -- 172.21.15.102:0/3710941486 wait complete. 2023-10-14T09:38:32.109 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.099+0000 7fa117316640 1 Processor -- start 2023-10-14T09:38:32.109 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.099+0000 7fa117316640 1 -- start start 2023-10-14T09:38:32.109 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.100+0000 7fa117316640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa0fc0047c0 0x7fa1101f2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:32.110 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.100+0000 7fa117316640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1100c24a0 0x7fa1100c2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:32.110 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.100+0000 7fa117316640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa1100c4600 0x7fa1100c4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:32.110 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.100+0000 7fa117316640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1101557f0 con 0x7fa1100c24a0 2023-10-14T09:38:32.110 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.100+0000 7fa117316640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1100c4000 con 0x7fa1100c4600 2023-10-14T09:38:32.111 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.100+0000 7fa117316640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1100c4fc0 con 0x7fa0fc0047c0 2023-10-14T09:38:32.111 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.101+0000 7fa1148b1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1100c24a0 0x7fa1100c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:32.111 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.101+0000 7fa1148b1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1100c24a0 0x7fa1100c2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40848/0 (socket says 172.21.15.102:40848) 2023-10-14T09:38:32.111 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.101+0000 7fa1148b1640 1 -- 172.21.15.102:0/1904191217 learned_addr learned my addr 172.21.15.102:0/1904191217 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:32.111 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.101+0000 7fa1148b1640 1 -- 172.21.15.102:0/1904191217 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa0fc0047c0 msgr2=0x7fa1101f2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:32.112 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.101+0000 7fa1148b1640 1 --2- 172.21.15.102:0/1904191217 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa0fc0047c0 0x7fa1101f2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:32.112 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.101+0000 7fa1148b1640 1 -- 172.21.15.102:0/1904191217 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa1100c4600 msgr2=0x7fa1100c4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:32.112 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.101+0000 7fa1148b1640 1 --2- 172.21.15.102:0/1904191217 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa1100c4600 0x7fa1100c4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:32.112 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.101+0000 7fa1148b1640 1 -- 172.21.15.102:0/1904191217 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1100c2f60 con 0x7fa1100c24a0 2023-10-14T09:38:32.112 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.101+0000 7fa1148b1640 1 --2- 172.21.15.102:0/1904191217 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1100c24a0 0x7fa1100c2900 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa104000c00 tx=0x7fa10402e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:32.113 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.102+0000 7fa101ffb640 1 -- 172.21.15.102:0/1904191217 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10403c040 con 0x7fa1100c24a0 2023-10-14T09:38:32.113 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.102+0000 7fa101ffb640 1 -- 172.21.15.102:0/1904191217 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10402cce0 con 0x7fa1100c24a0 2023-10-14T09:38:32.113 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.102+0000 7fa117316640 1 -- 172.21.15.102:0/1904191217 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1100c3240 con 0x7fa1100c24a0 2023-10-14T09:38:32.113 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.102+0000 7fa101ffb640 1 -- 172.21.15.102:0/1904191217 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1040072b0 con 0x7fa1100c24a0 2023-10-14T09:38:32.113 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.102+0000 7fa117316640 1 -- 172.21.15.102:0/1904191217 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1100c3800 con 0x7fa1100c24a0 2023-10-14T09:38:32.114 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.103+0000 7fa117316640 1 -- 172.21.15.102:0/1904191217 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa11004e160 con 0x7fa1100c24a0 2023-10-14T09:38:32.114 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.104+0000 7fa101ffb640 1 -- 172.21.15.102:0/1904191217 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa104032070 con 0x7fa1100c24a0 2023-10-14T09:38:32.114 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.105+0000 7fa101ffb640 1 --2- 172.21.15.102:0/1904191217 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa0f406ae70 0x7fa0f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:32.114 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.105+0000 7fa101ffb640 1 -- 172.21.15.102:0/1904191217 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fa1040aa9d0 con 0x7fa1100c24a0 2023-10-14T09:38:32.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.105+0000 7fa1150b2640 1 --2- 172.21.15.102:0/1904191217 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa0f406ae70 0x7fa0f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:32.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.106+0000 7fa1150b2640 1 --2- 172.21.15.102:0/1904191217 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa0f406ae70 0x7fa0f406d330 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa110069740 tx=0x7fa10c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:32.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.109+0000 7fa101ffb640 1 -- 172.21.15.102:0/1904191217 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa104075a50 con 0x7fa1100c24a0 2023-10-14T09:38:32.341 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:32.339+0000 7fa117316640 1 -- 172.21.15.102:0/1904191217 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "testcephfs1", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa1100cb020 con 0x7fa1100c24a0 2023-10-14T09:38:33.015 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.013+0000 7fa101ffb640 1 -- 172.21.15.102:0/1904191217 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "testcephfs1", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 123+0+0 (secure 0 0 0) 0x7fa104079070 con 0x7fa1100c24a0 2023-10-14T09:38:33.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.017+0000 7fa117316640 1 -- 172.21.15.102:0/1904191217 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa0f406ae70 msgr2=0x7fa0f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:33.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.017+0000 7fa117316640 1 --2- 172.21.15.102:0/1904191217 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa0f406ae70 0x7fa0f406d330 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa110069740 tx=0x7fa10c009040 comp rx=0 tx=0).stop 2023-10-14T09:38:33.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.017+0000 7fa117316640 1 -- 172.21.15.102:0/1904191217 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1100c24a0 msgr2=0x7fa1100c2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:33.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.017+0000 7fa117316640 1 --2- 172.21.15.102:0/1904191217 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1100c24a0 0x7fa1100c2900 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa104000c00 tx=0x7fa10402e070 comp rx=0 tx=0).stop 2023-10-14T09:38:33.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.017+0000 7fa117316640 1 -- 172.21.15.102:0/1904191217 shutdown_connections 2023-10-14T09:38:33.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.017+0000 7fa117316640 1 --2- 172.21.15.102:0/1904191217 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa0f406ae70 0x7fa0f406d330 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:33.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.017+0000 7fa117316640 1 --2- 172.21.15.102:0/1904191217 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa1100c4600 0x7fa1100c4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:33.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.017+0000 7fa117316640 1 --2- 172.21.15.102:0/1904191217 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1100c24a0 0x7fa1100c2900 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:33.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.017+0000 7fa117316640 1 --2- 172.21.15.102:0/1904191217 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa0fc0047c0 0x7fa1101f2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:33.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.017+0000 7fa117316640 1 -- 172.21.15.102:0/1904191217 >> 172.21.15.102:0/1904191217 conn(0x7fa1100ce9b0 msgr2=0x7fa1100af950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:33.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.017+0000 7fa117316640 1 -- 172.21.15.102:0/1904191217 shutdown_connections 2023-10-14T09:38:33.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.017+0000 7fa117316640 1 -- 172.21.15.102:0/1904191217 wait complete. 2023-10-14T09:38:33.040 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-14T09:38:33.041 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set testcephfs1 allow_standby_replay false 2023-10-14T09:38:33.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.240+0000 7f2fd4739640 1 Processor -- start 2023-10-14T09:38:33.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.240+0000 7f2fd4739640 1 -- start start 2023-10-14T09:38:33.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.242+0000 7f2fd4739640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f2fcc06a4b0 0x7f2fcc0ca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:33.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.242+0000 7f2fd4739640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2fcc0c9ca0 0x7f2fcc0ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:33.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.242+0000 7f2fd4739640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fcc0cb030 con 0x7f2fcc15ad70 2023-10-14T09:38:33.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.242+0000 7f2fd4739640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fcc0cae30 con 0x7f2fcc0c9ca0 2023-10-14T09:38:33.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.242+0000 7f2fd4739640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fcc0c91c0 con 0x7f2fcc06a4b0 2023-10-14T09:38:33.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.242+0000 7f2fd24d5640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f2fcc15ad70 0x7f2fcc069da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55594/0 (socket says 172.21.15.102:55594) 2023-10-14T09:38:33.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.242+0000 7f2fd24d5640 1 -- 172.21.15.102:0/745279820 learned_addr learned my addr 172.21.15.102:0/745279820 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:33.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.242+0000 7f2fd2cd6640 1 --2- 172.21.15.102:0/745279820 >> v2:172.21.15.102:3300/0 conn(0x7f2fcc0c9ca0 0x7f2fcc0ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:33.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.242+0000 7f2fd1cd4640 1 --2- 172.21.15.102:0/745279820 >> v2:172.21.15.129:3300/0 conn(0x7f2fcc06a4b0 0x7f2fcc0ca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:33.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.243+0000 7f2fd2cd6640 1 -- 172.21.15.102:0/745279820 >> v2:172.21.15.129:3300/0 conn(0x7f2fcc06a4b0 msgr2=0x7f2fcc0ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:33.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.243+0000 7f2fd2cd6640 1 --2- 172.21.15.102:0/745279820 >> v2:172.21.15.129:3300/0 conn(0x7f2fcc06a4b0 0x7f2fcc0ca3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:33.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.243+0000 7f2fd2cd6640 1 -- 172.21.15.102:0/745279820 >> v1:172.21.15.102:6789/0 conn(0x7f2fcc15ad70 legacy=0x7f2fcc069da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:33.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.243+0000 7f2fd2cd6640 1 -- 172.21.15.102:0/745279820 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fcc0c94a0 con 0x7f2fcc0c9ca0 2023-10-14T09:38:33.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.244+0000 7f2fd2cd6640 1 --2- 172.21.15.102:0/745279820 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2fcc0c9ca0 0x7f2fcc0ca8f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc0ce870 tx=0x7f2fc402bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b78c5acc610bae14 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:33.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.244+0000 7f2fd14d3640 1 -- 172.21.15.102:0/745279820 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc402cc70 con 0x7f2fcc0c9ca0 2023-10-14T09:38:33.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.244+0000 7f2fd14d3640 1 -- 172.21.15.102:0/745279820 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc402cdd0 con 0x7f2fcc0c9ca0 2023-10-14T09:38:33.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.244+0000 7f2fd14d3640 1 -- 172.21.15.102:0/745279820 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc4034660 con 0x7f2fcc0c9ca0 2023-10-14T09:38:33.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.245+0000 7f2fd4739640 1 -- 172.21.15.102:0/745279820 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2fcc0c9ca0 msgr2=0x7f2fcc0ca8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:33.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.245+0000 7f2fd4739640 1 --2- 172.21.15.102:0/745279820 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2fcc0c9ca0 0x7f2fcc0ca8f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc0ce870 tx=0x7f2fc402bec0 comp rx=0 tx=0).stop 2023-10-14T09:38:33.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.245+0000 7f2fd4739640 1 -- 172.21.15.102:0/745279820 shutdown_connections 2023-10-14T09:38:33.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.245+0000 7f2fd4739640 1 --2- 172.21.15.102:0/745279820 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2fcc0c9ca0 0x7f2fcc0ca8f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:33.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.245+0000 7f2fd4739640 1 --2- 172.21.15.102:0/745279820 >> v2:172.21.15.129:3300/0 conn(0x7f2fcc06a4b0 0x7f2fcc0ca3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:33.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.245+0000 7f2fd4739640 1 -- 172.21.15.102:0/745279820 >> 172.21.15.102:0/745279820 conn(0x7f2fcc0ce9b0 msgr2=0x7f2fcc0cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:33.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.245+0000 7f2fd4739640 1 -- 172.21.15.102:0/745279820 shutdown_connections 2023-10-14T09:38:33.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.245+0000 7f2fd4739640 1 -- 172.21.15.102:0/745279820 wait complete. 2023-10-14T09:38:33.252 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.247+0000 7f2fd4739640 1 Processor -- start 2023-10-14T09:38:33.252 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.247+0000 7f2fd4739640 1 -- start start 2023-10-14T09:38:33.252 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.248+0000 7f2fd4739640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2fcc06a4b0 0x7f2fcc0b3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:33.253 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.248+0000 7f2fd4739640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2fcc0c9ca0 0x7f2fcc157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:33.253 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.248+0000 7f2fd4739640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2fcc15ad70 0x7f2fcc0ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:33.253 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.248+0000 7f2fd4739640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc1f2220 con 0x7f2fcc0c9ca0 2023-10-14T09:38:33.253 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.248+0000 7f2fd4739640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc0aee20 con 0x7f2fcc06a4b0 2023-10-14T09:38:33.253 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.248+0000 7f2fd4739640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc0af100 con 0x7f2fcc15ad70 2023-10-14T09:38:33.254 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.248+0000 7f2fd1cd4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2fcc0c9ca0 0x7f2fcc157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:33.254 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.248+0000 7f2fd1cd4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2fcc0c9ca0 0x7f2fcc157860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40864/0 (socket says 172.21.15.102:40864) 2023-10-14T09:38:33.254 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.248+0000 7f2fd1cd4640 1 -- 172.21.15.102:0/1585980587 learned_addr learned my addr 172.21.15.102:0/1585980587 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:33.254 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.249+0000 7f2fd24d5640 1 --2- 172.21.15.102:0/1585980587 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2fcc06a4b0 0x7f2fcc0b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:33.254 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.249+0000 7f2fd2cd6640 1 --2- 172.21.15.102:0/1585980587 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2fcc15ad70 0x7f2fcc0ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:33.254 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.249+0000 7f2fd1cd4640 1 -- 172.21.15.102:0/1585980587 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2fcc15ad70 msgr2=0x7f2fcc0ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:33.255 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.249+0000 7f2fd1cd4640 1 --2- 172.21.15.102:0/1585980587 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2fcc15ad70 0x7f2fcc0ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:33.255 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.249+0000 7f2fd1cd4640 1 -- 172.21.15.102:0/1585980587 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2fcc06a4b0 msgr2=0x7f2fcc0b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:33.255 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.249+0000 7f2fd1cd4640 1 --2- 172.21.15.102:0/1585980587 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2fcc06a4b0 0x7f2fcc0b3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:33.255 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.249+0000 7f2fd1cd4640 1 -- 172.21.15.102:0/1585980587 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc4009a70 con 0x7f2fcc0c9ca0 2023-10-14T09:38:33.255 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.249+0000 7f2fd1cd4640 1 --2- 172.21.15.102:0/1585980587 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2fcc0c9ca0 0x7f2fcc157860 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc00d800 tx=0x7f2fbc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:33.256 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.249+0000 7f2fc2ffd640 1 -- 172.21.15.102:0/1585980587 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc00b6c0 con 0x7f2fcc0c9ca0 2023-10-14T09:38:33.256 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.250+0000 7f2fc2ffd640 1 -- 172.21.15.102:0/1585980587 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fbc00b820 con 0x7f2fcc0c9ca0 2023-10-14T09:38:33.256 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.250+0000 7f2fc2ffd640 1 -- 172.21.15.102:0/1585980587 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc00bbb0 con 0x7f2fcc0c9ca0 2023-10-14T09:38:33.256 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.250+0000 7f2fd4739640 1 -- 172.21.15.102:0/1585980587 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fcc0cd130 con 0x7f2fcc0c9ca0 2023-10-14T09:38:33.256 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.250+0000 7f2fd4739640 1 -- 172.21.15.102:0/1585980587 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fcc0aea40 con 0x7f2fcc0c9ca0 2023-10-14T09:38:33.257 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.251+0000 7f2fd4739640 1 -- 172.21.15.102:0/1585980587 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fcc0cd2f0 con 0x7f2fcc0c9ca0 2023-10-14T09:38:33.258 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.252+0000 7f2fc2ffd640 1 -- 172.21.15.102:0/1585980587 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2fbc00bd10 con 0x7f2fcc0c9ca0 2023-10-14T09:38:33.258 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.253+0000 7f2fc2ffd640 1 --2- 172.21.15.102:0/1585980587 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2fb006ae70 0x7f2fb006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:33.258 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.253+0000 7f2fc2ffd640 1 -- 172.21.15.102:0/1585980587 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f2fbc089c70 con 0x7f2fcc0c9ca0 2023-10-14T09:38:33.258 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.253+0000 7f2fd24d5640 1 --2- 172.21.15.102:0/1585980587 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2fb006ae70 0x7f2fb006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:33.258 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.254+0000 7f2fd24d5640 1 --2- 172.21.15.102:0/1585980587 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2fb006ae70 0x7f2fb006d330 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8005880 tx=0x7f2fc8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:33.259 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.257+0000 7f2fc2ffd640 1 -- 172.21.15.102:0/1585980587 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2fbc054c60 con 0x7f2fcc0c9ca0 2023-10-14T09:38:33.483 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:33.481+0000 7f2fd4739640 1 -- 172.21.15.102:0/1585980587 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "testcephfs1", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2fcc0ccf90 con 0x7f2fcc0c9ca0 2023-10-14T09:38:34.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.025+0000 7f2fc2ffd640 1 -- 172.21.15.102:0/1585980587 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "testcephfs1", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 127+0+0 (secure 0 0 0) 0x7f2fcc0ccf90 con 0x7f2fcc0c9ca0 2023-10-14T09:38:34.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.029+0000 7f2fd4739640 1 -- 172.21.15.102:0/1585980587 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2fb006ae70 msgr2=0x7f2fb006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:34.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.029+0000 7f2fd4739640 1 --2- 172.21.15.102:0/1585980587 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2fb006ae70 0x7f2fb006d330 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8005880 tx=0x7f2fc8009040 comp rx=0 tx=0).stop 2023-10-14T09:38:34.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.029+0000 7f2fd4739640 1 -- 172.21.15.102:0/1585980587 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2fcc0c9ca0 msgr2=0x7f2fcc157860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:34.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.029+0000 7f2fd4739640 1 --2- 172.21.15.102:0/1585980587 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2fcc0c9ca0 0x7f2fcc157860 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc00d800 tx=0x7f2fbc00dcc0 comp rx=0 tx=0).stop 2023-10-14T09:38:34.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.029+0000 7f2fd4739640 1 -- 172.21.15.102:0/1585980587 shutdown_connections 2023-10-14T09:38:34.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.029+0000 7f2fd4739640 1 --2- 172.21.15.102:0/1585980587 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f2fb006ae70 0x7f2fb006d330 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:34.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.029+0000 7f2fd4739640 1 --2- 172.21.15.102:0/1585980587 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2fcc15ad70 0x7f2fcc0ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:34.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.029+0000 7f2fd4739640 1 --2- 172.21.15.102:0/1585980587 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2fcc0c9ca0 0x7f2fcc157860 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:34.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.029+0000 7f2fd4739640 1 --2- 172.21.15.102:0/1585980587 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2fcc06a4b0 0x7f2fcc0b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:34.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.029+0000 7f2fd4739640 1 -- 172.21.15.102:0/1585980587 >> 172.21.15.102:0/1585980587 conn(0x7f2fcc0ce9b0 msgr2=0x7f2fcc0afc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:34.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.029+0000 7f2fd4739640 1 -- 172.21.15.102:0/1585980587 shutdown_connections 2023-10-14T09:38:34.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.029+0000 7f2fd4739640 1 -- 172.21.15.102:0/1585980587 wait complete. 2023-10-14T09:38:34.055 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'testcephfs1' 2023-10-14T09:38:34.056 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:38:34.272 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.270+0000 7f6e21687640 1 Processor -- start 2023-10-14T09:38:34.272 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.270+0000 7f6e21687640 1 -- start start 2023-10-14T09:38:34.273 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.272+0000 7f6e21687640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6e1c06c3f0 0x7f6e1c06c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:34.274 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.272+0000 7f6e21687640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e1c0cd630 con 0x7f6e1c15e540 2023-10-14T09:38:34.274 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.272+0000 7f6e21687640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e1c0ce1b0 con 0x7f6e1c15e0c0 2023-10-14T09:38:34.274 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.272+0000 7f6e21687640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c06cd10 con 0x7f6e1c06c3f0 2023-10-14T09:38:34.274 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.272+0000 7f6e1b7fe640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f6e1c15e540 0x7f6e1c0b1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55610/0 (socket says 172.21.15.102:55610) 2023-10-14T09:38:34.275 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.272+0000 7f6e1b7fe640 1 -- 172.21.15.102:0/3158562041 learned_addr learned my addr 172.21.15.102:0/3158562041 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:34.277 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.272+0000 7f6e1affd640 1 --2- 172.21.15.102:0/3158562041 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6e1c06c3f0 0x7f6e1c06c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:34.277 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.272+0000 7f6e1a7fc640 1 -- 172.21.15.102:0/3158562041 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1113617849 0 0) 0x7f6e1c0cd630 con 0x7f6e1c15e540 2023-10-14T09:38:34.277 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.273+0000 7f6e1a7fc640 1 -- 172.21.15.102:0/3158562041 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e08003520 con 0x7f6e1c15e540 2023-10-14T09:38:34.277 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.273+0000 7f6e1a7fc640 1 -- 172.21.15.102:0/3158562041 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3515179593 0 0) 0x7f6e08003520 con 0x7f6e1c15e540 2023-10-14T09:38:34.278 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.273+0000 7f6e1a7fc640 1 -- 172.21.15.102:0/3158562041 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6e1c06c3f0 msgr2=0x7f6e1c06c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:34.278 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.273+0000 7f6e1a7fc640 1 --2- 172.21.15.102:0/3158562041 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6e1c06c3f0 0x7f6e1c06c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:34.278 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.273+0000 7f6e1a7fc640 1 -- 172.21.15.102:0/3158562041 >> v1:172.21.15.129:6789/0 conn(0x7f6e1c15e0c0 legacy=0x7f6e1c0b4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:34.278 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.273+0000 7f6e1a7fc640 1 -- 172.21.15.102:0/3158562041 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e1c0d2170 con 0x7f6e1c15e540 2023-10-14T09:38:34.278 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.273+0000 7f6e1a7fc640 1 -- 172.21.15.102:0/3158562041 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4030661168 0 0) 0x7f6e140019f0 con 0x7f6e1c15e540 2023-10-14T09:38:34.279 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.273+0000 7f6e1a7fc640 1 -- 172.21.15.102:0/3158562041 >> v1:172.21.15.102:6789/0 conn(0x7f6e1c15e540 legacy=0x7f6e1c0b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:34.279 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.273+0000 7f6e1a7fc640 1 --2- 172.21.15.102:0/3158562041 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6e1c06c3f0 0x7f6e080039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:34.279 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.273+0000 7f6e1a7fc640 1 --2- 172.21.15.102:0/3158562041 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e08003f70 0x7f6e080047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:34.279 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.273+0000 7f6e1a7fc640 1 --2- 172.21.15.102:0/3158562041 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6e08004d00 0x7f6e08005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:34.279 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.273+0000 7f6e1a7fc640 1 -- 172.21.15.102:0/3158562041 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c06cd10 con 0x7f6e08003f70 2023-10-14T09:38:34.280 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.273+0000 7f6e1a7fc640 1 -- 172.21.15.102:0/3158562041 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0800bac0 con 0x7f6e08004d00 2023-10-14T09:38:34.280 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.273+0000 7f6e1a7fc640 1 -- 172.21.15.102:0/3158562041 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0800bc80 con 0x7f6e1c06c3f0 2023-10-14T09:38:34.280 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.273+0000 7f6e13fff640 1 --2- 172.21.15.102:0/3158562041 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e08003f70 0x7f6e080047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:34.280 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.274+0000 7f6e13fff640 1 -- 172.21.15.102:0/3158562041 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6e1c06c3f0 msgr2=0x7f6e080039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:34.280 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.274+0000 7f6e13fff640 1 --2- 172.21.15.102:0/3158562041 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6e1c06c3f0 0x7f6e080039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:34.281 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.274+0000 7f6e13fff640 1 -- 172.21.15.102:0/3158562041 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6e08004d00 msgr2=0x7f6e08005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:34.281 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.274+0000 7f6e13fff640 1 --2- 172.21.15.102:0/3158562041 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6e08004d00 0x7f6e08005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:34.281 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.274+0000 7f6e13fff640 1 -- 172.21.15.102:0/3158562041 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e08003520 con 0x7f6e08003f70 2023-10-14T09:38:34.281 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.275+0000 7f6e13fff640 1 --2- 172.21.15.102:0/3158562041 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e08003f70 0x7f6e080047c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6e04001750 tx=0x7f6e080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e620a0053aa49b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:34.281 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.275+0000 7f6e1a7fc640 1 -- 172.21.15.102:0/3158562041 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e040052d0 con 0x7f6e08003f70 2023-10-14T09:38:34.282 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.275+0000 7f6e1a7fc640 1 -- 172.21.15.102:0/3158562041 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e0402e050 con 0x7f6e08003f70 2023-10-14T09:38:34.282 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.275+0000 7f6e1a7fc640 1 -- 172.21.15.102:0/3158562041 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e04003830 con 0x7f6e08003f70 2023-10-14T09:38:34.285 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.276+0000 7f6e21687640 1 -- 172.21.15.102:0/3158562041 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e08003f70 msgr2=0x7f6e080047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:34.285 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.276+0000 7f6e21687640 1 --2- 172.21.15.102:0/3158562041 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e08003f70 0x7f6e080047c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6e04001750 tx=0x7f6e080057f0 comp rx=0 tx=0).stop 2023-10-14T09:38:34.286 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.276+0000 7f6e1b7fe640 1 -- 172.21.15.102:0/3158562041 reap_dead start 2023-10-14T09:38:34.286 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.276+0000 7f6e21687640 1 -- 172.21.15.102:0/3158562041 shutdown_connections 2023-10-14T09:38:34.286 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.276+0000 7f6e21687640 1 -- 172.21.15.102:0/3158562041 >> 172.21.15.102:0/3158562041 conn(0x7f6e1c0d2cb0 msgr2=0x7f6e1c0d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:34.286 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.276+0000 7f6e21687640 1 -- 172.21.15.102:0/3158562041 shutdown_connections 2023-10-14T09:38:34.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.276+0000 7f6e21687640 1 -- 172.21.15.102:0/3158562041 wait complete. 2023-10-14T09:38:34.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.277+0000 7f6e21687640 1 Processor -- start 2023-10-14T09:38:34.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.278+0000 7f6e21687640 1 -- start start 2023-10-14T09:38:34.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.278+0000 7f6e21687640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6e08003f70 0x7f6e1c0cc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:34.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.278+0000 7f6e21687640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e1c1f2aa0 0x7f6e1c159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:34.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.278+0000 7f6e21687640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6e1c15a030 0x7f6e1c15a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:34.288 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.278+0000 7f6e21687640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c150fc0 con 0x7f6e1c1f2aa0 2023-10-14T09:38:34.288 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.278+0000 7f6e21687640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c158dc0 con 0x7f6e1c15a030 2023-10-14T09:38:34.288 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.278+0000 7f6e21687640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c0b8950 con 0x7f6e08003f70 2023-10-14T09:38:34.288 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.279+0000 7f6e13fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e1c1f2aa0 0x7f6e1c159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:34.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.279+0000 7f6e13fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e1c1f2aa0 0x7f6e1c159af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40894/0 (socket says 172.21.15.102:40894) 2023-10-14T09:38:34.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.279+0000 7f6e13fff640 1 -- 172.21.15.102:0/2997867387 learned_addr learned my addr 172.21.15.102:0/2997867387 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:34.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.279+0000 7f6e13fff640 1 -- 172.21.15.102:0/2997867387 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6e08003f70 msgr2=0x7f6e1c0cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:34.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.279+0000 7f6e1affd640 1 --2- 172.21.15.102:0/2997867387 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6e08003f70 0x7f6e1c0cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:34.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.279+0000 7f6e13fff640 1 --2- 172.21.15.102:0/2997867387 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6e08003f70 0x7f6e1c0cc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:34.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.279+0000 7f6e13fff640 1 -- 172.21.15.102:0/2997867387 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6e1c15a030 msgr2=0x7f6e1c15a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:34.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.279+0000 7f6e1b7fe640 1 --2- 172.21.15.102:0/2997867387 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6e1c15a030 0x7f6e1c15a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:34.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.279+0000 7f6e13fff640 1 --2- 172.21.15.102:0/2997867387 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6e1c15a030 0x7f6e1c15a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:34.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.279+0000 7f6e13fff640 1 -- 172.21.15.102:0/2997867387 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e1c159010 con 0x7f6e1c1f2aa0 2023-10-14T09:38:34.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.280+0000 7f6e13fff640 1 --2- 172.21.15.102:0/2997867387 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e1c1f2aa0 0x7f6e1c159af0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6e04008fd0 tx=0x7f6e04001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:34.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.280+0000 7f6e137fe640 1 -- 172.21.15.102:0/2997867387 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e04007a30 con 0x7f6e1c1f2aa0 2023-10-14T09:38:34.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.280+0000 7f6e137fe640 1 -- 172.21.15.102:0/2997867387 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e040069e0 con 0x7f6e1c1f2aa0 2023-10-14T09:38:34.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.280+0000 7f6e137fe640 1 -- 172.21.15.102:0/2997867387 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e04006d90 con 0x7f6e1c1f2aa0 2023-10-14T09:38:34.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.280+0000 7f6e21687640 1 -- 172.21.15.102:0/2997867387 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e1c1592f0 con 0x7f6e1c1f2aa0 2023-10-14T09:38:34.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.280+0000 7f6e21687640 1 -- 172.21.15.102:0/2997867387 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e1c15aa20 con 0x7f6e1c1f2aa0 2023-10-14T09:38:34.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.281+0000 7f6e21687640 1 -- 172.21.15.102:0/2997867387 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e1c04e160 con 0x7f6e1c1f2aa0 2023-10-14T09:38:34.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.282+0000 7f6e137fe640 1 -- 172.21.15.102:0/2997867387 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6e040035f0 con 0x7f6e1c1f2aa0 2023-10-14T09:38:34.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.283+0000 7f6e137fe640 1 --2- 172.21.15.102:0/2997867387 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f6dfc06ae70 0x7f6dfc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:34.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.283+0000 7f6e137fe640 1 -- 172.21.15.102:0/2997867387 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f6e040ab5b0 con 0x7f6e1c1f2aa0 2023-10-14T09:38:34.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.283+0000 7f6e1affd640 1 --2- 172.21.15.102:0/2997867387 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f6dfc06ae70 0x7f6dfc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:34.293 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.284+0000 7f6e1affd640 1 --2- 172.21.15.102:0/2997867387 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f6dfc06ae70 0x7f6dfc06d330 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c009970 tx=0x7f6e0c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:34.293 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.287+0000 7f6e137fe640 1 -- 172.21.15.102:0/2997867387 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6e04076760 con 0x7f6e1c1f2aa0 2023-10-14T09:38:34.518 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.513+0000 7f6e21687640 1 -- 172.21.15.102:0/2997867387 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e1c15b240 con 0x7f6e1c1f2aa0 2023-10-14T09:38:34.518 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.514+0000 7f6e137fe640 1 -- 172.21.15.102:0/2997867387 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4930 (secure 0 0 0) 0x7f6e04079d80 con 0x7f6e1c1f2aa0 2023-10-14T09:38:34.519 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:38:34.519 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4690,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6834/2498306399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":2498306399},{"type":"v1","addr":"172.21.15.129:6834","nonce":2498306399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5112,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1229082928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1229082928},{"type":"v1","addr":"172.21.15.102:6835","nonce":1229082928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5115,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2934809937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2934809937},{"type":"v1","addr":"172.21.15.102:6837","nonce":2934809937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T09:38:30.451239+0000","modified":"2023-10-14T09:38:33.483456+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5130":{"gid":5130,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.129:6835/4209319148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6833","nonce":4209319148},{"type":"v1","addr":"172.21.15.129:6835","nonce":4209319148}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T09:38:34.520 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 15 2023-10-14T09:38:34.520 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.517+0000 7f6e21687640 1 -- 172.21.15.102:0/2997867387 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f6dfc06ae70 msgr2=0x7f6dfc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:34.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.517+0000 7f6e21687640 1 --2- 172.21.15.102:0/2997867387 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f6dfc06ae70 0x7f6dfc06d330 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c009970 tx=0x7f6e0c008040 comp rx=0 tx=0).stop 2023-10-14T09:38:34.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.517+0000 7f6e21687640 1 -- 172.21.15.102:0/2997867387 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e1c1f2aa0 msgr2=0x7f6e1c159af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:34.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.517+0000 7f6e21687640 1 --2- 172.21.15.102:0/2997867387 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e1c1f2aa0 0x7f6e1c159af0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6e04008fd0 tx=0x7f6e04001120 comp rx=0 tx=0).stop 2023-10-14T09:38:34.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.517+0000 7f6e21687640 1 -- 172.21.15.102:0/2997867387 shutdown_connections 2023-10-14T09:38:34.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.517+0000 7f6e21687640 1 --2- 172.21.15.102:0/2997867387 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f6dfc06ae70 0x7f6dfc06d330 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:34.522 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.517+0000 7f6e21687640 1 --2- 172.21.15.102:0/2997867387 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6e1c15a030 0x7f6e1c15a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:34.522 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.517+0000 7f6e21687640 1 --2- 172.21.15.102:0/2997867387 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e1c1f2aa0 0x7f6e1c159af0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:34.522 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.517+0000 7f6e21687640 1 --2- 172.21.15.102:0/2997867387 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6e08003f70 0x7f6e1c0cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:34.522 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.517+0000 7f6e21687640 1 -- 172.21.15.102:0/2997867387 >> 172.21.15.102:0/2997867387 conn(0x7f6e1c0d2cb0 msgr2=0x7f6e1c1600a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:34.522 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.517+0000 7f6e21687640 1 -- 172.21.15.102:0/2997867387 shutdown_connections 2023-10-14T09:38:34.523 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.518+0000 7f6e21687640 1 -- 172.21.15.102:0/2997867387 wait complete. 2023-10-14T09:38:34.538 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:38:34.745 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.744+0000 7fe54e941640 1 Processor -- start 2023-10-14T09:38:34.745 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.744+0000 7fe54e941640 1 -- start start 2023-10-14T09:38:34.747 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.746+0000 7fe54e941640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe5480cd0c0 0x7fe5481615f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:34.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.746+0000 7fe54e941640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe54815e3e0 con 0x7fe54815db00 2023-10-14T09:38:34.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.746+0000 7fe54e941640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5480cd4a0 con 0x7fe5480b0410 2023-10-14T09:38:34.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.746+0000 7fe54e941640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe54815e100 con 0x7fe5480cd0c0 2023-10-14T09:38:34.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.746+0000 7fe547fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe5480cd0c0 0x7fe5481615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:34.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.746+0000 7fe54cede640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fe54815db00 0x7fe54806f550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55612/0 (socket says 172.21.15.102:55612) 2023-10-14T09:38:34.749 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.746+0000 7fe54cede640 1 -- 172.21.15.102:0/3989976804 learned_addr learned my addr 172.21.15.102:0/3989976804 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:34.749 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.746+0000 7fe547fff640 1 -- 172.21.15.102:0/3989976804 >> v1:172.21.15.129:6789/0 conn(0x7fe5480b0410 legacy=0x7fe54815d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:34.749 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.746+0000 7fe547fff640 1 -- 172.21.15.102:0/3989976804 >> v1:172.21.15.102:6789/0 conn(0x7fe54815db00 legacy=0x7fe54806f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:34.749 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.746+0000 7fe547fff640 1 -- 172.21.15.102:0/3989976804 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe548160b10 con 0x7fe5480cd0c0 2023-10-14T09:38:34.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.747+0000 7fe547fff640 1 --2- 172.21.15.102:0/3989976804 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5480cd0c0 0x7fe5481615f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe5380097a0 tx=0x7fe53802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a18e82da202a13ec server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:34.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.747+0000 7fe5477fe640 1 -- 172.21.15.102:0/3989976804 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53802e070 con 0x7fe5480cd0c0 2023-10-14T09:38:34.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.747+0000 7fe5477fe640 1 -- 172.21.15.102:0/3989976804 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5380315a0 con 0x7fe5480cd0c0 2023-10-14T09:38:34.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.747+0000 7fe5477fe640 1 -- 172.21.15.102:0/3989976804 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe538031930 con 0x7fe5480cd0c0 2023-10-14T09:38:34.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.748+0000 7fe54e941640 1 -- 172.21.15.102:0/3989976804 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5480cd0c0 msgr2=0x7fe5481615f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:34.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.748+0000 7fe54e941640 1 --2- 172.21.15.102:0/3989976804 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5480cd0c0 0x7fe5481615f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe5380097a0 tx=0x7fe53802b840 comp rx=0 tx=0).stop 2023-10-14T09:38:34.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.748+0000 7fe54e941640 1 -- 172.21.15.102:0/3989976804 shutdown_connections 2023-10-14T09:38:34.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.748+0000 7fe54e941640 1 --2- 172.21.15.102:0/3989976804 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5480cd0c0 0x7fe5481615f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:34.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.748+0000 7fe54e941640 1 -- 172.21.15.102:0/3989976804 >> 172.21.15.102:0/3989976804 conn(0x7fe5480cb410 msgr2=0x7fe5480cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:34.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.748+0000 7fe54e941640 1 -- 172.21.15.102:0/3989976804 shutdown_connections 2023-10-14T09:38:34.753 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.748+0000 7fe54e941640 1 -- 172.21.15.102:0/3989976804 wait complete. 2023-10-14T09:38:34.755 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.750+0000 7fe54e941640 1 Processor -- start 2023-10-14T09:38:34.755 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.750+0000 7fe54e941640 1 -- start start 2023-10-14T09:38:34.755 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.751+0000 7fe54e941640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe5480b0410 0x7fe5480c4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:34.756 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.751+0000 7fe54e941640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5480cd0c0 0x7fe548156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:34.756 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.751+0000 7fe54e941640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe54815db00 0x7fe5480b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:34.756 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.751+0000 7fe54e941640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5480c3390 con 0x7fe5480cd0c0 2023-10-14T09:38:34.756 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.751+0000 7fe54e941640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5480c3670 con 0x7fe54815db00 2023-10-14T09:38:34.756 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.751+0000 7fe54e941640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5480c3950 con 0x7fe5480b0410 2023-10-14T09:38:34.757 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.751+0000 7fe53ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5480cd0c0 0x7fe548156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:34.757 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.751+0000 7fe53ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5480cd0c0 0x7fe548156e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40920/0 (socket says 172.21.15.102:40920) 2023-10-14T09:38:34.757 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.751+0000 7fe53ffff640 1 -- 172.21.15.102:0/3252809919 learned_addr learned my addr 172.21.15.102:0/3252809919 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:34.757 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.751+0000 7fe547fff640 1 --2- 172.21.15.102:0/3252809919 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe5480b0410 0x7fe5480c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:34.757 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.751+0000 7fe54cede640 1 --2- 172.21.15.102:0/3252809919 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe54815db00 0x7fe5480b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:34.758 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.751+0000 7fe53ffff640 1 -- 172.21.15.102:0/3252809919 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe5480b0410 msgr2=0x7fe5480c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:34.758 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.751+0000 7fe53ffff640 1 --2- 172.21.15.102:0/3252809919 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe5480b0410 0x7fe5480c4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:34.758 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.751+0000 7fe53ffff640 1 -- 172.21.15.102:0/3252809919 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe54815db00 msgr2=0x7fe5480b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:34.758 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.751+0000 7fe53ffff640 1 --2- 172.21.15.102:0/3252809919 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe54815db00 0x7fe5480b1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:34.758 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.751+0000 7fe53ffff640 1 -- 172.21.15.102:0/3252809919 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe538009400 con 0x7fe5480cd0c0 2023-10-14T09:38:34.759 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.751+0000 7fe547fff640 1 --2- 172.21.15.102:0/3252809919 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe5480b0410 0x7fe5480c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:34.759 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.752+0000 7fe53ffff640 1 --2- 172.21.15.102:0/3252809919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5480cd0c0 0x7fe548156e40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe53000c430 tx=0x7fe53000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:34.759 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.752+0000 7fe5457fa640 1 -- 172.21.15.102:0/3252809919 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe530011790 con 0x7fe5480cd0c0 2023-10-14T09:38:34.759 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.752+0000 7fe5457fa640 1 -- 172.21.15.102:0/3252809919 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5300118f0 con 0x7fe5480cd0c0 2023-10-14T09:38:34.759 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.752+0000 7fe5457fa640 1 -- 172.21.15.102:0/3252809919 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe530011ce0 con 0x7fe5480cd0c0 2023-10-14T09:38:34.760 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.752+0000 7fe54e941640 1 -- 172.21.15.102:0/3252809919 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5480c3c30 con 0x7fe5480cd0c0 2023-10-14T09:38:34.760 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.752+0000 7fe54e941640 1 -- 172.21.15.102:0/3252809919 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe548157380 con 0x7fe5480cd0c0 2023-10-14T09:38:34.760 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.754+0000 7fe54e941640 1 -- 172.21.15.102:0/3252809919 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe54804e160 con 0x7fe5480cd0c0 2023-10-14T09:38:34.761 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.755+0000 7fe5457fa640 1 -- 172.21.15.102:0/3252809919 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe53001c460 con 0x7fe5480cd0c0 2023-10-14T09:38:34.761 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.755+0000 7fe5457fa640 1 --2- 172.21.15.102:0/3252809919 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe52806ae70 0x7fe52806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:34.761 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.756+0000 7fe5457fa640 1 -- 172.21.15.102:0/3252809919 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fe5300895f0 con 0x7fe5480cd0c0 2023-10-14T09:38:34.761 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.756+0000 7fe547fff640 1 --2- 172.21.15.102:0/3252809919 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe52806ae70 0x7fe52806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:34.761 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.756+0000 7fe547fff640 1 --2- 172.21.15.102:0/3252809919 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe52806ae70 0x7fe52806d330 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe538036000 tx=0x7fe53803d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:34.762 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.761+0000 7fe5457fa640 1 -- 172.21.15.102:0/3252809919 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe530054680 con 0x7fe5480cd0c0 2023-10-14T09:38:34.953 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.952+0000 7fe54e941640 1 -- 172.21.15.102:0/3252809919 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe54815bd30 con 0x7fe5480cd0c0 2023-10-14T09:38:34.955 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.954+0000 7fe5457fa640 1 -- 172.21.15.102:0/3252809919 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16625 (secure 0 0 0) 0x7fe530057ca0 con 0x7fe5480cd0c0 2023-10-14T09:38:34.956 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:38:34.956 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":36,"fsid":"8a6cd69d-7f5b-4f2a-806a-0176c10aed50","created":"2023-10-14T09:36:56.745172+0000","modified":"2023-10-14T09:38:32.007570+0000","last_up_change":"2023-10-14T09:37:09.791473+0000","last_in_change":"2023-10-14T09:37:00.547186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:37:09.952407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T09:38:28.133199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_data","create_time":"2023-10-14T09:38:29.466239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e5aef8f3-878f-482b-b522-9a5b958b90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6801","nonce":1727250718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6803","nonce":1727250718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6807","nonce":1727250718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6805","nonce":1727250718}]},"public_addr":"172.21.15.102:6801/1727250718","cluster_addr":"172.21.15.102:6803/1727250718","heartbeat_back_addr":"172.21.15.102:6807/1727250718","heartbeat_front_addr":"172.21.15.102:6805/1727250718","state":["exists","up"]},{"osd":1,"uuid":"4a8cf50e-387b-4d47-9588-bd22e375a9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6809","nonce":1095651107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6811","nonce":1095651107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6815","nonce":1095651107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6813","nonce":1095651107}]},"public_addr":"172.21.15.102:6809/1095651107","cluster_addr":"172.21.15.102:6811/1095651107","heartbeat_back_addr":"172.21.15.102:6815/1095651107","heartbeat_front_addr":"172.21.15.102:6813/1095651107","state":["exists","up"]},{"osd":2,"uuid":"009ef55f-8a63-4219-bacd-d7c7b4500867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6820","nonce":2198222556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6825","nonce":2198222556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6831","nonce":2198222556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6829","nonce":2198222556}]},"public_addr":"172.21.15.102:6820/2198222556","cluster_addr":"172.21.15.102:6825/2198222556","heartbeat_back_addr":"172.21.15.102:6831/2198222556","heartbeat_front_addr":"172.21.15.102:6829/2198222556","state":["exists","up"]},{"osd":3,"uuid":"f2110eae-2ff9-4ed9-93d6-bd2361618211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6818","nonce":654726740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6821","nonce":654726740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6827","nonce":654726740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6823","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6824","nonce":654726740}]},"public_addr":"172.21.15.102:6818/654726740","cluster_addr":"172.21.15.102:6821/654726740","heartbeat_back_addr":"172.21.15.102:6827/654726740","heartbeat_front_addr":"172.21.15.102:6824/654726740","state":["exists","up"]},{"osd":4,"uuid":"33f1ae34-3100-40f7-9cb8-0eca2b358693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6817","nonce":507586170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6819","nonce":507586170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6823","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6825","nonce":507586170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6821","nonce":507586170}]},"public_addr":"172.21.15.129:6817/507586170","cluster_addr":"172.21.15.129:6819/507586170","heartbeat_back_addr":"172.21.15.129:6825/507586170","heartbeat_front_addr":"172.21.15.129:6821/507586170","state":["exists","up"]},{"osd":5,"uuid":"fab2fc62-3f3e-450d-93e0-770f39e80710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6801","nonce":1913451073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6803","nonce":1913451073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6807","nonce":1913451073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6805","nonce":1913451073}]},"public_addr":"172.21.15.129:6801/1913451073","cluster_addr":"172.21.15.129:6803/1913451073","heartbeat_back_addr":"172.21.15.129:6807/1913451073","heartbeat_front_addr":"172.21.15.129:6805/1913451073","state":["exists","up"]},{"osd":6,"uuid":"d7cc1d69-92e7-4253-a127-cfc0444a4809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6809","nonce":2853291511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6811","nonce":2853291511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6815","nonce":2853291511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6813","nonce":2853291511}]},"public_addr":"172.21.15.129:6809/2853291511","cluster_addr":"172.21.15.129:6811/2853291511","heartbeat_back_addr":"172.21.15.129:6815/2853291511","heartbeat_front_addr":"172.21.15.129:6813/2853291511","state":["exists","up"]},{"osd":7,"uuid":"1e403de1-09e2-4370-b9a7-e790ac44bbee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6824","nonce":2933886914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6827","nonce":2933886914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6831","nonce":2933886914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6829","nonce":2933886914}]},"public_addr":"172.21.15.129:6824/2933886914","cluster_addr":"172.21.15.129:6827/2933886914","heartbeat_back_addr":"172.21.15.129:6831/2933886914","heartbeat_front_addr":"172.21.15.129:6829/2933886914","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.849661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.868113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.933488+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.891794+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.901861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.858750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.911712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.996765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:38:34.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.957+0000 7fe54e941640 1 -- 172.21.15.102:0/3252809919 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe52806ae70 msgr2=0x7fe52806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:34.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.957+0000 7fe54e941640 1 --2- 172.21.15.102:0/3252809919 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe52806ae70 0x7fe52806d330 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe538036000 tx=0x7fe53803d040 comp rx=0 tx=0).stop 2023-10-14T09:38:34.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.957+0000 7fe54e941640 1 -- 172.21.15.102:0/3252809919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5480cd0c0 msgr2=0x7fe548156e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:34.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.957+0000 7fe54e941640 1 --2- 172.21.15.102:0/3252809919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5480cd0c0 0x7fe548156e40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe53000c430 tx=0x7fe53000c8f0 comp rx=0 tx=0).stop 2023-10-14T09:38:34.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.958+0000 7fe54e941640 1 -- 172.21.15.102:0/3252809919 shutdown_connections 2023-10-14T09:38:34.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.958+0000 7fe54e941640 1 --2- 172.21.15.102:0/3252809919 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe52806ae70 0x7fe52806d330 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:34.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.958+0000 7fe54e941640 1 --2- 172.21.15.102:0/3252809919 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe54815db00 0x7fe5480b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:34.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.958+0000 7fe54e941640 1 --2- 172.21.15.102:0/3252809919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5480cd0c0 0x7fe548156e40 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:34.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.958+0000 7fe54e941640 1 --2- 172.21.15.102:0/3252809919 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe5480b0410 0x7fe5480c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:34.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.958+0000 7fe54e941640 1 -- 172.21.15.102:0/3252809919 >> 172.21.15.102:0/3252809919 conn(0x7fe5480cb410 msgr2=0x7fe54815d180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:34.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.958+0000 7fe54e941640 1 -- 172.21.15.102:0/3252809919 shutdown_connections 2023-10-14T09:38:34.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:34.958+0000 7fe54e941640 1 -- 172.21.15.102:0/3252809919 wait complete. 2023-10-14T09:38:34.978 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T09:38:34.979 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:38:35.194 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.193+0000 7f11d7002640 1 Processor -- start 2023-10-14T09:38:35.194 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.193+0000 7f11d7002640 1 -- start start 2023-10-14T09:38:35.196 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.194+0000 7f11d7002640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f11d00cd0c0 0x7f11d01615f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:35.196 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.194+0000 7f11d7002640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f11d00b0410 0x7f11d00b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:35.197 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.194+0000 7f11d7002640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11d015e3e0 con 0x7f11d015d3f0 2023-10-14T09:38:35.197 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.194+0000 7f11d7002640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11d00b0de0 con 0x7f11d00cd0c0 2023-10-14T09:38:35.197 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.194+0000 7f11d7002640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11d00cd4a0 con 0x7f11d00b0410 2023-10-14T09:38:35.197 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.195+0000 7f11d4d9e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f11d00cd0c0 0x7f11d01615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:35.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.195+0000 7f11d4d9e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f11d00cd0c0 0x7f11d01615f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40934/0 (socket says 172.21.15.102:40934) 2023-10-14T09:38:35.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.195+0000 7f11d4d9e640 1 -- 172.21.15.102:0/3330683964 learned_addr learned my addr 172.21.15.102:0/3330683964 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:35.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.195+0000 7f11cffff640 1 --2- 172.21.15.102:0/3330683964 >> v2:172.21.15.129:3300/0 conn(0x7f11d00b0410 0x7f11d00b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:35.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.195+0000 7f11d4d9e640 1 -- 172.21.15.102:0/3330683964 >> v2:172.21.15.129:3300/0 conn(0x7f11d00b0410 msgr2=0x7f11d00b08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:35.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.195+0000 7f11d4d9e640 1 --2- 172.21.15.102:0/3330683964 >> v2:172.21.15.129:3300/0 conn(0x7f11d00b0410 0x7f11d00b08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:35.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.196+0000 7f11d4d9e640 1 -- 172.21.15.102:0/3330683964 >> v1:172.21.15.129:6789/0 conn(0x7f11d015d3f0 legacy=0x7f11d015d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:35.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.196+0000 7f11d4d9e640 1 -- 172.21.15.102:0/3330683964 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d015e100 con 0x7f11d00cd0c0 2023-10-14T09:38:35.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.197+0000 7f11d4d9e640 1 --2- 172.21.15.102:0/3330683964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11d00cd0c0 0x7f11d01615f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f11d00cdad0 tx=0x7f11c402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2fa9d047acd7594 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:35.201 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.197+0000 7f11cf7fe640 1 -- 172.21.15.102:0/3330683964 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c40317e0 con 0x7f11d00cd0c0 2023-10-14T09:38:35.201 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.197+0000 7f11cf7fe640 1 -- 172.21.15.102:0/3330683964 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c4031940 con 0x7f11d00cd0c0 2023-10-14T09:38:35.201 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.197+0000 7f11cf7fe640 1 -- 172.21.15.102:0/3330683964 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c4031cd0 con 0x7f11d00cd0c0 2023-10-14T09:38:35.201 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.198+0000 7f11d7002640 1 -- 172.21.15.102:0/3330683964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11d00cd0c0 msgr2=0x7f11d01615f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:35.201 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.198+0000 7f11d7002640 1 --2- 172.21.15.102:0/3330683964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11d00cd0c0 0x7f11d01615f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f11d00cdad0 tx=0x7f11c402b880 comp rx=0 tx=0).stop 2023-10-14T09:38:35.202 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.198+0000 7f11d7002640 1 -- 172.21.15.102:0/3330683964 shutdown_connections 2023-10-14T09:38:35.202 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.198+0000 7f11d7002640 1 --2- 172.21.15.102:0/3330683964 >> v2:172.21.15.129:3300/0 conn(0x7f11d00b0410 0x7f11d00b08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:35.202 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.198+0000 7f11d7002640 1 --2- 172.21.15.102:0/3330683964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11d00cd0c0 0x7f11d01615f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:35.202 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.198+0000 7f11d7002640 1 -- 172.21.15.102:0/3330683964 >> 172.21.15.102:0/3330683964 conn(0x7f11d00cb410 msgr2=0x7f11d00cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:35.203 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.198+0000 7f11d7002640 1 -- 172.21.15.102:0/3330683964 shutdown_connections 2023-10-14T09:38:35.203 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.198+0000 7f11d7002640 1 -- 172.21.15.102:0/3330683964 wait complete. 2023-10-14T09:38:35.203 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.200+0000 7f11d7002640 1 Processor -- start 2023-10-14T09:38:35.203 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.200+0000 7f11d7002640 1 -- start start 2023-10-14T09:38:35.206 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.201+0000 7f11d7002640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f11d00b0410 0x7f11d0155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:35.206 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.201+0000 7f11d7002640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11d00cd0c0 0x7f11d00c5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:35.206 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.201+0000 7f11d7002640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f11d015d3f0 0x7f11d00c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:35.206 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.201+0000 7f11d7002640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d00c5370 con 0x7f11d00cd0c0 2023-10-14T09:38:35.207 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.201+0000 7f11d7002640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d00c6da0 con 0x7f11d00b0410 2023-10-14T09:38:35.207 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.201+0000 7f11d7002640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d00c47f0 con 0x7f11d015d3f0 2023-10-14T09:38:35.207 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.201+0000 7f11cffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11d00cd0c0 0x7f11d00c5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:35.207 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.201+0000 7f11cffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11d00cd0c0 0x7f11d00c5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40938/0 (socket says 172.21.15.102:40938) 2023-10-14T09:38:35.207 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.201+0000 7f11cffff640 1 -- 172.21.15.102:0/1033443193 learned_addr learned my addr 172.21.15.102:0/1033443193 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:35.208 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.202+0000 7f11cffff640 1 -- 172.21.15.102:0/1033443193 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f11d015d3f0 msgr2=0x7f11d00c5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:35.208 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.202+0000 7f11cffff640 1 --2- 172.21.15.102:0/1033443193 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f11d015d3f0 0x7f11d00c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:35.208 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.202+0000 7f11cffff640 1 -- 172.21.15.102:0/1033443193 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f11d00b0410 msgr2=0x7f11d0155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:35.208 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.202+0000 7f11d4d9e640 1 --2- 172.21.15.102:0/1033443193 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f11d00b0410 0x7f11d0155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:35.209 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.202+0000 7f11cffff640 1 --2- 172.21.15.102:0/1033443193 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f11d00b0410 0x7f11d0155d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:35.209 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.202+0000 7f11cffff640 1 -- 172.21.15.102:0/1033443193 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c40094d0 con 0x7f11d00cd0c0 2023-10-14T09:38:35.209 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.202+0000 7f11cffff640 1 --2- 172.21.15.102:0/1033443193 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11d00cd0c0 0x7f11d00c5a60 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00d5f0 tx=0x7f11bc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:35.209 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.202+0000 7f11cd7fa640 1 -- 172.21.15.102:0/1033443193 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc0125f0 con 0x7f11d00cd0c0 2023-10-14T09:38:35.209 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.202+0000 7f11cd7fa640 1 -- 172.21.15.102:0/1033443193 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11bc012750 con 0x7f11d00cd0c0 2023-10-14T09:38:35.210 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.202+0000 7f11cd7fa640 1 -- 172.21.15.102:0/1033443193 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc012b00 con 0x7f11d00cd0c0 2023-10-14T09:38:35.210 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.202+0000 7f11d7002640 1 -- 172.21.15.102:0/1033443193 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d00c4ad0 con 0x7f11d00cd0c0 2023-10-14T09:38:35.210 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.202+0000 7f11d7002640 1 -- 172.21.15.102:0/1033443193 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d00c5090 con 0x7f11d00cd0c0 2023-10-14T09:38:35.210 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.204+0000 7f11d7002640 1 -- 172.21.15.102:0/1033443193 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d004e160 con 0x7f11d00cd0c0 2023-10-14T09:38:35.210 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.205+0000 7f11cd7fa640 1 -- 172.21.15.102:0/1033443193 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f11bc012c60 con 0x7f11d00cd0c0 2023-10-14T09:38:35.211 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.205+0000 7f11cd7fa640 1 --2- 172.21.15.102:0/1033443193 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f11b406ae70 0x7f11b406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:35.212 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.206+0000 7f11cd7fa640 1 -- 172.21.15.102:0/1033443193 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f11bc089b20 con 0x7f11d00cd0c0 2023-10-14T09:38:35.212 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.206+0000 7f11d4d9e640 1 --2- 172.21.15.102:0/1033443193 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f11b406ae70 0x7f11b406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:35.212 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.207+0000 7f11d4d9e640 1 --2- 172.21.15.102:0/1033443193 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f11b406ae70 0x7f11b406d330 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f11c4036000 tx=0x7f11c403d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:35.212 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.210+0000 7f11cd7fa640 1 -- 172.21.15.102:0/1033443193 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f11bc054b50 con 0x7f11d00cd0c0 2023-10-14T09:38:35.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.395+0000 7f11d7002640 1 -- 172.21.15.102:0/1033443193 --> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f11d0160df0 con 0x7f11b406ae70 2023-10-14T09:38:35.422 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.421+0000 7f11cd7fa640 1 -- 172.21.15.102:0/1033443193 <== mgr.4104 v2:172.21.15.102:6832/1125265706 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274979 (secure 0 0 0) 0x7f11c4031bb0 con 0x7f11b406ae70 2023-10-14T09:38:35.425 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:38:35.427 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2023-10-14T09:38:35.429 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.427+0000 7f11d7002640 1 -- 172.21.15.102:0/1033443193 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f11b406ae70 msgr2=0x7f11b406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:35.429 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.427+0000 7f11d7002640 1 --2- 172.21.15.102:0/1033443193 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f11b406ae70 0x7f11b406d330 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f11c4036000 tx=0x7f11c403d040 comp rx=0 tx=0).stop 2023-10-14T09:38:35.430 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.427+0000 7f11d7002640 1 -- 172.21.15.102:0/1033443193 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11d00cd0c0 msgr2=0x7f11d00c5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:35.430 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.427+0000 7f11d7002640 1 --2- 172.21.15.102:0/1033443193 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11d00cd0c0 0x7f11d00c5a60 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00d5f0 tx=0x7f11bc00dab0 comp rx=0 tx=0).stop 2023-10-14T09:38:35.430 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.428+0000 7f11d7002640 1 -- 172.21.15.102:0/1033443193 shutdown_connections 2023-10-14T09:38:35.430 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.428+0000 7f11d7002640 1 --2- 172.21.15.102:0/1033443193 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f11b406ae70 0x7f11b406d330 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:35.430 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.428+0000 7f11d7002640 1 --2- 172.21.15.102:0/1033443193 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f11d015d3f0 0x7f11d00c5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:35.431 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.428+0000 7f11d7002640 1 --2- 172.21.15.102:0/1033443193 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11d00cd0c0 0x7f11d00c5a60 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:35.431 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.428+0000 7f11d7002640 1 --2- 172.21.15.102:0/1033443193 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f11d00b0410 0x7f11d0155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:35.431 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.428+0000 7f11d7002640 1 -- 172.21.15.102:0/1033443193 >> 172.21.15.102:0/1033443193 conn(0x7f11d00cb410 msgr2=0x7f11d0156d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:35.431 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.428+0000 7f11d7002640 1 -- 172.21.15.102:0/1033443193 shutdown_connections 2023-10-14T09:38:35.431 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.428+0000 7f11d7002640 1 -- 172.21.15.102:0/1033443193 wait complete. 2023-10-14T09:38:35.449 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2023-10-14T09:38:33.898400+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":52,"acting":52,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":220132,"kb_used_data":3972,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754588,"statfs":{"total":773094113280,"available":772868698112,"internally_reserved":0,"allocated":4067328,"data_stored":2275863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.917318"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-14T09:38:28.993576+0000","last_change":"2023-10-14T09:38:28.993576+0000","last_active":"2023-10-14T09:38:28.965497+0000","last_peered":"2023-10-14T09:38:28.965497+0000","last_clean":"2023-10-14T09:38:28.965497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:28.993576+0000","last_undegraded":"2023-10-14T09:38:28.993576+0000","last_fullsized":"2023-10-14T09:38:28.993576+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:28.965497+0000","last_change":"2023-10-14T09:38:28.965497+0000","last_active":"2023-10-14T09:38:28.965497+0000","last_peered":"2023-10-14T09:38:28.965497+0000","last_clean":"2023-10-14T09:38:28.965497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:28.965497+0000","last_undegraded":"2023-10-14T09:38:28.965497+0000","last_fullsized":"2023-10-14T09:38:28.965497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-14T09:38:28.990622+0000","last_change":"2023-10-14T09:38:28.990622+0000","last_active":"2023-10-14T09:38:28.965497+0000","last_peered":"2023-10-14T09:38:28.965497+0000","last_clean":"2023-10-14T09:38:28.965497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:28.990622+0000","last_undegraded":"2023-10-14T09:38:28.990622+0000","last_fullsized":"2023-10-14T09:38:28.990622+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-14T09:38:28.990369+0000","last_change":"2023-10-14T09:38:28.990369+0000","last_active":"2023-10-14T09:38:28.965497+0000","last_peered":"2023-10-14T09:38:28.965497+0000","last_clean":"2023-10-14T09:38:28.965497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:28.990369+0000","last_undegraded":"2023-10-14T09:38:28.990369+0000","last_fullsized":"2023-10-14T09:38:28.990369+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-14T09:38:29.001719+0000","last_change":"2023-10-14T09:38:29.001719+0000","last_active":"2023-10-14T09:38:28.965497+0000","last_peered":"2023-10-14T09:38:28.965497+0000","last_clean":"2023-10-14T09:38:28.965497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.001719+0000","last_undegraded":"2023-10-14T09:38:29.001719+0000","last_fullsized":"2023-10-14T09:38:29.001719+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-14T09:38:28.999043+0000","last_change":"2023-10-14T09:38:28.999043+0000","last_active":"2023-10-14T09:38:28.965497+0000","last_peered":"2023-10-14T09:38:28.965497+0000","last_clean":"2023-10-14T09:38:28.965497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:28.999043+0000","last_undegraded":"2023-10-14T09:38:28.999043+0000","last_fullsized":"2023-10-14T09:38:28.999043+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-14T09:38:28.990604+0000","last_change":"2023-10-14T09:38:28.990604+0000","last_active":"2023-10-14T09:38:28.965497+0000","last_peered":"2023-10-14T09:38:28.965497+0000","last_clean":"2023-10-14T09:38:28.965497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:28.990604+0000","last_undegraded":"2023-10-14T09:38:28.990604+0000","last_fullsized":"2023-10-14T09:38:28.990604+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-14T09:38:28.998997+0000","last_change":"2023-10-14T09:38:28.998997+0000","last_active":"2023-10-14T09:38:28.965497+0000","last_peered":"2023-10-14T09:38:28.965497+0000","last_clean":"2023-10-14T09:38:28.965497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:28.998997+0000","last_undegraded":"2023-10-14T09:38:28.998997+0000","last_fullsized":"2023-10-14T09:38:28.998997+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-14T09:38:28.991811+0000","last_change":"2023-10-14T09:38:28.991811+0000","last_active":"2023-10-14T09:38:28.965497+0000","last_peered":"2023-10-14T09:38:28.965497+0000","last_clean":"2023-10-14T09:38:28.965497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:28.991811+0000","last_undegraded":"2023-10-14T09:38:28.991811+0000","last_fullsized":"2023-10-14T09:38:28.991811+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:28.965497+0000","last_change":"2023-10-14T09:38:28.965497+0000","last_active":"2023-10-14T09:38:28.965497+0000","last_peered":"2023-10-14T09:38:28.965497+0000","last_clean":"2023-10-14T09:38:28.965497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:28.965497+0000","last_undegraded":"2023-10-14T09:38:28.965497+0000","last_fullsized":"2023-10-14T09:38:28.965497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:28.965497+0000","last_change":"2023-10-14T09:38:28.965497+0000","last_active":"2023-10-14T09:38:28.965497+0000","last_peered":"2023-10-14T09:38:28.965497+0000","last_clean":"2023-10-14T09:38:28.965497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:28.965497+0000","last_undegraded":"2023-10-14T09:38:28.965497+0000","last_fullsized":"2023-10-14T09:38:28.965497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-14T09:38:28.991125+0000","last_change":"2023-10-14T09:38:28.991125+0000","last_active":"2023-10-14T09:38:28.965497+0000","last_peered":"2023-10-14T09:38:28.965497+0000","last_clean":"2023-10-14T09:38:28.965497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:28.991125+0000","last_undegraded":"2023-10-14T09:38:28.991125+0000","last_fullsized":"2023-10-14T09:38:28.991125+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-14T09:38:28.999196+0000","last_change":"2023-10-14T09:38:28.999196+0000","last_active":"2023-10-14T09:38:28.965497+0000","last_peered":"2023-10-14T09:38:28.965497+0000","last_clean":"2023-10-14T09:38:28.965497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:28.999196+0000","last_undegraded":"2023-10-14T09:38:28.999196+0000","last_fullsized":"2023-10-14T09:38:28.999196+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-14T09:38:28.987759+0000","last_change":"2023-10-14T09:38:28.987759+0000","last_active":"2023-10-14T09:38:28.965497+0000","last_peered":"2023-10-14T09:38:28.965497+0000","last_clean":"2023-10-14T09:38:28.965497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:28.987759+0000","last_undegraded":"2023-10-14T09:38:28.987759+0000","last_fullsized":"2023-10-14T09:38:28.987759+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-14T09:38:28.991345+0000","last_change":"2023-10-14T09:38:28.991345+0000","last_active":"2023-10-14T09:38:28.965497+0000","last_peered":"2023-10-14T09:38:28.965497+0000","last_clean":"2023-10-14T09:38:28.965497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:28.991345+0000","last_undegraded":"2023-10-14T09:38:28.991345+0000","last_fullsized":"2023-10-14T09:38:28.991345+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-14T09:38:28.990791+0000","last_change":"2023-10-14T09:38:28.990791+0000","last_active":"2023-10-14T09:38:28.965497+0000","last_peered":"2023-10-14T09:38:28.965497+0000","last_clean":"2023-10-14T09:38:28.965497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:28.990791+0000","last_undegraded":"2023-10-14T09:38:28.990791+0000","last_fullsized":"2023-10-14T09:38:28.990791+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-14T09:38:28.986876+0000","last_change":"2023-10-14T09:38:28.986876+0000","last_active":"2023-10-14T09:38:28.965497+0000","last_peered":"2023-10-14T09:38:28.965497+0000","last_clean":"2023-10-14T09:38:28.965497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:28.986876+0000","last_undegraded":"2023-10-14T09:38:28.986876+0000","last_fullsized":"2023-10-14T09:38:28.986876+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-14T09:38:28.999347+0000","last_change":"2023-10-14T09:38:28.999347+0000","last_active":"2023-10-14T09:38:28.965497+0000","last_peered":"2023-10-14T09:38:28.965497+0000","last_clean":"2023-10-14T09:38:28.965497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:28.999347+0000","last_undegraded":"2023-10-14T09:38:28.999347+0000","last_fullsized":"2023-10-14T09:38:28.999347+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-14T09:38:28.999154+0000","last_change":"2023-10-14T09:38:28.999154+0000","last_active":"2023-10-14T09:38:28.965497+0000","last_peered":"2023-10-14T09:38:28.965497+0000","last_clean":"2023-10-14T09:38:28.965497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:28.999154+0000","last_undegraded":"2023-10-14T09:38:28.999154+0000","last_fullsized":"2023-10-14T09:38:28.999154+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-14T09:38:28.999224+0000","last_change":"2023-10-14T09:38:28.999224+0000","last_active":"2023-10-14T09:38:28.965497+0000","last_peered":"2023-10-14T09:38:28.965497+0000","last_clean":"2023-10-14T09:38:28.965497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:28.999224+0000","last_undegraded":"2023-10-14T09:38:28.999224+0000","last_fullsized":"2023-10-14T09:38:28.999224+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:28.965497+0000","last_change":"2023-10-14T09:38:28.965497+0000","last_active":"2023-10-14T09:38:28.965497+0000","last_peered":"2023-10-14T09:38:28.965497+0000","last_clean":"2023-10-14T09:38:28.965497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:28.965497+0000","last_undegraded":"2023-10-14T09:38:28.965497+0000","last_fullsized":"2023-10-14T09:38:28.965497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-14T09:38:28.993384+0000","last_change":"2023-10-14T09:38:28.993384+0000","last_active":"2023-10-14T09:38:28.965497+0000","last_peered":"2023-10-14T09:38:28.965497+0000","last_clean":"2023-10-14T09:38:28.965497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:28.993384+0000","last_undegraded":"2023-10-14T09:38:28.993384+0000","last_fullsized":"2023-10-14T09:38:28.993384+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-14T09:38:29.000807+0000","last_change":"2023-10-14T09:38:29.000807+0000","last_active":"2023-10-14T09:38:28.965497+0000","last_peered":"2023-10-14T09:38:28.965497+0000","last_clean":"2023-10-14T09:38:28.965497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.000807+0000","last_undegraded":"2023-10-14T09:38:29.000807+0000","last_fullsized":"2023-10-14T09:38:29.000807+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:28.965497+0000","last_change":"2023-10-14T09:38:28.965497+0000","last_active":"2023-10-14T09:38:28.965497+0000","last_peered":"2023-10-14T09:38:28.965497+0000","last_clean":"2023-10-14T09:38:28.965497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:28.965497+0000","last_undegraded":"2023-10-14T09:38:28.965497+0000","last_fullsized":"2023-10-14T09:38:28.965497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-14T09:38:28.986135+0000","last_change":"2023-10-14T09:38:28.986135+0000","last_active":"2023-10-14T09:38:28.965497+0000","last_peered":"2023-10-14T09:38:28.965497+0000","last_clean":"2023-10-14T09:38:28.965497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:28.986135+0000","last_undegraded":"2023-10-14T09:38:28.986135+0000","last_fullsized":"2023-10-14T09:38:28.986135+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:28.965497+0000","last_change":"2023-10-14T09:38:28.965497+0000","last_active":"2023-10-14T09:38:28.965497+0000","last_peered":"2023-10-14T09:38:28.965497+0000","last_clean":"2023-10-14T09:38:28.965497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:28.965497+0000","last_undegraded":"2023-10-14T09:38:28.965497+0000","last_fullsized":"2023-10-14T09:38:28.965497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-14T09:38:28.986135+0000","last_change":"2023-10-14T09:38:28.986135+0000","last_active":"2023-10-14T09:38:28.965497+0000","last_peered":"2023-10-14T09:38:28.965497+0000","last_clean":"2023-10-14T09:38:28.965497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:28.986135+0000","last_undegraded":"2023-10-14T09:38:28.986135+0000","last_fullsized":"2023-10-14T09:38:28.986135+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:28.965497+0000","last_change":"2023-10-14T09:38:28.965497+0000","last_active":"2023-10-14T09:38:28.965497+0000","last_peered":"2023-10-14T09:38:28.965497+0000","last_clean":"2023-10-14T09:38:28.965497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:28.965497+0000","last_undegraded":"2023-10-14T09:38:28.965497+0000","last_fullsized":"2023-10-14T09:38:28.965497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-14T09:38:28.986656+0000","last_change":"2023-10-14T09:38:28.986656+0000","last_active":"2023-10-14T09:38:28.965497+0000","last_peered":"2023-10-14T09:38:28.965497+0000","last_clean":"2023-10-14T09:38:28.965497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:28.986656+0000","last_undegraded":"2023-10-14T09:38:28.986656+0000","last_fullsized":"2023-10-14T09:38:28.986656+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-14T09:38:28.999075+0000","last_change":"2023-10-14T09:38:28.999075+0000","last_active":"2023-10-14T09:38:28.965497+0000","last_peered":"2023-10-14T09:38:28.965497+0000","last_clean":"2023-10-14T09:38:28.965497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:28.999075+0000","last_undegraded":"2023-10-14T09:38:28.999075+0000","last_fullsized":"2023-10-14T09:38:28.999075+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-14T09:38:28.991735+0000","last_change":"2023-10-14T09:38:28.991735+0000","last_active":"2023-10-14T09:38:28.965497+0000","last_peered":"2023-10-14T09:38:28.965497+0000","last_clean":"2023-10-14T09:38:28.965497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:28.991735+0000","last_undegraded":"2023-10-14T09:38:28.991735+0000","last_fullsized":"2023-10-14T09:38:28.991735+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T09:38:29.979593+0000","last_change":"2023-10-14T09:38:29.979593+0000","last_active":"2023-10-14T09:38:29.979593+0000","last_peered":"2023-10-14T09:38:29.979593+0000","last_clean":"2023-10-14T09:38:29.979593+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:29.979593+0000","last_undegraded":"2023-10-14T09:38:29.979593+0000","last_fullsized":"2023-10-14T09:38:29.979593+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-10-14T09:38:28.993587+0000","last_change":"2023-10-14T09:38:28.993587+0000","last_active":"2023-10-14T09:38:28.965497+0000","last_peered":"2023-10-14T09:38:28.965497+0000","last_clean":"2023-10-14T09:38:28.965497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T09:38:28.993587+0000","last_undegraded":"2023-10-14T09:38:28.993587+0000","last_fullsized":"2023-10-14T09:38:28.993587+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":174,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:38:23.414324+0000","last_change":"2023-10-14T09:37:12.368000+0000","last_active":"2023-10-14T09:38:23.414324+0000","last_peered":"2023-10-14T09:38:23.414324+0000","last_clean":"2023-10-14T09:38:23.414324+0000","last_became_active":"2023-10-14T09:37:12.364623+0000","last_became_peered":"2023-10-14T09:37:12.364623+0000","last_unstale":"2023-10-14T09:38:23.414324+0000","last_undegraded":"2023-10-14T09:38:23.414324+0000","last_fullsized":"2023-10-14T09:38:23.414324+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:10.796841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:10.796841+0000","last_clean_scrub_stamp":"2023-10-14T09:37:10.796841+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:48.940536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":50,"acting":50,"num_store_stats":5},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":958464,"data_stored":729444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.83399999999999996}]},{"osd":1,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.419}]},{"osd":2,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.5860000000000001},{"interface":"front","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":1.3340000000000001}]},{"osd":3,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.9060000000000001,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":1.1599999999999999}]},{"osd":4,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.4950000000000001}]},{"osd":5,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":3.0129999999999999,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.6080000000000001}]},{"osd":6,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.4260000000000002,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":1.7509999999999999},{"interface":"front","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.0710000000000002,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.6499999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":139076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.91100000000000003}]},{"osd":1,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.5009999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.4540000000000002,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.266}]},{"osd":3,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":4.5419999999999998,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":1.196},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":4.2839999999999998,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":0.78000000000000003}]},{"osd":4,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":1.034}]},{"osd":5,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.7069999999999999,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":1.6060000000000001}]},{"osd":7,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.347},{"interface":"front","average":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.5899999999999999,"5min":2.5899999999999999,"15min":2.5899999999999999},"last":1.141}]}]},{"osd":4,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":133249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":1.621,"5min":1.621,"15min":1.621},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":13.404,"5min":13.404,"15min":13.404},"last":1.121},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":9.4640000000000004,"5min":9.4640000000000004,"15min":9.4640000000000004},"last":1.077}]},{"osd":1,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":6.734,"5min":6.734,"15min":6.734},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.504,"5min":1.504,"15min":1.504},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":7.8860000000000001,"5min":7.8860000000000001,"15min":7.8860000000000001},"last":1.504}]},{"osd":2,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":1.591,"5min":1.591,"15min":1.591},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":7.8520000000000003,"5min":7.8520000000000003,"15min":7.8520000000000003},"last":1.637},{"interface":"front","average":{"1min":1.889,"5min":1.889,"15min":1.889},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":14.609,"5min":14.609,"15min":14.609},"last":1.357}]},{"osd":3,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":1.964,"5min":1.964,"15min":1.964},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":15.856,"5min":15.856,"15min":15.856},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":6.1970000000000001,"5min":6.1970000000000001,"15min":6.1970000000000001},"last":0.86099999999999999}]},{"osd":5,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":16.547000000000001,"5min":16.547000000000001,"15min":16.547000000000001},"last":1.7589999999999999},{"interface":"front","average":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":15.913,"5min":15.913,"15min":15.913},"last":1.4470000000000001}]},{"osd":6,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":2.3029999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":16.481999999999999,"5min":16.481999999999999,"15min":16.481999999999999},"last":1.7050000000000001},{"interface":"front","average":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":15.956,"5min":15.956,"15min":15.956},"last":1.5820000000000001}]},{"osd":7,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":6.6520000000000001,"5min":6.6520000000000001,"15min":6.6520000000000001},"last":1.405},{"interface":"front","average":{"1min":2.073,"5min":2.073,"15min":2.073},"min":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":10.314,"5min":10.314,"15min":10.314},"last":1.8109999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509459,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":139076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.497}]},{"osd":1,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.7349999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":0.58699999999999997}]},{"osd":2,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":2.77,"5min":2.77,"15min":2.77},"last":0.67100000000000004}]},{"osd":4,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":2.153,"5min":2.153,"15min":2.153},"last":1.0720000000000001}]},{"osd":5,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":3.6469999999999998,"5min":3.6469999999999998,"15min":3.6469999999999998},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.83899999999999997}]},{"osd":6,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.72699999999999998},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":3.6930000000000001,"5min":3.6930000000000001,"15min":3.6930000000000001},"last":1.1459999999999999}]},{"osd":7,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.4249999999999998,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":0.79000000000000004}]}]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":139076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.7789999999999999,"5min":2.7789999999999999,"15min":2.7789999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.432}]},{"osd":1,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.3490000000000002,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.34000000000000002}]},{"osd":3,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.4700000000000002,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.47599999999999998}]},{"osd":4,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.5960000000000001,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":3.1469999999999998,"5min":3.1469999999999998,"15min":3.1469999999999998},"last":0.92900000000000005}]},{"osd":5,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":4.0800000000000001,"5min":4.0800000000000001,"15min":4.0800000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":3.6709999999999998,"5min":3.6709999999999998,"15min":3.6709999999999998},"last":0.66700000000000004}]},{"osd":6,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.9249999999999998,"5min":2.9249999999999998,"15min":2.9249999999999998},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":3.081,"5min":3.081,"15min":3.081},"last":1.099}]},{"osd":7,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":5.0650000000000004,"5min":5.0650000000000004,"15min":5.0650000000000004},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":3.8849999999999998,"5min":3.8849999999999998,"15min":3.8849999999999998},"last":0.754}]}]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":139076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.376},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.52200000000000002}]},{"osd":2,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.34599999999999997}]},{"osd":3,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":3.1499999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.47599999999999998}]},{"osd":4,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":3.7320000000000002,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.997}]},{"osd":5,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":3.02,"5min":3.02,"15min":3.02},"last":1.048},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":3.827,"5min":3.827,"15min":3.827},"last":0.876}]},{"osd":6,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":3.3250000000000002,"5min":3.3250000000000002,"15min":3.3250000000000002},"last":0.79200000000000004}]},{"osd":7,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":3.9100000000000001,"5min":3.9100000000000001,"15min":3.9100000000000001},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":3.105,"5min":3.105,"15min":3.105},"last":0.93400000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542163,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":133249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.59799999999999998}]},{"osd":1,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.66100000000000003}]},{"osd":2,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":4.4610000000000003,"5min":4.4610000000000003,"15min":4.4610000000000003},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.82899999999999996}]},{"osd":3,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":1.008},{"interface":"front","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.198}]},{"osd":4,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.0509999999999999}]},{"osd":6,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":1.472}]},{"osd":7,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":2.387,"5min":2.387,"15min":2.387},"last":1.145},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.2769999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542163,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":946176,"data_stored":723617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":3.0750000000000002,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.2919999999999998,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.78300000000000003}]},{"osd":2,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":4.2210000000000001,"5min":4.2210000000000001,"15min":4.2210000000000001},"last":0.438}]},{"osd":3,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":3.6070000000000002,"5min":3.6070000000000002,"15min":3.6070000000000002},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.90000000000000002}]},{"osd":4,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":4.1609999999999996,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":2.391,"5min":2.391,"15min":2.391},"last":0.879}]},{"osd":5,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":3.8620000000000001,"5min":3.8620000000000001,"15min":3.8620000000000001},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":2.4220000000000002,"5min":2.4220000000000002,"15min":2.4220000000000002},"last":0.97999999999999998}]},{"osd":6,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":3.8210000000000002,"5min":3.8210000000000002,"15min":3.8210000000000002},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"min":{"1min":0.997,"5min":0.997,"15min":0.997},"max":{"1min":4.0999999999999996,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":0.91300000000000003}]},{"osd":7,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":1.581,"15min":1.581},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":4.1920000000000002,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":0.94799999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T09:38:35.455 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:38:35.708 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.707+0000 7fa4f80da640 1 Processor -- start 2023-10-14T09:38:35.708 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.707+0000 7fa4f80da640 1 -- start start 2023-10-14T09:38:35.710 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.709+0000 7fa4f80da640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa4f015ae80 0x7fa4f015e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:35.710 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.709+0000 7fa4f80da640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4f015ed60 con 0x7fa4f00ce390 2023-10-14T09:38:35.710 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.709+0000 7fa4f80da640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4f00707e0 con 0x7fa4f015aaa0 2023-10-14T09:38:35.711 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.709+0000 7fa4f80da640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4f006b810 con 0x7fa4f015ae80 2023-10-14T09:38:35.711 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.709+0000 7fa4f5675640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa4f015ae80 0x7fa4f015e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:35.711 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.709+0000 7fa4f6677640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fa4f00ce390 0x7fa4f0070f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55616/0 (socket says 172.21.15.102:55616) 2023-10-14T09:38:35.711 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.709+0000 7fa4f6677640 1 -- 172.21.15.102:0/1000761659 learned_addr learned my addr 172.21.15.102:0/1000761659 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:35.713 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.710+0000 7fa4f5675640 1 -- 172.21.15.102:0/1000761659 >> v1:172.21.15.129:6789/0 conn(0x7fa4f015aaa0 legacy=0x7fa4f00cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:35.713 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.710+0000 7fa4f5675640 1 -- 172.21.15.102:0/1000761659 >> v1:172.21.15.102:6789/0 conn(0x7fa4f00ce390 legacy=0x7fa4f0070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:35.713 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.710+0000 7fa4f5675640 1 -- 172.21.15.102:0/1000761659 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f015ef90 con 0x7fa4f015ae80 2023-10-14T09:38:35.713 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.711+0000 7fa4f5675640 1 --2- 172.21.15.102:0/1000761659 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4f015ae80 0x7fa4f015e820 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa4e00097a0 tx=0x7fa4e002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=886239d930011b2a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:35.713 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.711+0000 7fa4f4e74640 1 -- 172.21.15.102:0/1000761659 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e0031830 con 0x7fa4f015ae80 2023-10-14T09:38:35.714 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.711+0000 7fa4f4e74640 1 -- 172.21.15.102:0/1000761659 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e0031990 con 0x7fa4f015ae80 2023-10-14T09:38:35.714 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.711+0000 7fa4f4e74640 1 -- 172.21.15.102:0/1000761659 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e0031d20 con 0x7fa4f015ae80 2023-10-14T09:38:35.714 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.712+0000 7fa4f80da640 1 -- 172.21.15.102:0/1000761659 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4f015ae80 msgr2=0x7fa4f015e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:35.714 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.712+0000 7fa4f80da640 1 --2- 172.21.15.102:0/1000761659 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4f015ae80 0x7fa4f015e820 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa4e00097a0 tx=0x7fa4e002b8d0 comp rx=0 tx=0).stop 2023-10-14T09:38:35.714 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.712+0000 7fa4f80da640 1 -- 172.21.15.102:0/1000761659 shutdown_connections 2023-10-14T09:38:35.715 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.712+0000 7fa4f80da640 1 --2- 172.21.15.102:0/1000761659 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4f015ae80 0x7fa4f015e820 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:35.715 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.712+0000 7fa4f80da640 1 -- 172.21.15.102:0/1000761659 >> 172.21.15.102:0/1000761659 conn(0x7fa4f00cb410 msgr2=0x7fa4f00cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:35.715 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.712+0000 7fa4f80da640 1 -- 172.21.15.102:0/1000761659 shutdown_connections 2023-10-14T09:38:35.715 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.712+0000 7fa4f80da640 1 -- 172.21.15.102:0/1000761659 wait complete. 2023-10-14T09:38:35.717 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.714+0000 7fa4f80da640 1 Processor -- start 2023-10-14T09:38:35.717 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.714+0000 7fa4f80da640 1 -- start start 2023-10-14T09:38:35.718 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.715+0000 7fa4f80da640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa4f00ce390 0x7fa4f014dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:35.718 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.715+0000 7fa4f80da640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4f015aaa0 0x7fa4f00c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:35.718 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.715+0000 7fa4f80da640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa4f015ae80 0x7fa4f015d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:35.718 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.715+0000 7fa4f80da640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f01598a0 con 0x7fa4f015aaa0 2023-10-14T09:38:35.718 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.715+0000 7fa4f80da640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f0158c20 con 0x7fa4f015ae80 2023-10-14T09:38:35.719 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.715+0000 7fa4f80da640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f0158f00 con 0x7fa4f00ce390 2023-10-14T09:38:35.719 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.715+0000 7fa4f5675640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4f015aaa0 0x7fa4f00c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:35.719 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.715+0000 7fa4f5675640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4f015aaa0 0x7fa4f00c46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40958/0 (socket says 172.21.15.102:40958) 2023-10-14T09:38:35.719 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.715+0000 7fa4f5675640 1 -- 172.21.15.102:0/3249163653 learned_addr learned my addr 172.21.15.102:0/3249163653 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:35.719 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.715+0000 7fa4f6677640 1 --2- 172.21.15.102:0/3249163653 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa4f015ae80 0x7fa4f015d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:35.720 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.716+0000 7fa4f5675640 1 -- 172.21.15.102:0/3249163653 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa4f00ce390 msgr2=0x7fa4f014dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:35.720 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.716+0000 7fa4f5675640 1 --2- 172.21.15.102:0/3249163653 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa4f00ce390 0x7fa4f014dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:35.720 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.716+0000 7fa4f5675640 1 -- 172.21.15.102:0/3249163653 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa4f015ae80 msgr2=0x7fa4f015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:35.720 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.716+0000 7fa4f5675640 1 --2- 172.21.15.102:0/3249163653 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa4f015ae80 0x7fa4f015d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:35.720 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.716+0000 7fa4f5675640 1 -- 172.21.15.102:0/3249163653 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e0009400 con 0x7fa4f015aaa0 2023-10-14T09:38:35.720 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.716+0000 7fa4f5675640 1 --2- 172.21.15.102:0/3249163653 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4f015aaa0 0x7fa4f00c46e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0000c00 tx=0x7fa4e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:35.721 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.716+0000 7fa4e67fc640 1 -- 172.21.15.102:0/3249163653 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e003aa60 con 0x7fa4f015aaa0 2023-10-14T09:38:35.721 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.716+0000 7fa4e67fc640 1 -- 172.21.15.102:0/3249163653 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e003abc0 con 0x7fa4f015aaa0 2023-10-14T09:38:35.721 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.716+0000 7fa4e67fc640 1 -- 172.21.15.102:0/3249163653 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e00443f0 con 0x7fa4f015aaa0 2023-10-14T09:38:35.721 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.716+0000 7fa4f80da640 1 -- 172.21.15.102:0/3249163653 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4f01591e0 con 0x7fa4f015aaa0 2023-10-14T09:38:35.721 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.716+0000 7fa4f80da640 1 -- 172.21.15.102:0/3249163653 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4f014e130 con 0x7fa4f015aaa0 2023-10-14T09:38:35.722 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.717+0000 7fa4f80da640 1 -- 172.21.15.102:0/3249163653 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4f01599e0 con 0x7fa4f015aaa0 2023-10-14T09:38:35.723 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.718+0000 7fa4e67fc640 1 -- 172.21.15.102:0/3249163653 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa4e004d450 con 0x7fa4f015aaa0 2023-10-14T09:38:35.723 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.720+0000 7fa4e67fc640 1 --2- 172.21.15.102:0/3249163653 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa4d406ae70 0x7fa4d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:35.723 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.720+0000 7fa4e67fc640 1 -- 172.21.15.102:0/3249163653 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fa4e00ab870 con 0x7fa4f015aaa0 2023-10-14T09:38:35.723 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.720+0000 7fa4f5e76640 1 --2- 172.21.15.102:0/3249163653 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa4d406ae70 0x7fa4d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:35.723 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.721+0000 7fa4f5e76640 1 --2- 172.21.15.102:0/3249163653 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa4d406ae70 0x7fa4d406d330 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec003cc0 tx=0x7fa4ec0079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:35.725 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.724+0000 7fa4e67fc640 1 -- 172.21.15.102:0/3249163653 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa4f01599e0 con 0x7fa4f015aaa0 2023-10-14T09:38:35.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.913+0000 7fa4f80da640 1 -- 172.21.15.102:0/3249163653 --> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa4f015f550 con 0x7fa4d406ae70 2023-10-14T09:38:35.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.936+0000 7fa4e67fc640 1 -- 172.21.15.102:0/3249163653 <== mgr.4104 v2:172.21.15.102:6832/1125265706 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287419 (secure 0 0 0) 0x7fa4ec014400 con 0x7fa4d406ae70 2023-10-14T09:38:35.940 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:38:35.941 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2023-10-14T09:38:35.943 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.941+0000 7fa4f80da640 1 -- 172.21.15.102:0/3249163653 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa4d406ae70 msgr2=0x7fa4d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:35.943 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.941+0000 7fa4f80da640 1 --2- 172.21.15.102:0/3249163653 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa4d406ae70 0x7fa4d406d330 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec003cc0 tx=0x7fa4ec0079b0 comp rx=0 tx=0).stop 2023-10-14T09:38:35.943 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.941+0000 7fa4f80da640 1 -- 172.21.15.102:0/3249163653 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4f015aaa0 msgr2=0x7fa4f00c46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:35.944 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.941+0000 7fa4f80da640 1 --2- 172.21.15.102:0/3249163653 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4f015aaa0 0x7fa4f00c46e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0000c00 tx=0x7fa4e00046c0 comp rx=0 tx=0).stop 2023-10-14T09:38:35.944 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.941+0000 7fa4f80da640 1 -- 172.21.15.102:0/3249163653 shutdown_connections 2023-10-14T09:38:35.944 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.941+0000 7fa4f80da640 1 --2- 172.21.15.102:0/3249163653 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa4d406ae70 0x7fa4d406d330 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:35.944 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.941+0000 7fa4f80da640 1 --2- 172.21.15.102:0/3249163653 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa4f015ae80 0x7fa4f015d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:35.944 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.941+0000 7fa4f80da640 1 --2- 172.21.15.102:0/3249163653 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4f015aaa0 0x7fa4f00c46e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:35.944 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.941+0000 7fa4f80da640 1 --2- 172.21.15.102:0/3249163653 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa4f00ce390 0x7fa4f014dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:35.945 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.941+0000 7fa4f80da640 1 -- 172.21.15.102:0/3249163653 >> 172.21.15.102:0/3249163653 conn(0x7fa4f00cb410 msgr2=0x7fa4f00acaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:35.945 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.941+0000 7fa4f80da640 1 -- 172.21.15.102:0/3249163653 shutdown_connections 2023-10-14T09:38:35.945 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:35.941+0000 7fa4f80da640 1 -- 172.21.15.102:0/3249163653 wait complete. 2023-10-14T09:38:35.961 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2023-10-14T09:38:35.898976+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220536,"kb_used_data":4360,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754184,"statfs":{"total":773094113280,"available":772868284416,"internally_reserved":0,"allocated":4464640,"data_stored":2453460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001495"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.019582+0000","last_change":"2023-10-14T09:38:31.026111+0000","last_active":"2023-10-14T09:38:32.019582+0000","last_peered":"2023-10-14T09:38:32.019582+0000","last_clean":"2023-10-14T09:38:32.019582+0000","last_became_active":"2023-10-14T09:38:31.023780+0000","last_became_peered":"2023-10-14T09:38:31.023780+0000","last_unstale":"2023-10-14T09:38:32.019582+0000","last_undegraded":"2023-10-14T09:38:32.019582+0000","last_fullsized":"2023-10-14T09:38:32.019582+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:13:06.090004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344563+0000","last_change":"2023-10-14T09:38:31.028205+0000","last_active":"2023-10-14T09:38:32.344563+0000","last_peered":"2023-10-14T09:38:32.344563+0000","last_clean":"2023-10-14T09:38:32.344563+0000","last_became_active":"2023-10-14T09:38:31.027820+0000","last_became_peered":"2023-10-14T09:38:31.027820+0000","last_unstale":"2023-10-14T09:38:32.344563+0000","last_undegraded":"2023-10-14T09:38:32.344563+0000","last_fullsized":"2023-10-14T09:38:32.344563+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:30:53.824363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344137+0000","last_change":"2023-10-14T09:38:31.020589+0000","last_active":"2023-10-14T09:38:32.344137+0000","last_peered":"2023-10-14T09:38:32.344137+0000","last_clean":"2023-10-14T09:38:32.344137+0000","last_became_active":"2023-10-14T09:38:31.019892+0000","last_became_peered":"2023-10-14T09:38:31.019892+0000","last_unstale":"2023-10-14T09:38:32.344137+0000","last_undegraded":"2023-10-14T09:38:32.344137+0000","last_fullsized":"2023-10-14T09:38:32.344137+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:30:59.177841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344268+0000","last_change":"2023-10-14T09:38:31.035562+0000","last_active":"2023-10-14T09:38:32.344268+0000","last_peered":"2023-10-14T09:38:32.344268+0000","last_clean":"2023-10-14T09:38:32.344268+0000","last_became_active":"2023-10-14T09:38:31.035189+0000","last_became_peered":"2023-10-14T09:38:31.035189+0000","last_unstale":"2023-10-14T09:38:32.344268+0000","last_undegraded":"2023-10-14T09:38:32.344268+0000","last_fullsized":"2023-10-14T09:38:32.344268+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:46.045245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341193+0000","last_change":"2023-10-14T09:38:31.023485+0000","last_active":"2023-10-14T09:38:32.341193+0000","last_peered":"2023-10-14T09:38:32.341193+0000","last_clean":"2023-10-14T09:38:32.341193+0000","last_became_active":"2023-10-14T09:38:31.020777+0000","last_became_peered":"2023-10-14T09:38:31.020777+0000","last_unstale":"2023-10-14T09:38:32.341193+0000","last_undegraded":"2023-10-14T09:38:32.341193+0000","last_fullsized":"2023-10-14T09:38:32.341193+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:38:27.480319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342439+0000","last_change":"2023-10-14T09:38:31.028808+0000","last_active":"2023-10-14T09:38:32.342439+0000","last_peered":"2023-10-14T09:38:32.342439+0000","last_clean":"2023-10-14T09:38:32.342439+0000","last_became_active":"2023-10-14T09:38:31.027342+0000","last_became_peered":"2023-10-14T09:38:31.027342+0000","last_unstale":"2023-10-14T09:38:32.342439+0000","last_undegraded":"2023-10-14T09:38:32.342439+0000","last_fullsized":"2023-10-14T09:38:32.342439+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:41:28.301486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342132+0000","last_change":"2023-10-14T09:38:31.035347+0000","last_active":"2023-10-14T09:38:32.342132+0000","last_peered":"2023-10-14T09:38:32.342132+0000","last_clean":"2023-10-14T09:38:32.342132+0000","last_became_active":"2023-10-14T09:38:31.033760+0000","last_became_peered":"2023-10-14T09:38:31.033760+0000","last_unstale":"2023-10-14T09:38:32.342132+0000","last_undegraded":"2023-10-14T09:38:32.342132+0000","last_fullsized":"2023-10-14T09:38:32.342132+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:02:20.930526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341844+0000","last_change":"2023-10-14T09:38:31.024987+0000","last_active":"2023-10-14T09:38:32.341844+0000","last_peered":"2023-10-14T09:38:32.341844+0000","last_clean":"2023-10-14T09:38:32.341844+0000","last_became_active":"2023-10-14T09:38:31.024702+0000","last_became_peered":"2023-10-14T09:38:31.024702+0000","last_unstale":"2023-10-14T09:38:32.341844+0000","last_undegraded":"2023-10-14T09:38:32.341844+0000","last_fullsized":"2023-10-14T09:38:32.341844+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:23:43.555148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.019168+0000","last_change":"2023-10-14T09:38:31.024329+0000","last_active":"2023-10-14T09:38:32.019168+0000","last_peered":"2023-10-14T09:38:32.019168+0000","last_clean":"2023-10-14T09:38:32.019168+0000","last_became_active":"2023-10-14T09:38:31.023498+0000","last_became_peered":"2023-10-14T09:38:31.023498+0000","last_unstale":"2023-10-14T09:38:32.019168+0000","last_undegraded":"2023-10-14T09:38:32.019168+0000","last_fullsized":"2023-10-14T09:38:32.019168+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:46.045245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344549+0000","last_change":"2023-10-14T09:38:31.029616+0000","last_active":"2023-10-14T09:38:32.344549+0000","last_peered":"2023-10-14T09:38:32.344549+0000","last_clean":"2023-10-14T09:38:32.344549+0000","last_became_active":"2023-10-14T09:38:31.029268+0000","last_became_peered":"2023-10-14T09:38:31.029268+0000","last_unstale":"2023-10-14T09:38:32.344549+0000","last_undegraded":"2023-10-14T09:38:32.344549+0000","last_fullsized":"2023-10-14T09:38:32.344549+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:04:05.499565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343128+0000","last_change":"2023-10-14T09:38:31.035514+0000","last_active":"2023-10-14T09:38:32.343128+0000","last_peered":"2023-10-14T09:38:32.343128+0000","last_clean":"2023-10-14T09:38:32.343128+0000","last_became_active":"2023-10-14T09:38:31.033343+0000","last_became_peered":"2023-10-14T09:38:31.033343+0000","last_unstale":"2023-10-14T09:38:32.343128+0000","last_undegraded":"2023-10-14T09:38:32.343128+0000","last_fullsized":"2023-10-14T09:38:32.343128+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:55:53.322273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344359+0000","last_change":"2023-10-14T09:38:31.018326+0000","last_active":"2023-10-14T09:38:32.344359+0000","last_peered":"2023-10-14T09:38:32.344359+0000","last_clean":"2023-10-14T09:38:32.344359+0000","last_became_active":"2023-10-14T09:38:31.017971+0000","last_became_peered":"2023-10-14T09:38:31.017971+0000","last_unstale":"2023-10-14T09:38:32.344359+0000","last_undegraded":"2023-10-14T09:38:32.344359+0000","last_fullsized":"2023-10-14T09:38:32.344359+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:08.018148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341372+0000","last_change":"2023-10-14T09:38:31.019474+0000","last_active":"2023-10-14T09:38:32.341372+0000","last_peered":"2023-10-14T09:38:32.341372+0000","last_clean":"2023-10-14T09:38:32.341372+0000","last_became_active":"2023-10-14T09:38:31.019186+0000","last_became_peered":"2023-10-14T09:38:31.019186+0000","last_unstale":"2023-10-14T09:38:32.341372+0000","last_undegraded":"2023-10-14T09:38:32.341372+0000","last_fullsized":"2023-10-14T09:38:32.341372+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:36:21.378536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342644+0000","last_change":"2023-10-14T09:38:31.020718+0000","last_active":"2023-10-14T09:38:32.342644+0000","last_peered":"2023-10-14T09:38:32.342644+0000","last_clean":"2023-10-14T09:38:32.342644+0000","last_became_active":"2023-10-14T09:38:31.020409+0000","last_became_peered":"2023-10-14T09:38:31.020409+0000","last_unstale":"2023-10-14T09:38:32.342644+0000","last_undegraded":"2023-10-14T09:38:32.342644+0000","last_fullsized":"2023-10-14T09:38:32.342644+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:43:03.012824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342558+0000","last_change":"2023-10-14T09:38:31.025489+0000","last_active":"2023-10-14T09:38:32.342558+0000","last_peered":"2023-10-14T09:38:32.342558+0000","last_clean":"2023-10-14T09:38:32.342558+0000","last_became_active":"2023-10-14T09:38:31.025155+0000","last_became_peered":"2023-10-14T09:38:31.025155+0000","last_unstale":"2023-10-14T09:38:32.342558+0000","last_undegraded":"2023-10-14T09:38:32.342558+0000","last_fullsized":"2023-10-14T09:38:32.342558+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:14:59.816409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342426+0000","last_change":"2023-10-14T09:38:31.034136+0000","last_active":"2023-10-14T09:38:32.342426+0000","last_peered":"2023-10-14T09:38:32.342426+0000","last_clean":"2023-10-14T09:38:32.342426+0000","last_became_active":"2023-10-14T09:38:31.033869+0000","last_became_peered":"2023-10-14T09:38:31.033869+0000","last_unstale":"2023-10-14T09:38:32.342426+0000","last_undegraded":"2023-10-14T09:38:32.342426+0000","last_fullsized":"2023-10-14T09:38:32.342426+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:44.513959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343361+0000","last_change":"2023-10-14T09:38:31.030416+0000","last_active":"2023-10-14T09:38:32.343361+0000","last_peered":"2023-10-14T09:38:32.343361+0000","last_clean":"2023-10-14T09:38:32.343361+0000","last_became_active":"2023-10-14T09:38:31.029457+0000","last_became_peered":"2023-10-14T09:38:31.029457+0000","last_unstale":"2023-10-14T09:38:32.343361+0000","last_undegraded":"2023-10-14T09:38:32.343361+0000","last_fullsized":"2023-10-14T09:38:32.343361+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:41:28.301486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344776+0000","last_change":"2023-10-14T09:38:31.033346+0000","last_active":"2023-10-14T09:38:32.344776+0000","last_peered":"2023-10-14T09:38:32.344776+0000","last_clean":"2023-10-14T09:38:32.344776+0000","last_became_active":"2023-10-14T09:38:31.033040+0000","last_became_peered":"2023-10-14T09:38:31.033040+0000","last_unstale":"2023-10-14T09:38:32.344776+0000","last_undegraded":"2023-10-14T09:38:32.344776+0000","last_fullsized":"2023-10-14T09:38:32.344776+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:54:57.182070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343534+0000","last_change":"2023-10-14T09:38:31.026010+0000","last_active":"2023-10-14T09:38:32.343534+0000","last_peered":"2023-10-14T09:38:32.343534+0000","last_clean":"2023-10-14T09:38:32.343534+0000","last_became_active":"2023-10-14T09:38:31.025735+0000","last_became_peered":"2023-10-14T09:38:31.025735+0000","last_unstale":"2023-10-14T09:38:32.343534+0000","last_undegraded":"2023-10-14T09:38:32.343534+0000","last_fullsized":"2023-10-14T09:38:32.343534+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:07:02.738518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341225+0000","last_change":"2023-10-14T09:38:31.011800+0000","last_active":"2023-10-14T09:38:32.341225+0000","last_peered":"2023-10-14T09:38:32.341225+0000","last_clean":"2023-10-14T09:38:32.341225+0000","last_became_active":"2023-10-14T09:38:31.011363+0000","last_became_peered":"2023-10-14T09:38:31.011363+0000","last_unstale":"2023-10-14T09:38:32.341225+0000","last_undegraded":"2023-10-14T09:38:32.341225+0000","last_fullsized":"2023-10-14T09:38:32.341225+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:32:10.952099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.018172+0000","last_change":"2023-10-14T09:38:31.021882+0000","last_active":"2023-10-14T09:38:32.018172+0000","last_peered":"2023-10-14T09:38:32.018172+0000","last_clean":"2023-10-14T09:38:32.018172+0000","last_became_active":"2023-10-14T09:38:31.021555+0000","last_became_peered":"2023-10-14T09:38:31.021555+0000","last_unstale":"2023-10-14T09:38:32.018172+0000","last_undegraded":"2023-10-14T09:38:32.018172+0000","last_fullsized":"2023-10-14T09:38:32.018172+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:22.613894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.018500+0000","last_change":"2023-10-14T09:38:31.029992+0000","last_active":"2023-10-14T09:38:32.018500+0000","last_peered":"2023-10-14T09:38:32.018500+0000","last_clean":"2023-10-14T09:38:32.018500+0000","last_became_active":"2023-10-14T09:38:31.029712+0000","last_became_peered":"2023-10-14T09:38:31.029712+0000","last_unstale":"2023-10-14T09:38:32.018500+0000","last_undegraded":"2023-10-14T09:38:32.018500+0000","last_fullsized":"2023-10-14T09:38:32.018500+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:12.059563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345293+0000","last_change":"2023-10-14T09:38:31.023504+0000","last_active":"2023-10-14T09:38:32.345293+0000","last_peered":"2023-10-14T09:38:32.345293+0000","last_clean":"2023-10-14T09:38:32.345293+0000","last_became_active":"2023-10-14T09:38:31.023251+0000","last_became_peered":"2023-10-14T09:38:31.023251+0000","last_unstale":"2023-10-14T09:38:32.345293+0000","last_undegraded":"2023-10-14T09:38:32.345293+0000","last_fullsized":"2023-10-14T09:38:32.345293+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:29.053068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342651+0000","last_change":"2023-10-14T09:38:31.011612+0000","last_active":"2023-10-14T09:38:32.342651+0000","last_peered":"2023-10-14T09:38:32.342651+0000","last_clean":"2023-10-14T09:38:32.342651+0000","last_became_active":"2023-10-14T09:38:31.010860+0000","last_became_peered":"2023-10-14T09:38:31.010860+0000","last_unstale":"2023-10-14T09:38:32.342651+0000","last_undegraded":"2023-10-14T09:38:32.342651+0000","last_fullsized":"2023-10-14T09:38:32.342651+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:54:32.085213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344876+0000","last_change":"2023-10-14T09:38:31.023722+0000","last_active":"2023-10-14T09:38:32.344876+0000","last_peered":"2023-10-14T09:38:32.344876+0000","last_clean":"2023-10-14T09:38:32.344876+0000","last_became_active":"2023-10-14T09:38:31.023469+0000","last_became_peered":"2023-10-14T09:38:31.023469+0000","last_unstale":"2023-10-14T09:38:32.344876+0000","last_undegraded":"2023-10-14T09:38:32.344876+0000","last_fullsized":"2023-10-14T09:38:32.344876+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:26:03.834483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344738+0000","last_change":"2023-10-14T09:38:31.028525+0000","last_active":"2023-10-14T09:38:32.344738+0000","last_peered":"2023-10-14T09:38:32.344738+0000","last_clean":"2023-10-14T09:38:32.344738+0000","last_became_active":"2023-10-14T09:38:31.026660+0000","last_became_peered":"2023-10-14T09:38:31.026660+0000","last_unstale":"2023-10-14T09:38:32.344738+0000","last_undegraded":"2023-10-14T09:38:32.344738+0000","last_fullsized":"2023-10-14T09:38:32.344738+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:29:12.633954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344629+0000","last_change":"2023-10-14T09:38:31.026064+0000","last_active":"2023-10-14T09:38:32.344629+0000","last_peered":"2023-10-14T09:38:32.344629+0000","last_clean":"2023-10-14T09:38:32.344629+0000","last_became_active":"2023-10-14T09:38:31.025680+0000","last_became_peered":"2023-10-14T09:38:31.025680+0000","last_unstale":"2023-10-14T09:38:32.344629+0000","last_undegraded":"2023-10-14T09:38:32.344629+0000","last_fullsized":"2023-10-14T09:38:32.344629+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:05:14.584003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343991+0000","last_change":"2023-10-14T09:38:31.022957+0000","last_active":"2023-10-14T09:38:32.343991+0000","last_peered":"2023-10-14T09:38:32.343991+0000","last_clean":"2023-10-14T09:38:32.343991+0000","last_became_active":"2023-10-14T09:38:31.022641+0000","last_became_peered":"2023-10-14T09:38:31.022641+0000","last_unstale":"2023-10-14T09:38:32.343991+0000","last_undegraded":"2023-10-14T09:38:32.343991+0000","last_fullsized":"2023-10-14T09:38:32.343991+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:08:08.601763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.018402+0000","last_change":"2023-10-14T09:38:31.031585+0000","last_active":"2023-10-14T09:38:32.018402+0000","last_peered":"2023-10-14T09:38:32.018402+0000","last_clean":"2023-10-14T09:38:32.018402+0000","last_became_active":"2023-10-14T09:38:31.031302+0000","last_became_peered":"2023-10-14T09:38:31.031302+0000","last_unstale":"2023-10-14T09:38:32.018402+0000","last_undegraded":"2023-10-14T09:38:32.018402+0000","last_fullsized":"2023-10-14T09:38:32.018402+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:37:07.904425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341801+0000","last_change":"2023-10-14T09:38:31.029845+0000","last_active":"2023-10-14T09:38:32.341801+0000","last_peered":"2023-10-14T09:38:32.341801+0000","last_clean":"2023-10-14T09:38:32.341801+0000","last_became_active":"2023-10-14T09:38:31.029493+0000","last_became_peered":"2023-10-14T09:38:31.029493+0000","last_unstale":"2023-10-14T09:38:32.341801+0000","last_undegraded":"2023-10-14T09:38:32.341801+0000","last_fullsized":"2023-10-14T09:38:32.341801+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:05:14.584003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.020011+0000","last_change":"2023-10-14T09:38:31.025533+0000","last_active":"2023-10-14T09:38:32.020011+0000","last_peered":"2023-10-14T09:38:32.020011+0000","last_clean":"2023-10-14T09:38:32.020011+0000","last_became_active":"2023-10-14T09:38:31.025243+0000","last_became_peered":"2023-10-14T09:38:31.025243+0000","last_unstale":"2023-10-14T09:38:32.020011+0000","last_undegraded":"2023-10-14T09:38:32.020011+0000","last_fullsized":"2023-10-14T09:38:32.020011+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:32:55.434705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341995+0000","last_change":"2023-10-14T09:38:31.028763+0000","last_active":"2023-10-14T09:38:32.341995+0000","last_peered":"2023-10-14T09:38:32.341995+0000","last_clean":"2023-10-14T09:38:32.341995+0000","last_became_active":"2023-10-14T09:38:31.028420+0000","last_became_peered":"2023-10-14T09:38:31.028420+0000","last_unstale":"2023-10-14T09:38:32.341995+0000","last_undegraded":"2023-10-14T09:38:32.341995+0000","last_fullsized":"2023-10-14T09:38:32.341995+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:26:03.834483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345961+0000","last_change":"2023-10-14T09:38:31.024908+0000","last_active":"2023-10-14T09:38:32.345961+0000","last_peered":"2023-10-14T09:38:32.345961+0000","last_clean":"2023-10-14T09:38:32.345961+0000","last_became_active":"2023-10-14T09:38:31.023482+0000","last_became_peered":"2023-10-14T09:38:31.023482+0000","last_unstale":"2023-10-14T09:38:32.345961+0000","last_undegraded":"2023-10-14T09:38:32.345961+0000","last_fullsized":"2023-10-14T09:38:32.345961+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:14:59.816409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"35'4","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.048326+0000","last_change":"2023-10-14T09:38:30.031689+0000","last_active":"2023-10-14T09:38:31.048326+0000","last_peered":"2023-10-14T09:38:31.048326+0000","last_clean":"2023-10-14T09:38:31.048326+0000","last_became_active":"2023-10-14T09:38:30.031374+0000","last_became_peered":"2023-10-14T09:38:30.031374+0000","last_unstale":"2023-10-14T09:38:31.048326+0000","last_undegraded":"2023-10-14T09:38:31.048326+0000","last_fullsized":"2023-10-14T09:38:31.048326+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:32.881121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.019773+0000","last_change":"2023-10-14T09:38:31.026729+0000","last_active":"2023-10-14T09:38:32.019773+0000","last_peered":"2023-10-14T09:38:32.019773+0000","last_clean":"2023-10-14T09:38:32.019773+0000","last_became_active":"2023-10-14T09:38:31.026414+0000","last_became_peered":"2023-10-14T09:38:31.026414+0000","last_unstale":"2023-10-14T09:38:32.019773+0000","last_undegraded":"2023-10-14T09:38:32.019773+0000","last_fullsized":"2023-10-14T09:38:32.019773+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:09.182708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"35'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345785+0000","last_change":"2023-10-14T09:38:30.025206+0000","last_active":"2023-10-14T09:38:32.345785+0000","last_peered":"2023-10-14T09:38:32.345785+0000","last_clean":"2023-10-14T09:38:32.345785+0000","last_became_active":"2023-10-14T09:38:30.024910+0000","last_became_peered":"2023-10-14T09:38:30.024910+0000","last_unstale":"2023-10-14T09:38:32.345785+0000","last_undegraded":"2023-10-14T09:38:32.345785+0000","last_fullsized":"2023-10-14T09:38:32.345785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:35:31.581556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.018785+0000","last_change":"2023-10-14T09:38:31.030098+0000","last_active":"2023-10-14T09:38:32.018785+0000","last_peered":"2023-10-14T09:38:32.018785+0000","last_clean":"2023-10-14T09:38:32.018785+0000","last_became_active":"2023-10-14T09:38:31.029815+0000","last_became_peered":"2023-10-14T09:38:31.029815+0000","last_unstale":"2023-10-14T09:38:32.018785+0000","last_undegraded":"2023-10-14T09:38:32.018785+0000","last_fullsized":"2023-10-14T09:38:32.018785+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:23:27.986420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.041830+0000","last_change":"2023-10-14T09:38:30.017782+0000","last_active":"2023-10-14T09:38:31.041830+0000","last_peered":"2023-10-14T09:38:31.041830+0000","last_clean":"2023-10-14T09:38:31.041830+0000","last_became_active":"2023-10-14T09:38:30.017602+0000","last_became_peered":"2023-10-14T09:38:30.017602+0000","last_unstale":"2023-10-14T09:38:31.041830+0000","last_undegraded":"2023-10-14T09:38:31.041830+0000","last_fullsized":"2023-10-14T09:38:31.041830+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:34.119874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344746+0000","last_change":"2023-10-14T09:38:31.028602+0000","last_active":"2023-10-14T09:38:32.344746+0000","last_peered":"2023-10-14T09:38:32.344746+0000","last_clean":"2023-10-14T09:38:32.344746+0000","last_became_active":"2023-10-14T09:38:31.025645+0000","last_became_peered":"2023-10-14T09:38:31.025645+0000","last_unstale":"2023-10-14T09:38:32.344746+0000","last_undegraded":"2023-10-14T09:38:32.344746+0000","last_fullsized":"2023-10-14T09:38:32.344746+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:23:43.555148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.043829+0000","last_change":"2023-10-14T09:38:30.031331+0000","last_active":"2023-10-14T09:38:31.043829+0000","last_peered":"2023-10-14T09:38:31.043829+0000","last_clean":"2023-10-14T09:38:31.043829+0000","last_became_active":"2023-10-14T09:38:30.030556+0000","last_became_peered":"2023-10-14T09:38:30.030556+0000","last_unstale":"2023-10-14T09:38:31.043829+0000","last_undegraded":"2023-10-14T09:38:31.043829+0000","last_fullsized":"2023-10-14T09:38:31.043829+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:00:27.300436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342154+0000","last_change":"2023-10-14T09:38:31.029169+0000","last_active":"2023-10-14T09:38:32.342154+0000","last_peered":"2023-10-14T09:38:32.342154+0000","last_clean":"2023-10-14T09:38:32.342154+0000","last_became_active":"2023-10-14T09:38:31.028887+0000","last_became_peered":"2023-10-14T09:38:31.028887+0000","last_unstale":"2023-10-14T09:38:32.342154+0000","last_undegraded":"2023-10-14T09:38:32.342154+0000","last_fullsized":"2023-10-14T09:38:32.342154+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:05:40.247862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.043614+0000","last_change":"2023-10-14T09:38:30.026023+0000","last_active":"2023-10-14T09:38:31.043614+0000","last_peered":"2023-10-14T09:38:31.043614+0000","last_clean":"2023-10-14T09:38:31.043614+0000","last_became_active":"2023-10-14T09:38:30.025732+0000","last_became_peered":"2023-10-14T09:38:30.025732+0000","last_unstale":"2023-10-14T09:38:31.043614+0000","last_undegraded":"2023-10-14T09:38:31.043614+0000","last_fullsized":"2023-10-14T09:38:31.043614+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:30:03.089452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343662+0000","last_change":"2023-10-14T09:38:31.020554+0000","last_active":"2023-10-14T09:38:32.343662+0000","last_peered":"2023-10-14T09:38:32.343662+0000","last_clean":"2023-10-14T09:38:32.343662+0000","last_became_active":"2023-10-14T09:38:31.020184+0000","last_became_peered":"2023-10-14T09:38:31.020184+0000","last_unstale":"2023-10-14T09:38:32.343662+0000","last_undegraded":"2023-10-14T09:38:32.343662+0000","last_fullsized":"2023-10-14T09:38:32.343662+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:26:34.407953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.043817+0000","last_change":"2023-10-14T09:38:30.031642+0000","last_active":"2023-10-14T09:38:31.043817+0000","last_peered":"2023-10-14T09:38:31.043817+0000","last_clean":"2023-10-14T09:38:31.043817+0000","last_became_active":"2023-10-14T09:38:30.031356+0000","last_became_peered":"2023-10-14T09:38:30.031356+0000","last_unstale":"2023-10-14T09:38:31.043817+0000","last_undegraded":"2023-10-14T09:38:31.043817+0000","last_fullsized":"2023-10-14T09:38:31.043817+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:36:20.364439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.017009+0000","last_change":"2023-10-14T09:38:31.024293+0000","last_active":"2023-10-14T09:38:32.017009+0000","last_peered":"2023-10-14T09:38:32.017009+0000","last_clean":"2023-10-14T09:38:32.017009+0000","last_became_active":"2023-10-14T09:38:31.023990+0000","last_became_peered":"2023-10-14T09:38:31.023990+0000","last_unstale":"2023-10-14T09:38:32.017009+0000","last_undegraded":"2023-10-14T09:38:32.017009+0000","last_fullsized":"2023-10-14T09:38:32.017009+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:18.314768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.010745+0000","last_change":"2023-10-14T09:38:30.021813+0000","last_active":"2023-10-14T09:38:31.010745+0000","last_peered":"2023-10-14T09:38:31.010745+0000","last_clean":"2023-10-14T09:38:31.010745+0000","last_became_active":"2023-10-14T09:38:30.019461+0000","last_became_peered":"2023-10-14T09:38:30.019461+0000","last_unstale":"2023-10-14T09:38:31.010745+0000","last_undegraded":"2023-10-14T09:38:31.010745+0000","last_fullsized":"2023-10-14T09:38:31.010745+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:04:04.485468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342676+0000","last_change":"2023-10-14T09:38:31.016796+0000","last_active":"2023-10-14T09:38:32.342676+0000","last_peered":"2023-10-14T09:38:32.342676+0000","last_clean":"2023-10-14T09:38:32.342676+0000","last_became_active":"2023-10-14T09:38:31.016514+0000","last_became_peered":"2023-10-14T09:38:31.016514+0000","last_unstale":"2023-10-14T09:38:32.342676+0000","last_undegraded":"2023-10-14T09:38:32.342676+0000","last_fullsized":"2023-10-14T09:38:32.342676+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:23:27.986420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.006074+0000","last_change":"2023-10-14T09:38:30.035807+0000","last_active":"2023-10-14T09:38:31.006074+0000","last_peered":"2023-10-14T09:38:31.006074+0000","last_clean":"2023-10-14T09:38:31.006074+0000","last_became_active":"2023-10-14T09:38:30.035470+0000","last_became_peered":"2023-10-14T09:38:30.035470+0000","last_unstale":"2023-10-14T09:38:31.006074+0000","last_undegraded":"2023-10-14T09:38:31.006074+0000","last_fullsized":"2023-10-14T09:38:31.006074+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:38:26.466223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344016+0000","last_change":"2023-10-14T09:38:31.026082+0000","last_active":"2023-10-14T09:38:32.344016+0000","last_peered":"2023-10-14T09:38:32.344016+0000","last_clean":"2023-10-14T09:38:32.344016+0000","last_became_active":"2023-10-14T09:38:31.025794+0000","last_became_peered":"2023-10-14T09:38:31.025794+0000","last_unstale":"2023-10-14T09:38:32.344016+0000","last_undegraded":"2023-10-14T09:38:32.344016+0000","last_fullsized":"2023-10-14T09:38:32.344016+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:08:12.498616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.013494+0000","last_change":"2023-10-14T09:38:30.014502+0000","last_active":"2023-10-14T09:38:31.013494+0000","last_peered":"2023-10-14T09:38:31.013494+0000","last_clean":"2023-10-14T09:38:31.013494+0000","last_became_active":"2023-10-14T09:38:30.014042+0000","last_became_peered":"2023-10-14T09:38:30.014042+0000","last_unstale":"2023-10-14T09:38:31.013494+0000","last_undegraded":"2023-10-14T09:38:31.013494+0000","last_fullsized":"2023-10-14T09:38:31.013494+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:02:19.916430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343306+0000","last_change":"2023-10-14T09:38:31.021923+0000","last_active":"2023-10-14T09:38:32.343306+0000","last_peered":"2023-10-14T09:38:32.343306+0000","last_clean":"2023-10-14T09:38:32.343306+0000","last_became_active":"2023-10-14T09:38:31.021662+0000","last_became_peered":"2023-10-14T09:38:31.021662+0000","last_unstale":"2023-10-14T09:38:32.343306+0000","last_undegraded":"2023-10-14T09:38:32.343306+0000","last_fullsized":"2023-10-14T09:38:32.343306+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:18:08.718330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345934+0000","last_change":"2023-10-14T09:38:30.028000+0000","last_active":"2023-10-14T09:38:32.345934+0000","last_peered":"2023-10-14T09:38:32.345934+0000","last_clean":"2023-10-14T09:38:32.345934+0000","last_became_active":"2023-10-14T09:38:30.027696+0000","last_became_peered":"2023-10-14T09:38:30.027696+0000","last_unstale":"2023-10-14T09:38:32.345934+0000","last_undegraded":"2023-10-14T09:38:32.345934+0000","last_fullsized":"2023-10-14T09:38:32.345934+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:11.668342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343027+0000","last_change":"2023-10-14T09:38:31.026933+0000","last_active":"2023-10-14T09:38:32.343027+0000","last_peered":"2023-10-14T09:38:32.343027+0000","last_clean":"2023-10-14T09:38:32.343027+0000","last_became_active":"2023-10-14T09:38:31.026676+0000","last_became_peered":"2023-10-14T09:38:31.026676+0000","last_unstale":"2023-10-14T09:38:32.343027+0000","last_undegraded":"2023-10-14T09:38:32.343027+0000","last_fullsized":"2023-10-14T09:38:32.343027+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:39:19.700408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"35'3","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344090+0000","last_change":"2023-10-14T09:38:30.032207+0000","last_active":"2023-10-14T09:38:32.344090+0000","last_peered":"2023-10-14T09:38:32.344090+0000","last_clean":"2023-10-14T09:38:32.344090+0000","last_became_active":"2023-10-14T09:38:30.031907+0000","last_became_peered":"2023-10-14T09:38:30.031907+0000","last_unstale":"2023-10-14T09:38:32.344090+0000","last_undegraded":"2023-10-14T09:38:32.344090+0000","last_fullsized":"2023-10-14T09:38:32.344090+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:59:09.031590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343866+0000","last_change":"2023-10-14T09:38:31.021126+0000","last_active":"2023-10-14T09:38:32.343866+0000","last_peered":"2023-10-14T09:38:32.343866+0000","last_clean":"2023-10-14T09:38:32.343866+0000","last_became_active":"2023-10-14T09:38:31.020267+0000","last_became_peered":"2023-10-14T09:38:31.020267+0000","last_unstale":"2023-10-14T09:38:32.343866+0000","last_undegraded":"2023-10-14T09:38:32.343866+0000","last_fullsized":"2023-10-14T09:38:32.343866+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:29:07.359293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"35'6","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.048294+0000","last_change":"2023-10-14T09:38:30.020149+0000","last_active":"2023-10-14T09:38:31.048294+0000","last_peered":"2023-10-14T09:38:31.048294+0000","last_clean":"2023-10-14T09:38:31.048294+0000","last_became_active":"2023-10-14T09:38:30.019839+0000","last_became_peered":"2023-10-14T09:38:30.019839+0000","last_unstale":"2023-10-14T09:38:31.048294+0000","last_undegraded":"2023-10-14T09:38:31.048294+0000","last_fullsized":"2023-10-14T09:38:31.048294+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:54.807431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342588+0000","last_change":"2023-10-14T09:38:31.020699+0000","last_active":"2023-10-14T09:38:32.342588+0000","last_peered":"2023-10-14T09:38:32.342588+0000","last_clean":"2023-10-14T09:38:32.342588+0000","last_became_active":"2023-10-14T09:38:31.020347+0000","last_became_peered":"2023-10-14T09:38:31.020347+0000","last_unstale":"2023-10-14T09:38:32.342588+0000","last_undegraded":"2023-10-14T09:38:32.342588+0000","last_fullsized":"2023-10-14T09:38:32.342588+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:12.059563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.042951+0000","last_change":"2023-10-14T09:38:30.035740+0000","last_active":"2023-10-14T09:38:31.042951+0000","last_peered":"2023-10-14T09:38:31.042951+0000","last_clean":"2023-10-14T09:38:31.042951+0000","last_became_active":"2023-10-14T09:38:30.035424+0000","last_became_peered":"2023-10-14T09:38:30.035424+0000","last_unstale":"2023-10-14T09:38:31.042951+0000","last_undegraded":"2023-10-14T09:38:31.042951+0000","last_fullsized":"2023-10-14T09:38:31.042951+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:13:05.075908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342770+0000","last_change":"2023-10-14T09:38:31.028147+0000","last_active":"2023-10-14T09:38:32.342770+0000","last_peered":"2023-10-14T09:38:32.342770+0000","last_clean":"2023-10-14T09:38:32.342770+0000","last_became_active":"2023-10-14T09:38:31.027759+0000","last_became_peered":"2023-10-14T09:38:31.027759+0000","last_unstale":"2023-10-14T09:38:32.342770+0000","last_undegraded":"2023-10-14T09:38:32.342770+0000","last_fullsized":"2023-10-14T09:38:32.342770+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:28.333786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.004907+0000","last_change":"2023-10-14T09:38:30.025921+0000","last_active":"2023-10-14T09:38:31.004907+0000","last_peered":"2023-10-14T09:38:31.004907+0000","last_clean":"2023-10-14T09:38:31.004907+0000","last_became_active":"2023-10-14T09:38:30.025712+0000","last_became_peered":"2023-10-14T09:38:30.025712+0000","last_unstale":"2023-10-14T09:38:31.004907+0000","last_undegraded":"2023-10-14T09:38:31.004907+0000","last_fullsized":"2023-10-14T09:38:31.004907+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:13:05.075908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342190+0000","last_change":"2023-10-14T09:38:31.037744+0000","last_active":"2023-10-14T09:38:32.342190+0000","last_peered":"2023-10-14T09:38:32.342190+0000","last_clean":"2023-10-14T09:38:32.342190+0000","last_became_active":"2023-10-14T09:38:31.036628+0000","last_became_peered":"2023-10-14T09:38:31.036628+0000","last_unstale":"2023-10-14T09:38:32.342190+0000","last_undegraded":"2023-10-14T09:38:32.342190+0000","last_fullsized":"2023-10-14T09:38:32.342190+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:55.821527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.010492+0000","last_change":"2023-10-14T09:38:30.022460+0000","last_active":"2023-10-14T09:38:31.010492+0000","last_peered":"2023-10-14T09:38:31.010492+0000","last_clean":"2023-10-14T09:38:31.010492+0000","last_became_active":"2023-10-14T09:38:30.022182+0000","last_became_peered":"2023-10-14T09:38:30.022182+0000","last_unstale":"2023-10-14T09:38:31.010492+0000","last_undegraded":"2023-10-14T09:38:31.010492+0000","last_fullsized":"2023-10-14T09:38:31.010492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:45.031149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.020009+0000","last_change":"2023-10-14T09:38:31.039814+0000","last_active":"2023-10-14T09:38:32.020009+0000","last_peered":"2023-10-14T09:38:32.020009+0000","last_clean":"2023-10-14T09:38:32.020009+0000","last_became_active":"2023-10-14T09:38:31.039518+0000","last_became_peered":"2023-10-14T09:38:31.039518+0000","last_unstale":"2023-10-14T09:38:32.020009+0000","last_undegraded":"2023-10-14T09:38:32.020009+0000","last_fullsized":"2023-10-14T09:38:32.020009+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:22.613894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"35'8","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.046908+0000","last_change":"2023-10-14T09:38:30.015580+0000","last_active":"2023-10-14T09:38:31.046908+0000","last_peered":"2023-10-14T09:38:31.046908+0000","last_clean":"2023-10-14T09:38:31.046908+0000","last_became_active":"2023-10-14T09:38:30.014562+0000","last_became_peered":"2023-10-14T09:38:30.014562+0000","last_unstale":"2023-10-14T09:38:31.046908+0000","last_undegraded":"2023-10-14T09:38:31.046908+0000","last_fullsized":"2023-10-14T09:38:31.046908+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:27.669263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.018236+0000","last_change":"2023-10-14T09:38:31.026009+0000","last_active":"2023-10-14T09:38:32.018236+0000","last_peered":"2023-10-14T09:38:32.018236+0000","last_clean":"2023-10-14T09:38:32.018236+0000","last_became_active":"2023-10-14T09:38:31.025665+0000","last_became_peered":"2023-10-14T09:38:31.025665+0000","last_unstale":"2023-10-14T09:38:32.018236+0000","last_undegraded":"2023-10-14T09:38:32.018236+0000","last_fullsized":"2023-10-14T09:38:32.018236+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:16:06.675198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.046534+0000","last_change":"2023-10-14T09:38:30.027344+0000","last_active":"2023-10-14T09:38:31.046534+0000","last_peered":"2023-10-14T09:38:31.046534+0000","last_clean":"2023-10-14T09:38:31.046534+0000","last_became_active":"2023-10-14T09:38:30.025331+0000","last_became_peered":"2023-10-14T09:38:30.025331+0000","last_unstale":"2023-10-14T09:38:31.046534+0000","last_undegraded":"2023-10-14T09:38:31.046534+0000","last_fullsized":"2023-10-14T09:38:31.046534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:16:05.661101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344384+0000","last_change":"2023-10-14T09:38:31.033233+0000","last_active":"2023-10-14T09:38:32.344384+0000","last_peered":"2023-10-14T09:38:32.344384+0000","last_clean":"2023-10-14T09:38:32.344384+0000","last_became_active":"2023-10-14T09:38:31.032912+0000","last_became_peered":"2023-10-14T09:38:31.032912+0000","last_unstale":"2023-10-14T09:38:32.344384+0000","last_undegraded":"2023-10-14T09:38:32.344384+0000","last_fullsized":"2023-10-14T09:38:32.344384+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:52:28.791327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.043036+0000","last_change":"2023-10-14T09:38:30.035623+0000","last_active":"2023-10-14T09:38:31.043036+0000","last_peered":"2023-10-14T09:38:31.043036+0000","last_clean":"2023-10-14T09:38:31.043036+0000","last_became_active":"2023-10-14T09:38:30.035283+0000","last_became_peered":"2023-10-14T09:38:30.035283+0000","last_unstale":"2023-10-14T09:38:31.043036+0000","last_undegraded":"2023-10-14T09:38:31.043036+0000","last_fullsized":"2023-10-14T09:38:31.043036+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:32:09.938003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344424+0000","last_change":"2023-10-14T09:38:31.035370+0000","last_active":"2023-10-14T09:38:32.344424+0000","last_peered":"2023-10-14T09:38:32.344424+0000","last_clean":"2023-10-14T09:38:32.344424+0000","last_became_active":"2023-10-14T09:38:31.034768+0000","last_became_peered":"2023-10-14T09:38:31.034768+0000","last_unstale":"2023-10-14T09:38:32.344424+0000","last_undegraded":"2023-10-14T09:38:32.344424+0000","last_fullsized":"2023-10-14T09:38:32.344424+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:28.683360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.045638+0000","last_change":"2023-10-14T09:38:30.032461+0000","last_active":"2023-10-14T09:38:31.045638+0000","last_peered":"2023-10-14T09:38:31.045638+0000","last_clean":"2023-10-14T09:38:31.045638+0000","last_became_active":"2023-10-14T09:38:30.030927+0000","last_became_peered":"2023-10-14T09:38:30.030927+0000","last_unstale":"2023-10-14T09:38:31.045638+0000","last_undegraded":"2023-10-14T09:38:31.045638+0000","last_fullsized":"2023-10-14T09:38:31.045638+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:18:05.378855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341272+0000","last_change":"2023-10-14T09:38:31.026882+0000","last_active":"2023-10-14T09:38:32.341272+0000","last_peered":"2023-10-14T09:38:32.341272+0000","last_clean":"2023-10-14T09:38:32.341272+0000","last_became_active":"2023-10-14T09:38:31.026615+0000","last_became_peered":"2023-10-14T09:38:31.026615+0000","last_unstale":"2023-10-14T09:38:32.341272+0000","last_undegraded":"2023-10-14T09:38:32.341272+0000","last_fullsized":"2023-10-14T09:38:32.341272+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:39:04.991127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.013395+0000","last_change":"2023-10-14T09:38:30.028028+0000","last_active":"2023-10-14T09:38:31.013395+0000","last_peered":"2023-10-14T09:38:31.013395+0000","last_clean":"2023-10-14T09:38:31.013395+0000","last_became_active":"2023-10-14T09:38:30.026795+0000","last_became_peered":"2023-10-14T09:38:30.026795+0000","last_unstale":"2023-10-14T09:38:31.013395+0000","last_undegraded":"2023-10-14T09:38:31.013395+0000","last_fullsized":"2023-10-14T09:38:31.013395+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:08.168611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341771+0000","last_change":"2023-10-14T09:38:31.032201+0000","last_active":"2023-10-14T09:38:32.341771+0000","last_peered":"2023-10-14T09:38:32.341771+0000","last_clean":"2023-10-14T09:38:32.341771+0000","last_became_active":"2023-10-14T09:38:31.031921+0000","last_became_peered":"2023-10-14T09:38:31.031921+0000","last_unstale":"2023-10-14T09:38:32.341771+0000","last_undegraded":"2023-10-14T09:38:32.341771+0000","last_fullsized":"2023-10-14T09:38:32.341771+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:30:04.103548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345526+0000","last_change":"2023-10-14T09:38:30.021600+0000","last_active":"2023-10-14T09:38:32.345526+0000","last_peered":"2023-10-14T09:38:32.345526+0000","last_clean":"2023-10-14T09:38:32.345526+0000","last_became_active":"2023-10-14T09:38:30.021312+0000","last_became_peered":"2023-10-14T09:38:30.021312+0000","last_unstale":"2023-10-14T09:38:32.345526+0000","last_undegraded":"2023-10-14T09:38:32.345526+0000","last_fullsized":"2023-10-14T09:38:32.345526+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:55:23.928233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341541+0000","last_change":"2023-10-14T09:38:31.023661+0000","last_active":"2023-10-14T09:38:32.341541+0000","last_peered":"2023-10-14T09:38:32.341541+0000","last_clean":"2023-10-14T09:38:32.341541+0000","last_became_active":"2023-10-14T09:38:31.023340+0000","last_became_peered":"2023-10-14T09:38:31.023340+0000","last_unstale":"2023-10-14T09:38:32.341541+0000","last_undegraded":"2023-10-14T09:38:32.341541+0000","last_fullsized":"2023-10-14T09:38:32.341541+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:49:04.384325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.016548+0000","last_change":"2023-10-14T09:38:30.033606+0000","last_active":"2023-10-14T09:38:31.016548+0000","last_peered":"2023-10-14T09:38:31.016548+0000","last_clean":"2023-10-14T09:38:31.016548+0000","last_became_active":"2023-10-14T09:38:30.033284+0000","last_became_peered":"2023-10-14T09:38:30.033284+0000","last_unstale":"2023-10-14T09:38:31.016548+0000","last_undegraded":"2023-10-14T09:38:31.016548+0000","last_fullsized":"2023-10-14T09:38:31.016548+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:26:23.409048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341209+0000","last_change":"2023-10-14T09:38:31.020259+0000","last_active":"2023-10-14T09:38:32.341209+0000","last_peered":"2023-10-14T09:38:32.341209+0000","last_clean":"2023-10-14T09:38:32.341209+0000","last_became_active":"2023-10-14T09:38:31.019732+0000","last_became_peered":"2023-10-14T09:38:31.019732+0000","last_unstale":"2023-10-14T09:38:32.341209+0000","last_undegraded":"2023-10-14T09:38:32.341209+0000","last_fullsized":"2023-10-14T09:38:32.341209+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:39:13.767140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.009471+0000","last_change":"2023-10-14T09:38:30.032802+0000","last_active":"2023-10-14T09:38:31.009471+0000","last_peered":"2023-10-14T09:38:31.009471+0000","last_clean":"2023-10-14T09:38:31.009471+0000","last_became_active":"2023-10-14T09:38:30.032500+0000","last_became_peered":"2023-10-14T09:38:30.032500+0000","last_unstale":"2023-10-14T09:38:31.009471+0000","last_undegraded":"2023-10-14T09:38:31.009471+0000","last_fullsized":"2023-10-14T09:38:31.009471+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:32.881121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342037+0000","last_change":"2023-10-14T09:38:31.030686+0000","last_active":"2023-10-14T09:38:32.342037+0000","last_peered":"2023-10-14T09:38:32.342037+0000","last_clean":"2023-10-14T09:38:32.342037+0000","last_became_active":"2023-10-14T09:38:31.030399+0000","last_became_peered":"2023-10-14T09:38:31.030399+0000","last_unstale":"2023-10-14T09:38:32.342037+0000","last_undegraded":"2023-10-14T09:38:32.342037+0000","last_fullsized":"2023-10-14T09:38:32.342037+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:35.133971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342880+0000","last_change":"2023-10-14T09:38:30.029157+0000","last_active":"2023-10-14T09:38:32.342880+0000","last_peered":"2023-10-14T09:38:32.342880+0000","last_clean":"2023-10-14T09:38:32.342880+0000","last_became_active":"2023-10-14T09:38:30.028540+0000","last_became_peered":"2023-10-14T09:38:30.028540+0000","last_unstale":"2023-10-14T09:38:32.342880+0000","last_undegraded":"2023-10-14T09:38:32.342880+0000","last_fullsized":"2023-10-14T09:38:32.342880+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:11.668342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341394+0000","last_change":"2023-10-14T09:38:31.016140+0000","last_active":"2023-10-14T09:38:32.341394+0000","last_peered":"2023-10-14T09:38:32.341394+0000","last_clean":"2023-10-14T09:38:32.341394+0000","last_became_active":"2023-10-14T09:38:31.015654+0000","last_became_peered":"2023-10-14T09:38:31.015654+0000","last_unstale":"2023-10-14T09:38:32.341394+0000","last_undegraded":"2023-10-14T09:38:32.341394+0000","last_fullsized":"2023-10-14T09:38:32.341394+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:13:35.685099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.043592+0000","last_change":"2023-10-14T09:38:30.030703+0000","last_active":"2023-10-14T09:38:31.043592+0000","last_peered":"2023-10-14T09:38:31.043592+0000","last_clean":"2023-10-14T09:38:31.043592+0000","last_became_active":"2023-10-14T09:38:30.030387+0000","last_became_peered":"2023-10-14T09:38:30.030387+0000","last_unstale":"2023-10-14T09:38:31.043592+0000","last_undegraded":"2023-10-14T09:38:31.043592+0000","last_fullsized":"2023-10-14T09:38:31.043592+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:37:06.890328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344251+0000","last_change":"2023-10-14T09:38:31.024132+0000","last_active":"2023-10-14T09:38:32.344251+0000","last_peered":"2023-10-14T09:38:32.344251+0000","last_clean":"2023-10-14T09:38:32.344251+0000","last_became_active":"2023-10-14T09:38:31.023043+0000","last_became_peered":"2023-10-14T09:38:31.023043+0000","last_unstale":"2023-10-14T09:38:32.344251+0000","last_undegraded":"2023-10-14T09:38:32.344251+0000","last_fullsized":"2023-10-14T09:38:32.344251+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:26:18.683878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345866+0000","last_change":"2023-10-14T09:38:30.024854+0000","last_active":"2023-10-14T09:38:32.345866+0000","last_peered":"2023-10-14T09:38:32.345866+0000","last_clean":"2023-10-14T09:38:32.345866+0000","last_became_active":"2023-10-14T09:38:30.024536+0000","last_became_peered":"2023-10-14T09:38:30.024536+0000","last_unstale":"2023-10-14T09:38:32.345866+0000","last_undegraded":"2023-10-14T09:38:32.345866+0000","last_fullsized":"2023-10-14T09:38:32.345866+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:47:13.277147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345881+0000","last_change":"2023-10-14T09:38:31.024182+0000","last_active":"2023-10-14T09:38:32.345881+0000","last_peered":"2023-10-14T09:38:32.345881+0000","last_clean":"2023-10-14T09:38:32.345881+0000","last_became_active":"2023-10-14T09:38:31.023855+0000","last_became_peered":"2023-10-14T09:38:31.023855+0000","last_unstale":"2023-10-14T09:38:32.345881+0000","last_undegraded":"2023-10-14T09:38:32.345881+0000","last_fullsized":"2023-10-14T09:38:32.345881+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:59:10.045687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.008529+0000","last_change":"2023-10-14T09:38:30.023306+0000","last_active":"2023-10-14T09:38:31.008529+0000","last_peered":"2023-10-14T09:38:31.008529+0000","last_clean":"2023-10-14T09:38:31.008529+0000","last_became_active":"2023-10-14T09:38:30.023068+0000","last_became_peered":"2023-10-14T09:38:30.023068+0000","last_unstale":"2023-10-14T09:38:31.008529+0000","last_undegraded":"2023-10-14T09:38:31.008529+0000","last_fullsized":"2023-10-14T09:38:31.008529+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:21.599798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.019849+0000","last_change":"2023-10-14T09:38:31.027123+0000","last_active":"2023-10-14T09:38:32.019849+0000","last_peered":"2023-10-14T09:38:32.019849+0000","last_clean":"2023-10-14T09:38:32.019849+0000","last_became_active":"2023-10-14T09:38:31.026838+0000","last_became_peered":"2023-10-14T09:38:31.026838+0000","last_unstale":"2023-10-14T09:38:32.019849+0000","last_undegraded":"2023-10-14T09:38:32.019849+0000","last_fullsized":"2023-10-14T09:38:32.019849+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:18.314768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345598+0000","last_change":"2023-10-14T09:38:30.029783+0000","last_active":"2023-10-14T09:38:32.345598+0000","last_peered":"2023-10-14T09:38:32.345598+0000","last_clean":"2023-10-14T09:38:32.345598+0000","last_became_active":"2023-10-14T09:38:30.029514+0000","last_became_peered":"2023-10-14T09:38:30.029514+0000","last_unstale":"2023-10-14T09:38:32.345598+0000","last_undegraded":"2023-10-14T09:38:32.345598+0000","last_fullsized":"2023-10-14T09:38:32.345598+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:12:06.845824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345460+0000","last_change":"2023-10-14T09:38:31.030071+0000","last_active":"2023-10-14T09:38:32.345460+0000","last_peered":"2023-10-14T09:38:32.345460+0000","last_clean":"2023-10-14T09:38:32.345460+0000","last_became_active":"2023-10-14T09:38:31.029521+0000","last_became_peered":"2023-10-14T09:38:31.029521+0000","last_unstale":"2023-10-14T09:38:32.345460+0000","last_undegraded":"2023-10-14T09:38:32.345460+0000","last_fullsized":"2023-10-14T09:38:32.345460+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:45:03.414149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.005434+0000","last_change":"2023-10-14T09:38:30.030457+0000","last_active":"2023-10-14T09:38:31.005434+0000","last_peered":"2023-10-14T09:38:31.005434+0000","last_clean":"2023-10-14T09:38:31.005434+0000","last_became_active":"2023-10-14T09:38:30.029517+0000","last_became_peered":"2023-10-14T09:38:30.029517+0000","last_unstale":"2023-10-14T09:38:31.005434+0000","last_undegraded":"2023-10-14T09:38:31.005434+0000","last_fullsized":"2023-10-14T09:38:31.005434+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:08.168611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341965+0000","last_change":"2023-10-14T09:38:31.034569+0000","last_active":"2023-10-14T09:38:32.341965+0000","last_peered":"2023-10-14T09:38:32.341965+0000","last_clean":"2023-10-14T09:38:32.341965+0000","last_became_active":"2023-10-14T09:38:31.034300+0000","last_became_peered":"2023-10-14T09:38:31.034300+0000","last_unstale":"2023-10-14T09:38:32.341965+0000","last_undegraded":"2023-10-14T09:38:32.341965+0000","last_fullsized":"2023-10-14T09:38:32.341965+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:55:53.322273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.009658+0000","last_change":"2023-10-14T09:38:30.030715+0000","last_active":"2023-10-14T09:38:31.009658+0000","last_peered":"2023-10-14T09:38:31.009658+0000","last_clean":"2023-10-14T09:38:31.009658+0000","last_became_active":"2023-10-14T09:38:30.030374+0000","last_became_peered":"2023-10-14T09:38:30.030374+0000","last_unstale":"2023-10-14T09:38:31.009658+0000","last_undegraded":"2023-10-14T09:38:31.009658+0000","last_fullsized":"2023-10-14T09:38:31.009658+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:26:23.409048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.017240+0000","last_change":"2023-10-14T09:38:31.033069+0000","last_active":"2023-10-14T09:38:32.017240+0000","last_peered":"2023-10-14T09:38:32.017240+0000","last_clean":"2023-10-14T09:38:32.017240+0000","last_became_active":"2023-10-14T09:38:31.032648+0000","last_became_peered":"2023-10-14T09:38:31.032648+0000","last_unstale":"2023-10-14T09:38:32.017240+0000","last_undegraded":"2023-10-14T09:38:32.017240+0000","last_fullsized":"2023-10-14T09:38:32.017240+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:32:55.434705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.010423+0000","last_change":"2023-10-14T09:38:30.020581+0000","last_active":"2023-10-14T09:38:31.010423+0000","last_peered":"2023-10-14T09:38:31.010423+0000","last_clean":"2023-10-14T09:38:31.010423+0000","last_became_active":"2023-10-14T09:38:30.020321+0000","last_became_peered":"2023-10-14T09:38:30.020321+0000","last_unstale":"2023-10-14T09:38:31.010423+0000","last_undegraded":"2023-10-14T09:38:31.010423+0000","last_fullsized":"2023-10-14T09:38:31.010423+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:23:26.972323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342673+0000","last_change":"2023-10-14T09:38:31.024792+0000","last_active":"2023-10-14T09:38:32.342673+0000","last_peered":"2023-10-14T09:38:32.342673+0000","last_clean":"2023-10-14T09:38:32.342673+0000","last_became_active":"2023-10-14T09:38:31.024478+0000","last_became_peered":"2023-10-14T09:38:31.024478+0000","last_unstale":"2023-10-14T09:38:32.342673+0000","last_undegraded":"2023-10-14T09:38:32.342673+0000","last_fullsized":"2023-10-14T09:38:32.342673+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:49:22.040318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.015743+0000","last_change":"2023-10-14T09:38:30.033668+0000","last_active":"2023-10-14T09:38:31.015743+0000","last_peered":"2023-10-14T09:38:31.015743+0000","last_clean":"2023-10-14T09:38:31.015743+0000","last_became_active":"2023-10-14T09:38:30.033358+0000","last_became_peered":"2023-10-14T09:38:30.033358+0000","last_unstale":"2023-10-14T09:38:31.015743+0000","last_undegraded":"2023-10-14T09:38:31.015743+0000","last_fullsized":"2023-10-14T09:38:31.015743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:30:03.089452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":177,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.016331+0000","last_change":"2023-10-14T09:37:12.368000+0000","last_active":"2023-10-14T09:38:31.016331+0000","last_peered":"2023-10-14T09:38:31.016331+0000","last_clean":"2023-10-14T09:38:31.016331+0000","last_became_active":"2023-10-14T09:37:12.364623+0000","last_became_peered":"2023-10-14T09:37:12.364623+0000","last_unstale":"2023-10-14T09:38:31.016331+0000","last_undegraded":"2023-10-14T09:38:31.016331+0000","last_fullsized":"2023-10-14T09:38:31.016331+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:10.796841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:10.796841+0000","last_clean_scrub_stamp":"2023-10-14T09:37:10.796841+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:48.940536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509459,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":999424,"data_stored":748946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":1.5600000000000001}]},{"osd":1,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":1.331},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.054}]},{"osd":2,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":1.421}]},{"osd":3,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":1.147},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.9060000000000001,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":1.504}]},{"osd":4,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.6759999999999999},{"interface":"front","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.389}]},{"osd":5,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":3.0129999999999999,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":1.774},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.823}]},{"osd":6,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.4260000000000002,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":1.9350000000000001},{"interface":"front","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.0710000000000002,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.4770000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509461,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":409600,"data_stored":159104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.76400000000000001}]},{"osd":1,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":1.028},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.85299999999999998}]},{"osd":2,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.4540000000000002,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.86299999999999999}]},{"osd":3,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":4.5419999999999998,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":4.2839999999999998,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":0.61399999999999999}]},{"osd":4,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":1.22}]},{"osd":5,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.7069999999999999,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":1.093}]},{"osd":7,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.5899999999999999,"5min":2.5899999999999999,"15min":2.5899999999999999},"last":1.254}]}]},{"osd":4,"up_from":15,"seq":64424509461,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":409600,"data_stored":158592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":1.621,"5min":1.621,"15min":1.621},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":13.404,"5min":13.404,"15min":13.404},"last":1.137},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":9.4640000000000004,"5min":9.4640000000000004,"15min":9.4640000000000004},"last":0.998}]},{"osd":1,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":6.734,"5min":6.734,"15min":6.734},"last":1.179},{"interface":"front","average":{"1min":1.504,"5min":1.504,"15min":1.504},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":7.8860000000000001,"5min":7.8860000000000001,"15min":7.8860000000000001},"last":1.2749999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":1.591,"5min":1.591,"15min":1.591},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":7.8520000000000003,"5min":7.8520000000000003,"15min":7.8520000000000003},"last":1.218},{"interface":"front","average":{"1min":1.889,"5min":1.889,"15min":1.889},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":14.609,"5min":14.609,"15min":14.609},"last":1.248}]},{"osd":3,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":1.964,"5min":1.964,"15min":1.964},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":15.856,"5min":15.856,"15min":15.856},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":6.1970000000000001,"5min":6.1970000000000001,"15min":6.1970000000000001},"last":0.78700000000000003}]},{"osd":5,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":16.547000000000001,"5min":16.547000000000001,"15min":16.547000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":15.913,"5min":15.913,"15min":15.913},"last":0.67300000000000004}]},{"osd":6,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":2.3029999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":16.481999999999999,"5min":16.481999999999999,"15min":16.481999999999999},"last":1.0880000000000001},{"interface":"front","average":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":15.956,"5min":15.956,"15min":15.956},"last":0.94799999999999995}]},{"osd":7,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":6.6520000000000001,"5min":6.6520000000000001,"15min":6.6520000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":2.073,"5min":2.073,"15min":2.073},"min":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":10.314,"5min":10.314,"15min":10.314},"last":1.325}]}]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":160122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.56200000000000006}]},{"osd":1,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.7349999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":0.73999999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.875},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":2.77,"5min":2.77,"15min":2.77},"last":1.133}]},{"osd":4,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.077},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":2.153,"5min":2.153,"15min":2.153},"last":1.167}]},{"osd":5,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":3.6469999999999998,"5min":3.6469999999999998,"15min":3.6469999999999998},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.90100000000000002}]},{"osd":6,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.05},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":3.6930000000000001,"5min":3.6930000000000001,"15min":3.6930000000000001},"last":1.284}]},{"osd":7,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.4249999999999998,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.22},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.2430000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509461,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":158558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.7789999999999999,"5min":2.7789999999999999,"15min":2.7789999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.39800000000000002}]},{"osd":1,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.3490000000000002,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.502}]},{"osd":3,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.4700000000000002,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.45900000000000002}]},{"osd":4,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.5960000000000001,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":3.1469999999999998,"5min":3.1469999999999998,"15min":3.1469999999999998},"last":0.91900000000000004}]},{"osd":5,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":4.0800000000000001,"5min":4.0800000000000001,"15min":4.0800000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":3.6709999999999998,"5min":3.6709999999999998,"15min":3.6709999999999998},"last":0.999}]},{"osd":6,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.9249999999999998,"5min":2.9249999999999998,"15min":2.9249999999999998},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":3.081,"5min":3.081,"15min":3.081},"last":0.83899999999999997}]},{"osd":7,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":5.0650000000000004,"5min":5.0650000000000004,"15min":5.0650000000000004},"last":0.60799999999999998},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":3.8849999999999998,"5min":3.8849999999999998,"15min":3.8849999999999998},"last":1.05}]}]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":160122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":1.123},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.476}]},{"osd":2,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.747}]},{"osd":3,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":3.1499999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.302}]},{"osd":4,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":3.7320000000000002,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":1.27},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.232}]},{"osd":5,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":3.02,"5min":3.02,"15min":3.02},"last":1.012},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":3.827,"5min":3.827,"15min":3.827},"last":1.1919999999999999}]},{"osd":6,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.597},{"interface":"front","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":3.3250000000000002,"5min":3.3250000000000002,"15min":3.3250000000000002},"last":1.4279999999999999}]},{"osd":7,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":3.9100000000000001,"5min":3.9100000000000001,"15min":3.9100000000000001},"last":1.411},{"interface":"front","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":3.105,"5min":3.105,"15min":3.105},"last":1.8220000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542164,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":159160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.173},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.5720000000000001}]},{"osd":1,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.482},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.747}]},{"osd":2,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":4.4610000000000003,"5min":4.4610000000000003,"15min":4.4610000000000003},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.88900000000000001}]},{"osd":3,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.089}]},{"osd":4,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":1.351},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.6240000000000001}]},{"osd":6,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":1.252}]},{"osd":7,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":2.387,"5min":2.387,"15min":2.387},"last":1.679},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.403}]}]},{"osd":0,"up_from":14,"seq":60129542164,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":995328,"data_stored":748856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":3.0750000000000002,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.2919999999999998,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":1.1970000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":1.7470000000000001},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":4.2210000000000001,"5min":4.2210000000000001,"15min":4.2210000000000001},"last":1.012}]},{"osd":3,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":3.6070000000000002,"5min":3.6070000000000002,"15min":3.6070000000000002},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.3380000000000001}]},{"osd":4,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":4.1609999999999996,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":1.27},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":2.391,"5min":2.391,"15min":2.391},"last":1.242}]},{"osd":5,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":3.8620000000000001,"5min":3.8620000000000001,"15min":3.8620000000000001},"last":1.6799999999999999},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":2.4220000000000002,"5min":2.4220000000000002,"15min":2.4220000000000002},"last":1.486}]},{"osd":6,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":3.8210000000000002,"5min":3.8210000000000002,"15min":3.8210000000000002},"last":1.538},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"min":{"1min":0.997,"5min":0.997,"15min":0.997},"max":{"1min":4.0999999999999996,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":1.405}]},{"osd":7,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":1.581,"15min":1.581},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":4.1920000000000002,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":1.593},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.6359999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T09:38:35.967 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T09:38:35.967 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=testcephfs1' mds allow 2023-10-14T09:38:36.227 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.226+0000 7f1bb344b640 1 Processor -- start 2023-10-14T09:38:36.227 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.226+0000 7f1bb344b640 1 -- start start 2023-10-14T09:38:36.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.228+0000 7f1bb344b640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f1bac0b0b20 0x7f1bac15d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:36.229 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.228+0000 7f1bb344b640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bac15e3c0 con 0x7f1bac1615d0 2023-10-14T09:38:36.229 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.228+0000 7f1bb344b640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bac15e0e0 con 0x7f1bac0ccfc0 2023-10-14T09:38:36.229 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.228+0000 7f1bb344b640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bac160af0 con 0x7f1bac0b0b20 2023-10-14T09:38:36.231 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.228+0000 7f1bb19e8640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f1bac1615d0 0x7f1bac15d930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55632/0 (socket says 172.21.15.102:55632) 2023-10-14T09:38:36.231 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.228+0000 7f1bb19e8640 1 -- 172.21.15.102:0/1383047349 learned_addr learned my addr 172.21.15.102:0/1383047349 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:36.231 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.228+0000 7f1bb09e6640 1 --2- 172.21.15.102:0/1383047349 >> v2:172.21.15.129:3300/0 conn(0x7f1bac0b0b20 0x7f1bac15d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:36.232 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.229+0000 7f1ba3fff640 1 -- 172.21.15.102:0/1383047349 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2303946073 0 0) 0x7f1bac15e3c0 con 0x7f1bac1615d0 2023-10-14T09:38:36.232 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.229+0000 7f1ba3fff640 1 -- 172.21.15.102:0/1383047349 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b98003520 con 0x7f1bac1615d0 2023-10-14T09:38:36.232 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.229+0000 7f1ba3fff640 1 -- 172.21.15.102:0/1383047349 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2847412902 0 0) 0x7f1b98003520 con 0x7f1bac1615d0 2023-10-14T09:38:36.232 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.229+0000 7f1ba3fff640 1 -- 172.21.15.102:0/1383047349 >> v2:172.21.15.129:3300/0 conn(0x7f1bac0b0b20 msgr2=0x7f1bac15d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:36.232 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.229+0000 7f1ba3fff640 1 --2- 172.21.15.102:0/1383047349 >> v2:172.21.15.129:3300/0 conn(0x7f1bac0b0b20 0x7f1bac15d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:36.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.229+0000 7f1ba3fff640 1 -- 172.21.15.102:0/1383047349 >> v1:172.21.15.129:6789/0 conn(0x7f1bac0ccfc0 legacy=0x7f1bac0b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:36.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.229+0000 7f1ba3fff640 1 -- 172.21.15.102:0/1383047349 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bac160dd0 con 0x7f1bac1615d0 2023-10-14T09:38:36.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.229+0000 7f1ba3fff640 1 -- 172.21.15.102:0/1383047349 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4030661168 0 0) 0x7f1ba40019f0 con 0x7f1bac1615d0 2023-10-14T09:38:36.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.229+0000 7f1ba3fff640 1 -- 172.21.15.102:0/1383047349 >> v1:172.21.15.102:6789/0 conn(0x7f1bac1615d0 legacy=0x7f1bac15d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:36.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.229+0000 7f1ba3fff640 1 --2- 172.21.15.102:0/1383047349 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1b98003970 0x7f1b98003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:36.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.229+0000 7f1ba3fff640 1 --2- 172.21.15.102:0/1383047349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b980047c0 0x7f1b98004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:36.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.229+0000 7f1ba3fff640 1 --2- 172.21.15.102:0/1383047349 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1b98005180 0x7f1b9800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:36.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.229+0000 7f1ba3fff640 1 -- 172.21.15.102:0/1383047349 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bac160af0 con 0x7f1b980047c0 2023-10-14T09:38:36.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.229+0000 7f1ba3fff640 1 -- 172.21.15.102:0/1383047349 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9800c120 con 0x7f1b98005180 2023-10-14T09:38:36.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.229+0000 7f1ba3fff640 1 -- 172.21.15.102:0/1383047349 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9800c2e0 con 0x7f1b98003970 2023-10-14T09:38:36.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.229+0000 7f1bb09e6640 1 --2- 172.21.15.102:0/1383047349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b980047c0 0x7f1b98004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:36.235 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.230+0000 7f1bb19e8640 1 --2- 172.21.15.102:0/1383047349 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1b98005180 0x7f1b9800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:36.235 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.230+0000 7f1bb11e7640 1 --2- 172.21.15.102:0/1383047349 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1b98003970 0x7f1b98003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:36.235 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.230+0000 7f1bb09e6640 1 -- 172.21.15.102:0/1383047349 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1b98003970 msgr2=0x7f1b98003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:36.235 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.230+0000 7f1bb09e6640 1 --2- 172.21.15.102:0/1383047349 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1b98003970 0x7f1b98003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:36.235 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.230+0000 7f1bb09e6640 1 -- 172.21.15.102:0/1383047349 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1b98005180 msgr2=0x7f1b9800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:36.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.230+0000 7f1bb09e6640 1 --2- 172.21.15.102:0/1383047349 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1b98005180 0x7f1b9800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:36.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.230+0000 7f1bb09e6640 1 -- 172.21.15.102:0/1383047349 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b98003520 con 0x7f1b980047c0 2023-10-14T09:38:36.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.230+0000 7f1bb19e8640 1 -- 172.21.15.102:0/1383047349 reap_dead start 2023-10-14T09:38:36.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.230+0000 7f1bb11e7640 1 --2- 172.21.15.102:0/1383047349 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1b98003970 0x7f1b98003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:36.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.231+0000 7f1bb09e6640 1 --2- 172.21.15.102:0/1383047349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b980047c0 0x7f1b98004c40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c009ac0 tx=0x7f1b980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa225f0bc4951787 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:36.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.231+0000 7f1ba3fff640 1 -- 172.21.15.102:0/1383047349 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c02c6b0 con 0x7f1b980047c0 2023-10-14T09:38:36.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.231+0000 7f1ba3fff640 1 -- 172.21.15.102:0/1383047349 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b9c02c810 con 0x7f1b980047c0 2023-10-14T09:38:36.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.231+0000 7f1ba3fff640 1 -- 172.21.15.102:0/1383047349 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c02cba0 con 0x7f1b980047c0 2023-10-14T09:38:36.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.232+0000 7f1bb344b640 1 -- 172.21.15.102:0/1383047349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b980047c0 msgr2=0x7f1b98004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:36.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.232+0000 7f1bb344b640 1 --2- 172.21.15.102:0/1383047349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b980047c0 0x7f1b98004c40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c009ac0 tx=0x7f1b980057f0 comp rx=0 tx=0).stop 2023-10-14T09:38:36.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.232+0000 7f1bb344b640 1 -- 172.21.15.102:0/1383047349 shutdown_connections 2023-10-14T09:38:36.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.232+0000 7f1bb344b640 1 --2- 172.21.15.102:0/1383047349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b980047c0 0x7f1b98004c40 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:36.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.232+0000 7f1bb344b640 1 -- 172.21.15.102:0/1383047349 >> 172.21.15.102:0/1383047349 conn(0x7f1bac0cb410 msgr2=0x7f1bac0cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:36.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.232+0000 7f1bb344b640 1 -- 172.21.15.102:0/1383047349 shutdown_connections 2023-10-14T09:38:36.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.232+0000 7f1bb344b640 1 -- 172.21.15.102:0/1383047349 wait complete. 2023-10-14T09:38:36.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.234+0000 7f1bb344b640 1 Processor -- start 2023-10-14T09:38:36.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.234+0000 7f1bb344b640 1 -- start start 2023-10-14T09:38:36.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.235+0000 7f1bb344b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1b980047c0 0x7f1bac0c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:36.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.235+0000 7f1bb344b640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1bac0b3130 0x7f1bac0b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:36.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.235+0000 7f1bb344b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1bac1541c0 0x7f1bac154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:36.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.235+0000 7f1bb344b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bac0b3af0 con 0x7f1bac1541c0 2023-10-14T09:38:36.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.235+0000 7f1bb344b640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bac152ae0 con 0x7f1b980047c0 2023-10-14T09:38:36.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.235+0000 7f1bb344b640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bac152dc0 con 0x7f1bac0b3130 2023-10-14T09:38:36.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.235+0000 7f1bb19e8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1bac1541c0 0x7f1bac154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:36.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.235+0000 7f1bb19e8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1bac1541c0 0x7f1bac154640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40978/0 (socket says 172.21.15.102:40978) 2023-10-14T09:38:36.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.235+0000 7f1bb19e8640 1 -- 172.21.15.102:0/1042207324 learned_addr learned my addr 172.21.15.102:0/1042207324 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:36.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.236+0000 7f1bb11e7640 1 --2- 172.21.15.102:0/1042207324 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1b980047c0 0x7f1bac0c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:36.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.236+0000 7f1bb09e6640 1 --2- 172.21.15.102:0/1042207324 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1bac0b3130 0x7f1bac0b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:36.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.236+0000 7f1bb19e8640 1 -- 172.21.15.102:0/1042207324 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1bac0b3130 msgr2=0x7f1bac0b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:36.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.236+0000 7f1bb19e8640 1 --2- 172.21.15.102:0/1042207324 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1bac0b3130 0x7f1bac0b35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:36.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.236+0000 7f1bb19e8640 1 -- 172.21.15.102:0/1042207324 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1b980047c0 msgr2=0x7f1bac0c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:36.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.236+0000 7f1bb19e8640 1 --2- 172.21.15.102:0/1042207324 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1b980047c0 0x7f1bac0c4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:36.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.236+0000 7f1bb19e8640 1 -- 172.21.15.102:0/1042207324 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bac1530a0 con 0x7f1bac1541c0 2023-10-14T09:38:36.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.236+0000 7f1bb09e6640 1 --2- 172.21.15.102:0/1042207324 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1bac0b3130 0x7f1bac0b35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:36.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.236+0000 7f1bb19e8640 1 --2- 172.21.15.102:0/1042207324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1bac1541c0 0x7f1bac154640 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1bac0cc190 tx=0x7f1ba400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:36.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.236+0000 7f1ba1ffb640 1 -- 172.21.15.102:0/1042207324 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba400ec10 con 0x7f1bac1541c0 2023-10-14T09:38:36.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.236+0000 7f1ba1ffb640 1 -- 172.21.15.102:0/1042207324 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba400ed70 con 0x7f1bac1541c0 2023-10-14T09:38:36.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.237+0000 7f1bb344b640 1 -- 172.21.15.102:0/1042207324 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bac153380 con 0x7f1bac1541c0 2023-10-14T09:38:36.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.237+0000 7f1ba1ffb640 1 -- 172.21.15.102:0/1042207324 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba400eee0 con 0x7f1bac1541c0 2023-10-14T09:38:36.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.237+0000 7f1bb344b640 1 -- 172.21.15.102:0/1042207324 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bac154b80 con 0x7f1bac1541c0 2023-10-14T09:38:36.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.238+0000 7f1bb344b640 1 -- 172.21.15.102:0/1042207324 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bac0709e0 con 0x7f1bac1541c0 2023-10-14T09:38:36.247 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.239+0000 7f1ba1ffb640 1 -- 172.21.15.102:0/1042207324 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1ba4013640 con 0x7f1bac1541c0 2023-10-14T09:38:36.247 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.240+0000 7f1ba1ffb640 1 --2- 172.21.15.102:0/1042207324 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1b9006aea0 0x7f1b9006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:36.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.240+0000 7f1ba1ffb640 1 -- 172.21.15.102:0/1042207324 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f1ba4089b90 con 0x7f1bac1541c0 2023-10-14T09:38:36.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.240+0000 7f1bb11e7640 1 --2- 172.21.15.102:0/1042207324 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1b9006aea0 0x7f1b9006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:36.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.240+0000 7f1bb11e7640 1 --2- 172.21.15.102:0/1042207324 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1b9006aea0 0x7f1b9006d360 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1bac069740 tx=0x7f1ba8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:36.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.244+0000 7f1ba1ffb640 1 -- 172.21.15.102:0/1042207324 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1ba4054b80 con 0x7f1bac1541c0 2023-10-14T09:38:36.502 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.502+0000 7f1bb344b640 1 -- 172.21.15.102:0/1042207324 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=testcephfs1", "mds", "allow"]} v 0) v1 -- 0x7f1bac04e160 con 0x7f1bac1541c0 2023-10-14T09:38:36.507 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.507+0000 7f1ba1ffb640 1 -- 172.21.15.102:0/1042207324 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=testcephfs1", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 195+0+152 (secure 0 0 0) 0x7f1ba40581a0 con 0x7f1bac1541c0 2023-10-14T09:38:36.508 INFO:teuthology.orchestra.run.smithi102.stdout:[client.0] 2023-10-14T09:38:36.508 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAGYSpl2DQTAxAAccp2NglfLx6Vx/BGxH6+fA== 2023-10-14T09:38:36.508 INFO:teuthology.orchestra.run.smithi102.stdout: caps mds = "allow" 2023-10-14T09:38:36.509 INFO:teuthology.orchestra.run.smithi102.stdout: caps mon = "allow r" 2023-10-14T09:38:36.509 INFO:teuthology.orchestra.run.smithi102.stdout: caps osd = "allow rw tag cephfs data=testcephfs1" 2023-10-14T09:38:36.509 INFO:teuthology.orchestra.run.smithi102.stderr:updated caps for client.0 2023-10-14T09:38:36.511 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.510+0000 7f1bb344b640 1 -- 172.21.15.102:0/1042207324 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1b9006aea0 msgr2=0x7f1b9006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:36.511 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.510+0000 7f1bb344b640 1 --2- 172.21.15.102:0/1042207324 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1b9006aea0 0x7f1b9006d360 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1bac069740 tx=0x7f1ba8009040 comp rx=0 tx=0).stop 2023-10-14T09:38:36.511 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.510+0000 7f1bb344b640 1 -- 172.21.15.102:0/1042207324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1bac1541c0 msgr2=0x7f1bac154640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:36.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.510+0000 7f1bb344b640 1 --2- 172.21.15.102:0/1042207324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1bac1541c0 0x7f1bac154640 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1bac0cc190 tx=0x7f1ba400e530 comp rx=0 tx=0).stop 2023-10-14T09:38:36.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.510+0000 7f1bb344b640 1 -- 172.21.15.102:0/1042207324 shutdown_connections 2023-10-14T09:38:36.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.510+0000 7f1bb344b640 1 --2- 172.21.15.102:0/1042207324 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1b9006aea0 0x7f1b9006d360 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:36.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.510+0000 7f1bb344b640 1 --2- 172.21.15.102:0/1042207324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1bac1541c0 0x7f1bac154640 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:36.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.510+0000 7f1bb344b640 1 --2- 172.21.15.102:0/1042207324 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1bac0b3130 0x7f1bac0b35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:36.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.510+0000 7f1bb344b640 1 --2- 172.21.15.102:0/1042207324 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1b980047c0 0x7f1bac0c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:36.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.510+0000 7f1bb344b640 1 -- 172.21.15.102:0/1042207324 >> 172.21.15.102:0/1042207324 conn(0x7f1bac0cb410 msgr2=0x7f1bac070010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:36.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.510+0000 7f1bb344b640 1 -- 172.21.15.102:0/1042207324 shutdown_connections 2023-10-14T09:38:36.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.511+0000 7f1bb344b640 1 -- 172.21.15.102:0/1042207324 wait complete. 2023-10-14T09:38:36.529 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:38:36.733 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.731+0000 7f867d983640 1 Processor -- start 2023-10-14T09:38:36.734 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.731+0000 7f867d983640 1 -- start start 2023-10-14T09:38:36.735 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.733+0000 7f867d983640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f86780b0b20 0x7f86781615f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:36.736 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.733+0000 7f867d983640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f867815d3f0 0x7f867815d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:36.736 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.733+0000 7f867d983640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f867815e3e0 con 0x7f86780cd0c0 2023-10-14T09:38:36.736 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.733+0000 7f867d983640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86780cd4a0 con 0x7f86780b0b20 2023-10-14T09:38:36.736 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.733+0000 7f867d983640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867815e100 con 0x7f867815d3f0 2023-10-14T09:38:36.736 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.734+0000 7f866e7fc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f86780b0b20 0x7f86781615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:36.737 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.734+0000 7f866e7fc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f86780b0b20 0x7f86781615f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40992/0 (socket says 172.21.15.102:40992) 2023-10-14T09:38:36.737 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.734+0000 7f8676ffd640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f86780cd0c0 0x7f86780b0410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55642/0 (socket says 172.21.15.102:55642) 2023-10-14T09:38:36.737 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.734+0000 7f866e7fc640 1 -- 172.21.15.102:0/2930807769 learned_addr learned my addr 172.21.15.102:0/2930807769 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:36.738 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.734+0000 7f866e7fc640 1 -- 172.21.15.102:0/2930807769 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f867815d3f0 msgr2=0x7f867815d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:36.738 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.734+0000 7f866e7fc640 1 --2- 172.21.15.102:0/2930807769 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f867815d3f0 0x7f867815d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:36.738 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.734+0000 7f866e7fc640 1 -- 172.21.15.102:0/2930807769 >> v1:172.21.15.102:6789/0 conn(0x7f86780cd0c0 legacy=0x7f86780b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:36.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.734+0000 7f86767fc640 1 -- 172.21.15.102:0/2930807769 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3322707671 0 0) 0x7f867815e3e0 con 0x7f86780cd0c0 2023-10-14T09:38:36.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.734+0000 7f866e7fc640 1 -- 172.21.15.102:0/2930807769 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8678160b10 con 0x7f86780b0b20 2023-10-14T09:38:36.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.735+0000 7f866e7fc640 1 --2- 172.21.15.102:0/2930807769 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86780b0b20 0x7f86781615f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8660009870 tx=0x7f866002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f4f1809a654917 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:36.740 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.737+0000 7f86767fc640 1 -- 172.21.15.102:0/2930807769 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8660031640 con 0x7f86780b0b20 2023-10-14T09:38:36.740 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.737+0000 7f86767fc640 1 -- 172.21.15.102:0/2930807769 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86600317a0 con 0x7f86780b0b20 2023-10-14T09:38:36.740 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.737+0000 7f86767fc640 1 -- 172.21.15.102:0/2930807769 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8660031b30 con 0x7f86780b0b20 2023-10-14T09:38:36.741 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.737+0000 7f867d983640 1 -- 172.21.15.102:0/2930807769 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86780b0b20 msgr2=0x7f86781615f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:36.741 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.737+0000 7f867d983640 1 --2- 172.21.15.102:0/2930807769 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86780b0b20 0x7f86781615f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8660009870 tx=0x7f866002b8f0 comp rx=0 tx=0).stop 2023-10-14T09:38:36.741 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.738+0000 7f867d983640 1 -- 172.21.15.102:0/2930807769 shutdown_connections 2023-10-14T09:38:36.741 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.738+0000 7f867d983640 1 --2- 172.21.15.102:0/2930807769 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f867815d3f0 0x7f867815d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:36.741 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.738+0000 7f867d983640 1 --2- 172.21.15.102:0/2930807769 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86780b0b20 0x7f86781615f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:36.742 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.738+0000 7f867d983640 1 -- 172.21.15.102:0/2930807769 >> 172.21.15.102:0/2930807769 conn(0x7f86780cb410 msgr2=0x7f86780cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:36.742 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.738+0000 7f867d983640 1 -- 172.21.15.102:0/2930807769 shutdown_connections 2023-10-14T09:38:36.742 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.738+0000 7f867d983640 1 -- 172.21.15.102:0/2930807769 wait complete. 2023-10-14T09:38:36.744 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.739+0000 7f867d983640 1 Processor -- start 2023-10-14T09:38:36.744 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.739+0000 7f867d983640 1 -- start start 2023-10-14T09:38:36.744 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.740+0000 7f867d983640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f86780b0b20 0x7f86780b0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:36.744 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.740+0000 7f867d983640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f86780cd0c0 0x7f8678154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:36.745 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.740+0000 7f867d983640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f867815d3f0 0x7f86780af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:36.745 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.740+0000 7f867d983640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86780afbe0 con 0x7f867815d3f0 2023-10-14T09:38:36.745 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.740+0000 7f867d983640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86780ae350 con 0x7f86780cd0c0 2023-10-14T09:38:36.745 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.740+0000 7f867d983640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86780afe60 con 0x7f86780b0b20 2023-10-14T09:38:36.746 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.741+0000 7f86777fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f867815d3f0 0x7f86780af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:36.746 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.741+0000 7f86777fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f867815d3f0 0x7f86780af6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40994/0 (socket says 172.21.15.102:40994) 2023-10-14T09:38:36.746 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.741+0000 7f86777fe640 1 -- 172.21.15.102:0/2213837234 learned_addr learned my addr 172.21.15.102:0/2213837234 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:36.746 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.741+0000 7f866e7fc640 1 --2- 172.21.15.102:0/2213837234 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f86780cd0c0 0x7f8678154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:36.746 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.741+0000 7f86777fe640 1 -- 172.21.15.102:0/2213837234 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f86780b0b20 msgr2=0x7f86780b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:36.747 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.741+0000 7f86777fe640 1 --2- 172.21.15.102:0/2213837234 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f86780b0b20 0x7f86780b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:36.747 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.741+0000 7f86777fe640 1 -- 172.21.15.102:0/2213837234 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f86780cd0c0 msgr2=0x7f8678154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:36.747 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.741+0000 7f86777fe640 1 --2- 172.21.15.102:0/2213837234 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f86780cd0c0 0x7f8678154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:36.747 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.741+0000 7f86777fe640 1 -- 172.21.15.102:0/2213837234 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86600094d0 con 0x7f867815d3f0 2023-10-14T09:38:36.747 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.741+0000 7f866e7fc640 1 --2- 172.21.15.102:0/2213837234 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f86780cd0c0 0x7f8678154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:36.747 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.741+0000 7f86777fe640 1 --2- 172.21.15.102:0/2213837234 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f867815d3f0 0x7f86780af6a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f867000b970 tx=0x7f867000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:36.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.742+0000 7f8674ff9640 1 -- 172.21.15.102:0/2213837234 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867000cb40 con 0x7f867815d3f0 2023-10-14T09:38:36.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.742+0000 7f8674ff9640 1 -- 172.21.15.102:0/2213837234 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867000ccc0 con 0x7f867815d3f0 2023-10-14T09:38:36.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.742+0000 7f867d983640 1 -- 172.21.15.102:0/2213837234 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86780ae5f0 con 0x7f867815d3f0 2023-10-14T09:38:36.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.742+0000 7f8674ff9640 1 -- 172.21.15.102:0/2213837234 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8670014680 con 0x7f867815d3f0 2023-10-14T09:38:36.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.742+0000 7f867d983640 1 -- 172.21.15.102:0/2213837234 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86780aebb0 con 0x7f867815d3f0 2023-10-14T09:38:36.749 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.743+0000 7f867d983640 1 -- 172.21.15.102:0/2213837234 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86781615f0 con 0x7f867815d3f0 2023-10-14T09:38:36.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.744+0000 7f8674ff9640 1 -- 172.21.15.102:0/2213837234 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f867001d3b0 con 0x7f867815d3f0 2023-10-14T09:38:36.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.745+0000 7f8674ff9640 1 --2- 172.21.15.102:0/2213837234 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f865806ae70 0x7f865806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:36.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.745+0000 7f8674ff9640 1 -- 172.21.15.102:0/2213837234 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f8670089680 con 0x7f867815d3f0 2023-10-14T09:38:36.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.745+0000 7f8676ffd640 1 --2- 172.21.15.102:0/2213837234 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f865806ae70 0x7f865806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:36.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.746+0000 7f8676ffd640 1 --2- 172.21.15.102:0/2213837234 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f865806ae70 0x7f865806d330 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8668007fd0 tx=0x7f8668007960 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:36.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.749+0000 7f8674ff9640 1 -- 172.21.15.102:0/2213837234 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8670054670 con 0x7f867815d3f0 2023-10-14T09:38:36.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.981+0000 7f867d983640 1 -- 172.21.15.102:0/2213837234 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f867804e160 con 0x7f867815d3f0 2023-10-14T09:38:36.983 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.982+0000 7f8674ff9640 1 -- 172.21.15.102:0/2213837234 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4930 (secure 0 0 0) 0x7f8670057c90 con 0x7f867815d3f0 2023-10-14T09:38:36.984 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:38:36.984 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4690,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6834/2498306399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":2498306399},{"type":"v1","addr":"172.21.15.129:6834","nonce":2498306399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5112,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1229082928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1229082928},{"type":"v1","addr":"172.21.15.102:6835","nonce":1229082928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5115,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2934809937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2934809937},{"type":"v1","addr":"172.21.15.102:6837","nonce":2934809937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T09:38:30.451239+0000","modified":"2023-10-14T09:38:33.483456+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5130":{"gid":5130,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.129:6835/4209319148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6833","nonce":4209319148},{"type":"v1","addr":"172.21.15.129:6835","nonce":4209319148}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T09:38:36.984 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 15 2023-10-14T09:38:36.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.984+0000 7f867d983640 1 -- 172.21.15.102:0/2213837234 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f865806ae70 msgr2=0x7f865806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:36.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.984+0000 7f867d983640 1 --2- 172.21.15.102:0/2213837234 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f865806ae70 0x7f865806d330 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8668007fd0 tx=0x7f8668007960 comp rx=0 tx=0).stop 2023-10-14T09:38:36.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.984+0000 7f867d983640 1 -- 172.21.15.102:0/2213837234 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f867815d3f0 msgr2=0x7f86780af6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:36.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.984+0000 7f867d983640 1 --2- 172.21.15.102:0/2213837234 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f867815d3f0 0x7f86780af6a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f867000b970 tx=0x7f867000be30 comp rx=0 tx=0).stop 2023-10-14T09:38:36.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.985+0000 7f867d983640 1 -- 172.21.15.102:0/2213837234 shutdown_connections 2023-10-14T09:38:36.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.985+0000 7f867d983640 1 --2- 172.21.15.102:0/2213837234 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f865806ae70 0x7f865806d330 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:36.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.985+0000 7f867d983640 1 --2- 172.21.15.102:0/2213837234 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f867815d3f0 0x7f86780af6a0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:36.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.985+0000 7f867d983640 1 --2- 172.21.15.102:0/2213837234 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f86780cd0c0 0x7f8678154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:36.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.985+0000 7f867d983640 1 --2- 172.21.15.102:0/2213837234 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f86780b0b20 0x7f86780b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:36.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.985+0000 7f867d983640 1 -- 172.21.15.102:0/2213837234 >> 172.21.15.102:0/2213837234 conn(0x7f86780cb410 msgr2=0x7f86780c8fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:36.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.985+0000 7f867d983640 1 -- 172.21.15.102:0/2213837234 shutdown_connections 2023-10-14T09:38:36.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:36.985+0000 7f867d983640 1 -- 172.21.15.102:0/2213837234 wait complete. 2023-10-14T09:38:37.406 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T09:38:30.451239+0000', 'modified': '2023-10-14T09:38:33.483456+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5130}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5130': {'gid': 5130, 'name': 'b', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.129:6835/4209319148', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6833', 'nonce': 4209319148}, {'type': 'v1', 'addr': '172.21.15.129:6835', 'nonce': 4209319148}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'testcephfs1', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-14T09:38:37.406 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T09:38:37.407 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-14T09:38:37.631 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.630+0000 7fe1f2060640 1 Processor -- start 2023-10-14T09:38:37.632 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.630+0000 7fe1f2060640 1 -- start start 2023-10-14T09:38:37.633 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.631+0000 7fe1f2060640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe1ec0ad970 0x7fe1ec0cca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:37.633 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.631+0000 7fe1f2060640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1ec15b9d0 con 0x7fe1ec06c040 2023-10-14T09:38:37.633 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.631+0000 7fe1f2060640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1ec15bcb0 con 0x7fe1ec0ccfb0 2023-10-14T09:38:37.634 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.631+0000 7fe1f2060640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1ec15bf90 con 0x7fe1ec0ad970 2023-10-14T09:38:37.634 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.632+0000 7fe1f085d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe1ec0ad970 0x7fe1ec0cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:37.634 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.632+0000 7fe1f085d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe1ec0ad970 0x7fe1ec0cca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41006/0 (socket says 172.21.15.102:41006) 2023-10-14T09:38:37.634 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.632+0000 7fe1f085d640 1 -- 172.21.15.102:0/421753119 learned_addr learned my addr 172.21.15.102:0/421753119 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:37.636 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.632+0000 7fe1f085d640 1 -- 172.21.15.102:0/421753119 >> v1:172.21.15.129:6789/0 conn(0x7fe1ec0ccfb0 legacy=0x7fe1ec0cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:37.636 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.632+0000 7fe1f085d640 1 -- 172.21.15.102:0/421753119 >> v1:172.21.15.102:6789/0 conn(0x7fe1ec06c040 legacy=0x7fe1ec06c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:37.636 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.632+0000 7fe1f085d640 1 -- 172.21.15.102:0/421753119 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ec0cc270 con 0x7fe1ec0ad970 2023-10-14T09:38:37.637 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.632+0000 7fe1dffff640 1 -- 172.21.15.102:0/421753119 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2420459495 0 0) 0x7fe1ec15b9d0 con 0x7fe1ec06c040 2023-10-14T09:38:37.637 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.633+0000 7fe1f085d640 1 --2- 172.21.15.102:0/421753119 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1ec0ad970 0x7fe1ec0cca70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00098a0 tx=0x7fe1e002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f6e1654cb7e95a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:37.637 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.634+0000 7fe1dffff640 1 -- 172.21.15.102:0/421753119 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0030840 con 0x7fe1ec0ad970 2023-10-14T09:38:37.637 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.634+0000 7fe1dffff640 1 -- 172.21.15.102:0/421753119 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e00309a0 con 0x7fe1ec0ad970 2023-10-14T09:38:37.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.634+0000 7fe1dffff640 1 -- 172.21.15.102:0/421753119 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0030d30 con 0x7fe1ec0ad970 2023-10-14T09:38:37.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.634+0000 7fe1f2060640 1 -- 172.21.15.102:0/421753119 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1ec0ad970 msgr2=0x7fe1ec0cca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:37.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.634+0000 7fe1f2060640 1 --2- 172.21.15.102:0/421753119 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1ec0ad970 0x7fe1ec0cca70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00098a0 tx=0x7fe1e002b980 comp rx=0 tx=0).stop 2023-10-14T09:38:37.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.634+0000 7fe1f2060640 1 -- 172.21.15.102:0/421753119 shutdown_connections 2023-10-14T09:38:37.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.634+0000 7fe1f2060640 1 --2- 172.21.15.102:0/421753119 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1ec0ad970 0x7fe1ec0cca70 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.634+0000 7fe1f2060640 1 -- 172.21.15.102:0/421753119 >> 172.21.15.102:0/421753119 conn(0x7fe1ec0ce6a0 msgr2=0x7fe1ec0ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:37.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.634+0000 7fe1f2060640 1 -- 172.21.15.102:0/421753119 shutdown_connections 2023-10-14T09:38:37.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.634+0000 7fe1f2060640 1 -- 172.21.15.102:0/421753119 wait complete. 2023-10-14T09:38:37.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.636+0000 7fe1f2060640 1 Processor -- start 2023-10-14T09:38:37.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.636+0000 7fe1f2060640 1 -- start start 2023-10-14T09:38:37.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.637+0000 7fe1f2060640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1ec06c040 0x7fe1ec14a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:37.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.637+0000 7fe1f2060640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe1ec0ad970 0x7fe1ec157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:37.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.637+0000 7fe1f2060640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe1ec0ccfb0 0x7fe1ec0b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:37.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.637+0000 7fe1f2060640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec0adf80 con 0x7fe1ec06c040 2023-10-14T09:38:37.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.637+0000 7fe1f2060640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec0b0630 con 0x7fe1ec0ccfb0 2023-10-14T09:38:37.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.637+0000 7fe1f2060640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec158130 con 0x7fe1ec0ad970 2023-10-14T09:38:37.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.637+0000 7fe1f105e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1ec06c040 0x7fe1ec14a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:37.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.637+0000 7fe1f105e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1ec06c040 0x7fe1ec14a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41012/0 (socket says 172.21.15.102:41012) 2023-10-14T09:38:37.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.637+0000 7fe1f105e640 1 -- 172.21.15.102:0/1220430622 learned_addr learned my addr 172.21.15.102:0/1220430622 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:37.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.638+0000 7fe1f085d640 1 --2- 172.21.15.102:0/1220430622 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe1ec0ad970 0x7fe1ec157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:37.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.638+0000 7fe1f105e640 1 -- 172.21.15.102:0/1220430622 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe1ec0ad970 msgr2=0x7fe1ec157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:37.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.638+0000 7fe1f185f640 1 --2- 172.21.15.102:0/1220430622 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe1ec0ccfb0 0x7fe1ec0b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:37.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.638+0000 7fe1f105e640 1 --2- 172.21.15.102:0/1220430622 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe1ec0ad970 0x7fe1ec157850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.638+0000 7fe1f105e640 1 -- 172.21.15.102:0/1220430622 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe1ec0ccfb0 msgr2=0x7fe1ec0b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:37.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.638+0000 7fe1f105e640 1 --2- 172.21.15.102:0/1220430622 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe1ec0ccfb0 0x7fe1ec0b3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.638+0000 7fe1f105e640 1 -- 172.21.15.102:0/1220430622 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e00094d0 con 0x7fe1ec06c040 2023-10-14T09:38:37.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.638+0000 7fe1f185f640 1 --2- 172.21.15.102:0/1220430622 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe1ec0ccfb0 0x7fe1ec0b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:37.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.638+0000 7fe1f105e640 1 --2- 172.21.15.102:0/1220430622 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1ec06c040 0x7fe1ec14a6b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe1e800c410 tx=0x7fe1e800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:37.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.638+0000 7fe1ddffb640 1 -- 172.21.15.102:0/1220430622 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e80035f0 con 0x7fe1ec06c040 2023-10-14T09:38:37.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.639+0000 7fe1ddffb640 1 -- 172.21.15.102:0/1220430622 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e8003770 con 0x7fe1ec06c040 2023-10-14T09:38:37.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.639+0000 7fe1f2060640 1 -- 172.21.15.102:0/1220430622 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1ec158410 con 0x7fe1ec06c040 2023-10-14T09:38:37.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.639+0000 7fe1ddffb640 1 -- 172.21.15.102:0/1220430622 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e8003b20 con 0x7fe1ec06c040 2023-10-14T09:38:37.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.639+0000 7fe1f2060640 1 -- 172.21.15.102:0/1220430622 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ec1589d0 con 0x7fe1ec06c040 2023-10-14T09:38:37.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.642+0000 7fe1ddffb640 1 -- 172.21.15.102:0/1220430622 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe1e8003c80 con 0x7fe1ec06c040 2023-10-14T09:38:37.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.643+0000 7fe1ddffb640 1 --2- 172.21.15.102:0/1220430622 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe1d006ae70 0x7fe1d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:37.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.643+0000 7fe1ddffb640 1 -- 172.21.15.102:0/1220430622 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fe1e8088c60 con 0x7fe1ec06c040 2023-10-14T09:38:37.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.643+0000 7fe1f085d640 1 --2- 172.21.15.102:0/1220430622 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe1d006ae70 0x7fe1d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:37.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.643+0000 7fe1f5e54740 1 Processor -- start 2023-10-14T09:38:37.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.644+0000 7fe1f5e54740 1 -- start start 2023-10-14T09:38:37.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.644+0000 7fe1f085d640 1 --2- 172.21.15.102:0/1220430622 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe1d006ae70 0x7fe1d006d330 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0036000 tx=0x7fe1e003b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:37.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.644+0000 7fe1f5e54740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611e6d07580 0x5611e6cda480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:37.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.644+0000 7fe1f5e54740 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611e6d07960 0x5611e6d0a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:37.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.645+0000 7fe1f5e54740 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5611e6cda9c0 0x5611e6d0a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:37.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.645+0000 7fe1f5e54740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611e6bf67a0 con 0x5611e6d07580 2023-10-14T09:38:37.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.645+0000 7fe1f5e54740 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611e6c48740 con 0x5611e6d07960 2023-10-14T09:38:37.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.645+0000 7fe1f5e54740 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611e6c45e30 con 0x5611e6cda9c0 2023-10-14T09:38:37.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.645+0000 7fe1f105e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611e6d07580 0x5611e6cda480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:37.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.645+0000 7fe1f105e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611e6d07580 0x5611e6cda480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41016/0 (socket says 172.21.15.102:41016) 2023-10-14T09:38:37.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.645+0000 7fe1f105e640 1 -- 172.21.15.102:0/1026826690 learned_addr learned my addr 172.21.15.102:0/1026826690 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:37.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.645+0000 7fe1f105e640 1 -- 172.21.15.102:0/1026826690 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5611e6cda9c0 msgr2=0x5611e6d0a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:37.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.645+0000 7fe1f105e640 1 --2- 172.21.15.102:0/1026826690 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5611e6cda9c0 0x5611e6d0a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.645+0000 7fe1f105e640 1 -- 172.21.15.102:0/1026826690 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611e6d07960 msgr2=0x5611e6d0a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:37.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.645+0000 7fe1f105e640 1 --2- 172.21.15.102:0/1026826690 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611e6d07960 0x5611e6d0a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.645+0000 7fe1f105e640 1 -- 172.21.15.102:0/1026826690 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611e6c05910 con 0x5611e6d07580 2023-10-14T09:38:37.653 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.645+0000 7fe1f105e640 1 --2- 172.21.15.102:0/1026826690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611e6d07580 0x5611e6cda480 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8005600 tx=0x7fe1e8057430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f06f26226240b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:37.653 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.646+0000 7fe1d6ffd640 1 -- 172.21.15.102:0/1026826690 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e805fca0 con 0x5611e6d07580 2023-10-14T09:38:37.653 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.646+0000 7fe1d6ffd640 1 -- 172.21.15.102:0/1026826690 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e8055d40 con 0x5611e6d07580 2023-10-14T09:38:37.653 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.646+0000 7fe1d6ffd640 1 -- 172.21.15.102:0/1026826690 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e80540b0 con 0x5611e6d07580 2023-10-14T09:38:37.653 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.646+0000 7fe1f5e54740 1 -- 172.21.15.102:0/1026826690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611e6d07580 msgr2=0x5611e6cda480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:37.654 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.646+0000 7fe1f5e54740 1 --2- 172.21.15.102:0/1026826690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611e6d07580 0x5611e6cda480 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8005600 tx=0x7fe1e8057430 comp rx=0 tx=0).stop 2023-10-14T09:38:37.654 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.646+0000 7fe1f5e54740 1 -- 172.21.15.102:0/1026826690 shutdown_connections 2023-10-14T09:38:37.654 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.646+0000 7fe1f5e54740 1 --2- 172.21.15.102:0/1026826690 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5611e6cda9c0 0x5611e6d0a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.654 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.646+0000 7fe1f5e54740 1 --2- 172.21.15.102:0/1026826690 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611e6d07960 0x5611e6d0a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.654 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.646+0000 7fe1f5e54740 1 --2- 172.21.15.102:0/1026826690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611e6d07580 0x5611e6cda480 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.655 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.646+0000 7fe1f5e54740 1 -- 172.21.15.102:0/1026826690 >> 172.21.15.102:0/1026826690 conn(0x5611e6cdc790 msgr2=0x5611e6d25310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:37.655 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.647+0000 7fe1f5e54740 1 -- 172.21.15.102:0/1026826690 shutdown_connections 2023-10-14T09:38:37.655 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.647+0000 7fe1f5e54740 1 -- 172.21.15.102:0/1026826690 wait complete. 2023-10-14T09:38:37.659 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.647+0000 7fe1f5e54740 1 -- start start 2023-10-14T09:38:37.659 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.648+0000 7fe1f5e54740 1 Processor -- start 2023-10-14T09:38:37.659 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.648+0000 7fe1f5e54740 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5611e6d07580 0x5611e6cf55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:37.659 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.648+0000 7fe1f5e54740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611e6d07960 0x5611e6d202d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:37.660 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.649+0000 7fe1f5e54740 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611e6d0c850 0x5611e6d0ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:37.660 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.649+0000 7fe1f5e54740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611e6c41720 con 0x5611e6d07960 2023-10-14T09:38:37.660 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.649+0000 7fe1f5e54740 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611e6bdf970 con 0x5611e6d0c850 2023-10-14T09:38:37.660 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.649+0000 7fe1f5e54740 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611e6bdf610 con 0x5611e6d07580 2023-10-14T09:38:37.660 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.649+0000 7fe1f5e54740 10 client.0 _ll_register_callbacks cb 0x5611e6c019d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:38:37.661 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.649+0000 7fe1f085d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611e6d07960 0x5611e6d202d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:37.661 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.649+0000 7fe1f085d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611e6d07960 0x5611e6d202d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41028/0 (socket says 172.21.15.102:41028) 2023-10-14T09:38:37.661 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.649+0000 7fe1f085d640 1 -- 172.21.15.102:0/290901588 learned_addr learned my addr 172.21.15.102:0/290901588 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:37.661 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.649+0000 7fe1f105e640 1 --2- 172.21.15.102:0/290901588 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5611e6d07580 0x5611e6cf55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:37.661 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.649+0000 7fe1f185f640 1 --2- 172.21.15.102:0/290901588 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611e6d0c850 0x5611e6d0ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:37.662 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.649+0000 7fe1f085d640 1 -- 172.21.15.102:0/290901588 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5611e6d07580 msgr2=0x5611e6cf55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:37.662 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.649+0000 7fe1f085d640 1 --2- 172.21.15.102:0/290901588 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5611e6d07580 0x5611e6cf55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.662 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.649+0000 7fe1f085d640 1 -- 172.21.15.102:0/290901588 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611e6d0c850 msgr2=0x5611e6d0ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:37.662 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.649+0000 7fe1f085d640 1 --2- 172.21.15.102:0/290901588 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611e6d0c850 0x5611e6d0ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.662 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.649+0000 7fe1f085d640 1 -- 172.21.15.102:0/290901588 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ec1589d0 con 0x5611e6d07960 2023-10-14T09:38:37.663 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.649+0000 7fe1f105e640 1 --2- 172.21.15.102:0/290901588 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5611e6d07580 0x5611e6cf55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:37.663 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.650+0000 7fe1f085d640 1 --2- 172.21.15.102:0/290901588 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611e6d07960 0x5611e6d202d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00099c0 tx=0x7fe1e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c08036e14139c62 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:37.663 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.650+0000 7fe1cbfff640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2023-10-14T09:38:37.663 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.650+0000 7fe1cbfff640 1 -- 172.21.15.102:0/290901588 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e00399e0 con 0x5611e6d07960 2023-10-14T09:38:37.663 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.650+0000 7fe1cbfff640 1 -- 172.21.15.102:0/290901588 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fe1e003e040 con 0x5611e6d07960 2023-10-14T09:38:37.664 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.650+0000 7fe1f5e54740 1 -- 172.21.15.102:0/290901588 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5611e6c68160 con 0x5611e6d07960 2023-10-14T09:38:37.664 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.650+0000 7fe1cbfff640 1 -- 172.21.15.102:0/290901588 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1e0039b40 con 0x5611e6d07960 2023-10-14T09:38:37.664 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.650+0000 7fe1f5e54740 10 client.5304 fetch_fsmap learned FSMap version 15 2023-10-14T09:38:37.664 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.650+0000 7fe1f5e54740 1 -- 172.21.15.102:0/290901588 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x5611e6c3fda0 con 0x5611e6d07960 2023-10-14T09:38:37.664 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.650+0000 7fe1cbfff640 1 -- 172.21.15.102:0/290901588 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5611e6c68160 con 0x5611e6d07960 2023-10-14T09:38:37.665 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.650+0000 7fe1cbfff640 1 -- 172.21.15.102:0/290901588 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 15) v1 ==== 3299+0+0 (secure 0 0 0) 0x7fe1e004d070 con 0x5611e6d07960 2023-10-14T09:38:37.665 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.651+0000 7fe1f5e54740 10 client.5304 fetch_fsmap finished waiting for FSMap version 15 2023-10-14T09:38:37.665 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.651+0000 7fe1f5e54740 10 client.5304 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-14T09:38:37.665 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.651+0000 7fe1f5e54740 20 client.5304 populate_metadata read hostname 'smithi102' 2023-10-14T09:38:37.665 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.651+0000 7fe1f5e54740 1 --2- 172.21.15.102:0/290901588 >> [v2:172.21.15.129:6833/4209319148,v1:172.21.15.129:6835/4209319148] conn(0x5611e6d395d0 0x5611e6cf5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:37.666 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.651+0000 7fe1f5e54740 4 client.5304 mds_command: new command op to 5130 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:38:37.666 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.651+0000 7fe1f5e54740 1 -- 172.21.15.102:0/290901588 --> [v2:172.21.15.129:6833/4209319148,v1:172.21.15.129:6835/4209319148] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5611e6c13cc0 con 0x5611e6d395d0 2023-10-14T09:38:37.666 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.651+0000 7fe1f105e640 1 --2- 172.21.15.102:0/290901588 >> [v2:172.21.15.129:6833/4209319148,v1:172.21.15.129:6835/4209319148] conn(0x5611e6d395d0 0x5611e6cf5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:37.666 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.652+0000 7fe1f105e640 1 --2- 172.21.15.102:0/290901588 >> [v2:172.21.15.129:6833/4209319148,v1:172.21.15.129:6835/4209319148] conn(0x5611e6d395d0 0x5611e6cf5f30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99333c08808a1ca5 server_cookie=89d6f5c9d7eb81ad in_seq=0 out_seq=0 2023-10-14T09:38:37.666 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.652+0000 7fe1cbfff640 10 client.5304 ms_handle_connect on v2:172.21.15.129:6833/4209319148 2023-10-14T09:38:37.667 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.654+0000 7fe1cbfff640 1 -- 172.21.15.102:0/290901588 <== mds.0 v2:172.21.15.129:6833/4209319148 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5611e6c13cc0 con 0x5611e6d395d0 2023-10-14T09:38:37.667 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.654+0000 7fe1cbfff640 10 client.5304 handle_command_reply: tid=0 2023-10-14T09:38:37.667 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.654+0000 7fe1f5e54740 1 client.5304 shutdown 2023-10-14T09:38:37.667 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.654+0000 7fe1f5e54740 1 -- 172.21.15.102:0/290901588 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611e6d07960 msgr2=0x5611e6d202d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:37.667 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.654+0000 7fe1f5e54740 1 --2- 172.21.15.102:0/290901588 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611e6d07960 0x5611e6d202d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00099c0 tx=0x7fe1e00046c0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.667 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.654+0000 7fe1f5e54740 1 -- 172.21.15.102:0/290901588 shutdown_connections 2023-10-14T09:38:37.668 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.654+0000 7fe1f5e54740 1 --2- 172.21.15.102:0/290901588 >> [v2:172.21.15.129:6833/4209319148,v1:172.21.15.129:6835/4209319148] conn(0x5611e6d395d0 0x5611e6cf5f30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.668 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.654+0000 7fe1f5e54740 1 --2- 172.21.15.102:0/290901588 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611e6d0c850 0x5611e6d0ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.668 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.654+0000 7fe1f5e54740 1 --2- 172.21.15.102:0/290901588 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611e6d07960 0x5611e6d202d0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.668 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.654+0000 7fe1f5e54740 1 --2- 172.21.15.102:0/290901588 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5611e6d07580 0x5611e6cf55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.668 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.654+0000 7fe1cbfff640 0 client.5304 ms_handle_reset on v2:172.21.15.129:6833/4209319148 2023-10-14T09:38:37.669 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.654+0000 7fe1f5e54740 1 -- 172.21.15.102:0/290901588 >> 172.21.15.102:0/290901588 conn(0x5611e6cda9c0 msgr2=0x5611e6cde430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:37.669 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.655+0000 7fe1f5e54740 1 -- 172.21.15.102:0/290901588 shutdown_connections 2023-10-14T09:38:37.669 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.655+0000 7fe1f5e54740 1 -- 172.21.15.102:0/290901588 wait complete. 2023-10-14T09:38:37.669 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.655+0000 7fe1f5e54740 20 client.5304 trim_cache size 0 max 16384 2023-10-14T09:38:37.673 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.671+0000 7fe1f5e54740 1 Processor -- start 2023-10-14T09:38:37.673 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.671+0000 7fe1f5e54740 1 -- start start 2023-10-14T09:38:37.674 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.672+0000 7fe1f5e54740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611e6d07580 0x5611e6d21580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:37.674 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.672+0000 7fe1f5e54740 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5611e6d07960 0x5611e6cddf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:37.674 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.672+0000 7fe1f5e54740 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611e6d0c850 0x5611e6cde4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:37.675 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.672+0000 7fe1f5e54740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611e69a5f20 con 0x5611e6d07580 2023-10-14T09:38:37.675 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.672+0000 7fe1f5e54740 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611e6d20e20 con 0x5611e6d0c850 2023-10-14T09:38:37.675 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.672+0000 7fe1f5e54740 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611e6d0df70 con 0x5611e6d07960 2023-10-14T09:38:37.675 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.672+0000 7fe1f105e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611e6d07580 0x5611e6d21580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:37.675 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.673+0000 7fe1f105e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611e6d07580 0x5611e6d21580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41034/0 (socket says 172.21.15.102:41034) 2023-10-14T09:38:37.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.673+0000 7fe1f105e640 1 -- 172.21.15.102:0/1227788549 learned_addr learned my addr 172.21.15.102:0/1227788549 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:37.677 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.673+0000 7fe1f185f640 1 --2- 172.21.15.102:0/1227788549 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611e6d0c850 0x5611e6cde4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:37.678 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.673+0000 7fe1f085d640 1 --2- 172.21.15.102:0/1227788549 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5611e6d07960 0x5611e6cddf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:37.678 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.673+0000 7fe1f105e640 1 -- 172.21.15.102:0/1227788549 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5611e6d07960 msgr2=0x5611e6cddf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:37.678 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.673+0000 7fe1f105e640 1 --2- 172.21.15.102:0/1227788549 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5611e6d07960 0x5611e6cddf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.678 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.673+0000 7fe1f105e640 1 -- 172.21.15.102:0/1227788549 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611e6d0c850 msgr2=0x5611e6cde4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:37.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.673+0000 7fe1f105e640 1 --2- 172.21.15.102:0/1227788549 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611e6d0c850 0x5611e6cde4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.673+0000 7fe1f105e640 1 -- 172.21.15.102:0/1227788549 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611e6bdeb80 con 0x5611e6d07580 2023-10-14T09:38:37.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.673+0000 7fe1f105e640 1 --2- 172.21.15.102:0/1227788549 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611e6d07580 0x5611e6d21580 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8053ea0 tx=0x7fe1e8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eafc8abd280294ce server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:37.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.673+0000 7fe1d77fe640 1 -- 172.21.15.102:0/1227788549 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e805fd20 con 0x5611e6d07580 2023-10-14T09:38:37.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.673+0000 7fe1d77fe640 1 -- 172.21.15.102:0/1227788549 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e806f170 con 0x5611e6d07580 2023-10-14T09:38:37.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.673+0000 7fe1d77fe640 1 -- 172.21.15.102:0/1227788549 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e806f2e0 con 0x5611e6d07580 2023-10-14T09:38:37.680 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.674+0000 7fe1f5e54740 1 -- 172.21.15.102:0/1227788549 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611e6d07580 msgr2=0x5611e6d21580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:37.680 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.674+0000 7fe1f5e54740 1 --2- 172.21.15.102:0/1227788549 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611e6d07580 0x5611e6d21580 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8053ea0 tx=0x7fe1e8017000 comp rx=0 tx=0).stop 2023-10-14T09:38:37.680 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.674+0000 7fe1f5e54740 1 -- 172.21.15.102:0/1227788549 shutdown_connections 2023-10-14T09:38:37.680 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.674+0000 7fe1f5e54740 1 --2- 172.21.15.102:0/1227788549 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611e6d0c850 0x5611e6cde4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.680 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.674+0000 7fe1f5e54740 1 --2- 172.21.15.102:0/1227788549 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5611e6d07960 0x5611e6cddf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.681 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.674+0000 7fe1f5e54740 1 --2- 172.21.15.102:0/1227788549 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611e6d07580 0x5611e6d21580 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.681 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.674+0000 7fe1f5e54740 1 -- 172.21.15.102:0/1227788549 >> 172.21.15.102:0/1227788549 conn(0x5611e6cda9c0 msgr2=0x5611e6cd1880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:37.681 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.674+0000 7fe1f5e54740 1 -- 172.21.15.102:0/1227788549 shutdown_connections 2023-10-14T09:38:37.681 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.674+0000 7fe1f5e54740 1 -- 172.21.15.102:0/1227788549 wait complete. 2023-10-14T09:38:37.681 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.675+0000 7fe1f5e54740 1 -- start start 2023-10-14T09:38:37.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.675+0000 7fe1f5e54740 1 Processor -- start 2023-10-14T09:38:37.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.676+0000 7fe1f5e54740 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611e6d07580 0x5611e6d38300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:37.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.676+0000 7fe1f5e54740 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5611e6d07960 0x5611e6cde350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:37.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.676+0000 7fe1f5e54740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611e6d0c850 0x5611e6d8cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:37.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.676+0000 7fe1f5e54740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611e6d8e9e0 con 0x5611e6d0c850 2023-10-14T09:38:37.683 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.676+0000 7fe1f5e54740 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611e6d48200 con 0x5611e6d07580 2023-10-14T09:38:37.683 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.676+0000 7fe1f5e54740 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611e6cde890 con 0x5611e6d07960 2023-10-14T09:38:37.683 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.676+0000 7fe1f5e54740 10 client.0 _ll_register_callbacks cb 0x5611e6cda910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:38:37.686 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.676+0000 7fe1f185f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611e6d0c850 0x5611e6d8cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:37.686 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.676+0000 7fe1f185f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611e6d0c850 0x5611e6d8cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41044/0 (socket says 172.21.15.102:41044) 2023-10-14T09:38:37.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.676+0000 7fe1f185f640 1 -- 172.21.15.102:0/1761876134 learned_addr learned my addr 172.21.15.102:0/1761876134 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:37.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.677+0000 7fe1f085d640 1 --2- 172.21.15.102:0/1761876134 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5611e6d07960 0x5611e6cde350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:37.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.677+0000 7fe1f105e640 1 --2- 172.21.15.102:0/1761876134 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611e6d07580 0x5611e6d38300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:37.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.677+0000 7fe1f185f640 1 -- 172.21.15.102:0/1761876134 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5611e6d07960 msgr2=0x5611e6cde350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:37.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.677+0000 7fe1f185f640 1 --2- 172.21.15.102:0/1761876134 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5611e6d07960 0x5611e6cde350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.677+0000 7fe1f185f640 1 -- 172.21.15.102:0/1761876134 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611e6d07580 msgr2=0x5611e6d38300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:37.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.677+0000 7fe1f185f640 1 --2- 172.21.15.102:0/1761876134 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611e6d07580 0x5611e6d38300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.677+0000 7fe1f185f640 1 -- 172.21.15.102:0/1761876134 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611e6c05910 con 0x5611e6d0c850 2023-10-14T09:38:37.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.677+0000 7fe1f085d640 1 --2- 172.21.15.102:0/1761876134 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5611e6d07960 0x5611e6cde350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:37.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.677+0000 7fe1f185f640 1 --2- 172.21.15.102:0/1761876134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611e6d0c850 0x5611e6d8cd30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40104f0 tx=0x7fe1e40109b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c43f92c54292131 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:37.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.677+0000 7fe1cbfff640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2023-10-14T09:38:37.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.677+0000 7fe1cbfff640 1 -- 172.21.15.102:0/1761876134 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e4014830 con 0x5611e6d0c850 2023-10-14T09:38:37.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.677+0000 7fe1cbfff640 1 -- 172.21.15.102:0/1761876134 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fe1e400c050 con 0x5611e6d0c850 2023-10-14T09:38:37.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.677+0000 7fe1f5e54740 1 -- 172.21.15.102:0/1761876134 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe1e8055d40 con 0x5611e6d0c850 2023-10-14T09:38:37.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.677+0000 7fe1cbfff640 1 -- 172.21.15.102:0/1761876134 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1e4014990 con 0x5611e6d0c850 2023-10-14T09:38:37.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.677+0000 7fe1f5e54740 10 client.5310 fetch_fsmap learned FSMap version 15 2023-10-14T09:38:37.690 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.677+0000 7fe1f5e54740 1 -- 172.21.15.102:0/1761876134 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x5611e6c04170 con 0x5611e6d0c850 2023-10-14T09:38:37.690 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.678+0000 7fe1cbfff640 1 -- 172.21.15.102:0/1761876134 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e8055d40 con 0x5611e6d0c850 2023-10-14T09:38:37.690 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.678+0000 7fe1cbfff640 1 -- 172.21.15.102:0/1761876134 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 15) v1 ==== 3299+0+0 (secure 0 0 0) 0x7fe1e4012040 con 0x5611e6d0c850 2023-10-14T09:38:37.690 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.678+0000 7fe1f5e54740 10 client.5310 fetch_fsmap finished waiting for FSMap version 15 2023-10-14T09:38:37.690 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.678+0000 7fe1f5e54740 10 client.5310 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-14T09:38:37.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.678+0000 7fe1f5e54740 20 client.5310 populate_metadata read hostname 'smithi102' 2023-10-14T09:38:37.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.678+0000 7fe1f5e54740 1 --2- 172.21.15.102:0/1761876134 >> [v2:172.21.15.129:6833/4209319148,v1:172.21.15.129:6835/4209319148] conn(0x5611e6d8d270 0x5611e6cf35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:37.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.678+0000 7fe1f5e54740 4 client.5310 mds_command: new command op to 5130 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T09:38:37.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.678+0000 7fe1f5e54740 1 -- 172.21.15.102:0/1761876134 --> [v2:172.21.15.129:6833/4209319148,v1:172.21.15.129:6835/4209319148] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5611e6c3a700 con 0x5611e6d8d270 2023-10-14T09:38:37.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.678+0000 7fe1f105e640 1 --2- 172.21.15.102:0/1761876134 >> [v2:172.21.15.129:6833/4209319148,v1:172.21.15.129:6835/4209319148] conn(0x5611e6d8d270 0x5611e6cf35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:37.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.679+0000 7fe1cbfff640 10 client.5310 ms_handle_connect on v2:172.21.15.129:6833/4209319148 2023-10-14T09:38:37.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.679+0000 7fe1f105e640 1 --2- 172.21.15.102:0/1761876134 >> [v2:172.21.15.129:6833/4209319148,v1:172.21.15.129:6835/4209319148] conn(0x5611e6d8d270 0x5611e6cf35d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9e781b2144c4eec server_cookie=420e1a934fae31d8 in_seq=0 out_seq=0 2023-10-14T09:38:37.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.680+0000 7fe1cbfff640 1 -- 172.21.15.102:0/1761876134 <== mds.0 v2:172.21.15.129:6833/4209319148 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+336 (crc 0 0 0) 0x5611e6c3a700 con 0x5611e6d8d270 2023-10-14T09:38:37.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.680+0000 7fe1cbfff640 10 client.5310 handle_command_reply: tid=0 2023-10-14T09:38:37.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.680+0000 7fe1f5e54740 1 client.5310 shutdown 2023-10-14T09:38:37.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.680+0000 7fe1f5e54740 1 -- 172.21.15.102:0/1761876134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611e6d0c850 msgr2=0x5611e6d8cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:37.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.680+0000 7fe1f5e54740 1 --2- 172.21.15.102:0/1761876134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611e6d0c850 0x5611e6d8cd30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40104f0 tx=0x7fe1e40109b0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.680+0000 7fe1f5e54740 1 -- 172.21.15.102:0/1761876134 shutdown_connections 2023-10-14T09:38:37.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.680+0000 7fe1f5e54740 1 --2- 172.21.15.102:0/1761876134 >> [v2:172.21.15.129:6833/4209319148,v1:172.21.15.129:6835/4209319148] conn(0x5611e6d8d270 0x5611e6cf35d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.680+0000 7fe1f5e54740 1 --2- 172.21.15.102:0/1761876134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611e6d0c850 0x5611e6d8cd30 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.680+0000 7fe1f5e54740 1 --2- 172.21.15.102:0/1761876134 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5611e6d07960 0x5611e6cde350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.680+0000 7fe1cbfff640 0 client.5310 ms_handle_reset on v2:172.21.15.129:6833/4209319148 2023-10-14T09:38:37.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.680+0000 7fe1f5e54740 1 --2- 172.21.15.102:0/1761876134 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611e6d07580 0x5611e6d38300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.680+0000 7fe1f5e54740 1 -- 172.21.15.102:0/1761876134 >> 172.21.15.102:0/1761876134 conn(0x5611e6cda9c0 msgr2=0x5611e6d28820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:37.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.680+0000 7fe1f5e54740 1 -- 172.21.15.102:0/1761876134 shutdown_connections 2023-10-14T09:38:37.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.680+0000 7fe1f5e54740 1 -- 172.21.15.102:0/1761876134 wait complete. 2023-10-14T09:38:37.695 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.680+0000 7fe1f5e54740 20 client.5310 trim_cache size 0 max 16384 2023-10-14T09:38:37.695 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-10-14T09:38:37.695 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_fsid": "8a6cd69d-7f5b-4f2a-806a-0176c10aed50", 2023-10-14T09:38:37.696 INFO:teuthology.orchestra.run.smithi102.stdout: "whoami": 0, 2023-10-14T09:38:37.696 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 5130, 2023-10-14T09:38:37.696 INFO:teuthology.orchestra.run.smithi102.stdout: "want_state": "up:active", 2023-10-14T09:38:37.696 INFO:teuthology.orchestra.run.smithi102.stdout: "state": "up:active", 2023-10-14T09:38:37.696 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "testcephfs1", 2023-10-14T09:38:37.696 INFO:teuthology.orchestra.run.smithi102.stdout: "rank_uptime": 6.6690831060000004, 2023-10-14T09:38:37.697 INFO:teuthology.orchestra.run.smithi102.stdout: "mdsmap_epoch": 15, 2023-10-14T09:38:37.697 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch": 36, 2023-10-14T09:38:37.697 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch_barrier": 36, 2023-10-14T09:38:37.697 INFO:teuthology.orchestra.run.smithi102.stdout: "uptime": 16.472506989999999 2023-10-14T09:38:37.697 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-10-14T09:38:37.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.681+0000 7fe1f2060640 1 -- 172.21.15.102:0/1220430622 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe1d006ae70 msgr2=0x7fe1d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:37.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.681+0000 7fe1f2060640 1 --2- 172.21.15.102:0/1220430622 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe1d006ae70 0x7fe1d006d330 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0036000 tx=0x7fe1e003b040 comp rx=0 tx=0).stop 2023-10-14T09:38:37.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.681+0000 7fe1f2060640 1 -- 172.21.15.102:0/1220430622 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1ec06c040 msgr2=0x7fe1ec14a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:37.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.681+0000 7fe1f2060640 1 --2- 172.21.15.102:0/1220430622 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1ec06c040 0x7fe1ec14a6b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe1e800c410 tx=0x7fe1e800c8d0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.681+0000 7fe1f2060640 1 -- 172.21.15.102:0/1220430622 shutdown_connections 2023-10-14T09:38:37.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.681+0000 7fe1f2060640 1 --2- 172.21.15.102:0/1220430622 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe1d006ae70 0x7fe1d006d330 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.681+0000 7fe1f2060640 1 --2- 172.21.15.102:0/1220430622 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe1ec0ccfb0 0x7fe1ec0b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.681+0000 7fe1f2060640 1 --2- 172.21.15.102:0/1220430622 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe1ec0ad970 0x7fe1ec157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.681+0000 7fe1f2060640 1 --2- 172.21.15.102:0/1220430622 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1ec06c040 0x7fe1ec14a6b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.681+0000 7fe1f2060640 1 -- 172.21.15.102:0/1220430622 >> 172.21.15.102:0/1220430622 conn(0x7fe1ec0ce6a0 msgr2=0x7fe1ec0c6900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:37.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.681+0000 7fe1f2060640 1 -- 172.21.15.102:0/1220430622 shutdown_connections 2023-10-14T09:38:37.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.681+0000 7fe1f2060640 1 -- 172.21.15.102:0/1220430622 wait complete. 2023-10-14T09:38:37.702 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T09:38:37.899 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.897+0000 7fc2a970f640 1 Processor -- start 2023-10-14T09:38:37.900 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.898+0000 7fc2a970f640 1 -- start start 2023-10-14T09:38:37.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.899+0000 7fc2a970f640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fc2a40ce390 0x7fc2a415e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:37.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.899+0000 7fc2a970f640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a415ed60 con 0x7fc2a415aaa0 2023-10-14T09:38:37.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.899+0000 7fc2a970f640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a40707e0 con 0x7fc2a415ae80 2023-10-14T09:38:37.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.899+0000 7fc2a970f640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a406b810 con 0x7fc2a40ce390 2023-10-14T09:38:37.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.900+0000 7fc2a2ffd640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fc2a415aaa0 0x7fc2a40cc560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55672/0 (socket says 172.21.15.102:55672) 2023-10-14T09:38:37.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.900+0000 7fc2a2ffd640 1 -- 172.21.15.102:0/3182351473 learned_addr learned my addr 172.21.15.102:0/3182351473 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:37.904 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.900+0000 7fc2a27fc640 1 -- 172.21.15.102:0/3182351473 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 662363200 0 0) 0x7fc2a415ed60 con 0x7fc2a415aaa0 2023-10-14T09:38:37.904 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.900+0000 7fc2a37fe640 1 --2- 172.21.15.102:0/3182351473 >> v2:172.21.15.129:3300/0 conn(0x7fc2a40ce390 0x7fc2a415e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:37.905 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.900+0000 7fc2a27fc640 1 -- 172.21.15.102:0/3182351473 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc290003520 con 0x7fc2a415aaa0 2023-10-14T09:38:37.905 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.900+0000 7fc2a27fc640 1 -- 172.21.15.102:0/3182351473 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2826608271 0 0) 0x7fc290003520 con 0x7fc2a415aaa0 2023-10-14T09:38:37.905 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.900+0000 7fc2a27fc640 1 -- 172.21.15.102:0/3182351473 >> v2:172.21.15.129:3300/0 conn(0x7fc2a40ce390 msgr2=0x7fc2a415e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:37.905 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.900+0000 7fc2a27fc640 1 --2- 172.21.15.102:0/3182351473 >> v2:172.21.15.129:3300/0 conn(0x7fc2a40ce390 0x7fc2a415e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.905 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.900+0000 7fc2a27fc640 1 -- 172.21.15.102:0/3182351473 >> v1:172.21.15.129:6789/0 conn(0x7fc2a415ae80 legacy=0x7fc2a4070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:37.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.900+0000 7fc2a27fc640 1 -- 172.21.15.102:0/3182351473 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a415ef90 con 0x7fc2a415aaa0 2023-10-14T09:38:37.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.900+0000 7fc2a27fc640 1 -- 172.21.15.102:0/3182351473 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4030661168 0 0) 0x7fc2940019f0 con 0x7fc2a415aaa0 2023-10-14T09:38:37.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.900+0000 7fc2a27fc640 1 -- 172.21.15.102:0/3182351473 >> v1:172.21.15.102:6789/0 conn(0x7fc2a415aaa0 legacy=0x7fc2a40cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:37.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.901+0000 7fc2a27fc640 1 --2- 172.21.15.102:0/3182351473 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc2900039c0 0x7fc290003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:37.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.901+0000 7fc2a27fc640 1 --2- 172.21.15.102:0/3182351473 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc2900047c0 0x7fc290004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:37.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.901+0000 7fc2a27fc640 1 --2- 172.21.15.102:0/3182351473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2900051d0 0x7fc29000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:37.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.901+0000 7fc2a27fc640 1 -- 172.21.15.102:0/3182351473 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a406b810 con 0x7fc2900051d0 2023-10-14T09:38:37.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.901+0000 7fc2a27fc640 1 -- 172.21.15.102:0/3182351473 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29000c100 con 0x7fc2900039c0 2023-10-14T09:38:37.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.901+0000 7fc2a27fc640 1 -- 172.21.15.102:0/3182351473 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29000c2c0 con 0x7fc2900047c0 2023-10-14T09:38:37.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.901+0000 7fc2a37fe640 1 --2- 172.21.15.102:0/3182351473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2900051d0 0x7fc29000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:37.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.901+0000 7fc2a2ffd640 1 --2- 172.21.15.102:0/3182351473 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc2900039c0 0x7fc290003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:37.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.901+0000 7fc29a7fc640 1 --2- 172.21.15.102:0/3182351473 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc2900047c0 0x7fc290004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:37.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.902+0000 7fc2a37fe640 1 -- 172.21.15.102:0/3182351473 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc2900047c0 msgr2=0x7fc290004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:37.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.902+0000 7fc2a37fe640 1 --2- 172.21.15.102:0/3182351473 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc2900047c0 0x7fc290004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.902+0000 7fc2a37fe640 1 -- 172.21.15.102:0/3182351473 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc2900039c0 msgr2=0x7fc290003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:37.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.902+0000 7fc2a37fe640 1 --2- 172.21.15.102:0/3182351473 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc2900039c0 0x7fc290003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.902+0000 7fc2a37fe640 1 -- 172.21.15.102:0/3182351473 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc290003520 con 0x7fc2900051d0 2023-10-14T09:38:37.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.902+0000 7fc2a2ffd640 1 --2- 172.21.15.102:0/3182351473 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc2900039c0 0x7fc290003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:38:37.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.903+0000 7fc2a37fe640 1 -- 172.21.15.102:0/3182351473 reap_dead start 2023-10-14T09:38:37.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.903+0000 7fc2a37fe640 1 --2- 172.21.15.102:0/3182351473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2900051d0 0x7fc29000b980 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc29c00ba00 tx=0x7fc2900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217fba9a0b69642d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:37.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.903+0000 7fc2a27fc640 1 -- 172.21.15.102:0/3182351473 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c004020 con 0x7fc2900051d0 2023-10-14T09:38:37.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.903+0000 7fc2a27fc640 1 -- 172.21.15.102:0/3182351473 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29c004180 con 0x7fc2900051d0 2023-10-14T09:38:37.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.903+0000 7fc2a27fc640 1 -- 172.21.15.102:0/3182351473 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c003610 con 0x7fc2900051d0 2023-10-14T09:38:37.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.904+0000 7fc2a970f640 1 -- 172.21.15.102:0/3182351473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2900051d0 msgr2=0x7fc29000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:37.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.904+0000 7fc2a970f640 1 --2- 172.21.15.102:0/3182351473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2900051d0 0x7fc29000b980 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc29c00ba00 tx=0x7fc2900057f0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.904+0000 7fc2a970f640 1 -- 172.21.15.102:0/3182351473 shutdown_connections 2023-10-14T09:38:37.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.904+0000 7fc2a970f640 1 --2- 172.21.15.102:0/3182351473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2900051d0 0x7fc29000b980 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.904+0000 7fc2a970f640 1 -- 172.21.15.102:0/3182351473 >> 172.21.15.102:0/3182351473 conn(0x7fc2a40cb410 msgr2=0x7fc2a40cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:37.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.904+0000 7fc2a970f640 1 -- 172.21.15.102:0/3182351473 shutdown_connections 2023-10-14T09:38:37.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.904+0000 7fc2a970f640 1 -- 172.21.15.102:0/3182351473 wait complete. 2023-10-14T09:38:37.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.906+0000 7fc2a970f640 1 Processor -- start 2023-10-14T09:38:37.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.906+0000 7fc2a970f640 1 -- start start 2023-10-14T09:38:37.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.907+0000 7fc2a970f640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc2900051d0 0x7fc2a41f48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:37.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.907+0000 7fc2a970f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc2a40c4c10 0x7fc2a40c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:37.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.907+0000 7fc2a970f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2a415d230 0x7fc2a415d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:37.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.907+0000 7fc2a970f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a41f16f0 con 0x7fc2a415d230 2023-10-14T09:38:37.916 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.907+0000 7fc2a970f640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a415dc20 con 0x7fc2a40c4c10 2023-10-14T09:38:37.916 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.907+0000 7fc2a970f640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a415b640 con 0x7fc2900051d0 2023-10-14T09:38:37.916 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.907+0000 7fc2a37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2a415d230 0x7fc2a415d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:37.916 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.907+0000 7fc2a37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2a415d230 0x7fc2a415d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41066/0 (socket says 172.21.15.102:41066) 2023-10-14T09:38:37.916 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.907+0000 7fc2a37fe640 1 -- 172.21.15.102:0/1631923834 learned_addr learned my addr 172.21.15.102:0/1631923834 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:37.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.907+0000 7fc2a2ffd640 1 --2- 172.21.15.102:0/1631923834 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc2900051d0 0x7fc2a41f48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:37.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.908+0000 7fc29a7fc640 1 --2- 172.21.15.102:0/1631923834 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc2a40c4c10 0x7fc2a40c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:37.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.908+0000 7fc2a37fe640 1 -- 172.21.15.102:0/1631923834 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc2900051d0 msgr2=0x7fc2a41f48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:37.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.908+0000 7fc2a37fe640 1 --2- 172.21.15.102:0/1631923834 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc2900051d0 0x7fc2a41f48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.908+0000 7fc2a37fe640 1 -- 172.21.15.102:0/1631923834 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc2a40c4c10 msgr2=0x7fc2a40c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:37.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.908+0000 7fc2a37fe640 1 --2- 172.21.15.102:0/1631923834 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc2a40c4c10 0x7fc2a40c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:37.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.908+0000 7fc2a37fe640 1 -- 172.21.15.102:0/1631923834 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a40c4800 con 0x7fc2a415d230 2023-10-14T09:38:37.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.908+0000 7fc29a7fc640 1 --2- 172.21.15.102:0/1631923834 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc2a40c4c10 0x7fc2a40c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:37.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.908+0000 7fc2a37fe640 1 --2- 172.21.15.102:0/1631923834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2a415d230 0x7fc2a415d6e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc29c00bb20 tx=0x7fc29c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:37.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.908+0000 7fc29bfff640 1 -- 172.21.15.102:0/1631923834 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c004430 con 0x7fc2a415d230 2023-10-14T09:38:37.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.908+0000 7fc29bfff640 1 -- 172.21.15.102:0/1631923834 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29c040070 con 0x7fc2a415d230 2023-10-14T09:38:37.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.908+0000 7fc29bfff640 1 -- 172.21.15.102:0/1631923834 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c03c690 con 0x7fc2a415d230 2023-10-14T09:38:37.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.908+0000 7fc2a970f640 1 -- 172.21.15.102:0/1631923834 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a41f0a70 con 0x7fc2a415d230 2023-10-14T09:38:37.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.909+0000 7fc2a970f640 1 -- 172.21.15.102:0/1631923834 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a41f1030 con 0x7fc2a415d230 2023-10-14T09:38:37.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.910+0000 7fc2a970f640 1 -- 172.21.15.102:0/1631923834 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a41f1830 con 0x7fc2a415d230 2023-10-14T09:38:37.920 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.910+0000 7fc29bfff640 1 -- 172.21.15.102:0/1631923834 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc29c042030 con 0x7fc2a415d230 2023-10-14T09:38:37.920 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.911+0000 7fc29bfff640 1 --2- 172.21.15.102:0/1631923834 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc28406ae70 0x7fc28406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:37.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.912+0000 7fc29bfff640 1 -- 172.21.15.102:0/1631923834 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fc29c0ab230 con 0x7fc2a415d230 2023-10-14T09:38:37.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.912+0000 7fc2a2ffd640 1 --2- 172.21.15.102:0/1631923834 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc28406ae70 0x7fc28406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:37.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.912+0000 7fc2a2ffd640 1 --2- 172.21.15.102:0/1631923834 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc28406ae70 0x7fc28406d330 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc294001350 tx=0x7fc294009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:37.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:37.916+0000 7fc29bfff640 1 -- 172.21.15.102:0/1631923834 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc29c0762b0 con 0x7fc2a415d230 2023-10-14T09:38:38.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:38.150+0000 7fc2a970f640 1 -- 172.21.15.102:0/1631923834 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc2a404e160 con 0x7fc2a415d230 2023-10-14T09:38:38.152 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:38.150+0000 7fc29bfff640 1 -- 172.21.15.102:0/1631923834 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+88 (secure 0 0 0) 0x7fc29c03c7f0 con 0x7fc2a415d230 2023-10-14T09:38:38.152 INFO:teuthology.orchestra.run.smithi102.stdout:name: testcephfs1, metadata pool: testcephfs1_metadata, data pools: [testcephfs1_data ] 2023-10-14T09:38:38.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:38.153+0000 7fc2a970f640 1 -- 172.21.15.102:0/1631923834 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc28406ae70 msgr2=0x7fc28406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:38.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:38.153+0000 7fc2a970f640 1 --2- 172.21.15.102:0/1631923834 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc28406ae70 0x7fc28406d330 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc294001350 tx=0x7fc294009040 comp rx=0 tx=0).stop 2023-10-14T09:38:38.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:38.153+0000 7fc2a970f640 1 -- 172.21.15.102:0/1631923834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2a415d230 msgr2=0x7fc2a415d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:38.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:38.153+0000 7fc2a970f640 1 --2- 172.21.15.102:0/1631923834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2a415d230 0x7fc2a415d6e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc29c00bb20 tx=0x7fc29c004730 comp rx=0 tx=0).stop 2023-10-14T09:38:38.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:38.153+0000 7fc2a970f640 1 -- 172.21.15.102:0/1631923834 shutdown_connections 2023-10-14T09:38:38.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:38.153+0000 7fc2a970f640 1 --2- 172.21.15.102:0/1631923834 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc28406ae70 0x7fc28406d330 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:38.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:38.153+0000 7fc2a970f640 1 --2- 172.21.15.102:0/1631923834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2a415d230 0x7fc2a415d6e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:38.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:38.153+0000 7fc2a970f640 1 --2- 172.21.15.102:0/1631923834 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc2a40c4c10 0x7fc2a40c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:38.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:38.153+0000 7fc2a970f640 1 --2- 172.21.15.102:0/1631923834 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc2900051d0 0x7fc2a41f48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:38.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:38.153+0000 7fc2a970f640 1 -- 172.21.15.102:0/1631923834 >> 172.21.15.102:0/1631923834 conn(0x7fc2a40cb410 msgr2=0x7fc2a4159cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:38.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:38.153+0000 7fc2a970f640 1 -- 172.21.15.102:0/1631923834 shutdown_connections 2023-10-14T09:38:38.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:38.153+0000 7fc2a970f640 1 -- 172.21.15.102:0/1631923834 wait complete. 2023-10-14T09:38:38.173 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T09:38:38.174 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T09:38:38.174 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi102.front.sepia.ceph.com 2023-10-14T09:38:38.175 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T09:38:38.175 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T09:38:38.175 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T09:38:38.176 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T09:38:38.176 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T09:38:38.176 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T09:38:38.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:38:38.177 DEBUG:teuthology.orchestra.run.smithi102:> ip addr 2023-10-14T09:38:38.229 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T09:38:38.229 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T09:38:38.229 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T09:38:38.229 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:38:38.230 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2023-10-14T09:38:38.230 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:38:38.230 INFO:teuthology.orchestra.run.smithi102.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T09:38:38.230 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dc brd ff:ff:ff:ff:ff:ff 2023-10-14T09:38:38.230 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f0 2023-10-14T09:38:38.231 INFO:teuthology.orchestra.run.smithi102.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T09:38:38.231 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dd brd ff:ff:ff:ff:ff:ff 2023-10-14T09:38:38.231 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f1 2023-10-14T09:38:38.231 INFO:teuthology.orchestra.run.smithi102.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T09:38:38.231 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:68 brd ff:ff:ff:ff:ff:ff 2023-10-14T09:38:38.232 INFO:teuthology.orchestra.run.smithi102.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T09:38:38.232 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:69 brd ff:ff:ff:ff:ff:ff 2023-10-14T09:38:38.232 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.21.15.102/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T09:38:38.232 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft 42308sec preferred_lft 42308sec 2023-10-14T09:38:38.232 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::ec4:7aff:fe8f:d769/64 scope link 2023-10-14T09:38:38.233 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:38:38.233 INFO:teuthology.orchestra.run.smithi102.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T09:38:38.233 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 16:ec:bb:57:4c:b9 brd ff:ff:ff:ff:ff:ff 2023-10-14T09:38:38.233 INFO:teuthology.orchestra.run.smithi102.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T09:38:38.233 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:38:38.234 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::4865:1ff:fe3f:e5e7/64 scope link 2023-10-14T09:38:38.234 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:38:38.234 INFO:teuthology.orchestra.run.smithi102.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T09:38:38.234 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 16:ec:bb:57:4c:b9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T09:38:38.234 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::14ec:bbff:fe57:4cb9/64 scope link 2023-10-14T09:38:38.235 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:38:38.235 INFO:teuthology.orchestra.run.smithi102.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T09:38:38.235 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 82:0f:5c:54:8b:0a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T09:38:38.235 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::800f:5cff:fe54:8b0a/64 scope link 2023-10-14T09:38:38.235 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:38:38.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:38:38.237 DEBUG:teuthology.orchestra.run.smithi102:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T09:38:38.331 INFO:teuthology.orchestra.run.smithi102.stdout:1 2023-10-14T09:38:38.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:38:38.336 DEBUG:teuthology.orchestra.run.smithi102:> route 2023-10-14T09:38:38.388 INFO:teuthology.orchestra.run.smithi102.stdout:Kernel IP routing table 2023-10-14T09:38:38.388 INFO:teuthology.orchestra.run.smithi102.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T09:38:38.388 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T09:38:38.388 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T09:38:38.389 INFO:teuthology.orchestra.run.smithi102.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T09:38:38.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:38:38.390 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2023-10-14T09:38:38.390 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2023-10-14T09:38:38.391 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T09:38:38.391 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T09:38:38.391 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T09:38:38.392 DEBUG:teuthology.orchestra.run.smithi102:> ') 2023-10-14T09:38:38.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:38:38.576 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2023-10-14T09:38:38.625 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T09:38:38.625 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T09:38:38.626 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T09:38:38.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:38:38.627 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set brx.0 up 2023-10-14T09:38:38.712 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T09:38:38.713 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T09:38:38.767 INFO:teuthology.orchestra.run.smithi102.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T09:38:38.767 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T09:38:38.768 DEBUG:teuthology.orchestra.run.smithi102:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T09:38:38.820 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-14T09:38:38.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:38:38.821 DEBUG:teuthology.orchestra.run.smithi102:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T09:38:38.955 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T09:38:38.955 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T09:38:38.989 INFO:teuthology.orchestra.run.smithi102.stderr:mount.ceph: kernel BUG! 2023-10-14T09:38:38.989 INFO:teuthology.orchestra.run.smithi102.stderr:mount error: no mds server is up or the cluster is laggy 2023-10-14T09:38:38.989 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T09:38:38.990 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T09:38:38.990 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.102:3300,172.21.15.129:3300,172.21.15.129:3301" 2023-10-14T09:38:38.990 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: trying mount with new device syntax: 0@8a6cd69d-7f5b-4f2a-806a-0176c10aed50.cephfs=/ 2023-10-14T09:38:38.990 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.102:3300/172.21.15.129:3300/172.21.15.129:3301" will pass to kernel 2023-10-14T09:38:38.996 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-14T09:38:38.996 INFO:tasks.cephfs.kernel_mount:mount command failed 2023-10-14T09:38:38.997 INFO:tasks.cephfs_test_runner:Validate binary .meta file on legacy subvol root doesn't break the system ... ERROR 2023-10-14T09:38:38.997 INFO:tasks.cephfs_test_runner: 2023-10-14T09:38:38.998 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-14T09:38:38.998 INFO:tasks.cephfs_test_runner:ERROR: test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2023-10-14T09:38:38.998 INFO:tasks.cephfs_test_runner:Validate binary .meta file on legacy subvol root doesn't break the system 2023-10-14T09:38:38.998 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-14T09:38:38.999 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-14T09:38:38.999 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/test_volumes.py", line 415, in setUp 2023-10-14T09:38:38.999 INFO:tasks.cephfs_test_runner: super(TestVolumesHelper, self).setUp() 2023-10-14T09:38:39.000 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/cephfs_test_case.py", line 184, in setUp 2023-10-14T09:38:39.000 INFO:tasks.cephfs_test_runner: self.mounts[i].mount_wait() 2023-10-14T09:38:39.000 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/mount.py", line 505, in mount_wait 2023-10-14T09:38:39.000 INFO:tasks.cephfs_test_runner: self.mount(**kwargs) 2023-10-14T09:38:39.000 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/kernel_mount.py", line 59, in mount 2023-10-14T09:38:39.001 INFO:tasks.cephfs_test_runner: retval = self._run_mount_cmd(mntopts, check_status) 2023-10-14T09:38:39.001 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/kernel_mount.py", line 83, in _run_mount_cmd 2023-10-14T09:38:39.001 INFO:tasks.cephfs_test_runner: self.client_remote.run(args=mount_cmd, timeout=300, 2023-10-14T09:38:39.001 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run 2023-10-14T09:38:39.002 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-14T09:38:39.002 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run 2023-10-14T09:38:39.002 INFO:tasks.cephfs_test_runner: r.wait() 2023-10-14T09:38:39.002 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait 2023-10-14T09:38:39.003 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-14T09:38:39.003 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-14T09:38:39.003 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-14T09:38:39.003 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi102 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback' 2023-10-14T09:38:39.004 INFO:tasks.cephfs_test_runner: 2023-10-14T09:38:39.004 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-14T09:38:39.004 INFO:tasks.cephfs_test_runner:Ran 1 test in 39.673s 2023-10-14T09:38:39.004 INFO:tasks.cephfs_test_runner: 2023-10-14T09:38:39.005 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-10-14T09:38:39.005 INFO:tasks.cephfs_test_runner: 2023-10-14T09:38:39.005 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-14T09:38:39.005 INFO:tasks.cephfs_test_runner:ERROR: test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2023-10-14T09:38:39.006 INFO:tasks.cephfs_test_runner:Validate binary .meta file on legacy subvol root doesn't break the system 2023-10-14T09:38:39.006 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-14T09:38:39.006 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-14T09:38:39.006 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/test_volumes.py", line 415, in setUp 2023-10-14T09:38:39.007 INFO:tasks.cephfs_test_runner: super(TestVolumesHelper, self).setUp() 2023-10-14T09:38:39.007 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/cephfs_test_case.py", line 184, in setUp 2023-10-14T09:38:39.007 INFO:tasks.cephfs_test_runner: self.mounts[i].mount_wait() 2023-10-14T09:38:39.007 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/mount.py", line 505, in mount_wait 2023-10-14T09:38:39.008 INFO:tasks.cephfs_test_runner: self.mount(**kwargs) 2023-10-14T09:38:39.008 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/kernel_mount.py", line 59, in mount 2023-10-14T09:38:39.008 INFO:tasks.cephfs_test_runner: retval = self._run_mount_cmd(mntopts, check_status) 2023-10-14T09:38:39.008 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/kernel_mount.py", line 83, in _run_mount_cmd 2023-10-14T09:38:39.009 INFO:tasks.cephfs_test_runner: self.client_remote.run(args=mount_cmd, timeout=300, 2023-10-14T09:38:39.009 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run 2023-10-14T09:38:39.009 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-14T09:38:39.009 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run 2023-10-14T09:38:39.009 INFO:tasks.cephfs_test_runner: r.wait() 2023-10-14T09:38:39.010 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait 2023-10-14T09:38:39.010 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-14T09:38:39.010 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-14T09:38:39.010 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-14T09:38:39.011 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi102 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback' 2023-10-14T09:38:39.011 INFO:tasks.cephfs_test_runner: 2023-10-14T09:38:39.011 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2023-10-14T09:38:39.073 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=45c235aaf4cd4381b84056f77ea83b22 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2023-10-14T09:38:39.075 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-14T09:38:39.084 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-14T09:38:39.091 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-14T09:38:39.092 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-10-14T09:38:39.092 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T09:38:39.165 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054299,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249408k,nr_inodes=812352,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-14T09:38:39.165 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-10-14T09:38:39.166 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T09:38:39.220 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054299,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249408k,nr_inodes=812352,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-14T09:38:39.220 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2023-10-14T09:38:39.221 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T09:38:39.281 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054298,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249408k,nr_inodes=812352,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-14T09:38:39.281 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2023-10-14T09:38:39.281 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T09:38:39.335 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054298,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249408k,nr_inodes=812352,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-14T09:38:39.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:38:39.336 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2023-10-14T09:38:39.396 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T09:38:39.396 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T09:38:39.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:38:39.398 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T09:38:39.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:38:39.492 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T09:38:39.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:38:39.580 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link delete ceph-brx 2023-10-14T09:38:39.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:38:39.720 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2023-10-14T09:38:39.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:38:39.770 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link delete ceph-brx 2023-10-14T09:38:39.851 INFO:teuthology.orchestra.run.smithi102.stderr:Cannot find device "ceph-brx" 2023-10-14T09:38:39.854 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:38:39.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:38:39.855 DEBUG:teuthology.orchestra.run.smithi129:> ip netns list 2023-10-14T09:38:39.916 INFO:teuthology.orchestra.run.smithi129.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T09:38:39.916 INFO:teuthology.orchestra.run.smithi129.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-14T09:38:39.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:38:39.918 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T09:38:40.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:38:40.014 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T09:38:40.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:38:40.104 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link delete ceph-brx 2023-10-14T09:38:40.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:38:40.252 DEBUG:teuthology.orchestra.run.smithi129:> ip netns list 2023-10-14T09:38:40.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:38:40.299 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link delete ceph-brx 2023-10-14T09:38:40.440 INFO:teuthology.orchestra.run.smithi129.stderr:Cannot find device "ceph-brx" 2023-10-14T09:38:40.443 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:38:40.444 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-14T09:38:40.453 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-14T09:38:40.454 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:38:40.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.675+0000 7f022ffe2640 1 Processor -- start 2023-10-14T09:38:40.677 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.675+0000 7f022ffe2640 1 -- start start 2023-10-14T09:38:40.678 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.676+0000 7f022ffe2640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f02280adb50 0x7f022806f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:40.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.676+0000 7f022ffe2640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f02280b0b20 0x7f0228164f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:40.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.676+0000 7f022ffe2640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0228071450 con 0x7f0228070fd0 2023-10-14T09:38:40.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.676+0000 7f022ffe2640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02280cc600 con 0x7f02280b0b20 2023-10-14T09:38:40.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.676+0000 7f022ffe2640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02280cc8e0 con 0x7f02280adb50 2023-10-14T09:38:40.680 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.677+0000 7f022d57d640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f0228070fd0 0x7f02280b0410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55674/0 (socket says 172.21.15.102:55674) 2023-10-14T09:38:40.680 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.677+0000 7f022d57d640 1 -- 172.21.15.102:0/2777822586 learned_addr learned my addr 172.21.15.102:0/2777822586 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:40.680 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.677+0000 7f022e57f640 1 --2- 172.21.15.102:0/2777822586 >> v2:172.21.15.102:3300/0 conn(0x7f02280b0b20 0x7f0228164f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:40.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.677+0000 7f022cd7c640 1 -- 172.21.15.102:0/2777822586 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2270010450 0 0) 0x7f0228071450 con 0x7f0228070fd0 2023-10-14T09:38:40.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.677+0000 7f022cd7c640 1 -- 172.21.15.102:0/2777822586 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0214003520 con 0x7f0228070fd0 2023-10-14T09:38:40.683 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.677+0000 7f022dd7e640 1 --2- 172.21.15.102:0/2777822586 >> v2:172.21.15.129:3300/0 conn(0x7f02280adb50 0x7f022806f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:40.683 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.677+0000 7f022e57f640 1 -- 172.21.15.102:0/2777822586 >> v2:172.21.15.129:3300/0 conn(0x7f02280adb50 msgr2=0x7f022806f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:40.683 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.677+0000 7f022e57f640 1 --2- 172.21.15.102:0/2777822586 >> v2:172.21.15.129:3300/0 conn(0x7f02280adb50 0x7f022806f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:40.683 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.677+0000 7f022e57f640 1 -- 172.21.15.102:0/2777822586 >> v1:172.21.15.102:6789/0 conn(0x7f0228070fd0 legacy=0x7f02280b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:40.684 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.677+0000 7f022e57f640 1 -- 172.21.15.102:0/2777822586 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02280ccbc0 con 0x7f02280b0b20 2023-10-14T09:38:40.684 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.678+0000 7f022dd7e640 1 --2- 172.21.15.102:0/2777822586 >> v2:172.21.15.129:3300/0 conn(0x7f02280adb50 0x7f022806f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:40.684 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.679+0000 7f022e57f640 1 --2- 172.21.15.102:0/2777822586 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02280b0b20 0x7f0228164f60 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0228071a00 tx=0x7f022002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1780426d6d129c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:40.684 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.679+0000 7f022cd7c640 1 -- 172.21.15.102:0/2777822586 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022002cc80 con 0x7f02280b0b20 2023-10-14T09:38:40.685 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.679+0000 7f022cd7c640 1 -- 172.21.15.102:0/2777822586 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022002cde0 con 0x7f02280b0b20 2023-10-14T09:38:40.685 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.679+0000 7f022cd7c640 1 -- 172.21.15.102:0/2777822586 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220034660 con 0x7f02280b0b20 2023-10-14T09:38:40.685 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.679+0000 7f022ffe2640 1 -- 172.21.15.102:0/2777822586 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02280b0b20 msgr2=0x7f0228164f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:40.685 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.679+0000 7f022ffe2640 1 --2- 172.21.15.102:0/2777822586 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02280b0b20 0x7f0228164f60 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0228071a00 tx=0x7f022002bed0 comp rx=0 tx=0).stop 2023-10-14T09:38:40.686 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.680+0000 7f022ffe2640 1 -- 172.21.15.102:0/2777822586 shutdown_connections 2023-10-14T09:38:40.686 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.680+0000 7f022ffe2640 1 --2- 172.21.15.102:0/2777822586 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02280b0b20 0x7f0228164f60 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:40.686 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.680+0000 7f022ffe2640 1 --2- 172.21.15.102:0/2777822586 >> v2:172.21.15.129:3300/0 conn(0x7f02280adb50 0x7f022806f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:40.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.680+0000 7f022ffe2640 1 -- 172.21.15.102:0/2777822586 >> 172.21.15.102:0/2777822586 conn(0x7f02280cb410 msgr2=0x7f02280cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:40.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.680+0000 7f022ffe2640 1 -- 172.21.15.102:0/2777822586 shutdown_connections 2023-10-14T09:38:40.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.680+0000 7f022ffe2640 1 -- 172.21.15.102:0/2777822586 wait complete. 2023-10-14T09:38:40.690 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.681+0000 7f022ffe2640 1 Processor -- start 2023-10-14T09:38:40.690 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.682+0000 7f022ffe2640 1 -- start start 2023-10-14T09:38:40.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.682+0000 7f022ffe2640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0228070fd0 0x7f022815ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:40.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.682+0000 7f022ffe2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02280adb50 0x7f02280b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:40.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.682+0000 7f022ffe2640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f02280b0b20 0x7f02280ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:40.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.682+0000 7f022ffe2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02280c4530 con 0x7f02280adb50 2023-10-14T09:38:40.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.682+0000 7f022ffe2640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02280be460 con 0x7f0228070fd0 2023-10-14T09:38:40.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.682+0000 7f022ffe2640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02280c38b0 con 0x7f02280b0b20 2023-10-14T09:38:40.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.683+0000 7f022d57d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02280adb50 0x7f02280b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:40.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.683+0000 7f022d57d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02280adb50 0x7f02280b2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41072/0 (socket says 172.21.15.102:41072) 2023-10-14T09:38:40.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.683+0000 7f022d57d640 1 -- 172.21.15.102:0/3781913196 learned_addr learned my addr 172.21.15.102:0/3781913196 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:40.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.683+0000 7f022dd7e640 1 --2- 172.21.15.102:0/3781913196 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0228070fd0 0x7f022815ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:40.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.683+0000 7f022e57f640 1 --2- 172.21.15.102:0/3781913196 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f02280b0b20 0x7f02280ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:40.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.683+0000 7f022d57d640 1 -- 172.21.15.102:0/3781913196 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f02280b0b20 msgr2=0x7f02280ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:40.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.683+0000 7f022d57d640 1 --2- 172.21.15.102:0/3781913196 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f02280b0b20 0x7f02280ae7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:40.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.683+0000 7f022d57d640 1 -- 172.21.15.102:0/3781913196 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0228070fd0 msgr2=0x7f022815ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:40.695 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.683+0000 7f022d57d640 1 --2- 172.21.15.102:0/3781913196 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0228070fd0 0x7f022815ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:40.695 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.683+0000 7f022d57d640 1 -- 172.21.15.102:0/3781913196 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0220009a70 con 0x7f02280adb50 2023-10-14T09:38:40.695 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.684+0000 7f022d57d640 1 --2- 172.21.15.102:0/3781913196 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02280adb50 0x7f02280b2e70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f021800c410 tx=0x7f021800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:40.695 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.684+0000 7f021e7fc640 1 -- 172.21.15.102:0/3781913196 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0218005ce0 con 0x7f02280adb50 2023-10-14T09:38:40.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.684+0000 7f021e7fc640 1 -- 172.21.15.102:0/3781913196 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0218005e40 con 0x7f02280adb50 2023-10-14T09:38:40.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.684+0000 7f021e7fc640 1 -- 172.21.15.102:0/3781913196 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02180072f0 con 0x7f02280adb50 2023-10-14T09:38:40.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.684+0000 7f022ffe2640 1 -- 172.21.15.102:0/3781913196 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02280c3b90 con 0x7f02280adb50 2023-10-14T09:38:40.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.684+0000 7f022ffe2640 1 -- 172.21.15.102:0/3781913196 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02280c4150 con 0x7f02280adb50 2023-10-14T09:38:40.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.685+0000 7f022ffe2640 1 -- 172.21.15.102:0/3781913196 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f022804e160 con 0x7f02280adb50 2023-10-14T09:38:40.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.686+0000 7f021e7fc640 1 -- 172.21.15.102:0/3781913196 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0218007450 con 0x7f02280adb50 2023-10-14T09:38:40.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.687+0000 7f021e7fc640 1 --2- 172.21.15.102:0/3781913196 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f020c06ae70 0x7f020c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:40.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.687+0000 7f021e7fc640 1 -- 172.21.15.102:0/3781913196 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f0218088c70 con 0x7f02280adb50 2023-10-14T09:38:40.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.688+0000 7f022dd7e640 1 --2- 172.21.15.102:0/3781913196 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f020c06ae70 0x7f020c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:40.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.688+0000 7f022dd7e640 1 --2- 172.21.15.102:0/3781913196 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f020c06ae70 0x7f020c06d330 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f022400a990 tx=0x7f0224008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:40.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.692+0000 7f021e7fc640 1 -- 172.21.15.102:0/3781913196 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0218057850 con 0x7f02280adb50 2023-10-14T09:38:40.880 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.878+0000 7f022ffe2640 1 -- 172.21.15.102:0/3781913196 --> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f022806fa90 con 0x7f020c06ae70 2023-10-14T09:38:40.895 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.894+0000 7f021e7fc640 1 -- 172.21.15.102:0/3781913196 <== mgr.4104 v2:172.21.15.102:6832/1125265706 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287479 (secure 0 0 0) 0x7f022400a710 con 0x7f020c06ae70 2023-10-14T09:38:40.899 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:38:40.901 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2023-10-14T09:38:40.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.899+0000 7f022ffe2640 1 -- 172.21.15.102:0/3781913196 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f020c06ae70 msgr2=0x7f020c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:40.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.899+0000 7f022ffe2640 1 --2- 172.21.15.102:0/3781913196 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f020c06ae70 0x7f020c06d330 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f022400a990 tx=0x7f0224008040 comp rx=0 tx=0).stop 2023-10-14T09:38:40.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.899+0000 7f022ffe2640 1 -- 172.21.15.102:0/3781913196 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02280adb50 msgr2=0x7f02280b2e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:40.904 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.899+0000 7f022ffe2640 1 --2- 172.21.15.102:0/3781913196 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02280adb50 0x7f02280b2e70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f021800c410 tx=0x7f021800c8d0 comp rx=0 tx=0).stop 2023-10-14T09:38:40.904 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.899+0000 7f022ffe2640 1 -- 172.21.15.102:0/3781913196 shutdown_connections 2023-10-14T09:38:40.904 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.899+0000 7f022ffe2640 1 --2- 172.21.15.102:0/3781913196 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f020c06ae70 0x7f020c06d330 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:40.905 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.899+0000 7f022ffe2640 1 --2- 172.21.15.102:0/3781913196 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f02280b0b20 0x7f02280ae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:40.905 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.899+0000 7f022ffe2640 1 --2- 172.21.15.102:0/3781913196 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02280adb50 0x7f02280b2e70 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:40.905 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.899+0000 7f022ffe2640 1 --2- 172.21.15.102:0/3781913196 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0228070fd0 0x7f022815ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:40.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.899+0000 7f022ffe2640 1 -- 172.21.15.102:0/3781913196 >> 172.21.15.102:0/3781913196 conn(0x7f02280cb410 msgr2=0x7f0228163b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:40.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.899+0000 7f022ffe2640 1 -- 172.21.15.102:0/3781913196 shutdown_connections 2023-10-14T09:38:40.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:40.899+0000 7f022ffe2640 1 -- 172.21.15.102:0/3781913196 wait complete. 2023-10-14T09:38:40.919 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2023-10-14T09:38:39.900127+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220536,"kb_used_data":4360,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754184,"statfs":{"total":773094113280,"available":772868284416,"internally_reserved":0,"allocated":4464640,"data_stored":2453460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.908950"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.019582+0000","last_change":"2023-10-14T09:38:31.026111+0000","last_active":"2023-10-14T09:38:32.019582+0000","last_peered":"2023-10-14T09:38:32.019582+0000","last_clean":"2023-10-14T09:38:32.019582+0000","last_became_active":"2023-10-14T09:38:31.023780+0000","last_became_peered":"2023-10-14T09:38:31.023780+0000","last_unstale":"2023-10-14T09:38:32.019582+0000","last_undegraded":"2023-10-14T09:38:32.019582+0000","last_fullsized":"2023-10-14T09:38:32.019582+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:13:06.090004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344563+0000","last_change":"2023-10-14T09:38:31.028205+0000","last_active":"2023-10-14T09:38:32.344563+0000","last_peered":"2023-10-14T09:38:32.344563+0000","last_clean":"2023-10-14T09:38:32.344563+0000","last_became_active":"2023-10-14T09:38:31.027820+0000","last_became_peered":"2023-10-14T09:38:31.027820+0000","last_unstale":"2023-10-14T09:38:32.344563+0000","last_undegraded":"2023-10-14T09:38:32.344563+0000","last_fullsized":"2023-10-14T09:38:32.344563+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:30:53.824363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344137+0000","last_change":"2023-10-14T09:38:31.020589+0000","last_active":"2023-10-14T09:38:32.344137+0000","last_peered":"2023-10-14T09:38:32.344137+0000","last_clean":"2023-10-14T09:38:32.344137+0000","last_became_active":"2023-10-14T09:38:31.019892+0000","last_became_peered":"2023-10-14T09:38:31.019892+0000","last_unstale":"2023-10-14T09:38:32.344137+0000","last_undegraded":"2023-10-14T09:38:32.344137+0000","last_fullsized":"2023-10-14T09:38:32.344137+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:30:59.177841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344268+0000","last_change":"2023-10-14T09:38:31.035562+0000","last_active":"2023-10-14T09:38:32.344268+0000","last_peered":"2023-10-14T09:38:32.344268+0000","last_clean":"2023-10-14T09:38:32.344268+0000","last_became_active":"2023-10-14T09:38:31.035189+0000","last_became_peered":"2023-10-14T09:38:31.035189+0000","last_unstale":"2023-10-14T09:38:32.344268+0000","last_undegraded":"2023-10-14T09:38:32.344268+0000","last_fullsized":"2023-10-14T09:38:32.344268+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:46.045245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341193+0000","last_change":"2023-10-14T09:38:31.023485+0000","last_active":"2023-10-14T09:38:32.341193+0000","last_peered":"2023-10-14T09:38:32.341193+0000","last_clean":"2023-10-14T09:38:32.341193+0000","last_became_active":"2023-10-14T09:38:31.020777+0000","last_became_peered":"2023-10-14T09:38:31.020777+0000","last_unstale":"2023-10-14T09:38:32.341193+0000","last_undegraded":"2023-10-14T09:38:32.341193+0000","last_fullsized":"2023-10-14T09:38:32.341193+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:38:27.480319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342439+0000","last_change":"2023-10-14T09:38:31.028808+0000","last_active":"2023-10-14T09:38:32.342439+0000","last_peered":"2023-10-14T09:38:32.342439+0000","last_clean":"2023-10-14T09:38:32.342439+0000","last_became_active":"2023-10-14T09:38:31.027342+0000","last_became_peered":"2023-10-14T09:38:31.027342+0000","last_unstale":"2023-10-14T09:38:32.342439+0000","last_undegraded":"2023-10-14T09:38:32.342439+0000","last_fullsized":"2023-10-14T09:38:32.342439+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:41:28.301486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342132+0000","last_change":"2023-10-14T09:38:31.035347+0000","last_active":"2023-10-14T09:38:32.342132+0000","last_peered":"2023-10-14T09:38:32.342132+0000","last_clean":"2023-10-14T09:38:32.342132+0000","last_became_active":"2023-10-14T09:38:31.033760+0000","last_became_peered":"2023-10-14T09:38:31.033760+0000","last_unstale":"2023-10-14T09:38:32.342132+0000","last_undegraded":"2023-10-14T09:38:32.342132+0000","last_fullsized":"2023-10-14T09:38:32.342132+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:02:20.930526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341844+0000","last_change":"2023-10-14T09:38:31.024987+0000","last_active":"2023-10-14T09:38:32.341844+0000","last_peered":"2023-10-14T09:38:32.341844+0000","last_clean":"2023-10-14T09:38:32.341844+0000","last_became_active":"2023-10-14T09:38:31.024702+0000","last_became_peered":"2023-10-14T09:38:31.024702+0000","last_unstale":"2023-10-14T09:38:32.341844+0000","last_undegraded":"2023-10-14T09:38:32.341844+0000","last_fullsized":"2023-10-14T09:38:32.341844+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:23:43.555148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.019168+0000","last_change":"2023-10-14T09:38:31.024329+0000","last_active":"2023-10-14T09:38:32.019168+0000","last_peered":"2023-10-14T09:38:32.019168+0000","last_clean":"2023-10-14T09:38:32.019168+0000","last_became_active":"2023-10-14T09:38:31.023498+0000","last_became_peered":"2023-10-14T09:38:31.023498+0000","last_unstale":"2023-10-14T09:38:32.019168+0000","last_undegraded":"2023-10-14T09:38:32.019168+0000","last_fullsized":"2023-10-14T09:38:32.019168+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:46.045245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344549+0000","last_change":"2023-10-14T09:38:31.029616+0000","last_active":"2023-10-14T09:38:32.344549+0000","last_peered":"2023-10-14T09:38:32.344549+0000","last_clean":"2023-10-14T09:38:32.344549+0000","last_became_active":"2023-10-14T09:38:31.029268+0000","last_became_peered":"2023-10-14T09:38:31.029268+0000","last_unstale":"2023-10-14T09:38:32.344549+0000","last_undegraded":"2023-10-14T09:38:32.344549+0000","last_fullsized":"2023-10-14T09:38:32.344549+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:04:05.499565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343128+0000","last_change":"2023-10-14T09:38:31.035514+0000","last_active":"2023-10-14T09:38:32.343128+0000","last_peered":"2023-10-14T09:38:32.343128+0000","last_clean":"2023-10-14T09:38:32.343128+0000","last_became_active":"2023-10-14T09:38:31.033343+0000","last_became_peered":"2023-10-14T09:38:31.033343+0000","last_unstale":"2023-10-14T09:38:32.343128+0000","last_undegraded":"2023-10-14T09:38:32.343128+0000","last_fullsized":"2023-10-14T09:38:32.343128+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:55:53.322273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344359+0000","last_change":"2023-10-14T09:38:31.018326+0000","last_active":"2023-10-14T09:38:32.344359+0000","last_peered":"2023-10-14T09:38:32.344359+0000","last_clean":"2023-10-14T09:38:32.344359+0000","last_became_active":"2023-10-14T09:38:31.017971+0000","last_became_peered":"2023-10-14T09:38:31.017971+0000","last_unstale":"2023-10-14T09:38:32.344359+0000","last_undegraded":"2023-10-14T09:38:32.344359+0000","last_fullsized":"2023-10-14T09:38:32.344359+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:08.018148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341372+0000","last_change":"2023-10-14T09:38:31.019474+0000","last_active":"2023-10-14T09:38:32.341372+0000","last_peered":"2023-10-14T09:38:32.341372+0000","last_clean":"2023-10-14T09:38:32.341372+0000","last_became_active":"2023-10-14T09:38:31.019186+0000","last_became_peered":"2023-10-14T09:38:31.019186+0000","last_unstale":"2023-10-14T09:38:32.341372+0000","last_undegraded":"2023-10-14T09:38:32.341372+0000","last_fullsized":"2023-10-14T09:38:32.341372+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:36:21.378536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342644+0000","last_change":"2023-10-14T09:38:31.020718+0000","last_active":"2023-10-14T09:38:32.342644+0000","last_peered":"2023-10-14T09:38:32.342644+0000","last_clean":"2023-10-14T09:38:32.342644+0000","last_became_active":"2023-10-14T09:38:31.020409+0000","last_became_peered":"2023-10-14T09:38:31.020409+0000","last_unstale":"2023-10-14T09:38:32.342644+0000","last_undegraded":"2023-10-14T09:38:32.342644+0000","last_fullsized":"2023-10-14T09:38:32.342644+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:43:03.012824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342558+0000","last_change":"2023-10-14T09:38:31.025489+0000","last_active":"2023-10-14T09:38:32.342558+0000","last_peered":"2023-10-14T09:38:32.342558+0000","last_clean":"2023-10-14T09:38:32.342558+0000","last_became_active":"2023-10-14T09:38:31.025155+0000","last_became_peered":"2023-10-14T09:38:31.025155+0000","last_unstale":"2023-10-14T09:38:32.342558+0000","last_undegraded":"2023-10-14T09:38:32.342558+0000","last_fullsized":"2023-10-14T09:38:32.342558+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:14:59.816409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342426+0000","last_change":"2023-10-14T09:38:31.034136+0000","last_active":"2023-10-14T09:38:32.342426+0000","last_peered":"2023-10-14T09:38:32.342426+0000","last_clean":"2023-10-14T09:38:32.342426+0000","last_became_active":"2023-10-14T09:38:31.033869+0000","last_became_peered":"2023-10-14T09:38:31.033869+0000","last_unstale":"2023-10-14T09:38:32.342426+0000","last_undegraded":"2023-10-14T09:38:32.342426+0000","last_fullsized":"2023-10-14T09:38:32.342426+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:44.513959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343361+0000","last_change":"2023-10-14T09:38:31.030416+0000","last_active":"2023-10-14T09:38:32.343361+0000","last_peered":"2023-10-14T09:38:32.343361+0000","last_clean":"2023-10-14T09:38:32.343361+0000","last_became_active":"2023-10-14T09:38:31.029457+0000","last_became_peered":"2023-10-14T09:38:31.029457+0000","last_unstale":"2023-10-14T09:38:32.343361+0000","last_undegraded":"2023-10-14T09:38:32.343361+0000","last_fullsized":"2023-10-14T09:38:32.343361+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:41:28.301486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344776+0000","last_change":"2023-10-14T09:38:31.033346+0000","last_active":"2023-10-14T09:38:32.344776+0000","last_peered":"2023-10-14T09:38:32.344776+0000","last_clean":"2023-10-14T09:38:32.344776+0000","last_became_active":"2023-10-14T09:38:31.033040+0000","last_became_peered":"2023-10-14T09:38:31.033040+0000","last_unstale":"2023-10-14T09:38:32.344776+0000","last_undegraded":"2023-10-14T09:38:32.344776+0000","last_fullsized":"2023-10-14T09:38:32.344776+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:54:57.182070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343534+0000","last_change":"2023-10-14T09:38:31.026010+0000","last_active":"2023-10-14T09:38:32.343534+0000","last_peered":"2023-10-14T09:38:32.343534+0000","last_clean":"2023-10-14T09:38:32.343534+0000","last_became_active":"2023-10-14T09:38:31.025735+0000","last_became_peered":"2023-10-14T09:38:31.025735+0000","last_unstale":"2023-10-14T09:38:32.343534+0000","last_undegraded":"2023-10-14T09:38:32.343534+0000","last_fullsized":"2023-10-14T09:38:32.343534+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:07:02.738518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341225+0000","last_change":"2023-10-14T09:38:31.011800+0000","last_active":"2023-10-14T09:38:32.341225+0000","last_peered":"2023-10-14T09:38:32.341225+0000","last_clean":"2023-10-14T09:38:32.341225+0000","last_became_active":"2023-10-14T09:38:31.011363+0000","last_became_peered":"2023-10-14T09:38:31.011363+0000","last_unstale":"2023-10-14T09:38:32.341225+0000","last_undegraded":"2023-10-14T09:38:32.341225+0000","last_fullsized":"2023-10-14T09:38:32.341225+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:32:10.952099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.018172+0000","last_change":"2023-10-14T09:38:31.021882+0000","last_active":"2023-10-14T09:38:32.018172+0000","last_peered":"2023-10-14T09:38:32.018172+0000","last_clean":"2023-10-14T09:38:32.018172+0000","last_became_active":"2023-10-14T09:38:31.021555+0000","last_became_peered":"2023-10-14T09:38:31.021555+0000","last_unstale":"2023-10-14T09:38:32.018172+0000","last_undegraded":"2023-10-14T09:38:32.018172+0000","last_fullsized":"2023-10-14T09:38:32.018172+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:22.613894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.018500+0000","last_change":"2023-10-14T09:38:31.029992+0000","last_active":"2023-10-14T09:38:32.018500+0000","last_peered":"2023-10-14T09:38:32.018500+0000","last_clean":"2023-10-14T09:38:32.018500+0000","last_became_active":"2023-10-14T09:38:31.029712+0000","last_became_peered":"2023-10-14T09:38:31.029712+0000","last_unstale":"2023-10-14T09:38:32.018500+0000","last_undegraded":"2023-10-14T09:38:32.018500+0000","last_fullsized":"2023-10-14T09:38:32.018500+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:12.059563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345293+0000","last_change":"2023-10-14T09:38:31.023504+0000","last_active":"2023-10-14T09:38:32.345293+0000","last_peered":"2023-10-14T09:38:32.345293+0000","last_clean":"2023-10-14T09:38:32.345293+0000","last_became_active":"2023-10-14T09:38:31.023251+0000","last_became_peered":"2023-10-14T09:38:31.023251+0000","last_unstale":"2023-10-14T09:38:32.345293+0000","last_undegraded":"2023-10-14T09:38:32.345293+0000","last_fullsized":"2023-10-14T09:38:32.345293+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:29.053068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342651+0000","last_change":"2023-10-14T09:38:31.011612+0000","last_active":"2023-10-14T09:38:32.342651+0000","last_peered":"2023-10-14T09:38:32.342651+0000","last_clean":"2023-10-14T09:38:32.342651+0000","last_became_active":"2023-10-14T09:38:31.010860+0000","last_became_peered":"2023-10-14T09:38:31.010860+0000","last_unstale":"2023-10-14T09:38:32.342651+0000","last_undegraded":"2023-10-14T09:38:32.342651+0000","last_fullsized":"2023-10-14T09:38:32.342651+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:54:32.085213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344876+0000","last_change":"2023-10-14T09:38:31.023722+0000","last_active":"2023-10-14T09:38:32.344876+0000","last_peered":"2023-10-14T09:38:32.344876+0000","last_clean":"2023-10-14T09:38:32.344876+0000","last_became_active":"2023-10-14T09:38:31.023469+0000","last_became_peered":"2023-10-14T09:38:31.023469+0000","last_unstale":"2023-10-14T09:38:32.344876+0000","last_undegraded":"2023-10-14T09:38:32.344876+0000","last_fullsized":"2023-10-14T09:38:32.344876+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:26:03.834483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344738+0000","last_change":"2023-10-14T09:38:31.028525+0000","last_active":"2023-10-14T09:38:32.344738+0000","last_peered":"2023-10-14T09:38:32.344738+0000","last_clean":"2023-10-14T09:38:32.344738+0000","last_became_active":"2023-10-14T09:38:31.026660+0000","last_became_peered":"2023-10-14T09:38:31.026660+0000","last_unstale":"2023-10-14T09:38:32.344738+0000","last_undegraded":"2023-10-14T09:38:32.344738+0000","last_fullsized":"2023-10-14T09:38:32.344738+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:29:12.633954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344629+0000","last_change":"2023-10-14T09:38:31.026064+0000","last_active":"2023-10-14T09:38:32.344629+0000","last_peered":"2023-10-14T09:38:32.344629+0000","last_clean":"2023-10-14T09:38:32.344629+0000","last_became_active":"2023-10-14T09:38:31.025680+0000","last_became_peered":"2023-10-14T09:38:31.025680+0000","last_unstale":"2023-10-14T09:38:32.344629+0000","last_undegraded":"2023-10-14T09:38:32.344629+0000","last_fullsized":"2023-10-14T09:38:32.344629+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:05:14.584003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343991+0000","last_change":"2023-10-14T09:38:31.022957+0000","last_active":"2023-10-14T09:38:32.343991+0000","last_peered":"2023-10-14T09:38:32.343991+0000","last_clean":"2023-10-14T09:38:32.343991+0000","last_became_active":"2023-10-14T09:38:31.022641+0000","last_became_peered":"2023-10-14T09:38:31.022641+0000","last_unstale":"2023-10-14T09:38:32.343991+0000","last_undegraded":"2023-10-14T09:38:32.343991+0000","last_fullsized":"2023-10-14T09:38:32.343991+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:08:08.601763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.018402+0000","last_change":"2023-10-14T09:38:31.031585+0000","last_active":"2023-10-14T09:38:32.018402+0000","last_peered":"2023-10-14T09:38:32.018402+0000","last_clean":"2023-10-14T09:38:32.018402+0000","last_became_active":"2023-10-14T09:38:31.031302+0000","last_became_peered":"2023-10-14T09:38:31.031302+0000","last_unstale":"2023-10-14T09:38:32.018402+0000","last_undegraded":"2023-10-14T09:38:32.018402+0000","last_fullsized":"2023-10-14T09:38:32.018402+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:37:07.904425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341801+0000","last_change":"2023-10-14T09:38:31.029845+0000","last_active":"2023-10-14T09:38:32.341801+0000","last_peered":"2023-10-14T09:38:32.341801+0000","last_clean":"2023-10-14T09:38:32.341801+0000","last_became_active":"2023-10-14T09:38:31.029493+0000","last_became_peered":"2023-10-14T09:38:31.029493+0000","last_unstale":"2023-10-14T09:38:32.341801+0000","last_undegraded":"2023-10-14T09:38:32.341801+0000","last_fullsized":"2023-10-14T09:38:32.341801+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:05:14.584003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.020011+0000","last_change":"2023-10-14T09:38:31.025533+0000","last_active":"2023-10-14T09:38:32.020011+0000","last_peered":"2023-10-14T09:38:32.020011+0000","last_clean":"2023-10-14T09:38:32.020011+0000","last_became_active":"2023-10-14T09:38:31.025243+0000","last_became_peered":"2023-10-14T09:38:31.025243+0000","last_unstale":"2023-10-14T09:38:32.020011+0000","last_undegraded":"2023-10-14T09:38:32.020011+0000","last_fullsized":"2023-10-14T09:38:32.020011+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:32:55.434705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341995+0000","last_change":"2023-10-14T09:38:31.028763+0000","last_active":"2023-10-14T09:38:32.341995+0000","last_peered":"2023-10-14T09:38:32.341995+0000","last_clean":"2023-10-14T09:38:32.341995+0000","last_became_active":"2023-10-14T09:38:31.028420+0000","last_became_peered":"2023-10-14T09:38:31.028420+0000","last_unstale":"2023-10-14T09:38:32.341995+0000","last_undegraded":"2023-10-14T09:38:32.341995+0000","last_fullsized":"2023-10-14T09:38:32.341995+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:26:03.834483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345961+0000","last_change":"2023-10-14T09:38:31.024908+0000","last_active":"2023-10-14T09:38:32.345961+0000","last_peered":"2023-10-14T09:38:32.345961+0000","last_clean":"2023-10-14T09:38:32.345961+0000","last_became_active":"2023-10-14T09:38:31.023482+0000","last_became_peered":"2023-10-14T09:38:31.023482+0000","last_unstale":"2023-10-14T09:38:32.345961+0000","last_undegraded":"2023-10-14T09:38:32.345961+0000","last_fullsized":"2023-10-14T09:38:32.345961+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:14:59.816409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"35'4","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.048326+0000","last_change":"2023-10-14T09:38:30.031689+0000","last_active":"2023-10-14T09:38:31.048326+0000","last_peered":"2023-10-14T09:38:31.048326+0000","last_clean":"2023-10-14T09:38:31.048326+0000","last_became_active":"2023-10-14T09:38:30.031374+0000","last_became_peered":"2023-10-14T09:38:30.031374+0000","last_unstale":"2023-10-14T09:38:31.048326+0000","last_undegraded":"2023-10-14T09:38:31.048326+0000","last_fullsized":"2023-10-14T09:38:31.048326+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:32.881121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.019773+0000","last_change":"2023-10-14T09:38:31.026729+0000","last_active":"2023-10-14T09:38:32.019773+0000","last_peered":"2023-10-14T09:38:32.019773+0000","last_clean":"2023-10-14T09:38:32.019773+0000","last_became_active":"2023-10-14T09:38:31.026414+0000","last_became_peered":"2023-10-14T09:38:31.026414+0000","last_unstale":"2023-10-14T09:38:32.019773+0000","last_undegraded":"2023-10-14T09:38:32.019773+0000","last_fullsized":"2023-10-14T09:38:32.019773+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:09.182708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"35'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345785+0000","last_change":"2023-10-14T09:38:30.025206+0000","last_active":"2023-10-14T09:38:32.345785+0000","last_peered":"2023-10-14T09:38:32.345785+0000","last_clean":"2023-10-14T09:38:32.345785+0000","last_became_active":"2023-10-14T09:38:30.024910+0000","last_became_peered":"2023-10-14T09:38:30.024910+0000","last_unstale":"2023-10-14T09:38:32.345785+0000","last_undegraded":"2023-10-14T09:38:32.345785+0000","last_fullsized":"2023-10-14T09:38:32.345785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:35:31.581556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.018785+0000","last_change":"2023-10-14T09:38:31.030098+0000","last_active":"2023-10-14T09:38:32.018785+0000","last_peered":"2023-10-14T09:38:32.018785+0000","last_clean":"2023-10-14T09:38:32.018785+0000","last_became_active":"2023-10-14T09:38:31.029815+0000","last_became_peered":"2023-10-14T09:38:31.029815+0000","last_unstale":"2023-10-14T09:38:32.018785+0000","last_undegraded":"2023-10-14T09:38:32.018785+0000","last_fullsized":"2023-10-14T09:38:32.018785+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:23:27.986420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.041830+0000","last_change":"2023-10-14T09:38:30.017782+0000","last_active":"2023-10-14T09:38:31.041830+0000","last_peered":"2023-10-14T09:38:31.041830+0000","last_clean":"2023-10-14T09:38:31.041830+0000","last_became_active":"2023-10-14T09:38:30.017602+0000","last_became_peered":"2023-10-14T09:38:30.017602+0000","last_unstale":"2023-10-14T09:38:31.041830+0000","last_undegraded":"2023-10-14T09:38:31.041830+0000","last_fullsized":"2023-10-14T09:38:31.041830+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:34.119874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344746+0000","last_change":"2023-10-14T09:38:31.028602+0000","last_active":"2023-10-14T09:38:32.344746+0000","last_peered":"2023-10-14T09:38:32.344746+0000","last_clean":"2023-10-14T09:38:32.344746+0000","last_became_active":"2023-10-14T09:38:31.025645+0000","last_became_peered":"2023-10-14T09:38:31.025645+0000","last_unstale":"2023-10-14T09:38:32.344746+0000","last_undegraded":"2023-10-14T09:38:32.344746+0000","last_fullsized":"2023-10-14T09:38:32.344746+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:23:43.555148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.043829+0000","last_change":"2023-10-14T09:38:30.031331+0000","last_active":"2023-10-14T09:38:31.043829+0000","last_peered":"2023-10-14T09:38:31.043829+0000","last_clean":"2023-10-14T09:38:31.043829+0000","last_became_active":"2023-10-14T09:38:30.030556+0000","last_became_peered":"2023-10-14T09:38:30.030556+0000","last_unstale":"2023-10-14T09:38:31.043829+0000","last_undegraded":"2023-10-14T09:38:31.043829+0000","last_fullsized":"2023-10-14T09:38:31.043829+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:00:27.300436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342154+0000","last_change":"2023-10-14T09:38:31.029169+0000","last_active":"2023-10-14T09:38:32.342154+0000","last_peered":"2023-10-14T09:38:32.342154+0000","last_clean":"2023-10-14T09:38:32.342154+0000","last_became_active":"2023-10-14T09:38:31.028887+0000","last_became_peered":"2023-10-14T09:38:31.028887+0000","last_unstale":"2023-10-14T09:38:32.342154+0000","last_undegraded":"2023-10-14T09:38:32.342154+0000","last_fullsized":"2023-10-14T09:38:32.342154+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:05:40.247862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.043614+0000","last_change":"2023-10-14T09:38:30.026023+0000","last_active":"2023-10-14T09:38:31.043614+0000","last_peered":"2023-10-14T09:38:31.043614+0000","last_clean":"2023-10-14T09:38:31.043614+0000","last_became_active":"2023-10-14T09:38:30.025732+0000","last_became_peered":"2023-10-14T09:38:30.025732+0000","last_unstale":"2023-10-14T09:38:31.043614+0000","last_undegraded":"2023-10-14T09:38:31.043614+0000","last_fullsized":"2023-10-14T09:38:31.043614+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:30:03.089452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343662+0000","last_change":"2023-10-14T09:38:31.020554+0000","last_active":"2023-10-14T09:38:32.343662+0000","last_peered":"2023-10-14T09:38:32.343662+0000","last_clean":"2023-10-14T09:38:32.343662+0000","last_became_active":"2023-10-14T09:38:31.020184+0000","last_became_peered":"2023-10-14T09:38:31.020184+0000","last_unstale":"2023-10-14T09:38:32.343662+0000","last_undegraded":"2023-10-14T09:38:32.343662+0000","last_fullsized":"2023-10-14T09:38:32.343662+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:26:34.407953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.043817+0000","last_change":"2023-10-14T09:38:30.031642+0000","last_active":"2023-10-14T09:38:31.043817+0000","last_peered":"2023-10-14T09:38:31.043817+0000","last_clean":"2023-10-14T09:38:31.043817+0000","last_became_active":"2023-10-14T09:38:30.031356+0000","last_became_peered":"2023-10-14T09:38:30.031356+0000","last_unstale":"2023-10-14T09:38:31.043817+0000","last_undegraded":"2023-10-14T09:38:31.043817+0000","last_fullsized":"2023-10-14T09:38:31.043817+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:36:20.364439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.017009+0000","last_change":"2023-10-14T09:38:31.024293+0000","last_active":"2023-10-14T09:38:32.017009+0000","last_peered":"2023-10-14T09:38:32.017009+0000","last_clean":"2023-10-14T09:38:32.017009+0000","last_became_active":"2023-10-14T09:38:31.023990+0000","last_became_peered":"2023-10-14T09:38:31.023990+0000","last_unstale":"2023-10-14T09:38:32.017009+0000","last_undegraded":"2023-10-14T09:38:32.017009+0000","last_fullsized":"2023-10-14T09:38:32.017009+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:18.314768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.010745+0000","last_change":"2023-10-14T09:38:30.021813+0000","last_active":"2023-10-14T09:38:31.010745+0000","last_peered":"2023-10-14T09:38:31.010745+0000","last_clean":"2023-10-14T09:38:31.010745+0000","last_became_active":"2023-10-14T09:38:30.019461+0000","last_became_peered":"2023-10-14T09:38:30.019461+0000","last_unstale":"2023-10-14T09:38:31.010745+0000","last_undegraded":"2023-10-14T09:38:31.010745+0000","last_fullsized":"2023-10-14T09:38:31.010745+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:04:04.485468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342676+0000","last_change":"2023-10-14T09:38:31.016796+0000","last_active":"2023-10-14T09:38:32.342676+0000","last_peered":"2023-10-14T09:38:32.342676+0000","last_clean":"2023-10-14T09:38:32.342676+0000","last_became_active":"2023-10-14T09:38:31.016514+0000","last_became_peered":"2023-10-14T09:38:31.016514+0000","last_unstale":"2023-10-14T09:38:32.342676+0000","last_undegraded":"2023-10-14T09:38:32.342676+0000","last_fullsized":"2023-10-14T09:38:32.342676+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:23:27.986420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.006074+0000","last_change":"2023-10-14T09:38:30.035807+0000","last_active":"2023-10-14T09:38:31.006074+0000","last_peered":"2023-10-14T09:38:31.006074+0000","last_clean":"2023-10-14T09:38:31.006074+0000","last_became_active":"2023-10-14T09:38:30.035470+0000","last_became_peered":"2023-10-14T09:38:30.035470+0000","last_unstale":"2023-10-14T09:38:31.006074+0000","last_undegraded":"2023-10-14T09:38:31.006074+0000","last_fullsized":"2023-10-14T09:38:31.006074+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:38:26.466223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344016+0000","last_change":"2023-10-14T09:38:31.026082+0000","last_active":"2023-10-14T09:38:32.344016+0000","last_peered":"2023-10-14T09:38:32.344016+0000","last_clean":"2023-10-14T09:38:32.344016+0000","last_became_active":"2023-10-14T09:38:31.025794+0000","last_became_peered":"2023-10-14T09:38:31.025794+0000","last_unstale":"2023-10-14T09:38:32.344016+0000","last_undegraded":"2023-10-14T09:38:32.344016+0000","last_fullsized":"2023-10-14T09:38:32.344016+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:08:12.498616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.013494+0000","last_change":"2023-10-14T09:38:30.014502+0000","last_active":"2023-10-14T09:38:31.013494+0000","last_peered":"2023-10-14T09:38:31.013494+0000","last_clean":"2023-10-14T09:38:31.013494+0000","last_became_active":"2023-10-14T09:38:30.014042+0000","last_became_peered":"2023-10-14T09:38:30.014042+0000","last_unstale":"2023-10-14T09:38:31.013494+0000","last_undegraded":"2023-10-14T09:38:31.013494+0000","last_fullsized":"2023-10-14T09:38:31.013494+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:02:19.916430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343306+0000","last_change":"2023-10-14T09:38:31.021923+0000","last_active":"2023-10-14T09:38:32.343306+0000","last_peered":"2023-10-14T09:38:32.343306+0000","last_clean":"2023-10-14T09:38:32.343306+0000","last_became_active":"2023-10-14T09:38:31.021662+0000","last_became_peered":"2023-10-14T09:38:31.021662+0000","last_unstale":"2023-10-14T09:38:32.343306+0000","last_undegraded":"2023-10-14T09:38:32.343306+0000","last_fullsized":"2023-10-14T09:38:32.343306+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:18:08.718330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345934+0000","last_change":"2023-10-14T09:38:30.028000+0000","last_active":"2023-10-14T09:38:32.345934+0000","last_peered":"2023-10-14T09:38:32.345934+0000","last_clean":"2023-10-14T09:38:32.345934+0000","last_became_active":"2023-10-14T09:38:30.027696+0000","last_became_peered":"2023-10-14T09:38:30.027696+0000","last_unstale":"2023-10-14T09:38:32.345934+0000","last_undegraded":"2023-10-14T09:38:32.345934+0000","last_fullsized":"2023-10-14T09:38:32.345934+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:11.668342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343027+0000","last_change":"2023-10-14T09:38:31.026933+0000","last_active":"2023-10-14T09:38:32.343027+0000","last_peered":"2023-10-14T09:38:32.343027+0000","last_clean":"2023-10-14T09:38:32.343027+0000","last_became_active":"2023-10-14T09:38:31.026676+0000","last_became_peered":"2023-10-14T09:38:31.026676+0000","last_unstale":"2023-10-14T09:38:32.343027+0000","last_undegraded":"2023-10-14T09:38:32.343027+0000","last_fullsized":"2023-10-14T09:38:32.343027+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:39:19.700408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"35'3","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344090+0000","last_change":"2023-10-14T09:38:30.032207+0000","last_active":"2023-10-14T09:38:32.344090+0000","last_peered":"2023-10-14T09:38:32.344090+0000","last_clean":"2023-10-14T09:38:32.344090+0000","last_became_active":"2023-10-14T09:38:30.031907+0000","last_became_peered":"2023-10-14T09:38:30.031907+0000","last_unstale":"2023-10-14T09:38:32.344090+0000","last_undegraded":"2023-10-14T09:38:32.344090+0000","last_fullsized":"2023-10-14T09:38:32.344090+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:59:09.031590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343866+0000","last_change":"2023-10-14T09:38:31.021126+0000","last_active":"2023-10-14T09:38:32.343866+0000","last_peered":"2023-10-14T09:38:32.343866+0000","last_clean":"2023-10-14T09:38:32.343866+0000","last_became_active":"2023-10-14T09:38:31.020267+0000","last_became_peered":"2023-10-14T09:38:31.020267+0000","last_unstale":"2023-10-14T09:38:32.343866+0000","last_undegraded":"2023-10-14T09:38:32.343866+0000","last_fullsized":"2023-10-14T09:38:32.343866+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:29:07.359293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"35'6","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.048294+0000","last_change":"2023-10-14T09:38:30.020149+0000","last_active":"2023-10-14T09:38:31.048294+0000","last_peered":"2023-10-14T09:38:31.048294+0000","last_clean":"2023-10-14T09:38:31.048294+0000","last_became_active":"2023-10-14T09:38:30.019839+0000","last_became_peered":"2023-10-14T09:38:30.019839+0000","last_unstale":"2023-10-14T09:38:31.048294+0000","last_undegraded":"2023-10-14T09:38:31.048294+0000","last_fullsized":"2023-10-14T09:38:31.048294+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:54.807431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342588+0000","last_change":"2023-10-14T09:38:31.020699+0000","last_active":"2023-10-14T09:38:32.342588+0000","last_peered":"2023-10-14T09:38:32.342588+0000","last_clean":"2023-10-14T09:38:32.342588+0000","last_became_active":"2023-10-14T09:38:31.020347+0000","last_became_peered":"2023-10-14T09:38:31.020347+0000","last_unstale":"2023-10-14T09:38:32.342588+0000","last_undegraded":"2023-10-14T09:38:32.342588+0000","last_fullsized":"2023-10-14T09:38:32.342588+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:12.059563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.042951+0000","last_change":"2023-10-14T09:38:30.035740+0000","last_active":"2023-10-14T09:38:31.042951+0000","last_peered":"2023-10-14T09:38:31.042951+0000","last_clean":"2023-10-14T09:38:31.042951+0000","last_became_active":"2023-10-14T09:38:30.035424+0000","last_became_peered":"2023-10-14T09:38:30.035424+0000","last_unstale":"2023-10-14T09:38:31.042951+0000","last_undegraded":"2023-10-14T09:38:31.042951+0000","last_fullsized":"2023-10-14T09:38:31.042951+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:13:05.075908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342770+0000","last_change":"2023-10-14T09:38:31.028147+0000","last_active":"2023-10-14T09:38:32.342770+0000","last_peered":"2023-10-14T09:38:32.342770+0000","last_clean":"2023-10-14T09:38:32.342770+0000","last_became_active":"2023-10-14T09:38:31.027759+0000","last_became_peered":"2023-10-14T09:38:31.027759+0000","last_unstale":"2023-10-14T09:38:32.342770+0000","last_undegraded":"2023-10-14T09:38:32.342770+0000","last_fullsized":"2023-10-14T09:38:32.342770+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:28.333786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.004907+0000","last_change":"2023-10-14T09:38:30.025921+0000","last_active":"2023-10-14T09:38:31.004907+0000","last_peered":"2023-10-14T09:38:31.004907+0000","last_clean":"2023-10-14T09:38:31.004907+0000","last_became_active":"2023-10-14T09:38:30.025712+0000","last_became_peered":"2023-10-14T09:38:30.025712+0000","last_unstale":"2023-10-14T09:38:31.004907+0000","last_undegraded":"2023-10-14T09:38:31.004907+0000","last_fullsized":"2023-10-14T09:38:31.004907+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:13:05.075908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342190+0000","last_change":"2023-10-14T09:38:31.037744+0000","last_active":"2023-10-14T09:38:32.342190+0000","last_peered":"2023-10-14T09:38:32.342190+0000","last_clean":"2023-10-14T09:38:32.342190+0000","last_became_active":"2023-10-14T09:38:31.036628+0000","last_became_peered":"2023-10-14T09:38:31.036628+0000","last_unstale":"2023-10-14T09:38:32.342190+0000","last_undegraded":"2023-10-14T09:38:32.342190+0000","last_fullsized":"2023-10-14T09:38:32.342190+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:55.821527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.010492+0000","last_change":"2023-10-14T09:38:30.022460+0000","last_active":"2023-10-14T09:38:31.010492+0000","last_peered":"2023-10-14T09:38:31.010492+0000","last_clean":"2023-10-14T09:38:31.010492+0000","last_became_active":"2023-10-14T09:38:30.022182+0000","last_became_peered":"2023-10-14T09:38:30.022182+0000","last_unstale":"2023-10-14T09:38:31.010492+0000","last_undegraded":"2023-10-14T09:38:31.010492+0000","last_fullsized":"2023-10-14T09:38:31.010492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:45.031149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.020009+0000","last_change":"2023-10-14T09:38:31.039814+0000","last_active":"2023-10-14T09:38:32.020009+0000","last_peered":"2023-10-14T09:38:32.020009+0000","last_clean":"2023-10-14T09:38:32.020009+0000","last_became_active":"2023-10-14T09:38:31.039518+0000","last_became_peered":"2023-10-14T09:38:31.039518+0000","last_unstale":"2023-10-14T09:38:32.020009+0000","last_undegraded":"2023-10-14T09:38:32.020009+0000","last_fullsized":"2023-10-14T09:38:32.020009+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:22.613894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"35'8","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.046908+0000","last_change":"2023-10-14T09:38:30.015580+0000","last_active":"2023-10-14T09:38:31.046908+0000","last_peered":"2023-10-14T09:38:31.046908+0000","last_clean":"2023-10-14T09:38:31.046908+0000","last_became_active":"2023-10-14T09:38:30.014562+0000","last_became_peered":"2023-10-14T09:38:30.014562+0000","last_unstale":"2023-10-14T09:38:31.046908+0000","last_undegraded":"2023-10-14T09:38:31.046908+0000","last_fullsized":"2023-10-14T09:38:31.046908+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:27.669263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.018236+0000","last_change":"2023-10-14T09:38:31.026009+0000","last_active":"2023-10-14T09:38:32.018236+0000","last_peered":"2023-10-14T09:38:32.018236+0000","last_clean":"2023-10-14T09:38:32.018236+0000","last_became_active":"2023-10-14T09:38:31.025665+0000","last_became_peered":"2023-10-14T09:38:31.025665+0000","last_unstale":"2023-10-14T09:38:32.018236+0000","last_undegraded":"2023-10-14T09:38:32.018236+0000","last_fullsized":"2023-10-14T09:38:32.018236+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:16:06.675198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.046534+0000","last_change":"2023-10-14T09:38:30.027344+0000","last_active":"2023-10-14T09:38:31.046534+0000","last_peered":"2023-10-14T09:38:31.046534+0000","last_clean":"2023-10-14T09:38:31.046534+0000","last_became_active":"2023-10-14T09:38:30.025331+0000","last_became_peered":"2023-10-14T09:38:30.025331+0000","last_unstale":"2023-10-14T09:38:31.046534+0000","last_undegraded":"2023-10-14T09:38:31.046534+0000","last_fullsized":"2023-10-14T09:38:31.046534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:16:05.661101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344384+0000","last_change":"2023-10-14T09:38:31.033233+0000","last_active":"2023-10-14T09:38:32.344384+0000","last_peered":"2023-10-14T09:38:32.344384+0000","last_clean":"2023-10-14T09:38:32.344384+0000","last_became_active":"2023-10-14T09:38:31.032912+0000","last_became_peered":"2023-10-14T09:38:31.032912+0000","last_unstale":"2023-10-14T09:38:32.344384+0000","last_undegraded":"2023-10-14T09:38:32.344384+0000","last_fullsized":"2023-10-14T09:38:32.344384+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:52:28.791327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.043036+0000","last_change":"2023-10-14T09:38:30.035623+0000","last_active":"2023-10-14T09:38:31.043036+0000","last_peered":"2023-10-14T09:38:31.043036+0000","last_clean":"2023-10-14T09:38:31.043036+0000","last_became_active":"2023-10-14T09:38:30.035283+0000","last_became_peered":"2023-10-14T09:38:30.035283+0000","last_unstale":"2023-10-14T09:38:31.043036+0000","last_undegraded":"2023-10-14T09:38:31.043036+0000","last_fullsized":"2023-10-14T09:38:31.043036+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:32:09.938003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344424+0000","last_change":"2023-10-14T09:38:31.035370+0000","last_active":"2023-10-14T09:38:32.344424+0000","last_peered":"2023-10-14T09:38:32.344424+0000","last_clean":"2023-10-14T09:38:32.344424+0000","last_became_active":"2023-10-14T09:38:31.034768+0000","last_became_peered":"2023-10-14T09:38:31.034768+0000","last_unstale":"2023-10-14T09:38:32.344424+0000","last_undegraded":"2023-10-14T09:38:32.344424+0000","last_fullsized":"2023-10-14T09:38:32.344424+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:28.683360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.045638+0000","last_change":"2023-10-14T09:38:30.032461+0000","last_active":"2023-10-14T09:38:31.045638+0000","last_peered":"2023-10-14T09:38:31.045638+0000","last_clean":"2023-10-14T09:38:31.045638+0000","last_became_active":"2023-10-14T09:38:30.030927+0000","last_became_peered":"2023-10-14T09:38:30.030927+0000","last_unstale":"2023-10-14T09:38:31.045638+0000","last_undegraded":"2023-10-14T09:38:31.045638+0000","last_fullsized":"2023-10-14T09:38:31.045638+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:18:05.378855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341272+0000","last_change":"2023-10-14T09:38:31.026882+0000","last_active":"2023-10-14T09:38:32.341272+0000","last_peered":"2023-10-14T09:38:32.341272+0000","last_clean":"2023-10-14T09:38:32.341272+0000","last_became_active":"2023-10-14T09:38:31.026615+0000","last_became_peered":"2023-10-14T09:38:31.026615+0000","last_unstale":"2023-10-14T09:38:32.341272+0000","last_undegraded":"2023-10-14T09:38:32.341272+0000","last_fullsized":"2023-10-14T09:38:32.341272+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:39:04.991127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.013395+0000","last_change":"2023-10-14T09:38:30.028028+0000","last_active":"2023-10-14T09:38:31.013395+0000","last_peered":"2023-10-14T09:38:31.013395+0000","last_clean":"2023-10-14T09:38:31.013395+0000","last_became_active":"2023-10-14T09:38:30.026795+0000","last_became_peered":"2023-10-14T09:38:30.026795+0000","last_unstale":"2023-10-14T09:38:31.013395+0000","last_undegraded":"2023-10-14T09:38:31.013395+0000","last_fullsized":"2023-10-14T09:38:31.013395+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:08.168611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341771+0000","last_change":"2023-10-14T09:38:31.032201+0000","last_active":"2023-10-14T09:38:32.341771+0000","last_peered":"2023-10-14T09:38:32.341771+0000","last_clean":"2023-10-14T09:38:32.341771+0000","last_became_active":"2023-10-14T09:38:31.031921+0000","last_became_peered":"2023-10-14T09:38:31.031921+0000","last_unstale":"2023-10-14T09:38:32.341771+0000","last_undegraded":"2023-10-14T09:38:32.341771+0000","last_fullsized":"2023-10-14T09:38:32.341771+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:30:04.103548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345526+0000","last_change":"2023-10-14T09:38:30.021600+0000","last_active":"2023-10-14T09:38:32.345526+0000","last_peered":"2023-10-14T09:38:32.345526+0000","last_clean":"2023-10-14T09:38:32.345526+0000","last_became_active":"2023-10-14T09:38:30.021312+0000","last_became_peered":"2023-10-14T09:38:30.021312+0000","last_unstale":"2023-10-14T09:38:32.345526+0000","last_undegraded":"2023-10-14T09:38:32.345526+0000","last_fullsized":"2023-10-14T09:38:32.345526+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:55:23.928233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341541+0000","last_change":"2023-10-14T09:38:31.023661+0000","last_active":"2023-10-14T09:38:32.341541+0000","last_peered":"2023-10-14T09:38:32.341541+0000","last_clean":"2023-10-14T09:38:32.341541+0000","last_became_active":"2023-10-14T09:38:31.023340+0000","last_became_peered":"2023-10-14T09:38:31.023340+0000","last_unstale":"2023-10-14T09:38:32.341541+0000","last_undegraded":"2023-10-14T09:38:32.341541+0000","last_fullsized":"2023-10-14T09:38:32.341541+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:49:04.384325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.016548+0000","last_change":"2023-10-14T09:38:30.033606+0000","last_active":"2023-10-14T09:38:31.016548+0000","last_peered":"2023-10-14T09:38:31.016548+0000","last_clean":"2023-10-14T09:38:31.016548+0000","last_became_active":"2023-10-14T09:38:30.033284+0000","last_became_peered":"2023-10-14T09:38:30.033284+0000","last_unstale":"2023-10-14T09:38:31.016548+0000","last_undegraded":"2023-10-14T09:38:31.016548+0000","last_fullsized":"2023-10-14T09:38:31.016548+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:26:23.409048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341209+0000","last_change":"2023-10-14T09:38:31.020259+0000","last_active":"2023-10-14T09:38:32.341209+0000","last_peered":"2023-10-14T09:38:32.341209+0000","last_clean":"2023-10-14T09:38:32.341209+0000","last_became_active":"2023-10-14T09:38:31.019732+0000","last_became_peered":"2023-10-14T09:38:31.019732+0000","last_unstale":"2023-10-14T09:38:32.341209+0000","last_undegraded":"2023-10-14T09:38:32.341209+0000","last_fullsized":"2023-10-14T09:38:32.341209+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:39:13.767140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.009471+0000","last_change":"2023-10-14T09:38:30.032802+0000","last_active":"2023-10-14T09:38:31.009471+0000","last_peered":"2023-10-14T09:38:31.009471+0000","last_clean":"2023-10-14T09:38:31.009471+0000","last_became_active":"2023-10-14T09:38:30.032500+0000","last_became_peered":"2023-10-14T09:38:30.032500+0000","last_unstale":"2023-10-14T09:38:31.009471+0000","last_undegraded":"2023-10-14T09:38:31.009471+0000","last_fullsized":"2023-10-14T09:38:31.009471+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:32.881121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342037+0000","last_change":"2023-10-14T09:38:31.030686+0000","last_active":"2023-10-14T09:38:32.342037+0000","last_peered":"2023-10-14T09:38:32.342037+0000","last_clean":"2023-10-14T09:38:32.342037+0000","last_became_active":"2023-10-14T09:38:31.030399+0000","last_became_peered":"2023-10-14T09:38:31.030399+0000","last_unstale":"2023-10-14T09:38:32.342037+0000","last_undegraded":"2023-10-14T09:38:32.342037+0000","last_fullsized":"2023-10-14T09:38:32.342037+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:35.133971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342880+0000","last_change":"2023-10-14T09:38:30.029157+0000","last_active":"2023-10-14T09:38:32.342880+0000","last_peered":"2023-10-14T09:38:32.342880+0000","last_clean":"2023-10-14T09:38:32.342880+0000","last_became_active":"2023-10-14T09:38:30.028540+0000","last_became_peered":"2023-10-14T09:38:30.028540+0000","last_unstale":"2023-10-14T09:38:32.342880+0000","last_undegraded":"2023-10-14T09:38:32.342880+0000","last_fullsized":"2023-10-14T09:38:32.342880+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:11.668342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341394+0000","last_change":"2023-10-14T09:38:31.016140+0000","last_active":"2023-10-14T09:38:32.341394+0000","last_peered":"2023-10-14T09:38:32.341394+0000","last_clean":"2023-10-14T09:38:32.341394+0000","last_became_active":"2023-10-14T09:38:31.015654+0000","last_became_peered":"2023-10-14T09:38:31.015654+0000","last_unstale":"2023-10-14T09:38:32.341394+0000","last_undegraded":"2023-10-14T09:38:32.341394+0000","last_fullsized":"2023-10-14T09:38:32.341394+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:13:35.685099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.043592+0000","last_change":"2023-10-14T09:38:30.030703+0000","last_active":"2023-10-14T09:38:31.043592+0000","last_peered":"2023-10-14T09:38:31.043592+0000","last_clean":"2023-10-14T09:38:31.043592+0000","last_became_active":"2023-10-14T09:38:30.030387+0000","last_became_peered":"2023-10-14T09:38:30.030387+0000","last_unstale":"2023-10-14T09:38:31.043592+0000","last_undegraded":"2023-10-14T09:38:31.043592+0000","last_fullsized":"2023-10-14T09:38:31.043592+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:37:06.890328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344251+0000","last_change":"2023-10-14T09:38:31.024132+0000","last_active":"2023-10-14T09:38:32.344251+0000","last_peered":"2023-10-14T09:38:32.344251+0000","last_clean":"2023-10-14T09:38:32.344251+0000","last_became_active":"2023-10-14T09:38:31.023043+0000","last_became_peered":"2023-10-14T09:38:31.023043+0000","last_unstale":"2023-10-14T09:38:32.344251+0000","last_undegraded":"2023-10-14T09:38:32.344251+0000","last_fullsized":"2023-10-14T09:38:32.344251+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:26:18.683878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:33.929347+0000","last_change":"2023-10-14T09:38:30.024854+0000","last_active":"2023-10-14T09:38:33.929347+0000","last_peered":"2023-10-14T09:38:33.929347+0000","last_clean":"2023-10-14T09:38:33.929347+0000","last_became_active":"2023-10-14T09:38:30.024536+0000","last_became_peered":"2023-10-14T09:38:30.024536+0000","last_unstale":"2023-10-14T09:38:33.929347+0000","last_undegraded":"2023-10-14T09:38:33.929347+0000","last_fullsized":"2023-10-14T09:38:33.929347+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:47:13.277147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345881+0000","last_change":"2023-10-14T09:38:31.024182+0000","last_active":"2023-10-14T09:38:32.345881+0000","last_peered":"2023-10-14T09:38:32.345881+0000","last_clean":"2023-10-14T09:38:32.345881+0000","last_became_active":"2023-10-14T09:38:31.023855+0000","last_became_peered":"2023-10-14T09:38:31.023855+0000","last_unstale":"2023-10-14T09:38:32.345881+0000","last_undegraded":"2023-10-14T09:38:32.345881+0000","last_fullsized":"2023-10-14T09:38:32.345881+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:59:10.045687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.008529+0000","last_change":"2023-10-14T09:38:30.023306+0000","last_active":"2023-10-14T09:38:31.008529+0000","last_peered":"2023-10-14T09:38:31.008529+0000","last_clean":"2023-10-14T09:38:31.008529+0000","last_became_active":"2023-10-14T09:38:30.023068+0000","last_became_peered":"2023-10-14T09:38:30.023068+0000","last_unstale":"2023-10-14T09:38:31.008529+0000","last_undegraded":"2023-10-14T09:38:31.008529+0000","last_fullsized":"2023-10-14T09:38:31.008529+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:21.599798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.019849+0000","last_change":"2023-10-14T09:38:31.027123+0000","last_active":"2023-10-14T09:38:32.019849+0000","last_peered":"2023-10-14T09:38:32.019849+0000","last_clean":"2023-10-14T09:38:32.019849+0000","last_became_active":"2023-10-14T09:38:31.026838+0000","last_became_peered":"2023-10-14T09:38:31.026838+0000","last_unstale":"2023-10-14T09:38:32.019849+0000","last_undegraded":"2023-10-14T09:38:32.019849+0000","last_fullsized":"2023-10-14T09:38:32.019849+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:18.314768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345598+0000","last_change":"2023-10-14T09:38:30.029783+0000","last_active":"2023-10-14T09:38:32.345598+0000","last_peered":"2023-10-14T09:38:32.345598+0000","last_clean":"2023-10-14T09:38:32.345598+0000","last_became_active":"2023-10-14T09:38:30.029514+0000","last_became_peered":"2023-10-14T09:38:30.029514+0000","last_unstale":"2023-10-14T09:38:32.345598+0000","last_undegraded":"2023-10-14T09:38:32.345598+0000","last_fullsized":"2023-10-14T09:38:32.345598+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:12:06.845824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345460+0000","last_change":"2023-10-14T09:38:31.030071+0000","last_active":"2023-10-14T09:38:32.345460+0000","last_peered":"2023-10-14T09:38:32.345460+0000","last_clean":"2023-10-14T09:38:32.345460+0000","last_became_active":"2023-10-14T09:38:31.029521+0000","last_became_peered":"2023-10-14T09:38:31.029521+0000","last_unstale":"2023-10-14T09:38:32.345460+0000","last_undegraded":"2023-10-14T09:38:32.345460+0000","last_fullsized":"2023-10-14T09:38:32.345460+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:45:03.414149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.005434+0000","last_change":"2023-10-14T09:38:30.030457+0000","last_active":"2023-10-14T09:38:31.005434+0000","last_peered":"2023-10-14T09:38:31.005434+0000","last_clean":"2023-10-14T09:38:31.005434+0000","last_became_active":"2023-10-14T09:38:30.029517+0000","last_became_peered":"2023-10-14T09:38:30.029517+0000","last_unstale":"2023-10-14T09:38:31.005434+0000","last_undegraded":"2023-10-14T09:38:31.005434+0000","last_fullsized":"2023-10-14T09:38:31.005434+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:08.168611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341965+0000","last_change":"2023-10-14T09:38:31.034569+0000","last_active":"2023-10-14T09:38:32.341965+0000","last_peered":"2023-10-14T09:38:32.341965+0000","last_clean":"2023-10-14T09:38:32.341965+0000","last_became_active":"2023-10-14T09:38:31.034300+0000","last_became_peered":"2023-10-14T09:38:31.034300+0000","last_unstale":"2023-10-14T09:38:32.341965+0000","last_undegraded":"2023-10-14T09:38:32.341965+0000","last_fullsized":"2023-10-14T09:38:32.341965+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:55:53.322273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.009658+0000","last_change":"2023-10-14T09:38:30.030715+0000","last_active":"2023-10-14T09:38:31.009658+0000","last_peered":"2023-10-14T09:38:31.009658+0000","last_clean":"2023-10-14T09:38:31.009658+0000","last_became_active":"2023-10-14T09:38:30.030374+0000","last_became_peered":"2023-10-14T09:38:30.030374+0000","last_unstale":"2023-10-14T09:38:31.009658+0000","last_undegraded":"2023-10-14T09:38:31.009658+0000","last_fullsized":"2023-10-14T09:38:31.009658+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:26:23.409048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.017240+0000","last_change":"2023-10-14T09:38:31.033069+0000","last_active":"2023-10-14T09:38:32.017240+0000","last_peered":"2023-10-14T09:38:32.017240+0000","last_clean":"2023-10-14T09:38:32.017240+0000","last_became_active":"2023-10-14T09:38:31.032648+0000","last_became_peered":"2023-10-14T09:38:31.032648+0000","last_unstale":"2023-10-14T09:38:32.017240+0000","last_undegraded":"2023-10-14T09:38:32.017240+0000","last_fullsized":"2023-10-14T09:38:32.017240+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:32:55.434705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.010423+0000","last_change":"2023-10-14T09:38:30.020581+0000","last_active":"2023-10-14T09:38:31.010423+0000","last_peered":"2023-10-14T09:38:31.010423+0000","last_clean":"2023-10-14T09:38:31.010423+0000","last_became_active":"2023-10-14T09:38:30.020321+0000","last_became_peered":"2023-10-14T09:38:30.020321+0000","last_unstale":"2023-10-14T09:38:31.010423+0000","last_undegraded":"2023-10-14T09:38:31.010423+0000","last_fullsized":"2023-10-14T09:38:31.010423+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:23:26.972323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342673+0000","last_change":"2023-10-14T09:38:31.024792+0000","last_active":"2023-10-14T09:38:32.342673+0000","last_peered":"2023-10-14T09:38:32.342673+0000","last_clean":"2023-10-14T09:38:32.342673+0000","last_became_active":"2023-10-14T09:38:31.024478+0000","last_became_peered":"2023-10-14T09:38:31.024478+0000","last_unstale":"2023-10-14T09:38:32.342673+0000","last_undegraded":"2023-10-14T09:38:32.342673+0000","last_fullsized":"2023-10-14T09:38:32.342673+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:49:22.040318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.015743+0000","last_change":"2023-10-14T09:38:30.033668+0000","last_active":"2023-10-14T09:38:31.015743+0000","last_peered":"2023-10-14T09:38:31.015743+0000","last_clean":"2023-10-14T09:38:31.015743+0000","last_became_active":"2023-10-14T09:38:30.033358+0000","last_became_peered":"2023-10-14T09:38:30.033358+0000","last_unstale":"2023-10-14T09:38:31.015743+0000","last_undegraded":"2023-10-14T09:38:31.015743+0000","last_fullsized":"2023-10-14T09:38:31.015743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:30:03.089452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":177,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.016331+0000","last_change":"2023-10-14T09:37:12.368000+0000","last_active":"2023-10-14T09:38:31.016331+0000","last_peered":"2023-10-14T09:38:31.016331+0000","last_clean":"2023-10-14T09:38:31.016331+0000","last_became_active":"2023-10-14T09:37:12.364623+0000","last_became_peered":"2023-10-14T09:37:12.364623+0000","last_unstale":"2023-10-14T09:38:31.016331+0000","last_undegraded":"2023-10-14T09:38:31.016331+0000","last_fullsized":"2023-10-14T09:38:31.016331+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:10.796841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:10.796841+0000","last_clean_scrub_stamp":"2023-10-14T09:37:10.796841+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:48.940536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509459,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":999424,"data_stored":748946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":1.5600000000000001}]},{"osd":1,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":1.331},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.054}]},{"osd":2,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":1.421}]},{"osd":3,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":1.147},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.9060000000000001,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":1.504}]},{"osd":4,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.6759999999999999},{"interface":"front","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.389}]},{"osd":5,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":3.0129999999999999,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":1.774},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.823}]},{"osd":6,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.4260000000000002,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":1.9350000000000001},{"interface":"front","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.0710000000000002,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.4770000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509461,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":409600,"data_stored":159104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.76400000000000001}]},{"osd":1,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":1.028},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.85299999999999998}]},{"osd":2,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.4540000000000002,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.86299999999999999}]},{"osd":3,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":4.5419999999999998,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":4.2839999999999998,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":0.61399999999999999}]},{"osd":4,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":1.22}]},{"osd":5,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.7069999999999999,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":1.093}]},{"osd":7,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.5899999999999999,"5min":2.5899999999999999,"15min":2.5899999999999999},"last":1.254}]}]},{"osd":4,"up_from":15,"seq":64424509461,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":409600,"data_stored":158592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":1.621,"5min":1.621,"15min":1.621},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":13.404,"5min":13.404,"15min":13.404},"last":1.137},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":9.4640000000000004,"5min":9.4640000000000004,"15min":9.4640000000000004},"last":0.998}]},{"osd":1,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":6.734,"5min":6.734,"15min":6.734},"last":1.179},{"interface":"front","average":{"1min":1.504,"5min":1.504,"15min":1.504},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":7.8860000000000001,"5min":7.8860000000000001,"15min":7.8860000000000001},"last":1.2749999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":1.591,"5min":1.591,"15min":1.591},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":7.8520000000000003,"5min":7.8520000000000003,"15min":7.8520000000000003},"last":1.218},{"interface":"front","average":{"1min":1.889,"5min":1.889,"15min":1.889},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":14.609,"5min":14.609,"15min":14.609},"last":1.248}]},{"osd":3,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":1.964,"5min":1.964,"15min":1.964},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":15.856,"5min":15.856,"15min":15.856},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":6.1970000000000001,"5min":6.1970000000000001,"15min":6.1970000000000001},"last":0.78700000000000003}]},{"osd":5,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":16.547000000000001,"5min":16.547000000000001,"15min":16.547000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":15.913,"5min":15.913,"15min":15.913},"last":0.67300000000000004}]},{"osd":6,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":2.3029999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":16.481999999999999,"5min":16.481999999999999,"15min":16.481999999999999},"last":1.0880000000000001},{"interface":"front","average":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":15.956,"5min":15.956,"15min":15.956},"last":0.94799999999999995}]},{"osd":7,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":6.6520000000000001,"5min":6.6520000000000001,"15min":6.6520000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":2.073,"5min":2.073,"15min":2.073},"min":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":10.314,"5min":10.314,"15min":10.314},"last":1.325}]}]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":160122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.56200000000000006}]},{"osd":1,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.7349999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":0.73999999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.875},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":2.77,"5min":2.77,"15min":2.77},"last":1.133}]},{"osd":4,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.077},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":2.153,"5min":2.153,"15min":2.153},"last":1.167}]},{"osd":5,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":3.6469999999999998,"5min":3.6469999999999998,"15min":3.6469999999999998},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.90100000000000002}]},{"osd":6,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.05},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":3.6930000000000001,"5min":3.6930000000000001,"15min":3.6930000000000001},"last":1.284}]},{"osd":7,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.4249999999999998,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.22},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.2430000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509461,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":158558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.7789999999999999,"5min":2.7789999999999999,"15min":2.7789999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.39800000000000002}]},{"osd":1,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.3490000000000002,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.502}]},{"osd":3,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.4700000000000002,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.45900000000000002}]},{"osd":4,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.5960000000000001,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":3.1469999999999998,"5min":3.1469999999999998,"15min":3.1469999999999998},"last":0.91900000000000004}]},{"osd":5,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":4.0800000000000001,"5min":4.0800000000000001,"15min":4.0800000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":3.6709999999999998,"5min":3.6709999999999998,"15min":3.6709999999999998},"last":0.999}]},{"osd":6,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.9249999999999998,"5min":2.9249999999999998,"15min":2.9249999999999998},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":3.081,"5min":3.081,"15min":3.081},"last":0.83899999999999997}]},{"osd":7,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":5.0650000000000004,"5min":5.0650000000000004,"15min":5.0650000000000004},"last":0.60799999999999998},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":3.8849999999999998,"5min":3.8849999999999998,"15min":3.8849999999999998},"last":1.05}]}]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":160122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":1.123},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.476}]},{"osd":2,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.747}]},{"osd":3,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":3.1499999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.302}]},{"osd":4,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":3.7320000000000002,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":1.27},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.232}]},{"osd":5,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":3.02,"5min":3.02,"15min":3.02},"last":1.012},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":3.827,"5min":3.827,"15min":3.827},"last":1.1919999999999999}]},{"osd":6,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.597},{"interface":"front","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":3.3250000000000002,"5min":3.3250000000000002,"15min":3.3250000000000002},"last":1.4279999999999999}]},{"osd":7,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":3.9100000000000001,"5min":3.9100000000000001,"15min":3.9100000000000001},"last":1.411},{"interface":"front","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":3.105,"5min":3.105,"15min":3.105},"last":1.8220000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542165,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":159160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.319}]},{"osd":1,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.78100000000000003}]},{"osd":2,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":4.4610000000000003,"5min":4.4610000000000003,"15min":4.4610000000000003},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.413}]},{"osd":3,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":0.995},{"interface":"front","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":0.96799999999999997}]},{"osd":4,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":1.077},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.6080000000000001}]},{"osd":6,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":1.3700000000000001}]},{"osd":7,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":2.387,"5min":2.387,"15min":2.387},"last":1.508},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.143}]}]},{"osd":0,"up_from":14,"seq":60129542165,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":995328,"data_stored":748856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":3.0750000000000002,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.2919999999999998,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.92500000000000004}]},{"osd":2,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":4.2210000000000001,"5min":4.2210000000000001,"15min":4.2210000000000001},"last":0.622}]},{"osd":3,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":3.6070000000000002,"5min":3.6070000000000002,"15min":3.6070000000000002},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.034}]},{"osd":4,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":4.1609999999999996,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":2.391,"5min":2.391,"15min":2.391},"last":1.6000000000000001}]},{"osd":5,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":3.8620000000000001,"5min":3.8620000000000001,"15min":3.8620000000000001},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":2.4220000000000002,"5min":2.4220000000000002,"15min":2.4220000000000002},"last":1.5069999999999999}]},{"osd":6,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":3.8210000000000002,"5min":3.8210000000000002,"15min":3.8210000000000002},"last":1.569},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"min":{"1min":0.997,"5min":0.997,"15min":0.997},"max":{"1min":4.0999999999999996,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":1.629}]},{"osd":7,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":1.581,"15min":1.581},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":4.1920000000000002,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":1.5369999999999999},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.2350000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T09:38:40.926 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:38:41.182 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.180+0000 7fe4a69b0640 1 Processor -- start 2023-10-14T09:38:41.182 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.180+0000 7fe4a69b0640 1 -- start start 2023-10-14T09:38:41.183 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.181+0000 7fe4a69b0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe4a00ce390 0x7fe4a015e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:41.184 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.181+0000 7fe4a69b0640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a015ed60 con 0x7fe4a015ae80 2023-10-14T09:38:41.184 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.181+0000 7fe4a69b0640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a00707e0 con 0x7fe4a015aaa0 2023-10-14T09:38:41.184 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.181+0000 7fe4a69b0640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a006b810 con 0x7fe4a00ce390 2023-10-14T09:38:41.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.182+0000 7fe4a4f4d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe4a00ce390 0x7fe4a015e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:41.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.182+0000 7fe497fff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fe4a015ae80 0x7fe4a0070f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55682/0 (socket says 172.21.15.102:55682) 2023-10-14T09:38:41.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.182+0000 7fe497fff640 1 -- 172.21.15.102:0/2302753721 learned_addr learned my addr 172.21.15.102:0/2302753721 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:41.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.182+0000 7fe4a4f4d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe4a00ce390 0x7fe4a015e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41082/0 (socket says 172.21.15.102:41082) 2023-10-14T09:38:41.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.182+0000 7fe4a4f4d640 1 -- 172.21.15.102:0/2302753721 >> v1:172.21.15.129:6789/0 conn(0x7fe4a015aaa0 legacy=0x7fe4a00cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:41.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.182+0000 7fe4a4f4d640 1 -- 172.21.15.102:0/2302753721 >> v1:172.21.15.102:6789/0 conn(0x7fe4a015ae80 legacy=0x7fe4a0070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:41.188 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.182+0000 7fe4a4f4d640 1 -- 172.21.15.102:0/2302753721 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a015ef90 con 0x7fe4a00ce390 2023-10-14T09:38:41.188 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.183+0000 7fe4a4f4d640 1 --2- 172.21.15.102:0/2302753721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4a00ce390 0x7fe4a015e820 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe4980097a0 tx=0x7fe49802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef0404e025e47c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:41.188 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.184+0000 7fe49f7fe640 1 -- 172.21.15.102:0/2302753721 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe498031830 con 0x7fe4a00ce390 2023-10-14T09:38:41.189 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.184+0000 7fe49f7fe640 1 -- 172.21.15.102:0/2302753721 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe498031990 con 0x7fe4a00ce390 2023-10-14T09:38:41.189 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.184+0000 7fe49f7fe640 1 -- 172.21.15.102:0/2302753721 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe498031d20 con 0x7fe4a00ce390 2023-10-14T09:38:41.189 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.184+0000 7fe4a69b0640 1 -- 172.21.15.102:0/2302753721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4a00ce390 msgr2=0x7fe4a015e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:41.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.184+0000 7fe4a69b0640 1 --2- 172.21.15.102:0/2302753721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4a00ce390 0x7fe4a015e820 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe4980097a0 tx=0x7fe49802b8d0 comp rx=0 tx=0).stop 2023-10-14T09:38:41.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.184+0000 7fe4a69b0640 1 -- 172.21.15.102:0/2302753721 shutdown_connections 2023-10-14T09:38:41.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.184+0000 7fe4a69b0640 1 --2- 172.21.15.102:0/2302753721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4a00ce390 0x7fe4a015e820 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:41.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.184+0000 7fe4a69b0640 1 -- 172.21.15.102:0/2302753721 >> 172.21.15.102:0/2302753721 conn(0x7fe4a00cb410 msgr2=0x7fe4a00cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:41.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.184+0000 7fe4a69b0640 1 -- 172.21.15.102:0/2302753721 shutdown_connections 2023-10-14T09:38:41.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.184+0000 7fe4a69b0640 1 -- 172.21.15.102:0/2302753721 wait complete. 2023-10-14T09:38:41.194 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.186+0000 7fe4a69b0640 1 Processor -- start 2023-10-14T09:38:41.194 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.186+0000 7fe4a69b0640 1 -- start start 2023-10-14T09:38:41.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.187+0000 7fe4a69b0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4a00ce390 0x7fe4a00af280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:41.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.187+0000 7fe4a69b0640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe4a015aaa0 0x7fe4a015b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:41.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.187+0000 7fe4a69b0640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe4a015ae80 0x7fe4a0140b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:41.196 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.187+0000 7fe4a69b0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a014eff0 con 0x7fe4a00ce390 2023-10-14T09:38:41.196 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.187+0000 7fe4a69b0640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a00b0c20 con 0x7fe4a015aaa0 2023-10-14T09:38:41.196 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.187+0000 7fe4a69b0640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a00afb80 con 0x7fe4a015ae80 2023-10-14T09:38:41.196 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.187+0000 7fe49ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4a00ce390 0x7fe4a00af280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:41.197 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.187+0000 7fe49ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4a00ce390 0x7fe4a00af280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41090/0 (socket says 172.21.15.102:41090) 2023-10-14T09:38:41.197 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.187+0000 7fe49ffff640 1 -- 172.21.15.102:0/1628618788 learned_addr learned my addr 172.21.15.102:0/1628618788 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:41.197 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.188+0000 7fe497fff640 1 --2- 172.21.15.102:0/1628618788 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe4a015aaa0 0x7fe4a015b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:41.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.188+0000 7fe49ffff640 1 -- 172.21.15.102:0/1628618788 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe4a015ae80 msgr2=0x7fe4a0140b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:41.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.188+0000 7fe4a4f4d640 1 --2- 172.21.15.102:0/1628618788 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe4a015ae80 0x7fe4a0140b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:41.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.188+0000 7fe49ffff640 1 --2- 172.21.15.102:0/1628618788 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe4a015ae80 0x7fe4a0140b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:41.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.188+0000 7fe49ffff640 1 -- 172.21.15.102:0/1628618788 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe4a015aaa0 msgr2=0x7fe4a015b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:41.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.188+0000 7fe49ffff640 1 --2- 172.21.15.102:0/1628618788 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe4a015aaa0 0x7fe4a015b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:41.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.188+0000 7fe49ffff640 1 -- 172.21.15.102:0/1628618788 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe498009400 con 0x7fe4a00ce390 2023-10-14T09:38:41.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.188+0000 7fe497fff640 1 --2- 172.21.15.102:0/1628618788 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe4a015aaa0 0x7fe4a015b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:41.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.188+0000 7fe49ffff640 1 --2- 172.21.15.102:0/1628618788 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4a00ce390 0x7fe4a00af280 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe49000c7c0 tx=0x7fe49000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:41.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.188+0000 7fe49d7fa640 1 -- 172.21.15.102:0/1628618788 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49000aa50 con 0x7fe4a00ce390 2023-10-14T09:38:41.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.189+0000 7fe49d7fa640 1 -- 172.21.15.102:0/1628618788 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49000abb0 con 0x7fe4a00ce390 2023-10-14T09:38:41.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.189+0000 7fe4a69b0640 1 -- 172.21.15.102:0/1628618788 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a00afe60 con 0x7fe4a00ce390 2023-10-14T09:38:41.201 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.189+0000 7fe49d7fa640 1 -- 172.21.15.102:0/1628618788 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe490012420 con 0x7fe4a00ce390 2023-10-14T09:38:41.201 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.189+0000 7fe4a69b0640 1 -- 172.21.15.102:0/1628618788 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a00b0420 con 0x7fe4a00ce390 2023-10-14T09:38:41.201 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.190+0000 7fe4a69b0640 1 -- 172.21.15.102:0/1628618788 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a004e160 con 0x7fe4a00ce390 2023-10-14T09:38:41.202 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.191+0000 7fe49d7fa640 1 -- 172.21.15.102:0/1628618788 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe490012580 con 0x7fe4a00ce390 2023-10-14T09:38:41.202 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.192+0000 7fe49d7fa640 1 --2- 172.21.15.102:0/1628618788 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe48006ae70 0x7fe48006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:41.202 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.192+0000 7fe49d7fa640 1 -- 172.21.15.102:0/1628618788 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fe490089910 con 0x7fe4a00ce390 2023-10-14T09:38:41.202 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.192+0000 7fe497fff640 1 --2- 172.21.15.102:0/1628618788 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe48006ae70 0x7fe48006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:41.203 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.193+0000 7fe497fff640 1 --2- 172.21.15.102:0/1628618788 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe48006ae70 0x7fe48006d330 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00c8cd0 tx=0x7fe488009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:41.203 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.196+0000 7fe49d7fa640 1 -- 172.21.15.102:0/1628618788 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe490054900 con 0x7fe4a00ce390 2023-10-14T09:38:41.388 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.386+0000 7fe4a69b0640 1 -- 172.21.15.102:0/1628618788 --> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe4a015f550 con 0x7fe48006ae70 2023-10-14T09:38:41.410 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.408+0000 7fe49d7fa640 1 -- 172.21.15.102:0/1628618788 <== mgr.4104 v2:172.21.15.102:6832/1125265706 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287479 (secure 0 0 0) 0x7fe488001c40 con 0x7fe48006ae70 2023-10-14T09:38:41.415 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:38:41.416 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2023-10-14T09:38:41.418 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.415+0000 7fe4a69b0640 1 -- 172.21.15.102:0/1628618788 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe48006ae70 msgr2=0x7fe48006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:41.418 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.415+0000 7fe4a69b0640 1 --2- 172.21.15.102:0/1628618788 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe48006ae70 0x7fe48006d330 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00c8cd0 tx=0x7fe488009040 comp rx=0 tx=0).stop 2023-10-14T09:38:41.419 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.415+0000 7fe4a69b0640 1 -- 172.21.15.102:0/1628618788 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4a00ce390 msgr2=0x7fe4a00af280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:41.419 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.415+0000 7fe4a69b0640 1 --2- 172.21.15.102:0/1628618788 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4a00ce390 0x7fe4a00af280 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe49000c7c0 tx=0x7fe49000cc80 comp rx=0 tx=0).stop 2023-10-14T09:38:41.419 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.415+0000 7fe4a69b0640 1 -- 172.21.15.102:0/1628618788 shutdown_connections 2023-10-14T09:38:41.419 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.415+0000 7fe4a69b0640 1 --2- 172.21.15.102:0/1628618788 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fe48006ae70 0x7fe48006d330 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:41.420 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.415+0000 7fe4a69b0640 1 --2- 172.21.15.102:0/1628618788 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe4a015ae80 0x7fe4a0140b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:41.420 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.415+0000 7fe4a69b0640 1 --2- 172.21.15.102:0/1628618788 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe4a015aaa0 0x7fe4a015b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:41.420 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.415+0000 7fe4a69b0640 1 --2- 172.21.15.102:0/1628618788 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4a00ce390 0x7fe4a00af280 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:41.420 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.415+0000 7fe4a69b0640 1 -- 172.21.15.102:0/1628618788 >> 172.21.15.102:0/1628618788 conn(0x7fe4a00cb410 msgr2=0x7fe4a0158c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:41.421 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.415+0000 7fe4a69b0640 1 -- 172.21.15.102:0/1628618788 shutdown_connections 2023-10-14T09:38:41.421 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.415+0000 7fe4a69b0640 1 -- 172.21.15.102:0/1628618788 wait complete. 2023-10-14T09:38:41.437 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2023-10-14T09:38:39.900127+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220536,"kb_used_data":4360,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754184,"statfs":{"total":773094113280,"available":772868284416,"internally_reserved":0,"allocated":4464640,"data_stored":2453460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.908950"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.019582+0000","last_change":"2023-10-14T09:38:31.026111+0000","last_active":"2023-10-14T09:38:32.019582+0000","last_peered":"2023-10-14T09:38:32.019582+0000","last_clean":"2023-10-14T09:38:32.019582+0000","last_became_active":"2023-10-14T09:38:31.023780+0000","last_became_peered":"2023-10-14T09:38:31.023780+0000","last_unstale":"2023-10-14T09:38:32.019582+0000","last_undegraded":"2023-10-14T09:38:32.019582+0000","last_fullsized":"2023-10-14T09:38:32.019582+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:13:06.090004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344563+0000","last_change":"2023-10-14T09:38:31.028205+0000","last_active":"2023-10-14T09:38:32.344563+0000","last_peered":"2023-10-14T09:38:32.344563+0000","last_clean":"2023-10-14T09:38:32.344563+0000","last_became_active":"2023-10-14T09:38:31.027820+0000","last_became_peered":"2023-10-14T09:38:31.027820+0000","last_unstale":"2023-10-14T09:38:32.344563+0000","last_undegraded":"2023-10-14T09:38:32.344563+0000","last_fullsized":"2023-10-14T09:38:32.344563+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:30:53.824363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344137+0000","last_change":"2023-10-14T09:38:31.020589+0000","last_active":"2023-10-14T09:38:32.344137+0000","last_peered":"2023-10-14T09:38:32.344137+0000","last_clean":"2023-10-14T09:38:32.344137+0000","last_became_active":"2023-10-14T09:38:31.019892+0000","last_became_peered":"2023-10-14T09:38:31.019892+0000","last_unstale":"2023-10-14T09:38:32.344137+0000","last_undegraded":"2023-10-14T09:38:32.344137+0000","last_fullsized":"2023-10-14T09:38:32.344137+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:30:59.177841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344268+0000","last_change":"2023-10-14T09:38:31.035562+0000","last_active":"2023-10-14T09:38:32.344268+0000","last_peered":"2023-10-14T09:38:32.344268+0000","last_clean":"2023-10-14T09:38:32.344268+0000","last_became_active":"2023-10-14T09:38:31.035189+0000","last_became_peered":"2023-10-14T09:38:31.035189+0000","last_unstale":"2023-10-14T09:38:32.344268+0000","last_undegraded":"2023-10-14T09:38:32.344268+0000","last_fullsized":"2023-10-14T09:38:32.344268+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:46.045245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341193+0000","last_change":"2023-10-14T09:38:31.023485+0000","last_active":"2023-10-14T09:38:32.341193+0000","last_peered":"2023-10-14T09:38:32.341193+0000","last_clean":"2023-10-14T09:38:32.341193+0000","last_became_active":"2023-10-14T09:38:31.020777+0000","last_became_peered":"2023-10-14T09:38:31.020777+0000","last_unstale":"2023-10-14T09:38:32.341193+0000","last_undegraded":"2023-10-14T09:38:32.341193+0000","last_fullsized":"2023-10-14T09:38:32.341193+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:38:27.480319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342439+0000","last_change":"2023-10-14T09:38:31.028808+0000","last_active":"2023-10-14T09:38:32.342439+0000","last_peered":"2023-10-14T09:38:32.342439+0000","last_clean":"2023-10-14T09:38:32.342439+0000","last_became_active":"2023-10-14T09:38:31.027342+0000","last_became_peered":"2023-10-14T09:38:31.027342+0000","last_unstale":"2023-10-14T09:38:32.342439+0000","last_undegraded":"2023-10-14T09:38:32.342439+0000","last_fullsized":"2023-10-14T09:38:32.342439+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:41:28.301486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342132+0000","last_change":"2023-10-14T09:38:31.035347+0000","last_active":"2023-10-14T09:38:32.342132+0000","last_peered":"2023-10-14T09:38:32.342132+0000","last_clean":"2023-10-14T09:38:32.342132+0000","last_became_active":"2023-10-14T09:38:31.033760+0000","last_became_peered":"2023-10-14T09:38:31.033760+0000","last_unstale":"2023-10-14T09:38:32.342132+0000","last_undegraded":"2023-10-14T09:38:32.342132+0000","last_fullsized":"2023-10-14T09:38:32.342132+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:02:20.930526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341844+0000","last_change":"2023-10-14T09:38:31.024987+0000","last_active":"2023-10-14T09:38:32.341844+0000","last_peered":"2023-10-14T09:38:32.341844+0000","last_clean":"2023-10-14T09:38:32.341844+0000","last_became_active":"2023-10-14T09:38:31.024702+0000","last_became_peered":"2023-10-14T09:38:31.024702+0000","last_unstale":"2023-10-14T09:38:32.341844+0000","last_undegraded":"2023-10-14T09:38:32.341844+0000","last_fullsized":"2023-10-14T09:38:32.341844+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:23:43.555148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.019168+0000","last_change":"2023-10-14T09:38:31.024329+0000","last_active":"2023-10-14T09:38:32.019168+0000","last_peered":"2023-10-14T09:38:32.019168+0000","last_clean":"2023-10-14T09:38:32.019168+0000","last_became_active":"2023-10-14T09:38:31.023498+0000","last_became_peered":"2023-10-14T09:38:31.023498+0000","last_unstale":"2023-10-14T09:38:32.019168+0000","last_undegraded":"2023-10-14T09:38:32.019168+0000","last_fullsized":"2023-10-14T09:38:32.019168+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:46.045245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344549+0000","last_change":"2023-10-14T09:38:31.029616+0000","last_active":"2023-10-14T09:38:32.344549+0000","last_peered":"2023-10-14T09:38:32.344549+0000","last_clean":"2023-10-14T09:38:32.344549+0000","last_became_active":"2023-10-14T09:38:31.029268+0000","last_became_peered":"2023-10-14T09:38:31.029268+0000","last_unstale":"2023-10-14T09:38:32.344549+0000","last_undegraded":"2023-10-14T09:38:32.344549+0000","last_fullsized":"2023-10-14T09:38:32.344549+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:04:05.499565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343128+0000","last_change":"2023-10-14T09:38:31.035514+0000","last_active":"2023-10-14T09:38:32.343128+0000","last_peered":"2023-10-14T09:38:32.343128+0000","last_clean":"2023-10-14T09:38:32.343128+0000","last_became_active":"2023-10-14T09:38:31.033343+0000","last_became_peered":"2023-10-14T09:38:31.033343+0000","last_unstale":"2023-10-14T09:38:32.343128+0000","last_undegraded":"2023-10-14T09:38:32.343128+0000","last_fullsized":"2023-10-14T09:38:32.343128+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:55:53.322273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344359+0000","last_change":"2023-10-14T09:38:31.018326+0000","last_active":"2023-10-14T09:38:32.344359+0000","last_peered":"2023-10-14T09:38:32.344359+0000","last_clean":"2023-10-14T09:38:32.344359+0000","last_became_active":"2023-10-14T09:38:31.017971+0000","last_became_peered":"2023-10-14T09:38:31.017971+0000","last_unstale":"2023-10-14T09:38:32.344359+0000","last_undegraded":"2023-10-14T09:38:32.344359+0000","last_fullsized":"2023-10-14T09:38:32.344359+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:08.018148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341372+0000","last_change":"2023-10-14T09:38:31.019474+0000","last_active":"2023-10-14T09:38:32.341372+0000","last_peered":"2023-10-14T09:38:32.341372+0000","last_clean":"2023-10-14T09:38:32.341372+0000","last_became_active":"2023-10-14T09:38:31.019186+0000","last_became_peered":"2023-10-14T09:38:31.019186+0000","last_unstale":"2023-10-14T09:38:32.341372+0000","last_undegraded":"2023-10-14T09:38:32.341372+0000","last_fullsized":"2023-10-14T09:38:32.341372+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:36:21.378536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342644+0000","last_change":"2023-10-14T09:38:31.020718+0000","last_active":"2023-10-14T09:38:32.342644+0000","last_peered":"2023-10-14T09:38:32.342644+0000","last_clean":"2023-10-14T09:38:32.342644+0000","last_became_active":"2023-10-14T09:38:31.020409+0000","last_became_peered":"2023-10-14T09:38:31.020409+0000","last_unstale":"2023-10-14T09:38:32.342644+0000","last_undegraded":"2023-10-14T09:38:32.342644+0000","last_fullsized":"2023-10-14T09:38:32.342644+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:43:03.012824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342558+0000","last_change":"2023-10-14T09:38:31.025489+0000","last_active":"2023-10-14T09:38:32.342558+0000","last_peered":"2023-10-14T09:38:32.342558+0000","last_clean":"2023-10-14T09:38:32.342558+0000","last_became_active":"2023-10-14T09:38:31.025155+0000","last_became_peered":"2023-10-14T09:38:31.025155+0000","last_unstale":"2023-10-14T09:38:32.342558+0000","last_undegraded":"2023-10-14T09:38:32.342558+0000","last_fullsized":"2023-10-14T09:38:32.342558+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:14:59.816409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342426+0000","last_change":"2023-10-14T09:38:31.034136+0000","last_active":"2023-10-14T09:38:32.342426+0000","last_peered":"2023-10-14T09:38:32.342426+0000","last_clean":"2023-10-14T09:38:32.342426+0000","last_became_active":"2023-10-14T09:38:31.033869+0000","last_became_peered":"2023-10-14T09:38:31.033869+0000","last_unstale":"2023-10-14T09:38:32.342426+0000","last_undegraded":"2023-10-14T09:38:32.342426+0000","last_fullsized":"2023-10-14T09:38:32.342426+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:44.513959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343361+0000","last_change":"2023-10-14T09:38:31.030416+0000","last_active":"2023-10-14T09:38:32.343361+0000","last_peered":"2023-10-14T09:38:32.343361+0000","last_clean":"2023-10-14T09:38:32.343361+0000","last_became_active":"2023-10-14T09:38:31.029457+0000","last_became_peered":"2023-10-14T09:38:31.029457+0000","last_unstale":"2023-10-14T09:38:32.343361+0000","last_undegraded":"2023-10-14T09:38:32.343361+0000","last_fullsized":"2023-10-14T09:38:32.343361+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:41:28.301486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344776+0000","last_change":"2023-10-14T09:38:31.033346+0000","last_active":"2023-10-14T09:38:32.344776+0000","last_peered":"2023-10-14T09:38:32.344776+0000","last_clean":"2023-10-14T09:38:32.344776+0000","last_became_active":"2023-10-14T09:38:31.033040+0000","last_became_peered":"2023-10-14T09:38:31.033040+0000","last_unstale":"2023-10-14T09:38:32.344776+0000","last_undegraded":"2023-10-14T09:38:32.344776+0000","last_fullsized":"2023-10-14T09:38:32.344776+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:54:57.182070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343534+0000","last_change":"2023-10-14T09:38:31.026010+0000","last_active":"2023-10-14T09:38:32.343534+0000","last_peered":"2023-10-14T09:38:32.343534+0000","last_clean":"2023-10-14T09:38:32.343534+0000","last_became_active":"2023-10-14T09:38:31.025735+0000","last_became_peered":"2023-10-14T09:38:31.025735+0000","last_unstale":"2023-10-14T09:38:32.343534+0000","last_undegraded":"2023-10-14T09:38:32.343534+0000","last_fullsized":"2023-10-14T09:38:32.343534+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:07:02.738518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341225+0000","last_change":"2023-10-14T09:38:31.011800+0000","last_active":"2023-10-14T09:38:32.341225+0000","last_peered":"2023-10-14T09:38:32.341225+0000","last_clean":"2023-10-14T09:38:32.341225+0000","last_became_active":"2023-10-14T09:38:31.011363+0000","last_became_peered":"2023-10-14T09:38:31.011363+0000","last_unstale":"2023-10-14T09:38:32.341225+0000","last_undegraded":"2023-10-14T09:38:32.341225+0000","last_fullsized":"2023-10-14T09:38:32.341225+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:32:10.952099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.018172+0000","last_change":"2023-10-14T09:38:31.021882+0000","last_active":"2023-10-14T09:38:32.018172+0000","last_peered":"2023-10-14T09:38:32.018172+0000","last_clean":"2023-10-14T09:38:32.018172+0000","last_became_active":"2023-10-14T09:38:31.021555+0000","last_became_peered":"2023-10-14T09:38:31.021555+0000","last_unstale":"2023-10-14T09:38:32.018172+0000","last_undegraded":"2023-10-14T09:38:32.018172+0000","last_fullsized":"2023-10-14T09:38:32.018172+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:22.613894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.018500+0000","last_change":"2023-10-14T09:38:31.029992+0000","last_active":"2023-10-14T09:38:32.018500+0000","last_peered":"2023-10-14T09:38:32.018500+0000","last_clean":"2023-10-14T09:38:32.018500+0000","last_became_active":"2023-10-14T09:38:31.029712+0000","last_became_peered":"2023-10-14T09:38:31.029712+0000","last_unstale":"2023-10-14T09:38:32.018500+0000","last_undegraded":"2023-10-14T09:38:32.018500+0000","last_fullsized":"2023-10-14T09:38:32.018500+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:12.059563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345293+0000","last_change":"2023-10-14T09:38:31.023504+0000","last_active":"2023-10-14T09:38:32.345293+0000","last_peered":"2023-10-14T09:38:32.345293+0000","last_clean":"2023-10-14T09:38:32.345293+0000","last_became_active":"2023-10-14T09:38:31.023251+0000","last_became_peered":"2023-10-14T09:38:31.023251+0000","last_unstale":"2023-10-14T09:38:32.345293+0000","last_undegraded":"2023-10-14T09:38:32.345293+0000","last_fullsized":"2023-10-14T09:38:32.345293+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:29.053068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342651+0000","last_change":"2023-10-14T09:38:31.011612+0000","last_active":"2023-10-14T09:38:32.342651+0000","last_peered":"2023-10-14T09:38:32.342651+0000","last_clean":"2023-10-14T09:38:32.342651+0000","last_became_active":"2023-10-14T09:38:31.010860+0000","last_became_peered":"2023-10-14T09:38:31.010860+0000","last_unstale":"2023-10-14T09:38:32.342651+0000","last_undegraded":"2023-10-14T09:38:32.342651+0000","last_fullsized":"2023-10-14T09:38:32.342651+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:54:32.085213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344876+0000","last_change":"2023-10-14T09:38:31.023722+0000","last_active":"2023-10-14T09:38:32.344876+0000","last_peered":"2023-10-14T09:38:32.344876+0000","last_clean":"2023-10-14T09:38:32.344876+0000","last_became_active":"2023-10-14T09:38:31.023469+0000","last_became_peered":"2023-10-14T09:38:31.023469+0000","last_unstale":"2023-10-14T09:38:32.344876+0000","last_undegraded":"2023-10-14T09:38:32.344876+0000","last_fullsized":"2023-10-14T09:38:32.344876+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:26:03.834483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344738+0000","last_change":"2023-10-14T09:38:31.028525+0000","last_active":"2023-10-14T09:38:32.344738+0000","last_peered":"2023-10-14T09:38:32.344738+0000","last_clean":"2023-10-14T09:38:32.344738+0000","last_became_active":"2023-10-14T09:38:31.026660+0000","last_became_peered":"2023-10-14T09:38:31.026660+0000","last_unstale":"2023-10-14T09:38:32.344738+0000","last_undegraded":"2023-10-14T09:38:32.344738+0000","last_fullsized":"2023-10-14T09:38:32.344738+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:29:12.633954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344629+0000","last_change":"2023-10-14T09:38:31.026064+0000","last_active":"2023-10-14T09:38:32.344629+0000","last_peered":"2023-10-14T09:38:32.344629+0000","last_clean":"2023-10-14T09:38:32.344629+0000","last_became_active":"2023-10-14T09:38:31.025680+0000","last_became_peered":"2023-10-14T09:38:31.025680+0000","last_unstale":"2023-10-14T09:38:32.344629+0000","last_undegraded":"2023-10-14T09:38:32.344629+0000","last_fullsized":"2023-10-14T09:38:32.344629+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:05:14.584003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343991+0000","last_change":"2023-10-14T09:38:31.022957+0000","last_active":"2023-10-14T09:38:32.343991+0000","last_peered":"2023-10-14T09:38:32.343991+0000","last_clean":"2023-10-14T09:38:32.343991+0000","last_became_active":"2023-10-14T09:38:31.022641+0000","last_became_peered":"2023-10-14T09:38:31.022641+0000","last_unstale":"2023-10-14T09:38:32.343991+0000","last_undegraded":"2023-10-14T09:38:32.343991+0000","last_fullsized":"2023-10-14T09:38:32.343991+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:08:08.601763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.018402+0000","last_change":"2023-10-14T09:38:31.031585+0000","last_active":"2023-10-14T09:38:32.018402+0000","last_peered":"2023-10-14T09:38:32.018402+0000","last_clean":"2023-10-14T09:38:32.018402+0000","last_became_active":"2023-10-14T09:38:31.031302+0000","last_became_peered":"2023-10-14T09:38:31.031302+0000","last_unstale":"2023-10-14T09:38:32.018402+0000","last_undegraded":"2023-10-14T09:38:32.018402+0000","last_fullsized":"2023-10-14T09:38:32.018402+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:37:07.904425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341801+0000","last_change":"2023-10-14T09:38:31.029845+0000","last_active":"2023-10-14T09:38:32.341801+0000","last_peered":"2023-10-14T09:38:32.341801+0000","last_clean":"2023-10-14T09:38:32.341801+0000","last_became_active":"2023-10-14T09:38:31.029493+0000","last_became_peered":"2023-10-14T09:38:31.029493+0000","last_unstale":"2023-10-14T09:38:32.341801+0000","last_undegraded":"2023-10-14T09:38:32.341801+0000","last_fullsized":"2023-10-14T09:38:32.341801+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:05:14.584003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.020011+0000","last_change":"2023-10-14T09:38:31.025533+0000","last_active":"2023-10-14T09:38:32.020011+0000","last_peered":"2023-10-14T09:38:32.020011+0000","last_clean":"2023-10-14T09:38:32.020011+0000","last_became_active":"2023-10-14T09:38:31.025243+0000","last_became_peered":"2023-10-14T09:38:31.025243+0000","last_unstale":"2023-10-14T09:38:32.020011+0000","last_undegraded":"2023-10-14T09:38:32.020011+0000","last_fullsized":"2023-10-14T09:38:32.020011+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:32:55.434705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341995+0000","last_change":"2023-10-14T09:38:31.028763+0000","last_active":"2023-10-14T09:38:32.341995+0000","last_peered":"2023-10-14T09:38:32.341995+0000","last_clean":"2023-10-14T09:38:32.341995+0000","last_became_active":"2023-10-14T09:38:31.028420+0000","last_became_peered":"2023-10-14T09:38:31.028420+0000","last_unstale":"2023-10-14T09:38:32.341995+0000","last_undegraded":"2023-10-14T09:38:32.341995+0000","last_fullsized":"2023-10-14T09:38:32.341995+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:26:03.834483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345961+0000","last_change":"2023-10-14T09:38:31.024908+0000","last_active":"2023-10-14T09:38:32.345961+0000","last_peered":"2023-10-14T09:38:32.345961+0000","last_clean":"2023-10-14T09:38:32.345961+0000","last_became_active":"2023-10-14T09:38:31.023482+0000","last_became_peered":"2023-10-14T09:38:31.023482+0000","last_unstale":"2023-10-14T09:38:32.345961+0000","last_undegraded":"2023-10-14T09:38:32.345961+0000","last_fullsized":"2023-10-14T09:38:32.345961+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:14:59.816409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"35'4","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.048326+0000","last_change":"2023-10-14T09:38:30.031689+0000","last_active":"2023-10-14T09:38:31.048326+0000","last_peered":"2023-10-14T09:38:31.048326+0000","last_clean":"2023-10-14T09:38:31.048326+0000","last_became_active":"2023-10-14T09:38:30.031374+0000","last_became_peered":"2023-10-14T09:38:30.031374+0000","last_unstale":"2023-10-14T09:38:31.048326+0000","last_undegraded":"2023-10-14T09:38:31.048326+0000","last_fullsized":"2023-10-14T09:38:31.048326+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:32.881121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.019773+0000","last_change":"2023-10-14T09:38:31.026729+0000","last_active":"2023-10-14T09:38:32.019773+0000","last_peered":"2023-10-14T09:38:32.019773+0000","last_clean":"2023-10-14T09:38:32.019773+0000","last_became_active":"2023-10-14T09:38:31.026414+0000","last_became_peered":"2023-10-14T09:38:31.026414+0000","last_unstale":"2023-10-14T09:38:32.019773+0000","last_undegraded":"2023-10-14T09:38:32.019773+0000","last_fullsized":"2023-10-14T09:38:32.019773+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:09.182708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"35'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345785+0000","last_change":"2023-10-14T09:38:30.025206+0000","last_active":"2023-10-14T09:38:32.345785+0000","last_peered":"2023-10-14T09:38:32.345785+0000","last_clean":"2023-10-14T09:38:32.345785+0000","last_became_active":"2023-10-14T09:38:30.024910+0000","last_became_peered":"2023-10-14T09:38:30.024910+0000","last_unstale":"2023-10-14T09:38:32.345785+0000","last_undegraded":"2023-10-14T09:38:32.345785+0000","last_fullsized":"2023-10-14T09:38:32.345785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:35:31.581556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.018785+0000","last_change":"2023-10-14T09:38:31.030098+0000","last_active":"2023-10-14T09:38:32.018785+0000","last_peered":"2023-10-14T09:38:32.018785+0000","last_clean":"2023-10-14T09:38:32.018785+0000","last_became_active":"2023-10-14T09:38:31.029815+0000","last_became_peered":"2023-10-14T09:38:31.029815+0000","last_unstale":"2023-10-14T09:38:32.018785+0000","last_undegraded":"2023-10-14T09:38:32.018785+0000","last_fullsized":"2023-10-14T09:38:32.018785+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:23:27.986420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.041830+0000","last_change":"2023-10-14T09:38:30.017782+0000","last_active":"2023-10-14T09:38:31.041830+0000","last_peered":"2023-10-14T09:38:31.041830+0000","last_clean":"2023-10-14T09:38:31.041830+0000","last_became_active":"2023-10-14T09:38:30.017602+0000","last_became_peered":"2023-10-14T09:38:30.017602+0000","last_unstale":"2023-10-14T09:38:31.041830+0000","last_undegraded":"2023-10-14T09:38:31.041830+0000","last_fullsized":"2023-10-14T09:38:31.041830+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:34.119874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344746+0000","last_change":"2023-10-14T09:38:31.028602+0000","last_active":"2023-10-14T09:38:32.344746+0000","last_peered":"2023-10-14T09:38:32.344746+0000","last_clean":"2023-10-14T09:38:32.344746+0000","last_became_active":"2023-10-14T09:38:31.025645+0000","last_became_peered":"2023-10-14T09:38:31.025645+0000","last_unstale":"2023-10-14T09:38:32.344746+0000","last_undegraded":"2023-10-14T09:38:32.344746+0000","last_fullsized":"2023-10-14T09:38:32.344746+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:23:43.555148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.043829+0000","last_change":"2023-10-14T09:38:30.031331+0000","last_active":"2023-10-14T09:38:31.043829+0000","last_peered":"2023-10-14T09:38:31.043829+0000","last_clean":"2023-10-14T09:38:31.043829+0000","last_became_active":"2023-10-14T09:38:30.030556+0000","last_became_peered":"2023-10-14T09:38:30.030556+0000","last_unstale":"2023-10-14T09:38:31.043829+0000","last_undegraded":"2023-10-14T09:38:31.043829+0000","last_fullsized":"2023-10-14T09:38:31.043829+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:00:27.300436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342154+0000","last_change":"2023-10-14T09:38:31.029169+0000","last_active":"2023-10-14T09:38:32.342154+0000","last_peered":"2023-10-14T09:38:32.342154+0000","last_clean":"2023-10-14T09:38:32.342154+0000","last_became_active":"2023-10-14T09:38:31.028887+0000","last_became_peered":"2023-10-14T09:38:31.028887+0000","last_unstale":"2023-10-14T09:38:32.342154+0000","last_undegraded":"2023-10-14T09:38:32.342154+0000","last_fullsized":"2023-10-14T09:38:32.342154+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:05:40.247862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.043614+0000","last_change":"2023-10-14T09:38:30.026023+0000","last_active":"2023-10-14T09:38:31.043614+0000","last_peered":"2023-10-14T09:38:31.043614+0000","last_clean":"2023-10-14T09:38:31.043614+0000","last_became_active":"2023-10-14T09:38:30.025732+0000","last_became_peered":"2023-10-14T09:38:30.025732+0000","last_unstale":"2023-10-14T09:38:31.043614+0000","last_undegraded":"2023-10-14T09:38:31.043614+0000","last_fullsized":"2023-10-14T09:38:31.043614+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:30:03.089452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343662+0000","last_change":"2023-10-14T09:38:31.020554+0000","last_active":"2023-10-14T09:38:32.343662+0000","last_peered":"2023-10-14T09:38:32.343662+0000","last_clean":"2023-10-14T09:38:32.343662+0000","last_became_active":"2023-10-14T09:38:31.020184+0000","last_became_peered":"2023-10-14T09:38:31.020184+0000","last_unstale":"2023-10-14T09:38:32.343662+0000","last_undegraded":"2023-10-14T09:38:32.343662+0000","last_fullsized":"2023-10-14T09:38:32.343662+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:26:34.407953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.043817+0000","last_change":"2023-10-14T09:38:30.031642+0000","last_active":"2023-10-14T09:38:31.043817+0000","last_peered":"2023-10-14T09:38:31.043817+0000","last_clean":"2023-10-14T09:38:31.043817+0000","last_became_active":"2023-10-14T09:38:30.031356+0000","last_became_peered":"2023-10-14T09:38:30.031356+0000","last_unstale":"2023-10-14T09:38:31.043817+0000","last_undegraded":"2023-10-14T09:38:31.043817+0000","last_fullsized":"2023-10-14T09:38:31.043817+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:36:20.364439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.017009+0000","last_change":"2023-10-14T09:38:31.024293+0000","last_active":"2023-10-14T09:38:32.017009+0000","last_peered":"2023-10-14T09:38:32.017009+0000","last_clean":"2023-10-14T09:38:32.017009+0000","last_became_active":"2023-10-14T09:38:31.023990+0000","last_became_peered":"2023-10-14T09:38:31.023990+0000","last_unstale":"2023-10-14T09:38:32.017009+0000","last_undegraded":"2023-10-14T09:38:32.017009+0000","last_fullsized":"2023-10-14T09:38:32.017009+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:18.314768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.010745+0000","last_change":"2023-10-14T09:38:30.021813+0000","last_active":"2023-10-14T09:38:31.010745+0000","last_peered":"2023-10-14T09:38:31.010745+0000","last_clean":"2023-10-14T09:38:31.010745+0000","last_became_active":"2023-10-14T09:38:30.019461+0000","last_became_peered":"2023-10-14T09:38:30.019461+0000","last_unstale":"2023-10-14T09:38:31.010745+0000","last_undegraded":"2023-10-14T09:38:31.010745+0000","last_fullsized":"2023-10-14T09:38:31.010745+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:04:04.485468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342676+0000","last_change":"2023-10-14T09:38:31.016796+0000","last_active":"2023-10-14T09:38:32.342676+0000","last_peered":"2023-10-14T09:38:32.342676+0000","last_clean":"2023-10-14T09:38:32.342676+0000","last_became_active":"2023-10-14T09:38:31.016514+0000","last_became_peered":"2023-10-14T09:38:31.016514+0000","last_unstale":"2023-10-14T09:38:32.342676+0000","last_undegraded":"2023-10-14T09:38:32.342676+0000","last_fullsized":"2023-10-14T09:38:32.342676+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:23:27.986420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.006074+0000","last_change":"2023-10-14T09:38:30.035807+0000","last_active":"2023-10-14T09:38:31.006074+0000","last_peered":"2023-10-14T09:38:31.006074+0000","last_clean":"2023-10-14T09:38:31.006074+0000","last_became_active":"2023-10-14T09:38:30.035470+0000","last_became_peered":"2023-10-14T09:38:30.035470+0000","last_unstale":"2023-10-14T09:38:31.006074+0000","last_undegraded":"2023-10-14T09:38:31.006074+0000","last_fullsized":"2023-10-14T09:38:31.006074+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:38:26.466223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344016+0000","last_change":"2023-10-14T09:38:31.026082+0000","last_active":"2023-10-14T09:38:32.344016+0000","last_peered":"2023-10-14T09:38:32.344016+0000","last_clean":"2023-10-14T09:38:32.344016+0000","last_became_active":"2023-10-14T09:38:31.025794+0000","last_became_peered":"2023-10-14T09:38:31.025794+0000","last_unstale":"2023-10-14T09:38:32.344016+0000","last_undegraded":"2023-10-14T09:38:32.344016+0000","last_fullsized":"2023-10-14T09:38:32.344016+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:08:12.498616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.013494+0000","last_change":"2023-10-14T09:38:30.014502+0000","last_active":"2023-10-14T09:38:31.013494+0000","last_peered":"2023-10-14T09:38:31.013494+0000","last_clean":"2023-10-14T09:38:31.013494+0000","last_became_active":"2023-10-14T09:38:30.014042+0000","last_became_peered":"2023-10-14T09:38:30.014042+0000","last_unstale":"2023-10-14T09:38:31.013494+0000","last_undegraded":"2023-10-14T09:38:31.013494+0000","last_fullsized":"2023-10-14T09:38:31.013494+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:02:19.916430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343306+0000","last_change":"2023-10-14T09:38:31.021923+0000","last_active":"2023-10-14T09:38:32.343306+0000","last_peered":"2023-10-14T09:38:32.343306+0000","last_clean":"2023-10-14T09:38:32.343306+0000","last_became_active":"2023-10-14T09:38:31.021662+0000","last_became_peered":"2023-10-14T09:38:31.021662+0000","last_unstale":"2023-10-14T09:38:32.343306+0000","last_undegraded":"2023-10-14T09:38:32.343306+0000","last_fullsized":"2023-10-14T09:38:32.343306+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:18:08.718330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345934+0000","last_change":"2023-10-14T09:38:30.028000+0000","last_active":"2023-10-14T09:38:32.345934+0000","last_peered":"2023-10-14T09:38:32.345934+0000","last_clean":"2023-10-14T09:38:32.345934+0000","last_became_active":"2023-10-14T09:38:30.027696+0000","last_became_peered":"2023-10-14T09:38:30.027696+0000","last_unstale":"2023-10-14T09:38:32.345934+0000","last_undegraded":"2023-10-14T09:38:32.345934+0000","last_fullsized":"2023-10-14T09:38:32.345934+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:11.668342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343027+0000","last_change":"2023-10-14T09:38:31.026933+0000","last_active":"2023-10-14T09:38:32.343027+0000","last_peered":"2023-10-14T09:38:32.343027+0000","last_clean":"2023-10-14T09:38:32.343027+0000","last_became_active":"2023-10-14T09:38:31.026676+0000","last_became_peered":"2023-10-14T09:38:31.026676+0000","last_unstale":"2023-10-14T09:38:32.343027+0000","last_undegraded":"2023-10-14T09:38:32.343027+0000","last_fullsized":"2023-10-14T09:38:32.343027+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:39:19.700408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"35'3","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344090+0000","last_change":"2023-10-14T09:38:30.032207+0000","last_active":"2023-10-14T09:38:32.344090+0000","last_peered":"2023-10-14T09:38:32.344090+0000","last_clean":"2023-10-14T09:38:32.344090+0000","last_became_active":"2023-10-14T09:38:30.031907+0000","last_became_peered":"2023-10-14T09:38:30.031907+0000","last_unstale":"2023-10-14T09:38:32.344090+0000","last_undegraded":"2023-10-14T09:38:32.344090+0000","last_fullsized":"2023-10-14T09:38:32.344090+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:59:09.031590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343866+0000","last_change":"2023-10-14T09:38:31.021126+0000","last_active":"2023-10-14T09:38:32.343866+0000","last_peered":"2023-10-14T09:38:32.343866+0000","last_clean":"2023-10-14T09:38:32.343866+0000","last_became_active":"2023-10-14T09:38:31.020267+0000","last_became_peered":"2023-10-14T09:38:31.020267+0000","last_unstale":"2023-10-14T09:38:32.343866+0000","last_undegraded":"2023-10-14T09:38:32.343866+0000","last_fullsized":"2023-10-14T09:38:32.343866+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:29:07.359293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"35'6","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.048294+0000","last_change":"2023-10-14T09:38:30.020149+0000","last_active":"2023-10-14T09:38:31.048294+0000","last_peered":"2023-10-14T09:38:31.048294+0000","last_clean":"2023-10-14T09:38:31.048294+0000","last_became_active":"2023-10-14T09:38:30.019839+0000","last_became_peered":"2023-10-14T09:38:30.019839+0000","last_unstale":"2023-10-14T09:38:31.048294+0000","last_undegraded":"2023-10-14T09:38:31.048294+0000","last_fullsized":"2023-10-14T09:38:31.048294+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:54.807431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342588+0000","last_change":"2023-10-14T09:38:31.020699+0000","last_active":"2023-10-14T09:38:32.342588+0000","last_peered":"2023-10-14T09:38:32.342588+0000","last_clean":"2023-10-14T09:38:32.342588+0000","last_became_active":"2023-10-14T09:38:31.020347+0000","last_became_peered":"2023-10-14T09:38:31.020347+0000","last_unstale":"2023-10-14T09:38:32.342588+0000","last_undegraded":"2023-10-14T09:38:32.342588+0000","last_fullsized":"2023-10-14T09:38:32.342588+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:12.059563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.042951+0000","last_change":"2023-10-14T09:38:30.035740+0000","last_active":"2023-10-14T09:38:31.042951+0000","last_peered":"2023-10-14T09:38:31.042951+0000","last_clean":"2023-10-14T09:38:31.042951+0000","last_became_active":"2023-10-14T09:38:30.035424+0000","last_became_peered":"2023-10-14T09:38:30.035424+0000","last_unstale":"2023-10-14T09:38:31.042951+0000","last_undegraded":"2023-10-14T09:38:31.042951+0000","last_fullsized":"2023-10-14T09:38:31.042951+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:13:05.075908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342770+0000","last_change":"2023-10-14T09:38:31.028147+0000","last_active":"2023-10-14T09:38:32.342770+0000","last_peered":"2023-10-14T09:38:32.342770+0000","last_clean":"2023-10-14T09:38:32.342770+0000","last_became_active":"2023-10-14T09:38:31.027759+0000","last_became_peered":"2023-10-14T09:38:31.027759+0000","last_unstale":"2023-10-14T09:38:32.342770+0000","last_undegraded":"2023-10-14T09:38:32.342770+0000","last_fullsized":"2023-10-14T09:38:32.342770+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:28.333786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.004907+0000","last_change":"2023-10-14T09:38:30.025921+0000","last_active":"2023-10-14T09:38:31.004907+0000","last_peered":"2023-10-14T09:38:31.004907+0000","last_clean":"2023-10-14T09:38:31.004907+0000","last_became_active":"2023-10-14T09:38:30.025712+0000","last_became_peered":"2023-10-14T09:38:30.025712+0000","last_unstale":"2023-10-14T09:38:31.004907+0000","last_undegraded":"2023-10-14T09:38:31.004907+0000","last_fullsized":"2023-10-14T09:38:31.004907+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:13:05.075908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342190+0000","last_change":"2023-10-14T09:38:31.037744+0000","last_active":"2023-10-14T09:38:32.342190+0000","last_peered":"2023-10-14T09:38:32.342190+0000","last_clean":"2023-10-14T09:38:32.342190+0000","last_became_active":"2023-10-14T09:38:31.036628+0000","last_became_peered":"2023-10-14T09:38:31.036628+0000","last_unstale":"2023-10-14T09:38:32.342190+0000","last_undegraded":"2023-10-14T09:38:32.342190+0000","last_fullsized":"2023-10-14T09:38:32.342190+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:55.821527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.010492+0000","last_change":"2023-10-14T09:38:30.022460+0000","last_active":"2023-10-14T09:38:31.010492+0000","last_peered":"2023-10-14T09:38:31.010492+0000","last_clean":"2023-10-14T09:38:31.010492+0000","last_became_active":"2023-10-14T09:38:30.022182+0000","last_became_peered":"2023-10-14T09:38:30.022182+0000","last_unstale":"2023-10-14T09:38:31.010492+0000","last_undegraded":"2023-10-14T09:38:31.010492+0000","last_fullsized":"2023-10-14T09:38:31.010492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:45.031149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.020009+0000","last_change":"2023-10-14T09:38:31.039814+0000","last_active":"2023-10-14T09:38:32.020009+0000","last_peered":"2023-10-14T09:38:32.020009+0000","last_clean":"2023-10-14T09:38:32.020009+0000","last_became_active":"2023-10-14T09:38:31.039518+0000","last_became_peered":"2023-10-14T09:38:31.039518+0000","last_unstale":"2023-10-14T09:38:32.020009+0000","last_undegraded":"2023-10-14T09:38:32.020009+0000","last_fullsized":"2023-10-14T09:38:32.020009+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:22.613894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"35'8","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.046908+0000","last_change":"2023-10-14T09:38:30.015580+0000","last_active":"2023-10-14T09:38:31.046908+0000","last_peered":"2023-10-14T09:38:31.046908+0000","last_clean":"2023-10-14T09:38:31.046908+0000","last_became_active":"2023-10-14T09:38:30.014562+0000","last_became_peered":"2023-10-14T09:38:30.014562+0000","last_unstale":"2023-10-14T09:38:31.046908+0000","last_undegraded":"2023-10-14T09:38:31.046908+0000","last_fullsized":"2023-10-14T09:38:31.046908+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:27.669263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.018236+0000","last_change":"2023-10-14T09:38:31.026009+0000","last_active":"2023-10-14T09:38:32.018236+0000","last_peered":"2023-10-14T09:38:32.018236+0000","last_clean":"2023-10-14T09:38:32.018236+0000","last_became_active":"2023-10-14T09:38:31.025665+0000","last_became_peered":"2023-10-14T09:38:31.025665+0000","last_unstale":"2023-10-14T09:38:32.018236+0000","last_undegraded":"2023-10-14T09:38:32.018236+0000","last_fullsized":"2023-10-14T09:38:32.018236+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:16:06.675198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.046534+0000","last_change":"2023-10-14T09:38:30.027344+0000","last_active":"2023-10-14T09:38:31.046534+0000","last_peered":"2023-10-14T09:38:31.046534+0000","last_clean":"2023-10-14T09:38:31.046534+0000","last_became_active":"2023-10-14T09:38:30.025331+0000","last_became_peered":"2023-10-14T09:38:30.025331+0000","last_unstale":"2023-10-14T09:38:31.046534+0000","last_undegraded":"2023-10-14T09:38:31.046534+0000","last_fullsized":"2023-10-14T09:38:31.046534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:16:05.661101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344384+0000","last_change":"2023-10-14T09:38:31.033233+0000","last_active":"2023-10-14T09:38:32.344384+0000","last_peered":"2023-10-14T09:38:32.344384+0000","last_clean":"2023-10-14T09:38:32.344384+0000","last_became_active":"2023-10-14T09:38:31.032912+0000","last_became_peered":"2023-10-14T09:38:31.032912+0000","last_unstale":"2023-10-14T09:38:32.344384+0000","last_undegraded":"2023-10-14T09:38:32.344384+0000","last_fullsized":"2023-10-14T09:38:32.344384+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:52:28.791327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.043036+0000","last_change":"2023-10-14T09:38:30.035623+0000","last_active":"2023-10-14T09:38:31.043036+0000","last_peered":"2023-10-14T09:38:31.043036+0000","last_clean":"2023-10-14T09:38:31.043036+0000","last_became_active":"2023-10-14T09:38:30.035283+0000","last_became_peered":"2023-10-14T09:38:30.035283+0000","last_unstale":"2023-10-14T09:38:31.043036+0000","last_undegraded":"2023-10-14T09:38:31.043036+0000","last_fullsized":"2023-10-14T09:38:31.043036+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:32:09.938003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344424+0000","last_change":"2023-10-14T09:38:31.035370+0000","last_active":"2023-10-14T09:38:32.344424+0000","last_peered":"2023-10-14T09:38:32.344424+0000","last_clean":"2023-10-14T09:38:32.344424+0000","last_became_active":"2023-10-14T09:38:31.034768+0000","last_became_peered":"2023-10-14T09:38:31.034768+0000","last_unstale":"2023-10-14T09:38:32.344424+0000","last_undegraded":"2023-10-14T09:38:32.344424+0000","last_fullsized":"2023-10-14T09:38:32.344424+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:28.683360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.045638+0000","last_change":"2023-10-14T09:38:30.032461+0000","last_active":"2023-10-14T09:38:31.045638+0000","last_peered":"2023-10-14T09:38:31.045638+0000","last_clean":"2023-10-14T09:38:31.045638+0000","last_became_active":"2023-10-14T09:38:30.030927+0000","last_became_peered":"2023-10-14T09:38:30.030927+0000","last_unstale":"2023-10-14T09:38:31.045638+0000","last_undegraded":"2023-10-14T09:38:31.045638+0000","last_fullsized":"2023-10-14T09:38:31.045638+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:18:05.378855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341272+0000","last_change":"2023-10-14T09:38:31.026882+0000","last_active":"2023-10-14T09:38:32.341272+0000","last_peered":"2023-10-14T09:38:32.341272+0000","last_clean":"2023-10-14T09:38:32.341272+0000","last_became_active":"2023-10-14T09:38:31.026615+0000","last_became_peered":"2023-10-14T09:38:31.026615+0000","last_unstale":"2023-10-14T09:38:32.341272+0000","last_undegraded":"2023-10-14T09:38:32.341272+0000","last_fullsized":"2023-10-14T09:38:32.341272+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:39:04.991127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.013395+0000","last_change":"2023-10-14T09:38:30.028028+0000","last_active":"2023-10-14T09:38:31.013395+0000","last_peered":"2023-10-14T09:38:31.013395+0000","last_clean":"2023-10-14T09:38:31.013395+0000","last_became_active":"2023-10-14T09:38:30.026795+0000","last_became_peered":"2023-10-14T09:38:30.026795+0000","last_unstale":"2023-10-14T09:38:31.013395+0000","last_undegraded":"2023-10-14T09:38:31.013395+0000","last_fullsized":"2023-10-14T09:38:31.013395+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:08.168611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341771+0000","last_change":"2023-10-14T09:38:31.032201+0000","last_active":"2023-10-14T09:38:32.341771+0000","last_peered":"2023-10-14T09:38:32.341771+0000","last_clean":"2023-10-14T09:38:32.341771+0000","last_became_active":"2023-10-14T09:38:31.031921+0000","last_became_peered":"2023-10-14T09:38:31.031921+0000","last_unstale":"2023-10-14T09:38:32.341771+0000","last_undegraded":"2023-10-14T09:38:32.341771+0000","last_fullsized":"2023-10-14T09:38:32.341771+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:30:04.103548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345526+0000","last_change":"2023-10-14T09:38:30.021600+0000","last_active":"2023-10-14T09:38:32.345526+0000","last_peered":"2023-10-14T09:38:32.345526+0000","last_clean":"2023-10-14T09:38:32.345526+0000","last_became_active":"2023-10-14T09:38:30.021312+0000","last_became_peered":"2023-10-14T09:38:30.021312+0000","last_unstale":"2023-10-14T09:38:32.345526+0000","last_undegraded":"2023-10-14T09:38:32.345526+0000","last_fullsized":"2023-10-14T09:38:32.345526+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:55:23.928233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341541+0000","last_change":"2023-10-14T09:38:31.023661+0000","last_active":"2023-10-14T09:38:32.341541+0000","last_peered":"2023-10-14T09:38:32.341541+0000","last_clean":"2023-10-14T09:38:32.341541+0000","last_became_active":"2023-10-14T09:38:31.023340+0000","last_became_peered":"2023-10-14T09:38:31.023340+0000","last_unstale":"2023-10-14T09:38:32.341541+0000","last_undegraded":"2023-10-14T09:38:32.341541+0000","last_fullsized":"2023-10-14T09:38:32.341541+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:49:04.384325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.016548+0000","last_change":"2023-10-14T09:38:30.033606+0000","last_active":"2023-10-14T09:38:31.016548+0000","last_peered":"2023-10-14T09:38:31.016548+0000","last_clean":"2023-10-14T09:38:31.016548+0000","last_became_active":"2023-10-14T09:38:30.033284+0000","last_became_peered":"2023-10-14T09:38:30.033284+0000","last_unstale":"2023-10-14T09:38:31.016548+0000","last_undegraded":"2023-10-14T09:38:31.016548+0000","last_fullsized":"2023-10-14T09:38:31.016548+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:26:23.409048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341209+0000","last_change":"2023-10-14T09:38:31.020259+0000","last_active":"2023-10-14T09:38:32.341209+0000","last_peered":"2023-10-14T09:38:32.341209+0000","last_clean":"2023-10-14T09:38:32.341209+0000","last_became_active":"2023-10-14T09:38:31.019732+0000","last_became_peered":"2023-10-14T09:38:31.019732+0000","last_unstale":"2023-10-14T09:38:32.341209+0000","last_undegraded":"2023-10-14T09:38:32.341209+0000","last_fullsized":"2023-10-14T09:38:32.341209+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:39:13.767140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.009471+0000","last_change":"2023-10-14T09:38:30.032802+0000","last_active":"2023-10-14T09:38:31.009471+0000","last_peered":"2023-10-14T09:38:31.009471+0000","last_clean":"2023-10-14T09:38:31.009471+0000","last_became_active":"2023-10-14T09:38:30.032500+0000","last_became_peered":"2023-10-14T09:38:30.032500+0000","last_unstale":"2023-10-14T09:38:31.009471+0000","last_undegraded":"2023-10-14T09:38:31.009471+0000","last_fullsized":"2023-10-14T09:38:31.009471+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:32.881121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342037+0000","last_change":"2023-10-14T09:38:31.030686+0000","last_active":"2023-10-14T09:38:32.342037+0000","last_peered":"2023-10-14T09:38:32.342037+0000","last_clean":"2023-10-14T09:38:32.342037+0000","last_became_active":"2023-10-14T09:38:31.030399+0000","last_became_peered":"2023-10-14T09:38:31.030399+0000","last_unstale":"2023-10-14T09:38:32.342037+0000","last_undegraded":"2023-10-14T09:38:32.342037+0000","last_fullsized":"2023-10-14T09:38:32.342037+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:35.133971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342880+0000","last_change":"2023-10-14T09:38:30.029157+0000","last_active":"2023-10-14T09:38:32.342880+0000","last_peered":"2023-10-14T09:38:32.342880+0000","last_clean":"2023-10-14T09:38:32.342880+0000","last_became_active":"2023-10-14T09:38:30.028540+0000","last_became_peered":"2023-10-14T09:38:30.028540+0000","last_unstale":"2023-10-14T09:38:32.342880+0000","last_undegraded":"2023-10-14T09:38:32.342880+0000","last_fullsized":"2023-10-14T09:38:32.342880+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:11.668342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341394+0000","last_change":"2023-10-14T09:38:31.016140+0000","last_active":"2023-10-14T09:38:32.341394+0000","last_peered":"2023-10-14T09:38:32.341394+0000","last_clean":"2023-10-14T09:38:32.341394+0000","last_became_active":"2023-10-14T09:38:31.015654+0000","last_became_peered":"2023-10-14T09:38:31.015654+0000","last_unstale":"2023-10-14T09:38:32.341394+0000","last_undegraded":"2023-10-14T09:38:32.341394+0000","last_fullsized":"2023-10-14T09:38:32.341394+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:13:35.685099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.043592+0000","last_change":"2023-10-14T09:38:30.030703+0000","last_active":"2023-10-14T09:38:31.043592+0000","last_peered":"2023-10-14T09:38:31.043592+0000","last_clean":"2023-10-14T09:38:31.043592+0000","last_became_active":"2023-10-14T09:38:30.030387+0000","last_became_peered":"2023-10-14T09:38:30.030387+0000","last_unstale":"2023-10-14T09:38:31.043592+0000","last_undegraded":"2023-10-14T09:38:31.043592+0000","last_fullsized":"2023-10-14T09:38:31.043592+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:37:06.890328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344251+0000","last_change":"2023-10-14T09:38:31.024132+0000","last_active":"2023-10-14T09:38:32.344251+0000","last_peered":"2023-10-14T09:38:32.344251+0000","last_clean":"2023-10-14T09:38:32.344251+0000","last_became_active":"2023-10-14T09:38:31.023043+0000","last_became_peered":"2023-10-14T09:38:31.023043+0000","last_unstale":"2023-10-14T09:38:32.344251+0000","last_undegraded":"2023-10-14T09:38:32.344251+0000","last_fullsized":"2023-10-14T09:38:32.344251+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:26:18.683878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:33.929347+0000","last_change":"2023-10-14T09:38:30.024854+0000","last_active":"2023-10-14T09:38:33.929347+0000","last_peered":"2023-10-14T09:38:33.929347+0000","last_clean":"2023-10-14T09:38:33.929347+0000","last_became_active":"2023-10-14T09:38:30.024536+0000","last_became_peered":"2023-10-14T09:38:30.024536+0000","last_unstale":"2023-10-14T09:38:33.929347+0000","last_undegraded":"2023-10-14T09:38:33.929347+0000","last_fullsized":"2023-10-14T09:38:33.929347+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:47:13.277147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345881+0000","last_change":"2023-10-14T09:38:31.024182+0000","last_active":"2023-10-14T09:38:32.345881+0000","last_peered":"2023-10-14T09:38:32.345881+0000","last_clean":"2023-10-14T09:38:32.345881+0000","last_became_active":"2023-10-14T09:38:31.023855+0000","last_became_peered":"2023-10-14T09:38:31.023855+0000","last_unstale":"2023-10-14T09:38:32.345881+0000","last_undegraded":"2023-10-14T09:38:32.345881+0000","last_fullsized":"2023-10-14T09:38:32.345881+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:59:10.045687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.008529+0000","last_change":"2023-10-14T09:38:30.023306+0000","last_active":"2023-10-14T09:38:31.008529+0000","last_peered":"2023-10-14T09:38:31.008529+0000","last_clean":"2023-10-14T09:38:31.008529+0000","last_became_active":"2023-10-14T09:38:30.023068+0000","last_became_peered":"2023-10-14T09:38:30.023068+0000","last_unstale":"2023-10-14T09:38:31.008529+0000","last_undegraded":"2023-10-14T09:38:31.008529+0000","last_fullsized":"2023-10-14T09:38:31.008529+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:21.599798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.019849+0000","last_change":"2023-10-14T09:38:31.027123+0000","last_active":"2023-10-14T09:38:32.019849+0000","last_peered":"2023-10-14T09:38:32.019849+0000","last_clean":"2023-10-14T09:38:32.019849+0000","last_became_active":"2023-10-14T09:38:31.026838+0000","last_became_peered":"2023-10-14T09:38:31.026838+0000","last_unstale":"2023-10-14T09:38:32.019849+0000","last_undegraded":"2023-10-14T09:38:32.019849+0000","last_fullsized":"2023-10-14T09:38:32.019849+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:18.314768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345598+0000","last_change":"2023-10-14T09:38:30.029783+0000","last_active":"2023-10-14T09:38:32.345598+0000","last_peered":"2023-10-14T09:38:32.345598+0000","last_clean":"2023-10-14T09:38:32.345598+0000","last_became_active":"2023-10-14T09:38:30.029514+0000","last_became_peered":"2023-10-14T09:38:30.029514+0000","last_unstale":"2023-10-14T09:38:32.345598+0000","last_undegraded":"2023-10-14T09:38:32.345598+0000","last_fullsized":"2023-10-14T09:38:32.345598+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:12:06.845824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345460+0000","last_change":"2023-10-14T09:38:31.030071+0000","last_active":"2023-10-14T09:38:32.345460+0000","last_peered":"2023-10-14T09:38:32.345460+0000","last_clean":"2023-10-14T09:38:32.345460+0000","last_became_active":"2023-10-14T09:38:31.029521+0000","last_became_peered":"2023-10-14T09:38:31.029521+0000","last_unstale":"2023-10-14T09:38:32.345460+0000","last_undegraded":"2023-10-14T09:38:32.345460+0000","last_fullsized":"2023-10-14T09:38:32.345460+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:45:03.414149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.005434+0000","last_change":"2023-10-14T09:38:30.030457+0000","last_active":"2023-10-14T09:38:31.005434+0000","last_peered":"2023-10-14T09:38:31.005434+0000","last_clean":"2023-10-14T09:38:31.005434+0000","last_became_active":"2023-10-14T09:38:30.029517+0000","last_became_peered":"2023-10-14T09:38:30.029517+0000","last_unstale":"2023-10-14T09:38:31.005434+0000","last_undegraded":"2023-10-14T09:38:31.005434+0000","last_fullsized":"2023-10-14T09:38:31.005434+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:08.168611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341965+0000","last_change":"2023-10-14T09:38:31.034569+0000","last_active":"2023-10-14T09:38:32.341965+0000","last_peered":"2023-10-14T09:38:32.341965+0000","last_clean":"2023-10-14T09:38:32.341965+0000","last_became_active":"2023-10-14T09:38:31.034300+0000","last_became_peered":"2023-10-14T09:38:31.034300+0000","last_unstale":"2023-10-14T09:38:32.341965+0000","last_undegraded":"2023-10-14T09:38:32.341965+0000","last_fullsized":"2023-10-14T09:38:32.341965+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:55:53.322273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.009658+0000","last_change":"2023-10-14T09:38:30.030715+0000","last_active":"2023-10-14T09:38:31.009658+0000","last_peered":"2023-10-14T09:38:31.009658+0000","last_clean":"2023-10-14T09:38:31.009658+0000","last_became_active":"2023-10-14T09:38:30.030374+0000","last_became_peered":"2023-10-14T09:38:30.030374+0000","last_unstale":"2023-10-14T09:38:31.009658+0000","last_undegraded":"2023-10-14T09:38:31.009658+0000","last_fullsized":"2023-10-14T09:38:31.009658+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:26:23.409048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.017240+0000","last_change":"2023-10-14T09:38:31.033069+0000","last_active":"2023-10-14T09:38:32.017240+0000","last_peered":"2023-10-14T09:38:32.017240+0000","last_clean":"2023-10-14T09:38:32.017240+0000","last_became_active":"2023-10-14T09:38:31.032648+0000","last_became_peered":"2023-10-14T09:38:31.032648+0000","last_unstale":"2023-10-14T09:38:32.017240+0000","last_undegraded":"2023-10-14T09:38:32.017240+0000","last_fullsized":"2023-10-14T09:38:32.017240+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:32:55.434705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.010423+0000","last_change":"2023-10-14T09:38:30.020581+0000","last_active":"2023-10-14T09:38:31.010423+0000","last_peered":"2023-10-14T09:38:31.010423+0000","last_clean":"2023-10-14T09:38:31.010423+0000","last_became_active":"2023-10-14T09:38:30.020321+0000","last_became_peered":"2023-10-14T09:38:30.020321+0000","last_unstale":"2023-10-14T09:38:31.010423+0000","last_undegraded":"2023-10-14T09:38:31.010423+0000","last_fullsized":"2023-10-14T09:38:31.010423+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:23:26.972323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342673+0000","last_change":"2023-10-14T09:38:31.024792+0000","last_active":"2023-10-14T09:38:32.342673+0000","last_peered":"2023-10-14T09:38:32.342673+0000","last_clean":"2023-10-14T09:38:32.342673+0000","last_became_active":"2023-10-14T09:38:31.024478+0000","last_became_peered":"2023-10-14T09:38:31.024478+0000","last_unstale":"2023-10-14T09:38:32.342673+0000","last_undegraded":"2023-10-14T09:38:32.342673+0000","last_fullsized":"2023-10-14T09:38:32.342673+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:49:22.040318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.015743+0000","last_change":"2023-10-14T09:38:30.033668+0000","last_active":"2023-10-14T09:38:31.015743+0000","last_peered":"2023-10-14T09:38:31.015743+0000","last_clean":"2023-10-14T09:38:31.015743+0000","last_became_active":"2023-10-14T09:38:30.033358+0000","last_became_peered":"2023-10-14T09:38:30.033358+0000","last_unstale":"2023-10-14T09:38:31.015743+0000","last_undegraded":"2023-10-14T09:38:31.015743+0000","last_fullsized":"2023-10-14T09:38:31.015743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:30:03.089452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":177,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.016331+0000","last_change":"2023-10-14T09:37:12.368000+0000","last_active":"2023-10-14T09:38:31.016331+0000","last_peered":"2023-10-14T09:38:31.016331+0000","last_clean":"2023-10-14T09:38:31.016331+0000","last_became_active":"2023-10-14T09:37:12.364623+0000","last_became_peered":"2023-10-14T09:37:12.364623+0000","last_unstale":"2023-10-14T09:38:31.016331+0000","last_undegraded":"2023-10-14T09:38:31.016331+0000","last_fullsized":"2023-10-14T09:38:31.016331+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:10.796841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:10.796841+0000","last_clean_scrub_stamp":"2023-10-14T09:37:10.796841+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:48.940536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509459,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":999424,"data_stored":748946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":1.5600000000000001}]},{"osd":1,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":1.331},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.054}]},{"osd":2,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":1.421}]},{"osd":3,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":1.147},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.9060000000000001,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":1.504}]},{"osd":4,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.6759999999999999},{"interface":"front","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.389}]},{"osd":5,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":3.0129999999999999,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":1.774},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.823}]},{"osd":6,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.4260000000000002,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":1.9350000000000001},{"interface":"front","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.0710000000000002,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.4770000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509461,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":409600,"data_stored":159104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.76400000000000001}]},{"osd":1,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":1.028},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.85299999999999998}]},{"osd":2,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.4540000000000002,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.86299999999999999}]},{"osd":3,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":4.5419999999999998,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":4.2839999999999998,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":0.61399999999999999}]},{"osd":4,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":1.22}]},{"osd":5,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.7069999999999999,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":1.093}]},{"osd":7,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.5899999999999999,"5min":2.5899999999999999,"15min":2.5899999999999999},"last":1.254}]}]},{"osd":4,"up_from":15,"seq":64424509461,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":409600,"data_stored":158592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":1.621,"5min":1.621,"15min":1.621},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":13.404,"5min":13.404,"15min":13.404},"last":1.137},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":9.4640000000000004,"5min":9.4640000000000004,"15min":9.4640000000000004},"last":0.998}]},{"osd":1,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":6.734,"5min":6.734,"15min":6.734},"last":1.179},{"interface":"front","average":{"1min":1.504,"5min":1.504,"15min":1.504},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":7.8860000000000001,"5min":7.8860000000000001,"15min":7.8860000000000001},"last":1.2749999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":1.591,"5min":1.591,"15min":1.591},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":7.8520000000000003,"5min":7.8520000000000003,"15min":7.8520000000000003},"last":1.218},{"interface":"front","average":{"1min":1.889,"5min":1.889,"15min":1.889},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":14.609,"5min":14.609,"15min":14.609},"last":1.248}]},{"osd":3,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":1.964,"5min":1.964,"15min":1.964},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":15.856,"5min":15.856,"15min":15.856},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":6.1970000000000001,"5min":6.1970000000000001,"15min":6.1970000000000001},"last":0.78700000000000003}]},{"osd":5,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":16.547000000000001,"5min":16.547000000000001,"15min":16.547000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":15.913,"5min":15.913,"15min":15.913},"last":0.67300000000000004}]},{"osd":6,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":2.3029999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":16.481999999999999,"5min":16.481999999999999,"15min":16.481999999999999},"last":1.0880000000000001},{"interface":"front","average":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":15.956,"5min":15.956,"15min":15.956},"last":0.94799999999999995}]},{"osd":7,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":6.6520000000000001,"5min":6.6520000000000001,"15min":6.6520000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":2.073,"5min":2.073,"15min":2.073},"min":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":10.314,"5min":10.314,"15min":10.314},"last":1.325}]}]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":160122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.56200000000000006}]},{"osd":1,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.7349999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":0.73999999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.875},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":2.77,"5min":2.77,"15min":2.77},"last":1.133}]},{"osd":4,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.077},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":2.153,"5min":2.153,"15min":2.153},"last":1.167}]},{"osd":5,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":3.6469999999999998,"5min":3.6469999999999998,"15min":3.6469999999999998},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.90100000000000002}]},{"osd":6,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.05},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":3.6930000000000001,"5min":3.6930000000000001,"15min":3.6930000000000001},"last":1.284}]},{"osd":7,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.4249999999999998,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.22},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.2430000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509461,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":158558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.7789999999999999,"5min":2.7789999999999999,"15min":2.7789999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.39800000000000002}]},{"osd":1,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.3490000000000002,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.502}]},{"osd":3,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.4700000000000002,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.45900000000000002}]},{"osd":4,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.5960000000000001,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":3.1469999999999998,"5min":3.1469999999999998,"15min":3.1469999999999998},"last":0.91900000000000004}]},{"osd":5,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":4.0800000000000001,"5min":4.0800000000000001,"15min":4.0800000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":3.6709999999999998,"5min":3.6709999999999998,"15min":3.6709999999999998},"last":0.999}]},{"osd":6,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.9249999999999998,"5min":2.9249999999999998,"15min":2.9249999999999998},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":3.081,"5min":3.081,"15min":3.081},"last":0.83899999999999997}]},{"osd":7,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":5.0650000000000004,"5min":5.0650000000000004,"15min":5.0650000000000004},"last":0.60799999999999998},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":3.8849999999999998,"5min":3.8849999999999998,"15min":3.8849999999999998},"last":1.05}]}]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":160122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":1.123},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.476}]},{"osd":2,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.747}]},{"osd":3,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":3.1499999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.302}]},{"osd":4,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":3.7320000000000002,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":1.27},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.232}]},{"osd":5,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":3.02,"5min":3.02,"15min":3.02},"last":1.012},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":3.827,"5min":3.827,"15min":3.827},"last":1.1919999999999999}]},{"osd":6,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.597},{"interface":"front","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":3.3250000000000002,"5min":3.3250000000000002,"15min":3.3250000000000002},"last":1.4279999999999999}]},{"osd":7,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":3.9100000000000001,"5min":3.9100000000000001,"15min":3.9100000000000001},"last":1.411},{"interface":"front","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":3.105,"5min":3.105,"15min":3.105},"last":1.8220000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542165,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":159160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.319}]},{"osd":1,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.78100000000000003}]},{"osd":2,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":4.4610000000000003,"5min":4.4610000000000003,"15min":4.4610000000000003},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.413}]},{"osd":3,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":0.995},{"interface":"front","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":0.96799999999999997}]},{"osd":4,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":1.077},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.6080000000000001}]},{"osd":6,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":1.3700000000000001}]},{"osd":7,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":2.387,"5min":2.387,"15min":2.387},"last":1.508},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.143}]}]},{"osd":0,"up_from":14,"seq":60129542165,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":995328,"data_stored":748856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":3.0750000000000002,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.2919999999999998,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.92500000000000004}]},{"osd":2,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":4.2210000000000001,"5min":4.2210000000000001,"15min":4.2210000000000001},"last":0.622}]},{"osd":3,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":3.6070000000000002,"5min":3.6070000000000002,"15min":3.6070000000000002},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.034}]},{"osd":4,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":4.1609999999999996,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":2.391,"5min":2.391,"15min":2.391},"last":1.6000000000000001}]},{"osd":5,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":3.8620000000000001,"5min":3.8620000000000001,"15min":3.8620000000000001},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":2.4220000000000002,"5min":2.4220000000000002,"15min":2.4220000000000002},"last":1.5069999999999999}]},{"osd":6,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":3.8210000000000002,"5min":3.8210000000000002,"15min":3.8210000000000002},"last":1.569},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"min":{"1min":0.997,"5min":0.997,"15min":0.997},"max":{"1min":4.0999999999999996,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":1.629}]},{"osd":7,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":1.581,"15min":1.581},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":4.1920000000000002,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":1.5369999999999999},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.2350000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T09:38:41.443 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-14T09:38:41.444 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:38:41.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.696+0000 7f8b29be9640 1 Processor -- start 2023-10-14T09:38:41.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.696+0000 7f8b29be9640 1 -- start start 2023-10-14T09:38:41.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.697+0000 7f8b29be9640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8b240b0b20 0x7f8b241615f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:41.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.698+0000 7f8b29be9640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f8b2415d3f0 0x7f8b2415d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:41.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.698+0000 7f8b29be9640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b2415e3e0 con 0x7f8b240cd0c0 2023-10-14T09:38:41.701 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.698+0000 7f8b29be9640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b240cd4a0 con 0x7f8b2415d3f0 2023-10-14T09:38:41.701 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.698+0000 7f8b29be9640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2415e100 con 0x7f8b240b0b20 2023-10-14T09:38:41.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.698+0000 7f8b23fff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f8b2415d3f0 0x7f8b2415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:41.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.698+0000 7f8b1bfff640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8b240b0b20 0x7f8b241615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:41.705 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.699+0000 7f8b23fff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f8b2415d3f0 0x7f8b2415d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.102:48060/0 (socket says 172.21.15.102:48060) 2023-10-14T09:38:41.705 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.699+0000 7f8b23fff640 1 -- 172.21.15.102:0/11934097 learned_addr learned my addr 172.21.15.102:0/11934097 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:41.705 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.699+0000 7f8b237fe640 1 --1- 172.21.15.102:0/11934097 >> v1:172.21.15.129:6789/0 conn(0x7f8b240cd0c0 0x7f8b240b0410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.102:46390/0 (socket says 172.21.15.102:46390) 2023-10-14T09:38:41.706 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.699+0000 7f8b23fff640 1 -- 172.21.15.102:0/11934097 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8b240b0b20 msgr2=0x7f8b241615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:41.706 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.699+0000 7f8b23fff640 1 --2- 172.21.15.102:0/11934097 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8b240b0b20 0x7f8b241615f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:41.707 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.699+0000 7f8b23fff640 1 -- 172.21.15.102:0/11934097 >> v1:172.21.15.129:6789/0 conn(0x7f8b240cd0c0 legacy=0x7f8b240b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:41.707 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.699+0000 7f8b23fff640 1 -- 172.21.15.102:0/11934097 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b24160b10 con 0x7f8b2415d3f0 2023-10-14T09:38:41.708 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.701+0000 7f8b23fff640 1 --2- 172.21.15.102:0/11934097 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8b2415d3f0 0x7f8b2415d860 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c009e50 tx=0x7f8b1c02bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73d044610d332614 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:41.708 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.701+0000 7f8b22ffd640 1 -- 172.21.15.102:0/11934097 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c02ca80 con 0x7f8b2415d3f0 2023-10-14T09:38:41.708 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.701+0000 7f8b22ffd640 1 -- 172.21.15.102:0/11934097 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1c02cbe0 con 0x7f8b2415d3f0 2023-10-14T09:38:41.709 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.701+0000 7f8b22ffd640 1 -- 172.21.15.102:0/11934097 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c0343f0 con 0x7f8b2415d3f0 2023-10-14T09:38:41.709 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.702+0000 7f8b29be9640 1 -- 172.21.15.102:0/11934097 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8b2415d3f0 msgr2=0x7f8b2415d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:41.710 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.702+0000 7f8b29be9640 1 --2- 172.21.15.102:0/11934097 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8b2415d3f0 0x7f8b2415d860 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c009e50 tx=0x7f8b1c02bee0 comp rx=0 tx=0).stop 2023-10-14T09:38:41.710 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.702+0000 7f8b29be9640 1 -- 172.21.15.102:0/11934097 shutdown_connections 2023-10-14T09:38:41.710 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.702+0000 7f8b29be9640 1 --2- 172.21.15.102:0/11934097 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8b2415d3f0 0x7f8b2415d860 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:41.710 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.702+0000 7f8b29be9640 1 --2- 172.21.15.102:0/11934097 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8b240b0b20 0x7f8b241615f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:41.711 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.702+0000 7f8b29be9640 1 -- 172.21.15.102:0/11934097 >> 172.21.15.102:0/11934097 conn(0x7f8b240cb410 msgr2=0x7f8b240cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:41.711 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.702+0000 7f8b29be9640 1 -- 172.21.15.102:0/11934097 shutdown_connections 2023-10-14T09:38:41.711 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.702+0000 7f8b29be9640 1 -- 172.21.15.102:0/11934097 wait complete. 2023-10-14T09:38:41.715 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.703+0000 7f8b29be9640 1 Processor -- start 2023-10-14T09:38:41.715 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.704+0000 7f8b29be9640 1 -- start start 2023-10-14T09:38:41.716 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.704+0000 7f8b29be9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8b240b0b20 0x7f8b24154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:41.716 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.705+0000 7f8b29be9640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8b240cd0c0 0x7f8b241f65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:41.716 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.705+0000 7f8b29be9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b2415d3f0 0x7f8b2415f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:41.716 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.705+0000 7f8b29be9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b241f7510 con 0x7f8b2415d3f0 2023-10-14T09:38:41.717 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.705+0000 7f8b29be9640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b240c5f00 con 0x7f8b240b0b20 2023-10-14T09:38:41.717 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.705+0000 7f8b29be9640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b24154f80 con 0x7f8b240cd0c0 2023-10-14T09:38:41.717 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.705+0000 7f8b23fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b2415d3f0 0x7f8b2415f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:41.718 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.705+0000 7f8b23fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b2415d3f0 0x7f8b2415f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41102/0 (socket says 172.21.15.102:41102) 2023-10-14T09:38:41.718 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.705+0000 7f8b23fff640 1 -- 172.21.15.102:0/2976246107 learned_addr learned my addr 172.21.15.102:0/2976246107 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:41.718 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.705+0000 7f8b237fe640 1 --2- 172.21.15.102:0/2976246107 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8b240b0b20 0x7f8b24154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:41.719 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.705+0000 7f8b23fff640 1 -- 172.21.15.102:0/2976246107 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8b240cd0c0 msgr2=0x7f8b241f65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:41.719 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.705+0000 7f8b23fff640 1 --2- 172.21.15.102:0/2976246107 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8b240cd0c0 0x7f8b241f65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:41.719 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.705+0000 7f8b23fff640 1 -- 172.21.15.102:0/2976246107 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8b240b0b20 msgr2=0x7f8b24154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:41.720 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.705+0000 7f8b23fff640 1 --2- 172.21.15.102:0/2976246107 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8b240b0b20 0x7f8b24154a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:41.720 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.705+0000 7f8b23fff640 1 -- 172.21.15.102:0/2976246107 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1c009b30 con 0x7f8b2415d3f0 2023-10-14T09:38:41.720 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.706+0000 7f8b23fff640 1 --2- 172.21.15.102:0/2976246107 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b2415d3f0 0x7f8b2415f5e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c009f70 tx=0x7f8b1c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:41.720 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.706+0000 7f8b20ff9640 1 -- 172.21.15.102:0/2976246107 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c009510 con 0x7f8b2415d3f0 2023-10-14T09:38:41.721 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.706+0000 7f8b20ff9640 1 -- 172.21.15.102:0/2976246107 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1c03e450 con 0x7f8b2415d3f0 2023-10-14T09:38:41.721 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.706+0000 7f8b29be9640 1 -- 172.21.15.102:0/2976246107 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b241f6f50 con 0x7f8b2415d3f0 2023-10-14T09:38:41.721 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.706+0000 7f8b20ff9640 1 -- 172.21.15.102:0/2976246107 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c03e820 con 0x7f8b2415d3f0 2023-10-14T09:38:41.722 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.706+0000 7f8b29be9640 1 -- 172.21.15.102:0/2976246107 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b240c5b90 con 0x7f8b2415d3f0 2023-10-14T09:38:41.722 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.707+0000 7f8b29be9640 1 -- 172.21.15.102:0/2976246107 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b2404e160 con 0x7f8b2415d3f0 2023-10-14T09:38:41.722 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.708+0000 7f8b20ff9640 1 -- 172.21.15.102:0/2976246107 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8b1c02cd50 con 0x7f8b2415d3f0 2023-10-14T09:38:41.723 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.709+0000 7f8b20ff9640 1 --2- 172.21.15.102:0/2976246107 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f8b0406ae70 0x7f8b0406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:41.723 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.709+0000 7f8b20ff9640 1 -- 172.21.15.102:0/2976246107 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f8b1c0ac060 con 0x7f8b2415d3f0 2023-10-14T09:38:41.723 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.709+0000 7f8b237fe640 1 --2- 172.21.15.102:0/2976246107 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f8b0406ae70 0x7f8b0406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:41.723 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.710+0000 7f8b237fe640 1 --2- 172.21.15.102:0/2976246107 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f8b0406ae70 0x7f8b0406d330 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8b14000f60 tx=0x7f8b14009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:41.724 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.713+0000 7f8b20ff9640 1 -- 172.21.15.102:0/2976246107 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8b1c0deca0 con 0x7f8b2415d3f0 2023-10-14T09:38:41.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.901+0000 7f8b29be9640 1 -- 172.21.15.102:0/2976246107 --> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b241610d0 con 0x7f8b0406ae70 2023-10-14T09:38:41.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.924+0000 7f8b20ff9640 1 -- 172.21.15.102:0/2976246107 <== mgr.4104 v2:172.21.15.102:6832/1125265706 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287499 (secure 0 0 0) 0x7f8b14001250 con 0x7f8b0406ae70 2023-10-14T09:38:41.930 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:38:41.932 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2023-10-14T09:38:41.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.929+0000 7f8b29be9640 1 -- 172.21.15.102:0/2976246107 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f8b0406ae70 msgr2=0x7f8b0406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:41.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.929+0000 7f8b29be9640 1 --2- 172.21.15.102:0/2976246107 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f8b0406ae70 0x7f8b0406d330 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8b14000f60 tx=0x7f8b14009040 comp rx=0 tx=0).stop 2023-10-14T09:38:41.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.929+0000 7f8b29be9640 1 -- 172.21.15.102:0/2976246107 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b2415d3f0 msgr2=0x7f8b2415f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:41.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.929+0000 7f8b29be9640 1 --2- 172.21.15.102:0/2976246107 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b2415d3f0 0x7f8b2415f5e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c009f70 tx=0x7f8b1c004a40 comp rx=0 tx=0).stop 2023-10-14T09:38:41.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.929+0000 7f8b29be9640 1 -- 172.21.15.102:0/2976246107 shutdown_connections 2023-10-14T09:38:41.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.929+0000 7f8b29be9640 1 --2- 172.21.15.102:0/2976246107 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f8b0406ae70 0x7f8b0406d330 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:41.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.929+0000 7f8b29be9640 1 --2- 172.21.15.102:0/2976246107 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b2415d3f0 0x7f8b2415f5e0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:41.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.929+0000 7f8b29be9640 1 --2- 172.21.15.102:0/2976246107 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8b240cd0c0 0x7f8b241f65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:41.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.929+0000 7f8b29be9640 1 --2- 172.21.15.102:0/2976246107 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8b240b0b20 0x7f8b24154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:41.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.930+0000 7f8b29be9640 1 -- 172.21.15.102:0/2976246107 >> 172.21.15.102:0/2976246107 conn(0x7f8b240cb410 msgr2=0x7f8b2406b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:41.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.930+0000 7f8b29be9640 1 -- 172.21.15.102:0/2976246107 shutdown_connections 2023-10-14T09:38:41.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:41.930+0000 7f8b29be9640 1 -- 172.21.15.102:0/2976246107 wait complete. 2023-10-14T09:38:41.952 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2023-10-14T09:38:41.900843+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220536,"kb_used_data":4360,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754184,"statfs":{"total":773094113280,"available":772868284416,"internally_reserved":0,"allocated":4464640,"data_stored":2453460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002838"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.019582+0000","last_change":"2023-10-14T09:38:31.026111+0000","last_active":"2023-10-14T09:38:32.019582+0000","last_peered":"2023-10-14T09:38:32.019582+0000","last_clean":"2023-10-14T09:38:32.019582+0000","last_became_active":"2023-10-14T09:38:31.023780+0000","last_became_peered":"2023-10-14T09:38:31.023780+0000","last_unstale":"2023-10-14T09:38:32.019582+0000","last_undegraded":"2023-10-14T09:38:32.019582+0000","last_fullsized":"2023-10-14T09:38:32.019582+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:13:06.090004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344563+0000","last_change":"2023-10-14T09:38:31.028205+0000","last_active":"2023-10-14T09:38:32.344563+0000","last_peered":"2023-10-14T09:38:32.344563+0000","last_clean":"2023-10-14T09:38:32.344563+0000","last_became_active":"2023-10-14T09:38:31.027820+0000","last_became_peered":"2023-10-14T09:38:31.027820+0000","last_unstale":"2023-10-14T09:38:32.344563+0000","last_undegraded":"2023-10-14T09:38:32.344563+0000","last_fullsized":"2023-10-14T09:38:32.344563+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:30:53.824363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344137+0000","last_change":"2023-10-14T09:38:31.020589+0000","last_active":"2023-10-14T09:38:32.344137+0000","last_peered":"2023-10-14T09:38:32.344137+0000","last_clean":"2023-10-14T09:38:32.344137+0000","last_became_active":"2023-10-14T09:38:31.019892+0000","last_became_peered":"2023-10-14T09:38:31.019892+0000","last_unstale":"2023-10-14T09:38:32.344137+0000","last_undegraded":"2023-10-14T09:38:32.344137+0000","last_fullsized":"2023-10-14T09:38:32.344137+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:30:59.177841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344268+0000","last_change":"2023-10-14T09:38:31.035562+0000","last_active":"2023-10-14T09:38:32.344268+0000","last_peered":"2023-10-14T09:38:32.344268+0000","last_clean":"2023-10-14T09:38:32.344268+0000","last_became_active":"2023-10-14T09:38:31.035189+0000","last_became_peered":"2023-10-14T09:38:31.035189+0000","last_unstale":"2023-10-14T09:38:32.344268+0000","last_undegraded":"2023-10-14T09:38:32.344268+0000","last_fullsized":"2023-10-14T09:38:32.344268+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:46.045245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341193+0000","last_change":"2023-10-14T09:38:31.023485+0000","last_active":"2023-10-14T09:38:32.341193+0000","last_peered":"2023-10-14T09:38:32.341193+0000","last_clean":"2023-10-14T09:38:32.341193+0000","last_became_active":"2023-10-14T09:38:31.020777+0000","last_became_peered":"2023-10-14T09:38:31.020777+0000","last_unstale":"2023-10-14T09:38:32.341193+0000","last_undegraded":"2023-10-14T09:38:32.341193+0000","last_fullsized":"2023-10-14T09:38:32.341193+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:38:27.480319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342439+0000","last_change":"2023-10-14T09:38:31.028808+0000","last_active":"2023-10-14T09:38:32.342439+0000","last_peered":"2023-10-14T09:38:32.342439+0000","last_clean":"2023-10-14T09:38:32.342439+0000","last_became_active":"2023-10-14T09:38:31.027342+0000","last_became_peered":"2023-10-14T09:38:31.027342+0000","last_unstale":"2023-10-14T09:38:32.342439+0000","last_undegraded":"2023-10-14T09:38:32.342439+0000","last_fullsized":"2023-10-14T09:38:32.342439+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:41:28.301486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342132+0000","last_change":"2023-10-14T09:38:31.035347+0000","last_active":"2023-10-14T09:38:32.342132+0000","last_peered":"2023-10-14T09:38:32.342132+0000","last_clean":"2023-10-14T09:38:32.342132+0000","last_became_active":"2023-10-14T09:38:31.033760+0000","last_became_peered":"2023-10-14T09:38:31.033760+0000","last_unstale":"2023-10-14T09:38:32.342132+0000","last_undegraded":"2023-10-14T09:38:32.342132+0000","last_fullsized":"2023-10-14T09:38:32.342132+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:02:20.930526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341844+0000","last_change":"2023-10-14T09:38:31.024987+0000","last_active":"2023-10-14T09:38:32.341844+0000","last_peered":"2023-10-14T09:38:32.341844+0000","last_clean":"2023-10-14T09:38:32.341844+0000","last_became_active":"2023-10-14T09:38:31.024702+0000","last_became_peered":"2023-10-14T09:38:31.024702+0000","last_unstale":"2023-10-14T09:38:32.341844+0000","last_undegraded":"2023-10-14T09:38:32.341844+0000","last_fullsized":"2023-10-14T09:38:32.341844+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:23:43.555148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.019168+0000","last_change":"2023-10-14T09:38:31.024329+0000","last_active":"2023-10-14T09:38:32.019168+0000","last_peered":"2023-10-14T09:38:32.019168+0000","last_clean":"2023-10-14T09:38:32.019168+0000","last_became_active":"2023-10-14T09:38:31.023498+0000","last_became_peered":"2023-10-14T09:38:31.023498+0000","last_unstale":"2023-10-14T09:38:32.019168+0000","last_undegraded":"2023-10-14T09:38:32.019168+0000","last_fullsized":"2023-10-14T09:38:32.019168+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:46.045245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344549+0000","last_change":"2023-10-14T09:38:31.029616+0000","last_active":"2023-10-14T09:38:32.344549+0000","last_peered":"2023-10-14T09:38:32.344549+0000","last_clean":"2023-10-14T09:38:32.344549+0000","last_became_active":"2023-10-14T09:38:31.029268+0000","last_became_peered":"2023-10-14T09:38:31.029268+0000","last_unstale":"2023-10-14T09:38:32.344549+0000","last_undegraded":"2023-10-14T09:38:32.344549+0000","last_fullsized":"2023-10-14T09:38:32.344549+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:04:05.499565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343128+0000","last_change":"2023-10-14T09:38:31.035514+0000","last_active":"2023-10-14T09:38:32.343128+0000","last_peered":"2023-10-14T09:38:32.343128+0000","last_clean":"2023-10-14T09:38:32.343128+0000","last_became_active":"2023-10-14T09:38:31.033343+0000","last_became_peered":"2023-10-14T09:38:31.033343+0000","last_unstale":"2023-10-14T09:38:32.343128+0000","last_undegraded":"2023-10-14T09:38:32.343128+0000","last_fullsized":"2023-10-14T09:38:32.343128+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:55:53.322273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344359+0000","last_change":"2023-10-14T09:38:31.018326+0000","last_active":"2023-10-14T09:38:32.344359+0000","last_peered":"2023-10-14T09:38:32.344359+0000","last_clean":"2023-10-14T09:38:32.344359+0000","last_became_active":"2023-10-14T09:38:31.017971+0000","last_became_peered":"2023-10-14T09:38:31.017971+0000","last_unstale":"2023-10-14T09:38:32.344359+0000","last_undegraded":"2023-10-14T09:38:32.344359+0000","last_fullsized":"2023-10-14T09:38:32.344359+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:08.018148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341372+0000","last_change":"2023-10-14T09:38:31.019474+0000","last_active":"2023-10-14T09:38:32.341372+0000","last_peered":"2023-10-14T09:38:32.341372+0000","last_clean":"2023-10-14T09:38:32.341372+0000","last_became_active":"2023-10-14T09:38:31.019186+0000","last_became_peered":"2023-10-14T09:38:31.019186+0000","last_unstale":"2023-10-14T09:38:32.341372+0000","last_undegraded":"2023-10-14T09:38:32.341372+0000","last_fullsized":"2023-10-14T09:38:32.341372+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:36:21.378536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342644+0000","last_change":"2023-10-14T09:38:31.020718+0000","last_active":"2023-10-14T09:38:32.342644+0000","last_peered":"2023-10-14T09:38:32.342644+0000","last_clean":"2023-10-14T09:38:32.342644+0000","last_became_active":"2023-10-14T09:38:31.020409+0000","last_became_peered":"2023-10-14T09:38:31.020409+0000","last_unstale":"2023-10-14T09:38:32.342644+0000","last_undegraded":"2023-10-14T09:38:32.342644+0000","last_fullsized":"2023-10-14T09:38:32.342644+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:43:03.012824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342558+0000","last_change":"2023-10-14T09:38:31.025489+0000","last_active":"2023-10-14T09:38:32.342558+0000","last_peered":"2023-10-14T09:38:32.342558+0000","last_clean":"2023-10-14T09:38:32.342558+0000","last_became_active":"2023-10-14T09:38:31.025155+0000","last_became_peered":"2023-10-14T09:38:31.025155+0000","last_unstale":"2023-10-14T09:38:32.342558+0000","last_undegraded":"2023-10-14T09:38:32.342558+0000","last_fullsized":"2023-10-14T09:38:32.342558+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:14:59.816409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342426+0000","last_change":"2023-10-14T09:38:31.034136+0000","last_active":"2023-10-14T09:38:32.342426+0000","last_peered":"2023-10-14T09:38:32.342426+0000","last_clean":"2023-10-14T09:38:32.342426+0000","last_became_active":"2023-10-14T09:38:31.033869+0000","last_became_peered":"2023-10-14T09:38:31.033869+0000","last_unstale":"2023-10-14T09:38:32.342426+0000","last_undegraded":"2023-10-14T09:38:32.342426+0000","last_fullsized":"2023-10-14T09:38:32.342426+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:44.513959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343361+0000","last_change":"2023-10-14T09:38:31.030416+0000","last_active":"2023-10-14T09:38:32.343361+0000","last_peered":"2023-10-14T09:38:32.343361+0000","last_clean":"2023-10-14T09:38:32.343361+0000","last_became_active":"2023-10-14T09:38:31.029457+0000","last_became_peered":"2023-10-14T09:38:31.029457+0000","last_unstale":"2023-10-14T09:38:32.343361+0000","last_undegraded":"2023-10-14T09:38:32.343361+0000","last_fullsized":"2023-10-14T09:38:32.343361+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:41:28.301486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344776+0000","last_change":"2023-10-14T09:38:31.033346+0000","last_active":"2023-10-14T09:38:32.344776+0000","last_peered":"2023-10-14T09:38:32.344776+0000","last_clean":"2023-10-14T09:38:32.344776+0000","last_became_active":"2023-10-14T09:38:31.033040+0000","last_became_peered":"2023-10-14T09:38:31.033040+0000","last_unstale":"2023-10-14T09:38:32.344776+0000","last_undegraded":"2023-10-14T09:38:32.344776+0000","last_fullsized":"2023-10-14T09:38:32.344776+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:54:57.182070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343534+0000","last_change":"2023-10-14T09:38:31.026010+0000","last_active":"2023-10-14T09:38:32.343534+0000","last_peered":"2023-10-14T09:38:32.343534+0000","last_clean":"2023-10-14T09:38:32.343534+0000","last_became_active":"2023-10-14T09:38:31.025735+0000","last_became_peered":"2023-10-14T09:38:31.025735+0000","last_unstale":"2023-10-14T09:38:32.343534+0000","last_undegraded":"2023-10-14T09:38:32.343534+0000","last_fullsized":"2023-10-14T09:38:32.343534+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:07:02.738518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341225+0000","last_change":"2023-10-14T09:38:31.011800+0000","last_active":"2023-10-14T09:38:32.341225+0000","last_peered":"2023-10-14T09:38:32.341225+0000","last_clean":"2023-10-14T09:38:32.341225+0000","last_became_active":"2023-10-14T09:38:31.011363+0000","last_became_peered":"2023-10-14T09:38:31.011363+0000","last_unstale":"2023-10-14T09:38:32.341225+0000","last_undegraded":"2023-10-14T09:38:32.341225+0000","last_fullsized":"2023-10-14T09:38:32.341225+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:32:10.952099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.018172+0000","last_change":"2023-10-14T09:38:31.021882+0000","last_active":"2023-10-14T09:38:32.018172+0000","last_peered":"2023-10-14T09:38:32.018172+0000","last_clean":"2023-10-14T09:38:32.018172+0000","last_became_active":"2023-10-14T09:38:31.021555+0000","last_became_peered":"2023-10-14T09:38:31.021555+0000","last_unstale":"2023-10-14T09:38:32.018172+0000","last_undegraded":"2023-10-14T09:38:32.018172+0000","last_fullsized":"2023-10-14T09:38:32.018172+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:22.613894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.018500+0000","last_change":"2023-10-14T09:38:31.029992+0000","last_active":"2023-10-14T09:38:32.018500+0000","last_peered":"2023-10-14T09:38:32.018500+0000","last_clean":"2023-10-14T09:38:32.018500+0000","last_became_active":"2023-10-14T09:38:31.029712+0000","last_became_peered":"2023-10-14T09:38:31.029712+0000","last_unstale":"2023-10-14T09:38:32.018500+0000","last_undegraded":"2023-10-14T09:38:32.018500+0000","last_fullsized":"2023-10-14T09:38:32.018500+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:12.059563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345293+0000","last_change":"2023-10-14T09:38:31.023504+0000","last_active":"2023-10-14T09:38:32.345293+0000","last_peered":"2023-10-14T09:38:32.345293+0000","last_clean":"2023-10-14T09:38:32.345293+0000","last_became_active":"2023-10-14T09:38:31.023251+0000","last_became_peered":"2023-10-14T09:38:31.023251+0000","last_unstale":"2023-10-14T09:38:32.345293+0000","last_undegraded":"2023-10-14T09:38:32.345293+0000","last_fullsized":"2023-10-14T09:38:32.345293+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:29.053068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342651+0000","last_change":"2023-10-14T09:38:31.011612+0000","last_active":"2023-10-14T09:38:32.342651+0000","last_peered":"2023-10-14T09:38:32.342651+0000","last_clean":"2023-10-14T09:38:32.342651+0000","last_became_active":"2023-10-14T09:38:31.010860+0000","last_became_peered":"2023-10-14T09:38:31.010860+0000","last_unstale":"2023-10-14T09:38:32.342651+0000","last_undegraded":"2023-10-14T09:38:32.342651+0000","last_fullsized":"2023-10-14T09:38:32.342651+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:54:32.085213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344876+0000","last_change":"2023-10-14T09:38:31.023722+0000","last_active":"2023-10-14T09:38:32.344876+0000","last_peered":"2023-10-14T09:38:32.344876+0000","last_clean":"2023-10-14T09:38:32.344876+0000","last_became_active":"2023-10-14T09:38:31.023469+0000","last_became_peered":"2023-10-14T09:38:31.023469+0000","last_unstale":"2023-10-14T09:38:32.344876+0000","last_undegraded":"2023-10-14T09:38:32.344876+0000","last_fullsized":"2023-10-14T09:38:32.344876+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:26:03.834483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344738+0000","last_change":"2023-10-14T09:38:31.028525+0000","last_active":"2023-10-14T09:38:32.344738+0000","last_peered":"2023-10-14T09:38:32.344738+0000","last_clean":"2023-10-14T09:38:32.344738+0000","last_became_active":"2023-10-14T09:38:31.026660+0000","last_became_peered":"2023-10-14T09:38:31.026660+0000","last_unstale":"2023-10-14T09:38:32.344738+0000","last_undegraded":"2023-10-14T09:38:32.344738+0000","last_fullsized":"2023-10-14T09:38:32.344738+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:29:12.633954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344629+0000","last_change":"2023-10-14T09:38:31.026064+0000","last_active":"2023-10-14T09:38:32.344629+0000","last_peered":"2023-10-14T09:38:32.344629+0000","last_clean":"2023-10-14T09:38:32.344629+0000","last_became_active":"2023-10-14T09:38:31.025680+0000","last_became_peered":"2023-10-14T09:38:31.025680+0000","last_unstale":"2023-10-14T09:38:32.344629+0000","last_undegraded":"2023-10-14T09:38:32.344629+0000","last_fullsized":"2023-10-14T09:38:32.344629+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:05:14.584003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343991+0000","last_change":"2023-10-14T09:38:31.022957+0000","last_active":"2023-10-14T09:38:32.343991+0000","last_peered":"2023-10-14T09:38:32.343991+0000","last_clean":"2023-10-14T09:38:32.343991+0000","last_became_active":"2023-10-14T09:38:31.022641+0000","last_became_peered":"2023-10-14T09:38:31.022641+0000","last_unstale":"2023-10-14T09:38:32.343991+0000","last_undegraded":"2023-10-14T09:38:32.343991+0000","last_fullsized":"2023-10-14T09:38:32.343991+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:08:08.601763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.018402+0000","last_change":"2023-10-14T09:38:31.031585+0000","last_active":"2023-10-14T09:38:32.018402+0000","last_peered":"2023-10-14T09:38:32.018402+0000","last_clean":"2023-10-14T09:38:32.018402+0000","last_became_active":"2023-10-14T09:38:31.031302+0000","last_became_peered":"2023-10-14T09:38:31.031302+0000","last_unstale":"2023-10-14T09:38:32.018402+0000","last_undegraded":"2023-10-14T09:38:32.018402+0000","last_fullsized":"2023-10-14T09:38:32.018402+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:37:07.904425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341801+0000","last_change":"2023-10-14T09:38:31.029845+0000","last_active":"2023-10-14T09:38:32.341801+0000","last_peered":"2023-10-14T09:38:32.341801+0000","last_clean":"2023-10-14T09:38:32.341801+0000","last_became_active":"2023-10-14T09:38:31.029493+0000","last_became_peered":"2023-10-14T09:38:31.029493+0000","last_unstale":"2023-10-14T09:38:32.341801+0000","last_undegraded":"2023-10-14T09:38:32.341801+0000","last_fullsized":"2023-10-14T09:38:32.341801+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:05:14.584003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.020011+0000","last_change":"2023-10-14T09:38:31.025533+0000","last_active":"2023-10-14T09:38:32.020011+0000","last_peered":"2023-10-14T09:38:32.020011+0000","last_clean":"2023-10-14T09:38:32.020011+0000","last_became_active":"2023-10-14T09:38:31.025243+0000","last_became_peered":"2023-10-14T09:38:31.025243+0000","last_unstale":"2023-10-14T09:38:32.020011+0000","last_undegraded":"2023-10-14T09:38:32.020011+0000","last_fullsized":"2023-10-14T09:38:32.020011+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:32:55.434705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341995+0000","last_change":"2023-10-14T09:38:31.028763+0000","last_active":"2023-10-14T09:38:32.341995+0000","last_peered":"2023-10-14T09:38:32.341995+0000","last_clean":"2023-10-14T09:38:32.341995+0000","last_became_active":"2023-10-14T09:38:31.028420+0000","last_became_peered":"2023-10-14T09:38:31.028420+0000","last_unstale":"2023-10-14T09:38:32.341995+0000","last_undegraded":"2023-10-14T09:38:32.341995+0000","last_fullsized":"2023-10-14T09:38:32.341995+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:26:03.834483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345961+0000","last_change":"2023-10-14T09:38:31.024908+0000","last_active":"2023-10-14T09:38:32.345961+0000","last_peered":"2023-10-14T09:38:32.345961+0000","last_clean":"2023-10-14T09:38:32.345961+0000","last_became_active":"2023-10-14T09:38:31.023482+0000","last_became_peered":"2023-10-14T09:38:31.023482+0000","last_unstale":"2023-10-14T09:38:32.345961+0000","last_undegraded":"2023-10-14T09:38:32.345961+0000","last_fullsized":"2023-10-14T09:38:32.345961+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:14:59.816409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"35'4","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.048326+0000","last_change":"2023-10-14T09:38:30.031689+0000","last_active":"2023-10-14T09:38:31.048326+0000","last_peered":"2023-10-14T09:38:31.048326+0000","last_clean":"2023-10-14T09:38:31.048326+0000","last_became_active":"2023-10-14T09:38:30.031374+0000","last_became_peered":"2023-10-14T09:38:30.031374+0000","last_unstale":"2023-10-14T09:38:31.048326+0000","last_undegraded":"2023-10-14T09:38:31.048326+0000","last_fullsized":"2023-10-14T09:38:31.048326+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:32.881121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.019773+0000","last_change":"2023-10-14T09:38:31.026729+0000","last_active":"2023-10-14T09:38:32.019773+0000","last_peered":"2023-10-14T09:38:32.019773+0000","last_clean":"2023-10-14T09:38:32.019773+0000","last_became_active":"2023-10-14T09:38:31.026414+0000","last_became_peered":"2023-10-14T09:38:31.026414+0000","last_unstale":"2023-10-14T09:38:32.019773+0000","last_undegraded":"2023-10-14T09:38:32.019773+0000","last_fullsized":"2023-10-14T09:38:32.019773+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:09.182708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"35'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345785+0000","last_change":"2023-10-14T09:38:30.025206+0000","last_active":"2023-10-14T09:38:32.345785+0000","last_peered":"2023-10-14T09:38:32.345785+0000","last_clean":"2023-10-14T09:38:32.345785+0000","last_became_active":"2023-10-14T09:38:30.024910+0000","last_became_peered":"2023-10-14T09:38:30.024910+0000","last_unstale":"2023-10-14T09:38:32.345785+0000","last_undegraded":"2023-10-14T09:38:32.345785+0000","last_fullsized":"2023-10-14T09:38:32.345785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:35:31.581556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.018785+0000","last_change":"2023-10-14T09:38:31.030098+0000","last_active":"2023-10-14T09:38:32.018785+0000","last_peered":"2023-10-14T09:38:32.018785+0000","last_clean":"2023-10-14T09:38:32.018785+0000","last_became_active":"2023-10-14T09:38:31.029815+0000","last_became_peered":"2023-10-14T09:38:31.029815+0000","last_unstale":"2023-10-14T09:38:32.018785+0000","last_undegraded":"2023-10-14T09:38:32.018785+0000","last_fullsized":"2023-10-14T09:38:32.018785+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:23:27.986420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.041830+0000","last_change":"2023-10-14T09:38:30.017782+0000","last_active":"2023-10-14T09:38:31.041830+0000","last_peered":"2023-10-14T09:38:31.041830+0000","last_clean":"2023-10-14T09:38:31.041830+0000","last_became_active":"2023-10-14T09:38:30.017602+0000","last_became_peered":"2023-10-14T09:38:30.017602+0000","last_unstale":"2023-10-14T09:38:31.041830+0000","last_undegraded":"2023-10-14T09:38:31.041830+0000","last_fullsized":"2023-10-14T09:38:31.041830+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:34.119874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344746+0000","last_change":"2023-10-14T09:38:31.028602+0000","last_active":"2023-10-14T09:38:32.344746+0000","last_peered":"2023-10-14T09:38:32.344746+0000","last_clean":"2023-10-14T09:38:32.344746+0000","last_became_active":"2023-10-14T09:38:31.025645+0000","last_became_peered":"2023-10-14T09:38:31.025645+0000","last_unstale":"2023-10-14T09:38:32.344746+0000","last_undegraded":"2023-10-14T09:38:32.344746+0000","last_fullsized":"2023-10-14T09:38:32.344746+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:23:43.555148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.043829+0000","last_change":"2023-10-14T09:38:30.031331+0000","last_active":"2023-10-14T09:38:31.043829+0000","last_peered":"2023-10-14T09:38:31.043829+0000","last_clean":"2023-10-14T09:38:31.043829+0000","last_became_active":"2023-10-14T09:38:30.030556+0000","last_became_peered":"2023-10-14T09:38:30.030556+0000","last_unstale":"2023-10-14T09:38:31.043829+0000","last_undegraded":"2023-10-14T09:38:31.043829+0000","last_fullsized":"2023-10-14T09:38:31.043829+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:00:27.300436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342154+0000","last_change":"2023-10-14T09:38:31.029169+0000","last_active":"2023-10-14T09:38:32.342154+0000","last_peered":"2023-10-14T09:38:32.342154+0000","last_clean":"2023-10-14T09:38:32.342154+0000","last_became_active":"2023-10-14T09:38:31.028887+0000","last_became_peered":"2023-10-14T09:38:31.028887+0000","last_unstale":"2023-10-14T09:38:32.342154+0000","last_undegraded":"2023-10-14T09:38:32.342154+0000","last_fullsized":"2023-10-14T09:38:32.342154+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:05:40.247862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.043614+0000","last_change":"2023-10-14T09:38:30.026023+0000","last_active":"2023-10-14T09:38:31.043614+0000","last_peered":"2023-10-14T09:38:31.043614+0000","last_clean":"2023-10-14T09:38:31.043614+0000","last_became_active":"2023-10-14T09:38:30.025732+0000","last_became_peered":"2023-10-14T09:38:30.025732+0000","last_unstale":"2023-10-14T09:38:31.043614+0000","last_undegraded":"2023-10-14T09:38:31.043614+0000","last_fullsized":"2023-10-14T09:38:31.043614+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:30:03.089452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343662+0000","last_change":"2023-10-14T09:38:31.020554+0000","last_active":"2023-10-14T09:38:32.343662+0000","last_peered":"2023-10-14T09:38:32.343662+0000","last_clean":"2023-10-14T09:38:32.343662+0000","last_became_active":"2023-10-14T09:38:31.020184+0000","last_became_peered":"2023-10-14T09:38:31.020184+0000","last_unstale":"2023-10-14T09:38:32.343662+0000","last_undegraded":"2023-10-14T09:38:32.343662+0000","last_fullsized":"2023-10-14T09:38:32.343662+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:26:34.407953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.043817+0000","last_change":"2023-10-14T09:38:30.031642+0000","last_active":"2023-10-14T09:38:31.043817+0000","last_peered":"2023-10-14T09:38:31.043817+0000","last_clean":"2023-10-14T09:38:31.043817+0000","last_became_active":"2023-10-14T09:38:30.031356+0000","last_became_peered":"2023-10-14T09:38:30.031356+0000","last_unstale":"2023-10-14T09:38:31.043817+0000","last_undegraded":"2023-10-14T09:38:31.043817+0000","last_fullsized":"2023-10-14T09:38:31.043817+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:36:20.364439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.017009+0000","last_change":"2023-10-14T09:38:31.024293+0000","last_active":"2023-10-14T09:38:32.017009+0000","last_peered":"2023-10-14T09:38:32.017009+0000","last_clean":"2023-10-14T09:38:32.017009+0000","last_became_active":"2023-10-14T09:38:31.023990+0000","last_became_peered":"2023-10-14T09:38:31.023990+0000","last_unstale":"2023-10-14T09:38:32.017009+0000","last_undegraded":"2023-10-14T09:38:32.017009+0000","last_fullsized":"2023-10-14T09:38:32.017009+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:18.314768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.010745+0000","last_change":"2023-10-14T09:38:30.021813+0000","last_active":"2023-10-14T09:38:31.010745+0000","last_peered":"2023-10-14T09:38:31.010745+0000","last_clean":"2023-10-14T09:38:31.010745+0000","last_became_active":"2023-10-14T09:38:30.019461+0000","last_became_peered":"2023-10-14T09:38:30.019461+0000","last_unstale":"2023-10-14T09:38:31.010745+0000","last_undegraded":"2023-10-14T09:38:31.010745+0000","last_fullsized":"2023-10-14T09:38:31.010745+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:04:04.485468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342676+0000","last_change":"2023-10-14T09:38:31.016796+0000","last_active":"2023-10-14T09:38:32.342676+0000","last_peered":"2023-10-14T09:38:32.342676+0000","last_clean":"2023-10-14T09:38:32.342676+0000","last_became_active":"2023-10-14T09:38:31.016514+0000","last_became_peered":"2023-10-14T09:38:31.016514+0000","last_unstale":"2023-10-14T09:38:32.342676+0000","last_undegraded":"2023-10-14T09:38:32.342676+0000","last_fullsized":"2023-10-14T09:38:32.342676+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:23:27.986420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.006074+0000","last_change":"2023-10-14T09:38:30.035807+0000","last_active":"2023-10-14T09:38:31.006074+0000","last_peered":"2023-10-14T09:38:31.006074+0000","last_clean":"2023-10-14T09:38:31.006074+0000","last_became_active":"2023-10-14T09:38:30.035470+0000","last_became_peered":"2023-10-14T09:38:30.035470+0000","last_unstale":"2023-10-14T09:38:31.006074+0000","last_undegraded":"2023-10-14T09:38:31.006074+0000","last_fullsized":"2023-10-14T09:38:31.006074+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:38:26.466223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344016+0000","last_change":"2023-10-14T09:38:31.026082+0000","last_active":"2023-10-14T09:38:32.344016+0000","last_peered":"2023-10-14T09:38:32.344016+0000","last_clean":"2023-10-14T09:38:32.344016+0000","last_became_active":"2023-10-14T09:38:31.025794+0000","last_became_peered":"2023-10-14T09:38:31.025794+0000","last_unstale":"2023-10-14T09:38:32.344016+0000","last_undegraded":"2023-10-14T09:38:32.344016+0000","last_fullsized":"2023-10-14T09:38:32.344016+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:08:12.498616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.013494+0000","last_change":"2023-10-14T09:38:30.014502+0000","last_active":"2023-10-14T09:38:31.013494+0000","last_peered":"2023-10-14T09:38:31.013494+0000","last_clean":"2023-10-14T09:38:31.013494+0000","last_became_active":"2023-10-14T09:38:30.014042+0000","last_became_peered":"2023-10-14T09:38:30.014042+0000","last_unstale":"2023-10-14T09:38:31.013494+0000","last_undegraded":"2023-10-14T09:38:31.013494+0000","last_fullsized":"2023-10-14T09:38:31.013494+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:02:19.916430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343306+0000","last_change":"2023-10-14T09:38:31.021923+0000","last_active":"2023-10-14T09:38:32.343306+0000","last_peered":"2023-10-14T09:38:32.343306+0000","last_clean":"2023-10-14T09:38:32.343306+0000","last_became_active":"2023-10-14T09:38:31.021662+0000","last_became_peered":"2023-10-14T09:38:31.021662+0000","last_unstale":"2023-10-14T09:38:32.343306+0000","last_undegraded":"2023-10-14T09:38:32.343306+0000","last_fullsized":"2023-10-14T09:38:32.343306+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:18:08.718330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345934+0000","last_change":"2023-10-14T09:38:30.028000+0000","last_active":"2023-10-14T09:38:32.345934+0000","last_peered":"2023-10-14T09:38:32.345934+0000","last_clean":"2023-10-14T09:38:32.345934+0000","last_became_active":"2023-10-14T09:38:30.027696+0000","last_became_peered":"2023-10-14T09:38:30.027696+0000","last_unstale":"2023-10-14T09:38:32.345934+0000","last_undegraded":"2023-10-14T09:38:32.345934+0000","last_fullsized":"2023-10-14T09:38:32.345934+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:11.668342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343027+0000","last_change":"2023-10-14T09:38:31.026933+0000","last_active":"2023-10-14T09:38:32.343027+0000","last_peered":"2023-10-14T09:38:32.343027+0000","last_clean":"2023-10-14T09:38:32.343027+0000","last_became_active":"2023-10-14T09:38:31.026676+0000","last_became_peered":"2023-10-14T09:38:31.026676+0000","last_unstale":"2023-10-14T09:38:32.343027+0000","last_undegraded":"2023-10-14T09:38:32.343027+0000","last_fullsized":"2023-10-14T09:38:32.343027+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:39:19.700408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"35'3","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344090+0000","last_change":"2023-10-14T09:38:30.032207+0000","last_active":"2023-10-14T09:38:32.344090+0000","last_peered":"2023-10-14T09:38:32.344090+0000","last_clean":"2023-10-14T09:38:32.344090+0000","last_became_active":"2023-10-14T09:38:30.031907+0000","last_became_peered":"2023-10-14T09:38:30.031907+0000","last_unstale":"2023-10-14T09:38:32.344090+0000","last_undegraded":"2023-10-14T09:38:32.344090+0000","last_fullsized":"2023-10-14T09:38:32.344090+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:59:09.031590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343866+0000","last_change":"2023-10-14T09:38:31.021126+0000","last_active":"2023-10-14T09:38:32.343866+0000","last_peered":"2023-10-14T09:38:32.343866+0000","last_clean":"2023-10-14T09:38:32.343866+0000","last_became_active":"2023-10-14T09:38:31.020267+0000","last_became_peered":"2023-10-14T09:38:31.020267+0000","last_unstale":"2023-10-14T09:38:32.343866+0000","last_undegraded":"2023-10-14T09:38:32.343866+0000","last_fullsized":"2023-10-14T09:38:32.343866+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:29:07.359293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"35'6","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.048294+0000","last_change":"2023-10-14T09:38:30.020149+0000","last_active":"2023-10-14T09:38:31.048294+0000","last_peered":"2023-10-14T09:38:31.048294+0000","last_clean":"2023-10-14T09:38:31.048294+0000","last_became_active":"2023-10-14T09:38:30.019839+0000","last_became_peered":"2023-10-14T09:38:30.019839+0000","last_unstale":"2023-10-14T09:38:31.048294+0000","last_undegraded":"2023-10-14T09:38:31.048294+0000","last_fullsized":"2023-10-14T09:38:31.048294+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:54.807431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342588+0000","last_change":"2023-10-14T09:38:31.020699+0000","last_active":"2023-10-14T09:38:32.342588+0000","last_peered":"2023-10-14T09:38:32.342588+0000","last_clean":"2023-10-14T09:38:32.342588+0000","last_became_active":"2023-10-14T09:38:31.020347+0000","last_became_peered":"2023-10-14T09:38:31.020347+0000","last_unstale":"2023-10-14T09:38:32.342588+0000","last_undegraded":"2023-10-14T09:38:32.342588+0000","last_fullsized":"2023-10-14T09:38:32.342588+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:12.059563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.042951+0000","last_change":"2023-10-14T09:38:30.035740+0000","last_active":"2023-10-14T09:38:31.042951+0000","last_peered":"2023-10-14T09:38:31.042951+0000","last_clean":"2023-10-14T09:38:31.042951+0000","last_became_active":"2023-10-14T09:38:30.035424+0000","last_became_peered":"2023-10-14T09:38:30.035424+0000","last_unstale":"2023-10-14T09:38:31.042951+0000","last_undegraded":"2023-10-14T09:38:31.042951+0000","last_fullsized":"2023-10-14T09:38:31.042951+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:13:05.075908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342770+0000","last_change":"2023-10-14T09:38:31.028147+0000","last_active":"2023-10-14T09:38:32.342770+0000","last_peered":"2023-10-14T09:38:32.342770+0000","last_clean":"2023-10-14T09:38:32.342770+0000","last_became_active":"2023-10-14T09:38:31.027759+0000","last_became_peered":"2023-10-14T09:38:31.027759+0000","last_unstale":"2023-10-14T09:38:32.342770+0000","last_undegraded":"2023-10-14T09:38:32.342770+0000","last_fullsized":"2023-10-14T09:38:32.342770+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:28.333786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.004907+0000","last_change":"2023-10-14T09:38:30.025921+0000","last_active":"2023-10-14T09:38:31.004907+0000","last_peered":"2023-10-14T09:38:31.004907+0000","last_clean":"2023-10-14T09:38:31.004907+0000","last_became_active":"2023-10-14T09:38:30.025712+0000","last_became_peered":"2023-10-14T09:38:30.025712+0000","last_unstale":"2023-10-14T09:38:31.004907+0000","last_undegraded":"2023-10-14T09:38:31.004907+0000","last_fullsized":"2023-10-14T09:38:31.004907+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:13:05.075908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342190+0000","last_change":"2023-10-14T09:38:31.037744+0000","last_active":"2023-10-14T09:38:32.342190+0000","last_peered":"2023-10-14T09:38:32.342190+0000","last_clean":"2023-10-14T09:38:32.342190+0000","last_became_active":"2023-10-14T09:38:31.036628+0000","last_became_peered":"2023-10-14T09:38:31.036628+0000","last_unstale":"2023-10-14T09:38:32.342190+0000","last_undegraded":"2023-10-14T09:38:32.342190+0000","last_fullsized":"2023-10-14T09:38:32.342190+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:55.821527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.010492+0000","last_change":"2023-10-14T09:38:30.022460+0000","last_active":"2023-10-14T09:38:31.010492+0000","last_peered":"2023-10-14T09:38:31.010492+0000","last_clean":"2023-10-14T09:38:31.010492+0000","last_became_active":"2023-10-14T09:38:30.022182+0000","last_became_peered":"2023-10-14T09:38:30.022182+0000","last_unstale":"2023-10-14T09:38:31.010492+0000","last_undegraded":"2023-10-14T09:38:31.010492+0000","last_fullsized":"2023-10-14T09:38:31.010492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:45.031149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.020009+0000","last_change":"2023-10-14T09:38:31.039814+0000","last_active":"2023-10-14T09:38:32.020009+0000","last_peered":"2023-10-14T09:38:32.020009+0000","last_clean":"2023-10-14T09:38:32.020009+0000","last_became_active":"2023-10-14T09:38:31.039518+0000","last_became_peered":"2023-10-14T09:38:31.039518+0000","last_unstale":"2023-10-14T09:38:32.020009+0000","last_undegraded":"2023-10-14T09:38:32.020009+0000","last_fullsized":"2023-10-14T09:38:32.020009+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:22.613894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"35'8","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.046908+0000","last_change":"2023-10-14T09:38:30.015580+0000","last_active":"2023-10-14T09:38:31.046908+0000","last_peered":"2023-10-14T09:38:31.046908+0000","last_clean":"2023-10-14T09:38:31.046908+0000","last_became_active":"2023-10-14T09:38:30.014562+0000","last_became_peered":"2023-10-14T09:38:30.014562+0000","last_unstale":"2023-10-14T09:38:31.046908+0000","last_undegraded":"2023-10-14T09:38:31.046908+0000","last_fullsized":"2023-10-14T09:38:31.046908+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:27.669263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.018236+0000","last_change":"2023-10-14T09:38:31.026009+0000","last_active":"2023-10-14T09:38:32.018236+0000","last_peered":"2023-10-14T09:38:32.018236+0000","last_clean":"2023-10-14T09:38:32.018236+0000","last_became_active":"2023-10-14T09:38:31.025665+0000","last_became_peered":"2023-10-14T09:38:31.025665+0000","last_unstale":"2023-10-14T09:38:32.018236+0000","last_undegraded":"2023-10-14T09:38:32.018236+0000","last_fullsized":"2023-10-14T09:38:32.018236+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:16:06.675198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.046534+0000","last_change":"2023-10-14T09:38:30.027344+0000","last_active":"2023-10-14T09:38:31.046534+0000","last_peered":"2023-10-14T09:38:31.046534+0000","last_clean":"2023-10-14T09:38:31.046534+0000","last_became_active":"2023-10-14T09:38:30.025331+0000","last_became_peered":"2023-10-14T09:38:30.025331+0000","last_unstale":"2023-10-14T09:38:31.046534+0000","last_undegraded":"2023-10-14T09:38:31.046534+0000","last_fullsized":"2023-10-14T09:38:31.046534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:16:05.661101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344384+0000","last_change":"2023-10-14T09:38:31.033233+0000","last_active":"2023-10-14T09:38:32.344384+0000","last_peered":"2023-10-14T09:38:32.344384+0000","last_clean":"2023-10-14T09:38:32.344384+0000","last_became_active":"2023-10-14T09:38:31.032912+0000","last_became_peered":"2023-10-14T09:38:31.032912+0000","last_unstale":"2023-10-14T09:38:32.344384+0000","last_undegraded":"2023-10-14T09:38:32.344384+0000","last_fullsized":"2023-10-14T09:38:32.344384+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:52:28.791327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.043036+0000","last_change":"2023-10-14T09:38:30.035623+0000","last_active":"2023-10-14T09:38:31.043036+0000","last_peered":"2023-10-14T09:38:31.043036+0000","last_clean":"2023-10-14T09:38:31.043036+0000","last_became_active":"2023-10-14T09:38:30.035283+0000","last_became_peered":"2023-10-14T09:38:30.035283+0000","last_unstale":"2023-10-14T09:38:31.043036+0000","last_undegraded":"2023-10-14T09:38:31.043036+0000","last_fullsized":"2023-10-14T09:38:31.043036+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:32:09.938003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344424+0000","last_change":"2023-10-14T09:38:31.035370+0000","last_active":"2023-10-14T09:38:32.344424+0000","last_peered":"2023-10-14T09:38:32.344424+0000","last_clean":"2023-10-14T09:38:32.344424+0000","last_became_active":"2023-10-14T09:38:31.034768+0000","last_became_peered":"2023-10-14T09:38:31.034768+0000","last_unstale":"2023-10-14T09:38:32.344424+0000","last_undegraded":"2023-10-14T09:38:32.344424+0000","last_fullsized":"2023-10-14T09:38:32.344424+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:28.683360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.045638+0000","last_change":"2023-10-14T09:38:30.032461+0000","last_active":"2023-10-14T09:38:31.045638+0000","last_peered":"2023-10-14T09:38:31.045638+0000","last_clean":"2023-10-14T09:38:31.045638+0000","last_became_active":"2023-10-14T09:38:30.030927+0000","last_became_peered":"2023-10-14T09:38:30.030927+0000","last_unstale":"2023-10-14T09:38:31.045638+0000","last_undegraded":"2023-10-14T09:38:31.045638+0000","last_fullsized":"2023-10-14T09:38:31.045638+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:18:05.378855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341272+0000","last_change":"2023-10-14T09:38:31.026882+0000","last_active":"2023-10-14T09:38:32.341272+0000","last_peered":"2023-10-14T09:38:32.341272+0000","last_clean":"2023-10-14T09:38:32.341272+0000","last_became_active":"2023-10-14T09:38:31.026615+0000","last_became_peered":"2023-10-14T09:38:31.026615+0000","last_unstale":"2023-10-14T09:38:32.341272+0000","last_undegraded":"2023-10-14T09:38:32.341272+0000","last_fullsized":"2023-10-14T09:38:32.341272+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:39:04.991127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.013395+0000","last_change":"2023-10-14T09:38:30.028028+0000","last_active":"2023-10-14T09:38:31.013395+0000","last_peered":"2023-10-14T09:38:31.013395+0000","last_clean":"2023-10-14T09:38:31.013395+0000","last_became_active":"2023-10-14T09:38:30.026795+0000","last_became_peered":"2023-10-14T09:38:30.026795+0000","last_unstale":"2023-10-14T09:38:31.013395+0000","last_undegraded":"2023-10-14T09:38:31.013395+0000","last_fullsized":"2023-10-14T09:38:31.013395+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:08.168611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341771+0000","last_change":"2023-10-14T09:38:31.032201+0000","last_active":"2023-10-14T09:38:32.341771+0000","last_peered":"2023-10-14T09:38:32.341771+0000","last_clean":"2023-10-14T09:38:32.341771+0000","last_became_active":"2023-10-14T09:38:31.031921+0000","last_became_peered":"2023-10-14T09:38:31.031921+0000","last_unstale":"2023-10-14T09:38:32.341771+0000","last_undegraded":"2023-10-14T09:38:32.341771+0000","last_fullsized":"2023-10-14T09:38:32.341771+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:30:04.103548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345526+0000","last_change":"2023-10-14T09:38:30.021600+0000","last_active":"2023-10-14T09:38:32.345526+0000","last_peered":"2023-10-14T09:38:32.345526+0000","last_clean":"2023-10-14T09:38:32.345526+0000","last_became_active":"2023-10-14T09:38:30.021312+0000","last_became_peered":"2023-10-14T09:38:30.021312+0000","last_unstale":"2023-10-14T09:38:32.345526+0000","last_undegraded":"2023-10-14T09:38:32.345526+0000","last_fullsized":"2023-10-14T09:38:32.345526+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:55:23.928233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341541+0000","last_change":"2023-10-14T09:38:31.023661+0000","last_active":"2023-10-14T09:38:32.341541+0000","last_peered":"2023-10-14T09:38:32.341541+0000","last_clean":"2023-10-14T09:38:32.341541+0000","last_became_active":"2023-10-14T09:38:31.023340+0000","last_became_peered":"2023-10-14T09:38:31.023340+0000","last_unstale":"2023-10-14T09:38:32.341541+0000","last_undegraded":"2023-10-14T09:38:32.341541+0000","last_fullsized":"2023-10-14T09:38:32.341541+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:49:04.384325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.016548+0000","last_change":"2023-10-14T09:38:30.033606+0000","last_active":"2023-10-14T09:38:31.016548+0000","last_peered":"2023-10-14T09:38:31.016548+0000","last_clean":"2023-10-14T09:38:31.016548+0000","last_became_active":"2023-10-14T09:38:30.033284+0000","last_became_peered":"2023-10-14T09:38:30.033284+0000","last_unstale":"2023-10-14T09:38:31.016548+0000","last_undegraded":"2023-10-14T09:38:31.016548+0000","last_fullsized":"2023-10-14T09:38:31.016548+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:26:23.409048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341209+0000","last_change":"2023-10-14T09:38:31.020259+0000","last_active":"2023-10-14T09:38:32.341209+0000","last_peered":"2023-10-14T09:38:32.341209+0000","last_clean":"2023-10-14T09:38:32.341209+0000","last_became_active":"2023-10-14T09:38:31.019732+0000","last_became_peered":"2023-10-14T09:38:31.019732+0000","last_unstale":"2023-10-14T09:38:32.341209+0000","last_undegraded":"2023-10-14T09:38:32.341209+0000","last_fullsized":"2023-10-14T09:38:32.341209+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:39:13.767140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.009471+0000","last_change":"2023-10-14T09:38:30.032802+0000","last_active":"2023-10-14T09:38:31.009471+0000","last_peered":"2023-10-14T09:38:31.009471+0000","last_clean":"2023-10-14T09:38:31.009471+0000","last_became_active":"2023-10-14T09:38:30.032500+0000","last_became_peered":"2023-10-14T09:38:30.032500+0000","last_unstale":"2023-10-14T09:38:31.009471+0000","last_undegraded":"2023-10-14T09:38:31.009471+0000","last_fullsized":"2023-10-14T09:38:31.009471+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:32.881121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342037+0000","last_change":"2023-10-14T09:38:31.030686+0000","last_active":"2023-10-14T09:38:32.342037+0000","last_peered":"2023-10-14T09:38:32.342037+0000","last_clean":"2023-10-14T09:38:32.342037+0000","last_became_active":"2023-10-14T09:38:31.030399+0000","last_became_peered":"2023-10-14T09:38:31.030399+0000","last_unstale":"2023-10-14T09:38:32.342037+0000","last_undegraded":"2023-10-14T09:38:32.342037+0000","last_fullsized":"2023-10-14T09:38:32.342037+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:35.133971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342880+0000","last_change":"2023-10-14T09:38:30.029157+0000","last_active":"2023-10-14T09:38:32.342880+0000","last_peered":"2023-10-14T09:38:32.342880+0000","last_clean":"2023-10-14T09:38:32.342880+0000","last_became_active":"2023-10-14T09:38:30.028540+0000","last_became_peered":"2023-10-14T09:38:30.028540+0000","last_unstale":"2023-10-14T09:38:32.342880+0000","last_undegraded":"2023-10-14T09:38:32.342880+0000","last_fullsized":"2023-10-14T09:38:32.342880+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:11.668342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341394+0000","last_change":"2023-10-14T09:38:31.016140+0000","last_active":"2023-10-14T09:38:32.341394+0000","last_peered":"2023-10-14T09:38:32.341394+0000","last_clean":"2023-10-14T09:38:32.341394+0000","last_became_active":"2023-10-14T09:38:31.015654+0000","last_became_peered":"2023-10-14T09:38:31.015654+0000","last_unstale":"2023-10-14T09:38:32.341394+0000","last_undegraded":"2023-10-14T09:38:32.341394+0000","last_fullsized":"2023-10-14T09:38:32.341394+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:13:35.685099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.043592+0000","last_change":"2023-10-14T09:38:30.030703+0000","last_active":"2023-10-14T09:38:31.043592+0000","last_peered":"2023-10-14T09:38:31.043592+0000","last_clean":"2023-10-14T09:38:31.043592+0000","last_became_active":"2023-10-14T09:38:30.030387+0000","last_became_peered":"2023-10-14T09:38:30.030387+0000","last_unstale":"2023-10-14T09:38:31.043592+0000","last_undegraded":"2023-10-14T09:38:31.043592+0000","last_fullsized":"2023-10-14T09:38:31.043592+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:37:06.890328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344251+0000","last_change":"2023-10-14T09:38:31.024132+0000","last_active":"2023-10-14T09:38:32.344251+0000","last_peered":"2023-10-14T09:38:32.344251+0000","last_clean":"2023-10-14T09:38:32.344251+0000","last_became_active":"2023-10-14T09:38:31.023043+0000","last_became_peered":"2023-10-14T09:38:31.023043+0000","last_unstale":"2023-10-14T09:38:32.344251+0000","last_undegraded":"2023-10-14T09:38:32.344251+0000","last_fullsized":"2023-10-14T09:38:32.344251+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:26:18.683878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:33.929347+0000","last_change":"2023-10-14T09:38:30.024854+0000","last_active":"2023-10-14T09:38:33.929347+0000","last_peered":"2023-10-14T09:38:33.929347+0000","last_clean":"2023-10-14T09:38:33.929347+0000","last_became_active":"2023-10-14T09:38:30.024536+0000","last_became_peered":"2023-10-14T09:38:30.024536+0000","last_unstale":"2023-10-14T09:38:33.929347+0000","last_undegraded":"2023-10-14T09:38:33.929347+0000","last_fullsized":"2023-10-14T09:38:33.929347+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:47:13.277147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345881+0000","last_change":"2023-10-14T09:38:31.024182+0000","last_active":"2023-10-14T09:38:32.345881+0000","last_peered":"2023-10-14T09:38:32.345881+0000","last_clean":"2023-10-14T09:38:32.345881+0000","last_became_active":"2023-10-14T09:38:31.023855+0000","last_became_peered":"2023-10-14T09:38:31.023855+0000","last_unstale":"2023-10-14T09:38:32.345881+0000","last_undegraded":"2023-10-14T09:38:32.345881+0000","last_fullsized":"2023-10-14T09:38:32.345881+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:59:10.045687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.008529+0000","last_change":"2023-10-14T09:38:30.023306+0000","last_active":"2023-10-14T09:38:31.008529+0000","last_peered":"2023-10-14T09:38:31.008529+0000","last_clean":"2023-10-14T09:38:31.008529+0000","last_became_active":"2023-10-14T09:38:30.023068+0000","last_became_peered":"2023-10-14T09:38:30.023068+0000","last_unstale":"2023-10-14T09:38:31.008529+0000","last_undegraded":"2023-10-14T09:38:31.008529+0000","last_fullsized":"2023-10-14T09:38:31.008529+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:21.599798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.019849+0000","last_change":"2023-10-14T09:38:31.027123+0000","last_active":"2023-10-14T09:38:32.019849+0000","last_peered":"2023-10-14T09:38:32.019849+0000","last_clean":"2023-10-14T09:38:32.019849+0000","last_became_active":"2023-10-14T09:38:31.026838+0000","last_became_peered":"2023-10-14T09:38:31.026838+0000","last_unstale":"2023-10-14T09:38:32.019849+0000","last_undegraded":"2023-10-14T09:38:32.019849+0000","last_fullsized":"2023-10-14T09:38:32.019849+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:18.314768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345598+0000","last_change":"2023-10-14T09:38:30.029783+0000","last_active":"2023-10-14T09:38:32.345598+0000","last_peered":"2023-10-14T09:38:32.345598+0000","last_clean":"2023-10-14T09:38:32.345598+0000","last_became_active":"2023-10-14T09:38:30.029514+0000","last_became_peered":"2023-10-14T09:38:30.029514+0000","last_unstale":"2023-10-14T09:38:32.345598+0000","last_undegraded":"2023-10-14T09:38:32.345598+0000","last_fullsized":"2023-10-14T09:38:32.345598+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:12:06.845824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345460+0000","last_change":"2023-10-14T09:38:31.030071+0000","last_active":"2023-10-14T09:38:32.345460+0000","last_peered":"2023-10-14T09:38:32.345460+0000","last_clean":"2023-10-14T09:38:32.345460+0000","last_became_active":"2023-10-14T09:38:31.029521+0000","last_became_peered":"2023-10-14T09:38:31.029521+0000","last_unstale":"2023-10-14T09:38:32.345460+0000","last_undegraded":"2023-10-14T09:38:32.345460+0000","last_fullsized":"2023-10-14T09:38:32.345460+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:45:03.414149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.005434+0000","last_change":"2023-10-14T09:38:30.030457+0000","last_active":"2023-10-14T09:38:31.005434+0000","last_peered":"2023-10-14T09:38:31.005434+0000","last_clean":"2023-10-14T09:38:31.005434+0000","last_became_active":"2023-10-14T09:38:30.029517+0000","last_became_peered":"2023-10-14T09:38:30.029517+0000","last_unstale":"2023-10-14T09:38:31.005434+0000","last_undegraded":"2023-10-14T09:38:31.005434+0000","last_fullsized":"2023-10-14T09:38:31.005434+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:08.168611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341965+0000","last_change":"2023-10-14T09:38:31.034569+0000","last_active":"2023-10-14T09:38:32.341965+0000","last_peered":"2023-10-14T09:38:32.341965+0000","last_clean":"2023-10-14T09:38:32.341965+0000","last_became_active":"2023-10-14T09:38:31.034300+0000","last_became_peered":"2023-10-14T09:38:31.034300+0000","last_unstale":"2023-10-14T09:38:32.341965+0000","last_undegraded":"2023-10-14T09:38:32.341965+0000","last_fullsized":"2023-10-14T09:38:32.341965+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:55:53.322273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.009658+0000","last_change":"2023-10-14T09:38:30.030715+0000","last_active":"2023-10-14T09:38:31.009658+0000","last_peered":"2023-10-14T09:38:31.009658+0000","last_clean":"2023-10-14T09:38:31.009658+0000","last_became_active":"2023-10-14T09:38:30.030374+0000","last_became_peered":"2023-10-14T09:38:30.030374+0000","last_unstale":"2023-10-14T09:38:31.009658+0000","last_undegraded":"2023-10-14T09:38:31.009658+0000","last_fullsized":"2023-10-14T09:38:31.009658+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:26:23.409048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.017240+0000","last_change":"2023-10-14T09:38:31.033069+0000","last_active":"2023-10-14T09:38:32.017240+0000","last_peered":"2023-10-14T09:38:32.017240+0000","last_clean":"2023-10-14T09:38:32.017240+0000","last_became_active":"2023-10-14T09:38:31.032648+0000","last_became_peered":"2023-10-14T09:38:31.032648+0000","last_unstale":"2023-10-14T09:38:32.017240+0000","last_undegraded":"2023-10-14T09:38:32.017240+0000","last_fullsized":"2023-10-14T09:38:32.017240+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:32:55.434705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.010423+0000","last_change":"2023-10-14T09:38:30.020581+0000","last_active":"2023-10-14T09:38:31.010423+0000","last_peered":"2023-10-14T09:38:31.010423+0000","last_clean":"2023-10-14T09:38:31.010423+0000","last_became_active":"2023-10-14T09:38:30.020321+0000","last_became_peered":"2023-10-14T09:38:30.020321+0000","last_unstale":"2023-10-14T09:38:31.010423+0000","last_undegraded":"2023-10-14T09:38:31.010423+0000","last_fullsized":"2023-10-14T09:38:31.010423+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:23:26.972323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342673+0000","last_change":"2023-10-14T09:38:31.024792+0000","last_active":"2023-10-14T09:38:32.342673+0000","last_peered":"2023-10-14T09:38:32.342673+0000","last_clean":"2023-10-14T09:38:32.342673+0000","last_became_active":"2023-10-14T09:38:31.024478+0000","last_became_peered":"2023-10-14T09:38:31.024478+0000","last_unstale":"2023-10-14T09:38:32.342673+0000","last_undegraded":"2023-10-14T09:38:32.342673+0000","last_fullsized":"2023-10-14T09:38:32.342673+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:49:22.040318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.015743+0000","last_change":"2023-10-14T09:38:30.033668+0000","last_active":"2023-10-14T09:38:31.015743+0000","last_peered":"2023-10-14T09:38:31.015743+0000","last_clean":"2023-10-14T09:38:31.015743+0000","last_became_active":"2023-10-14T09:38:30.033358+0000","last_became_peered":"2023-10-14T09:38:30.033358+0000","last_unstale":"2023-10-14T09:38:31.015743+0000","last_undegraded":"2023-10-14T09:38:31.015743+0000","last_fullsized":"2023-10-14T09:38:31.015743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:30:03.089452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":177,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.016331+0000","last_change":"2023-10-14T09:37:12.368000+0000","last_active":"2023-10-14T09:38:31.016331+0000","last_peered":"2023-10-14T09:38:31.016331+0000","last_clean":"2023-10-14T09:38:31.016331+0000","last_became_active":"2023-10-14T09:37:12.364623+0000","last_became_peered":"2023-10-14T09:37:12.364623+0000","last_unstale":"2023-10-14T09:38:31.016331+0000","last_undegraded":"2023-10-14T09:38:31.016331+0000","last_fullsized":"2023-10-14T09:38:31.016331+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:10.796841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:10.796841+0000","last_clean_scrub_stamp":"2023-10-14T09:37:10.796841+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:48.940536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509460,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":999424,"data_stored":748946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":1.0169999999999999}]},{"osd":1,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.1970000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.075},{"interface":"front","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":1.4219999999999999}]},{"osd":3,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.9060000000000001,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":1.137}]},{"osd":4,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":0.82899999999999996}]},{"osd":5,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":3.0129999999999999,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":0.88},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.4590000000000001}]},{"osd":6,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.4260000000000002,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":1.302},{"interface":"front","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.0710000000000002,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":0.97399999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509462,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":409600,"data_stored":159104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.216}]},{"osd":1,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.2669999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.4540000000000002,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.91400000000000003}]},{"osd":3,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":4.5419999999999998,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":4.2839999999999998,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":1.131}]},{"osd":4,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.5449999999999999},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":1.605}]},{"osd":5,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.7069999999999999,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":1.665}]},{"osd":7,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.6970000000000001},{"interface":"front","average":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.5899999999999999,"5min":2.5899999999999999,"15min":2.5899999999999999},"last":1.4990000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509462,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":409600,"data_stored":158592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":1.621,"5min":1.621,"15min":1.621},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":13.404,"5min":13.404,"15min":13.404},"last":0.67600000000000005},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":9.4640000000000004,"5min":9.4640000000000004,"15min":9.4640000000000004},"last":1.042}]},{"osd":1,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":6.734,"5min":6.734,"15min":6.734},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.504,"5min":1.504,"15min":1.504},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":7.8860000000000001,"5min":7.8860000000000001,"15min":7.8860000000000001},"last":0.60499999999999998}]},{"osd":2,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":1.591,"5min":1.591,"15min":1.591},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":7.8520000000000003,"5min":7.8520000000000003,"15min":7.8520000000000003},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.889,"5min":1.889,"15min":1.889},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":14.609,"5min":14.609,"15min":14.609},"last":1.3260000000000001}]},{"osd":3,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":1.964,"5min":1.964,"15min":1.964},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":15.856,"5min":15.856,"15min":15.856},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":6.1970000000000001,"5min":6.1970000000000001,"15min":6.1970000000000001},"last":0.94799999999999995}]},{"osd":5,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":16.547000000000001,"5min":16.547000000000001,"15min":16.547000000000001},"last":1.091},{"interface":"front","average":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":15.913,"5min":15.913,"15min":15.913},"last":1.4419999999999999}]},{"osd":6,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":2.3029999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":16.481999999999999,"5min":16.481999999999999,"15min":16.481999999999999},"last":1.208},{"interface":"front","average":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":15.956,"5min":15.956,"15min":15.956},"last":1.395}]},{"osd":7,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":6.6520000000000001,"5min":6.6520000000000001,"15min":6.6520000000000001},"last":1.2789999999999999},{"interface":"front","average":{"1min":2.073,"5min":2.073,"15min":2.073},"min":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":10.314,"5min":10.314,"15min":10.314},"last":1.3640000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":160122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.57899999999999996}]},{"osd":1,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.627},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.7349999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":0.54000000000000004}]},{"osd":2,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":2.77,"5min":2.77,"15min":2.77},"last":0.87}]},{"osd":4,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":0.998},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":2.153,"5min":2.153,"15min":2.153},"last":1.125}]},{"osd":5,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":3.6469999999999998,"5min":3.6469999999999998,"15min":3.6469999999999998},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.90000000000000002}]},{"osd":6,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":3.6930000000000001,"5min":3.6930000000000001,"15min":3.6930000000000001},"last":1.0980000000000001}]},{"osd":7,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.4249999999999998,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":0.83499999999999996}]}]},{"osd":2,"up_from":15,"seq":64424509462,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":158558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.7789999999999999,"5min":2.7789999999999999,"15min":2.7789999999999999},"last":1.119},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.755}]},{"osd":1,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.3490000000000002,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":1.026}]},{"osd":3,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.4700000000000002,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":1.1970000000000001}]},{"osd":4,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.5960000000000001,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":3.1469999999999998,"5min":3.1469999999999998,"15min":3.1469999999999998},"last":1.077}]},{"osd":5,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":4.0800000000000001,"5min":4.0800000000000001,"15min":4.0800000000000001},"last":1.258},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":3.6709999999999998,"5min":3.6709999999999998,"15min":3.6709999999999998},"last":1.304}]},{"osd":6,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.9249999999999998,"5min":2.9249999999999998,"15min":2.9249999999999998},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":3.081,"5min":3.081,"15min":3.081},"last":1.3360000000000001}]},{"osd":7,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":5.0650000000000004,"5min":5.0650000000000004,"15min":5.0650000000000004},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":3.8849999999999998,"5min":3.8849999999999998,"15min":3.8849999999999998},"last":1.494}]}]},{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":160122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":1.331},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.3640000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.4490000000000001},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.90100000000000002}]},{"osd":3,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":3.1499999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.5129999999999999},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.087}]},{"osd":4,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":3.7320000000000002,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.03}]},{"osd":5,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":3.02,"5min":3.02,"15min":3.02},"last":1.298},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":3.827,"5min":3.827,"15min":3.827},"last":1.5660000000000001}]},{"osd":6,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":3.3250000000000002,"5min":3.3250000000000002,"15min":3.3250000000000002},"last":1.216}]},{"osd":7,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":3.9100000000000001,"5min":3.9100000000000001,"15min":3.9100000000000001},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":3.105,"5min":3.105,"15min":3.105},"last":1.486}]}]},{"osd":5,"up_from":14,"seq":60129542165,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":159160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.319}]},{"osd":1,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.78100000000000003}]},{"osd":2,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":4.4610000000000003,"5min":4.4610000000000003,"15min":4.4610000000000003},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.413}]},{"osd":3,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":0.995},{"interface":"front","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":0.96799999999999997}]},{"osd":4,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":1.077},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.6080000000000001}]},{"osd":6,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":1.3700000000000001}]},{"osd":7,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":2.387,"5min":2.387,"15min":2.387},"last":1.508},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.143}]}]},{"osd":0,"up_from":14,"seq":60129542165,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":995328,"data_stored":748856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":3.0750000000000002,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.2919999999999998,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.92500000000000004}]},{"osd":2,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":4.2210000000000001,"5min":4.2210000000000001,"15min":4.2210000000000001},"last":0.622}]},{"osd":3,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":3.6070000000000002,"5min":3.6070000000000002,"15min":3.6070000000000002},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.034}]},{"osd":4,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":4.1609999999999996,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":2.391,"5min":2.391,"15min":2.391},"last":1.6000000000000001}]},{"osd":5,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":3.8620000000000001,"5min":3.8620000000000001,"15min":3.8620000000000001},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":2.4220000000000002,"5min":2.4220000000000002,"15min":2.4220000000000002},"last":1.5069999999999999}]},{"osd":6,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":3.8210000000000002,"5min":3.8210000000000002,"15min":3.8210000000000002},"last":1.569},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"min":{"1min":0.997,"5min":0.997,"15min":0.997},"max":{"1min":4.0999999999999996,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":1.629}]},{"osd":7,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":1.581,"15min":1.581},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":4.1920000000000002,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":1.5369999999999999},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.2350000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T09:38:41.958 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:38:42.213 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.212+0000 7ff126fde640 1 Processor -- start 2023-10-14T09:38:42.214 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.212+0000 7ff126fde640 1 -- start start 2023-10-14T09:38:42.216 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.213+0000 7ff126fde640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff12006c040 0x7ff12006c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:42.216 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.213+0000 7ff126fde640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff1200ad970 0x7ff12015e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:42.216 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.213+0000 7ff126fde640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff12006c960 con 0x7ff12015ebc0 2023-10-14T09:38:42.217 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.213+0000 7ff126fde640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff12015b9d0 con 0x7ff1200ad970 2023-10-14T09:38:42.217 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.213+0000 7ff126fde640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff12015bcb0 con 0x7ff12006c040 2023-10-14T09:38:42.217 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.214+0000 7ff1257db640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff1200ad970 0x7ff12015e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:42.218 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.214+0000 7ff1257db640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff1200ad970 0x7ff12015e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55578/0 (socket says 172.21.15.102:55578) 2023-10-14T09:38:42.218 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.214+0000 7ff1257db640 1 -- 172.21.15.102:0/3645286278 learned_addr learned my addr 172.21.15.102:0/3645286278 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:42.218 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.214+0000 7ff1257db640 1 -- 172.21.15.102:0/3645286278 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff12006c040 msgr2=0x7ff12006c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:42.218 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.214+0000 7ff1257db640 1 --2- 172.21.15.102:0/3645286278 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff12006c040 0x7ff12006c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:42.219 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.214+0000 7ff1257db640 1 -- 172.21.15.102:0/3645286278 >> v1:172.21.15.129:6789/0 conn(0x7ff12015ebc0 legacy=0x7ff1200cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:42.219 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.214+0000 7ff1257db640 1 -- 172.21.15.102:0/3645286278 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff12015bf90 con 0x7ff1200ad970 2023-10-14T09:38:42.220 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.215+0000 7ff1257db640 1 --2- 172.21.15.102:0/3645286278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1200ad970 0x7ff12015e680 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff1100098a0 tx=0x7ff11002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3aa18b479d24728 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:42.221 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.216+0000 7ff124fda640 1 -- 172.21.15.102:0/3645286278 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff110031640 con 0x7ff1200ad970 2023-10-14T09:38:42.221 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.216+0000 7ff124fda640 1 -- 172.21.15.102:0/3645286278 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1100317a0 con 0x7ff1200ad970 2023-10-14T09:38:42.221 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.216+0000 7ff124fda640 1 -- 172.21.15.102:0/3645286278 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff110031b30 con 0x7ff1200ad970 2023-10-14T09:38:42.221 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.216+0000 7ff126fde640 1 -- 172.21.15.102:0/3645286278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1200ad970 msgr2=0x7ff12015e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:42.222 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.216+0000 7ff126fde640 1 --2- 172.21.15.102:0/3645286278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1200ad970 0x7ff12015e680 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff1100098a0 tx=0x7ff11002b8f0 comp rx=0 tx=0).stop 2023-10-14T09:38:42.222 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.216+0000 7ff126fde640 1 -- 172.21.15.102:0/3645286278 shutdown_connections 2023-10-14T09:38:42.222 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.216+0000 7ff126fde640 1 --2- 172.21.15.102:0/3645286278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1200ad970 0x7ff12015e680 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:42.223 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.216+0000 7ff126fde640 1 --2- 172.21.15.102:0/3645286278 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff12006c040 0x7ff12006c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:42.223 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.216+0000 7ff126fde640 1 -- 172.21.15.102:0/3645286278 >> 172.21.15.102:0/3645286278 conn(0x7ff1200ce6a0 msgr2=0x7ff1200ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:42.223 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.217+0000 7ff126fde640 1 -- 172.21.15.102:0/3645286278 shutdown_connections 2023-10-14T09:38:42.223 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.217+0000 7ff126fde640 1 -- 172.21.15.102:0/3645286278 wait complete. 2023-10-14T09:38:42.224 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.218+0000 7ff126fde640 1 Processor -- start 2023-10-14T09:38:42.224 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.218+0000 7ff126fde640 1 -- start start 2023-10-14T09:38:42.226 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.219+0000 7ff126fde640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff12006c040 0x7ff1200c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:42.227 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.219+0000 7ff126fde640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff1200ad970 0x7ff1201e4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:42.227 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.219+0000 7ff126fde640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff12015ebc0 0x7ff12015a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:42.227 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.219+0000 7ff126fde640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1200c6e80 con 0x7ff12006c040 2023-10-14T09:38:42.227 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.219+0000 7ff126fde640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1200c77e0 con 0x7ff12015ebc0 2023-10-14T09:38:42.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.219+0000 7ff126fde640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1201e53d0 con 0x7ff1200ad970 2023-10-14T09:38:42.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.220+0000 7ff125fdc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff12006c040 0x7ff1200c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:42.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.220+0000 7ff125fdc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff12006c040 0x7ff1200c72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55584/0 (socket says 172.21.15.102:55584) 2023-10-14T09:38:42.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.220+0000 7ff125fdc640 1 -- 172.21.15.102:0/675399710 learned_addr learned my addr 172.21.15.102:0/675399710 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:42.229 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.220+0000 7ff125fdc640 1 -- 172.21.15.102:0/675399710 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff1200ad970 msgr2=0x7ff1201e4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:42.229 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.220+0000 7ff1267dd640 1 --2- 172.21.15.102:0/675399710 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff12015ebc0 0x7ff12015a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:42.229 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.220+0000 7ff125fdc640 1 --2- 172.21.15.102:0/675399710 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff1200ad970 0x7ff1201e4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:42.229 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.220+0000 7ff125fdc640 1 -- 172.21.15.102:0/675399710 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff12015ebc0 msgr2=0x7ff12015a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:42.230 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.220+0000 7ff125fdc640 1 --2- 172.21.15.102:0/675399710 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff12015ebc0 0x7ff12015a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:42.230 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.220+0000 7ff125fdc640 1 -- 172.21.15.102:0/675399710 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1100094d0 con 0x7ff12006c040 2023-10-14T09:38:42.230 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.220+0000 7ff125fdc640 1 --2- 172.21.15.102:0/675399710 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff12006c040 0x7ff1200c72a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff11c00b410 tx=0x7ff11c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:42.231 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.221+0000 7ff1167fc640 1 -- 172.21.15.102:0/675399710 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c011830 con 0x7ff12006c040 2023-10-14T09:38:42.231 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.221+0000 7ff1167fc640 1 -- 172.21.15.102:0/675399710 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11c0119b0 con 0x7ff12006c040 2023-10-14T09:38:42.231 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.221+0000 7ff126fde640 1 -- 172.21.15.102:0/675399710 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1200c7c90 con 0x7ff12006c040 2023-10-14T09:38:42.231 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.221+0000 7ff1167fc640 1 -- 172.21.15.102:0/675399710 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c011d60 con 0x7ff12006c040 2023-10-14T09:38:42.232 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.221+0000 7ff126fde640 1 -- 172.21.15.102:0/675399710 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1200c67c0 con 0x7ff12006c040 2023-10-14T09:38:42.232 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.222+0000 7ff126fde640 1 -- 172.21.15.102:0/675399710 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff12006b330 con 0x7ff12006c040 2023-10-14T09:38:42.232 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.223+0000 7ff1167fc640 1 -- 172.21.15.102:0/675399710 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff11c01a400 con 0x7ff12006c040 2023-10-14T09:38:42.232 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.224+0000 7ff1167fc640 1 --2- 172.21.15.102:0/675399710 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff10406ae70 0x7ff10406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:42.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.224+0000 7ff1167fc640 1 -- 172.21.15.102:0/675399710 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7ff11c089770 con 0x7ff12006c040 2023-10-14T09:38:42.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.224+0000 7ff1257db640 1 --2- 172.21.15.102:0/675399710 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff10406ae70 0x7ff10406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:42.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.225+0000 7ff1257db640 1 --2- 172.21.15.102:0/675399710 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff10406ae70 0x7ff10406d330 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff110036000 tx=0x7ff110030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:42.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.228+0000 7ff1167fc640 1 -- 172.21.15.102:0/675399710 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff11c054800 con 0x7ff12006c040 2023-10-14T09:38:42.421 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.419+0000 7ff126fde640 1 -- 172.21.15.102:0/675399710 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff12004e9b0 con 0x7ff12006c040 2023-10-14T09:38:42.423 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.421+0000 7ff1167fc640 1 -- 172.21.15.102:0/675399710 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16625 (secure 0 0 0) 0x7ff11c015090 con 0x7ff12006c040 2023-10-14T09:38:42.424 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:38:42.424 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":36,"fsid":"8a6cd69d-7f5b-4f2a-806a-0176c10aed50","created":"2023-10-14T09:36:56.745172+0000","modified":"2023-10-14T09:38:32.007570+0000","last_up_change":"2023-10-14T09:37:09.791473+0000","last_in_change":"2023-10-14T09:37:00.547186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:37:09.952407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T09:38:28.133199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_data","create_time":"2023-10-14T09:38:29.466239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e5aef8f3-878f-482b-b522-9a5b958b90b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6801","nonce":1727250718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6803","nonce":1727250718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6807","nonce":1727250718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1727250718},{"type":"v1","addr":"172.21.15.102:6805","nonce":1727250718}]},"public_addr":"172.21.15.102:6801/1727250718","cluster_addr":"172.21.15.102:6803/1727250718","heartbeat_back_addr":"172.21.15.102:6807/1727250718","heartbeat_front_addr":"172.21.15.102:6805/1727250718","state":["exists","up"]},{"osd":1,"uuid":"4a8cf50e-387b-4d47-9588-bd22e375a9ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6809","nonce":1095651107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6811","nonce":1095651107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6815","nonce":1095651107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1095651107},{"type":"v1","addr":"172.21.15.102:6813","nonce":1095651107}]},"public_addr":"172.21.15.102:6809/1095651107","cluster_addr":"172.21.15.102:6811/1095651107","heartbeat_back_addr":"172.21.15.102:6815/1095651107","heartbeat_front_addr":"172.21.15.102:6813/1095651107","state":["exists","up"]},{"osd":2,"uuid":"009ef55f-8a63-4219-bacd-d7c7b4500867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6820","nonce":2198222556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6825","nonce":2198222556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6831","nonce":2198222556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2198222556},{"type":"v1","addr":"172.21.15.102:6829","nonce":2198222556}]},"public_addr":"172.21.15.102:6820/2198222556","cluster_addr":"172.21.15.102:6825/2198222556","heartbeat_back_addr":"172.21.15.102:6831/2198222556","heartbeat_front_addr":"172.21.15.102:6829/2198222556","state":["exists","up"]},{"osd":3,"uuid":"f2110eae-2ff9-4ed9-93d6-bd2361618211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6818","nonce":654726740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6821","nonce":654726740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6827","nonce":654726740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6823","nonce":654726740},{"type":"v1","addr":"172.21.15.102:6824","nonce":654726740}]},"public_addr":"172.21.15.102:6818/654726740","cluster_addr":"172.21.15.102:6821/654726740","heartbeat_back_addr":"172.21.15.102:6827/654726740","heartbeat_front_addr":"172.21.15.102:6824/654726740","state":["exists","up"]},{"osd":4,"uuid":"33f1ae34-3100-40f7-9cb8-0eca2b358693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6817","nonce":507586170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6819","nonce":507586170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6823","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6825","nonce":507586170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":507586170},{"type":"v1","addr":"172.21.15.129:6821","nonce":507586170}]},"public_addr":"172.21.15.129:6817/507586170","cluster_addr":"172.21.15.129:6819/507586170","heartbeat_back_addr":"172.21.15.129:6825/507586170","heartbeat_front_addr":"172.21.15.129:6821/507586170","state":["exists","up"]},{"osd":5,"uuid":"fab2fc62-3f3e-450d-93e0-770f39e80710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6801","nonce":1913451073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6803","nonce":1913451073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6807","nonce":1913451073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1913451073},{"type":"v1","addr":"172.21.15.129:6805","nonce":1913451073}]},"public_addr":"172.21.15.129:6801/1913451073","cluster_addr":"172.21.15.129:6803/1913451073","heartbeat_back_addr":"172.21.15.129:6807/1913451073","heartbeat_front_addr":"172.21.15.129:6805/1913451073","state":["exists","up"]},{"osd":6,"uuid":"d7cc1d69-92e7-4253-a127-cfc0444a4809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6809","nonce":2853291511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6811","nonce":2853291511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6815","nonce":2853291511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":2853291511},{"type":"v1","addr":"172.21.15.129:6813","nonce":2853291511}]},"public_addr":"172.21.15.129:6809/2853291511","cluster_addr":"172.21.15.129:6811/2853291511","heartbeat_back_addr":"172.21.15.129:6815/2853291511","heartbeat_front_addr":"172.21.15.129:6813/2853291511","state":["exists","up"]},{"osd":7,"uuid":"1e403de1-09e2-4370-b9a7-e790ac44bbee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6824","nonce":2933886914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6827","nonce":2933886914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6831","nonce":2933886914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":2933886914},{"type":"v1","addr":"172.21.15.129:6829","nonce":2933886914}]},"public_addr":"172.21.15.129:6824/2933886914","cluster_addr":"172.21.15.129:6827/2933886914","heartbeat_back_addr":"172.21.15.129:6831/2933886914","heartbeat_front_addr":"172.21.15.129:6829/2933886914","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.849661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.868113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.933488+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.891794+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.901861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.858750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.911712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:37:05.996765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:38:42.426 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.424+0000 7ff126fde640 1 -- 172.21.15.102:0/675399710 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff10406ae70 msgr2=0x7ff10406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:42.426 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.424+0000 7ff126fde640 1 --2- 172.21.15.102:0/675399710 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff10406ae70 0x7ff10406d330 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff110036000 tx=0x7ff110030000 comp rx=0 tx=0).stop 2023-10-14T09:38:42.427 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.424+0000 7ff126fde640 1 -- 172.21.15.102:0/675399710 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff12006c040 msgr2=0x7ff1200c72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:42.427 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.424+0000 7ff126fde640 1 --2- 172.21.15.102:0/675399710 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff12006c040 0x7ff1200c72a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff11c00b410 tx=0x7ff11c00b8d0 comp rx=0 tx=0).stop 2023-10-14T09:38:42.427 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.424+0000 7ff126fde640 1 -- 172.21.15.102:0/675399710 shutdown_connections 2023-10-14T09:38:42.428 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.424+0000 7ff126fde640 1 --2- 172.21.15.102:0/675399710 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7ff10406ae70 0x7ff10406d330 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:42.428 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.424+0000 7ff126fde640 1 --2- 172.21.15.102:0/675399710 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff12015ebc0 0x7ff12015a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:42.428 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.424+0000 7ff126fde640 1 --2- 172.21.15.102:0/675399710 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff1200ad970 0x7ff1201e4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:42.428 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.424+0000 7ff126fde640 1 --2- 172.21.15.102:0/675399710 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff12006c040 0x7ff1200c72a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:42.429 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.424+0000 7ff126fde640 1 -- 172.21.15.102:0/675399710 >> 172.21.15.102:0/675399710 conn(0x7ff1200ce6a0 msgr2=0x7ff12015de00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:42.429 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.424+0000 7ff126fde640 1 -- 172.21.15.102:0/675399710 shutdown_connections 2023-10-14T09:38:42.429 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:42.424+0000 7ff126fde640 1 -- 172.21.15.102:0/675399710 wait complete. 2023-10-14T09:38:43.446 INFO:tasks.ceph:Scrubbing osd.0 2023-10-14T09:38:43.446 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-14T09:38:43.674 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.672+0000 7f74d4390640 1 Processor -- start 2023-10-14T09:38:43.675 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.672+0000 7f74d4390640 1 -- start start 2023-10-14T09:38:43.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.674+0000 7f74d4390640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f74cc0cca70 0x7f74cc0cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:43.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.674+0000 7f74d4390640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f74cc0cfa00 0x7f74cc15c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:43.677 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.674+0000 7f74d4390640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74cc06bbc0 con 0x7f74cc06cc60 2023-10-14T09:38:43.677 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.674+0000 7f74d4390640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74cc06bea0 con 0x7f74cc0cca70 2023-10-14T09:38:43.677 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.674+0000 7f74d4390640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc06c180 con 0x7f74cc0cfa00 2023-10-14T09:38:43.678 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.674+0000 7f74d212c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f74cc0cca70 0x7f74cc0cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:43.678 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.674+0000 7f74d192b640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f74cc06cc60 0x7f74cc0cf2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55532/0 (socket says 172.21.15.102:55532) 2023-10-14T09:38:43.678 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.674+0000 7f74d192b640 1 -- 172.21.15.102:0/1170572560 learned_addr learned my addr 172.21.15.102:0/1170572560 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:43.678 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.674+0000 7f74d212c640 1 -- 172.21.15.102:0/1170572560 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f74cc0cfa00 msgr2=0x7f74cc15c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:43.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.674+0000 7f74d212c640 1 --2- 172.21.15.102:0/1170572560 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f74cc0cfa00 0x7f74cc15c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:43.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.674+0000 7f74d212c640 1 -- 172.21.15.102:0/1170572560 >> v1:172.21.15.102:6789/0 conn(0x7f74cc06cc60 legacy=0x7f74cc0cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:43.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.674+0000 7f74d112a640 1 -- 172.21.15.102:0/1170572560 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 372533349 0 0) 0x7f74cc06bbc0 con 0x7f74cc06cc60 2023-10-14T09:38:43.680 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.675+0000 7f74d212c640 1 -- 172.21.15.102:0/1170572560 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74cc06c460 con 0x7f74cc0cca70 2023-10-14T09:38:43.681 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.676+0000 7f74d212c640 1 --2- 172.21.15.102:0/1170572560 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74cc0cca70 0x7f74cc0cdd70 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f74c80097a0 tx=0x7f74c802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b6097eb980223 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:43.681 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.676+0000 7f74d112a640 1 -- 172.21.15.102:0/1170572560 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c8031830 con 0x7f74cc0cca70 2023-10-14T09:38:43.681 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.676+0000 7f74d112a640 1 -- 172.21.15.102:0/1170572560 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c8031990 con 0x7f74cc0cca70 2023-10-14T09:38:43.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.676+0000 7f74d112a640 1 -- 172.21.15.102:0/1170572560 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c8031d20 con 0x7f74cc0cca70 2023-10-14T09:38:43.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.677+0000 7f74d4390640 1 -- 172.21.15.102:0/1170572560 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74cc0cca70 msgr2=0x7f74cc0cdd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:43.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.677+0000 7f74d4390640 1 --2- 172.21.15.102:0/1170572560 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74cc0cca70 0x7f74cc0cdd70 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f74c80097a0 tx=0x7f74c802b8d0 comp rx=0 tx=0).stop 2023-10-14T09:38:43.683 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.677+0000 7f74d4390640 1 -- 172.21.15.102:0/1170572560 shutdown_connections 2023-10-14T09:38:43.683 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.677+0000 7f74d4390640 1 --2- 172.21.15.102:0/1170572560 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f74cc0cfa00 0x7f74cc15c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:43.683 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.677+0000 7f74d4390640 1 --2- 172.21.15.102:0/1170572560 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74cc0cca70 0x7f74cc0cdd70 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:43.683 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.677+0000 7f74d4390640 1 -- 172.21.15.102:0/1170572560 >> 172.21.15.102:0/1170572560 conn(0x7f74cc099e30 msgr2=0x7f74cc0d0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:43.684 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.677+0000 7f74d4390640 1 -- 172.21.15.102:0/1170572560 shutdown_connections 2023-10-14T09:38:43.684 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.677+0000 7f74d4390640 1 -- 172.21.15.102:0/1170572560 wait complete. 2023-10-14T09:38:43.684 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.679+0000 7f74d4390640 1 Processor -- start 2023-10-14T09:38:43.685 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.679+0000 7f74d4390640 1 -- start start 2023-10-14T09:38:43.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.680+0000 7f74d4390640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74cc06cc60 0x7f74cc0c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:43.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.680+0000 7f74d4390640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f74cc0cca70 0x7f74cc0b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:43.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.680+0000 7f74d4390640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f74cc0cfa00 0x7f74cc06d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:43.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.680+0000 7f74d4390640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc09a880 con 0x7f74cc06cc60 2023-10-14T09:38:43.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.680+0000 7f74d4390640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc0b3b80 con 0x7f74cc0cca70 2023-10-14T09:38:43.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.680+0000 7f74d4390640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc0b3e20 con 0x7f74cc0cfa00 2023-10-14T09:38:43.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.680+0000 7f74d212c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74cc06cc60 0x7f74cc0c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:43.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.680+0000 7f74d212c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74cc06cc60 0x7f74cc0c9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55616/0 (socket says 172.21.15.102:55616) 2023-10-14T09:38:43.690 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.680+0000 7f74d212c640 1 -- 172.21.15.102:0/2548602596 learned_addr learned my addr 172.21.15.102:0/2548602596 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:43.690 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.680+0000 7f74d212c640 1 -- 172.21.15.102:0/2548602596 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f74cc0cfa00 msgr2=0x7f74cc06d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:43.690 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.680+0000 7f74d212c640 1 --2- 172.21.15.102:0/2548602596 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f74cc0cfa00 0x7f74cc06d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:43.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.680+0000 7f74d212c640 1 -- 172.21.15.102:0/2548602596 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f74cc0cca70 msgr2=0x7f74cc0b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:43.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.680+0000 7f74d212c640 1 --2- 172.21.15.102:0/2548602596 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f74cc0cca70 0x7f74cc0b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:43.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.680+0000 7f74d212c640 1 -- 172.21.15.102:0/2548602596 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c8009400 con 0x7f74cc06cc60 2023-10-14T09:38:43.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.681+0000 7f74d212c640 1 --2- 172.21.15.102:0/2548602596 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74cc06cc60 0x7f74cc0c9c80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f74c80098c0 tx=0x7f74c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:43.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.681+0000 7f74c2ffd640 1 -- 172.21.15.102:0/2548602596 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c803ba70 con 0x7f74cc06cc60 2023-10-14T09:38:43.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.681+0000 7f74c2ffd640 1 -- 172.21.15.102:0/2548602596 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c803bbd0 con 0x7f74cc06cc60 2023-10-14T09:38:43.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.681+0000 7f74c2ffd640 1 -- 172.21.15.102:0/2548602596 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c80453f0 con 0x7f74cc06cc60 2023-10-14T09:38:43.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.681+0000 7f74d4390640 1 -- 172.21.15.102:0/2548602596 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74cc0b4100 con 0x7f74cc06cc60 2023-10-14T09:38:43.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.681+0000 7f74d4390640 1 -- 172.21.15.102:0/2548602596 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74cc0b46c0 con 0x7f74cc06cc60 2023-10-14T09:38:43.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.682+0000 7f74d4390640 1 -- 172.21.15.102:0/2548602596 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f74cc0cce50 con 0x7f74cc06cc60 2023-10-14T09:38:43.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.683+0000 7f74c2ffd640 1 -- 172.21.15.102:0/2548602596 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f74c804e450 con 0x7f74cc06cc60 2023-10-14T09:38:43.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.684+0000 7f74c2ffd640 1 --2- 172.21.15.102:0/2548602596 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f74b006ae70 0x7f74b006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:43.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.684+0000 7f74c2ffd640 1 -- 172.21.15.102:0/2548602596 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f74c80ab840 con 0x7f74cc06cc60 2023-10-14T09:38:43.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.684+0000 7f74d192b640 1 --2- 172.21.15.102:0/2548602596 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f74b006ae70 0x7f74b006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:43.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.684+0000 7f74c2ffd640 1 --2- 172.21.15.102:0/2548602596 >> [v2:172.21.15.102:6800/1727250718,v1:172.21.15.102:6801/1727250718] conn(0x7f74b0073070 0x7f74b00754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:43.695 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.684+0000 7f74c2ffd640 1 -- 172.21.15.102:0/2548602596 --> [v2:172.21.15.102:6800/1727250718,v1:172.21.15.102:6801/1727250718] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f74b0075b80 con 0x7f74b0073070 2023-10-14T09:38:43.695 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.684+0000 7f74c2ffd640 1 -- 172.21.15.102:0/2548602596 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74c80b02c0 con 0x7f74cc06cc60 2023-10-14T09:38:43.695 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.685+0000 7f74d292d640 1 --2- 172.21.15.102:0/2548602596 >> [v2:172.21.15.102:6800/1727250718,v1:172.21.15.102:6801/1727250718] conn(0x7f74b0073070 0x7f74b00754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:43.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.685+0000 7f74d192b640 1 --2- 172.21.15.102:0/2548602596 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f74b006ae70 0x7f74b006d330 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f74bc007fd0 tx=0x7f74bc007920 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:43.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.685+0000 7f74d292d640 1 --2- 172.21.15.102:0/2548602596 >> [v2:172.21.15.102:6800/1727250718,v1:172.21.15.102:6801/1727250718] conn(0x7f74b0073070 0x7f74b00754b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:43.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.686+0000 7f74c2ffd640 1 -- 172.21.15.102:0/2548602596 <== osd.0 v2:172.21.15.102:6800/1727250718 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f74b0075b80 con 0x7f74b0073070 2023-10-14T09:38:43.702 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.700+0000 7f74d4390640 1 -- 172.21.15.102:0/2548602596 --> [v2:172.21.15.102:6800/1727250718,v1:172.21.15.102:6801/1727250718] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f74cc06c740 con 0x7f74b0073070 2023-10-14T09:38:43.702 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.700+0000 7f74c2ffd640 1 -- 172.21.15.102:0/2548602596 <== osd.0 v2:172.21.15.102:6800/1727250718 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f74c400ac40 con 0x7f74b0073070 2023-10-14T09:38:43.703 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-10-14T09:38:43.703 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T09:38:43.703 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-10-14T09:38:43.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.701+0000 7f74d4390640 1 -- 172.21.15.102:0/2548602596 >> [v2:172.21.15.102:6800/1727250718,v1:172.21.15.102:6801/1727250718] conn(0x7f74b0073070 msgr2=0x7f74b00754b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:43.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.701+0000 7f74d4390640 1 --2- 172.21.15.102:0/2548602596 >> [v2:172.21.15.102:6800/1727250718,v1:172.21.15.102:6801/1727250718] conn(0x7f74b0073070 0x7f74b00754b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:43.705 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.701+0000 7f74d4390640 1 -- 172.21.15.102:0/2548602596 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f74b006ae70 msgr2=0x7f74b006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:43.705 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.701+0000 7f74d4390640 1 --2- 172.21.15.102:0/2548602596 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f74b006ae70 0x7f74b006d330 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f74bc007fd0 tx=0x7f74bc007920 comp rx=0 tx=0).stop 2023-10-14T09:38:43.705 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.701+0000 7f74d4390640 1 -- 172.21.15.102:0/2548602596 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74cc06cc60 msgr2=0x7f74cc0c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:43.705 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.701+0000 7f74d4390640 1 --2- 172.21.15.102:0/2548602596 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74cc06cc60 0x7f74cc0c9c80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f74c80098c0 tx=0x7f74c80046c0 comp rx=0 tx=0).stop 2023-10-14T09:38:43.706 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.701+0000 7f74d292d640 1 -- 172.21.15.102:0/2548602596 reap_dead start 2023-10-14T09:38:43.706 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.701+0000 7f74d4390640 1 -- 172.21.15.102:0/2548602596 shutdown_connections 2023-10-14T09:38:43.706 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.701+0000 7f74d4390640 1 -- 172.21.15.102:0/2548602596 >> 172.21.15.102:0/2548602596 conn(0x7f74cc099e30 msgr2=0x7f74cc0cf2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:43.707 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.701+0000 7f74d4390640 1 -- 172.21.15.102:0/2548602596 shutdown_connections 2023-10-14T09:38:43.707 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.701+0000 7f74d4390640 1 -- 172.21.15.102:0/2548602596 wait complete. 2023-10-14T09:38:43.720 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-14T09:38:43.916 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.914+0000 7f62b9d01640 1 Processor -- start 2023-10-14T09:38:43.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.915+0000 7f62b9d01640 1 -- start start 2023-10-14T09:38:43.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.916+0000 7f62b9d01640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f62b40b0fc0 0x7f62b4167f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:43.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.916+0000 7f62b9d01640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62b415e5b0 con 0x7f62b41540e0 2023-10-14T09:38:43.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.916+0000 7f62b9d01640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62b41544c0 con 0x7f62b40cca00 2023-10-14T09:38:43.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.916+0000 7f62b9d01640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b40ccf00 con 0x7f62b40b0fc0 2023-10-14T09:38:43.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.916+0000 7f62b37fe640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f62b41540e0 0x7f62b40adae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55540/0 (socket says 172.21.15.102:55540) 2023-10-14T09:38:43.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.916+0000 7f62b37fe640 1 -- 172.21.15.102:0/2094674136 learned_addr learned my addr 172.21.15.102:0/2094674136 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:43.922 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.917+0000 7f62b2ffd640 1 -- 172.21.15.102:0/2094674136 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 511161124 0 0) 0x7f62b415e5b0 con 0x7f62b41540e0 2023-10-14T09:38:43.922 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.917+0000 7f62b2ffd640 1 -- 172.21.15.102:0/2094674136 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62a0003520 con 0x7f62b41540e0 2023-10-14T09:38:43.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.917+0000 7f62b3fff640 1 --2- 172.21.15.102:0/2094674136 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f62b40b0fc0 0x7f62b4167f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:43.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.917+0000 7f62b2ffd640 1 -- 172.21.15.102:0/2094674136 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 605880114 0 0) 0x7f62a0003520 con 0x7f62b41540e0 2023-10-14T09:38:43.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.917+0000 7f62b2ffd640 1 -- 172.21.15.102:0/2094674136 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f62b40b0fc0 msgr2=0x7f62b4167f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:43.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.917+0000 7f62b2ffd640 1 --2- 172.21.15.102:0/2094674136 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f62b40b0fc0 0x7f62b4167f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:43.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.917+0000 7f62b2ffd640 1 -- 172.21.15.102:0/2094674136 >> v1:172.21.15.129:6789/0 conn(0x7f62b40cca00 legacy=0x7f62b40b08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:43.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.917+0000 7f62b2ffd640 1 -- 172.21.15.102:0/2094674136 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b40cd1e0 con 0x7f62b41540e0 2023-10-14T09:38:43.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.917+0000 7f62b2ffd640 1 -- 172.21.15.102:0/2094674136 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4030661168 0 0) 0x7f62a4001670 con 0x7f62b41540e0 2023-10-14T09:38:43.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.918+0000 7f62b2ffd640 1 -- 172.21.15.102:0/2094674136 >> v1:172.21.15.102:6789/0 conn(0x7f62b41540e0 legacy=0x7f62b40adae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:43.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.918+0000 7f62b2ffd640 1 --2- 172.21.15.102:0/2094674136 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f62b40b0fc0 0x7f62a00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:43.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.918+0000 7f62b2ffd640 1 --2- 172.21.15.102:0/2094674136 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62a0003fd0 0x7f62a00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:43.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.918+0000 7f62b2ffd640 1 --2- 172.21.15.102:0/2094674136 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f62a0004d00 0x7f62a0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:43.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.918+0000 7f62b2ffd640 1 -- 172.21.15.102:0/2094674136 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b40ccf00 con 0x7f62a0003fd0 2023-10-14T09:38:43.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.918+0000 7f62b2ffd640 1 -- 172.21.15.102:0/2094674136 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a000bb40 con 0x7f62a0004d00 2023-10-14T09:38:43.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.918+0000 7f62b2ffd640 1 -- 172.21.15.102:0/2094674136 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a000bd00 con 0x7f62b40b0fc0 2023-10-14T09:38:43.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.918+0000 7f62aaffd640 1 --2- 172.21.15.102:0/2094674136 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62a0003fd0 0x7f62a00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:43.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.918+0000 7f62b3fff640 1 --2- 172.21.15.102:0/2094674136 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f62a0004d00 0x7f62a0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:43.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.918+0000 7f62aaffd640 1 -- 172.21.15.102:0/2094674136 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f62b40b0fc0 msgr2=0x7f62a00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:43.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.918+0000 7f62aaffd640 1 --2- 172.21.15.102:0/2094674136 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f62b40b0fc0 0x7f62a00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:43.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.918+0000 7f62aaffd640 1 -- 172.21.15.102:0/2094674136 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f62a0004d00 msgr2=0x7f62a0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:43.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.918+0000 7f62aaffd640 1 --2- 172.21.15.102:0/2094674136 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f62a0004d00 0x7f62a0005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:43.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.918+0000 7f62aaffd640 1 -- 172.21.15.102:0/2094674136 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a0003520 con 0x7f62a0003fd0 2023-10-14T09:38:43.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.919+0000 7f62aaffd640 1 --2- 172.21.15.102:0/2094674136 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62a0003fd0 0x7f62a00047c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f62b40cce30 tx=0x7f62a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b4fd1fe5d994a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:43.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.920+0000 7f62b2ffd640 1 -- 172.21.15.102:0/2094674136 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c0052d0 con 0x7f62a0003fd0 2023-10-14T09:38:43.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.920+0000 7f62b2ffd640 1 -- 172.21.15.102:0/2094674136 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629c02e050 con 0x7f62a0003fd0 2023-10-14T09:38:43.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.920+0000 7f62b2ffd640 1 -- 172.21.15.102:0/2094674136 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c003830 con 0x7f62a0003fd0 2023-10-14T09:38:43.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.920+0000 7f62b9d01640 1 -- 172.21.15.102:0/2094674136 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62a0003fd0 msgr2=0x7f62a00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:43.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.920+0000 7f62b9d01640 1 --2- 172.21.15.102:0/2094674136 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62a0003fd0 0x7f62a00047c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f62b40cce30 tx=0x7f62a00057f0 comp rx=0 tx=0).stop 2023-10-14T09:38:43.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.920+0000 7f62b3fff640 1 -- 172.21.15.102:0/2094674136 reap_dead start 2023-10-14T09:38:43.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.920+0000 7f62b9d01640 1 -- 172.21.15.102:0/2094674136 shutdown_connections 2023-10-14T09:38:43.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.920+0000 7f62b9d01640 1 -- 172.21.15.102:0/2094674136 >> 172.21.15.102:0/2094674136 conn(0x7f62b40cb8b0 msgr2=0x7f62b40cbcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:43.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.920+0000 7f62b9d01640 1 -- 172.21.15.102:0/2094674136 shutdown_connections 2023-10-14T09:38:43.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.920+0000 7f62b9d01640 1 -- 172.21.15.102:0/2094674136 wait complete. 2023-10-14T09:38:43.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.922+0000 7f62b9d01640 1 Processor -- start 2023-10-14T09:38:43.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.922+0000 7f62b9d01640 1 -- start start 2023-10-14T09:38:43.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.923+0000 7f62b9d01640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f62a0003fd0 0x7f62b40c31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:43.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.923+0000 7f62b9d01640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f62b40ad780 0x7f62b415f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:43.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.923+0000 7f62b9d01640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62b415fb60 0x7f62b4150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:43.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.923+0000 7f62b9d01640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b4156be0 con 0x7f62b415fb60 2023-10-14T09:38:43.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.923+0000 7f62b9d01640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b4156060 con 0x7f62b40ad780 2023-10-14T09:38:43.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.923+0000 7f62b9d01640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b4156340 con 0x7f62a0003fd0 2023-10-14T09:38:43.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.924+0000 7f62b3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62b415fb60 0x7f62b4150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:43.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.924+0000 7f62b3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62b415fb60 0x7f62b4150e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55630/0 (socket says 172.21.15.102:55630) 2023-10-14T09:38:43.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.924+0000 7f62b3fff640 1 -- 172.21.15.102:0/2440927828 learned_addr learned my addr 172.21.15.102:0/2440927828 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:43.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.924+0000 7f62b3fff640 1 -- 172.21.15.102:0/2440927828 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f62a0003fd0 msgr2=0x7f62b40c31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:43.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.924+0000 7f62b3fff640 1 --2- 172.21.15.102:0/2440927828 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f62a0003fd0 0x7f62b40c31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:43.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.924+0000 7f62b3fff640 1 -- 172.21.15.102:0/2440927828 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f62b40ad780 msgr2=0x7f62b415f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:43.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.924+0000 7f62aaffd640 1 --2- 172.21.15.102:0/2440927828 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f62b40ad780 0x7f62b415f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:43.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.924+0000 7f62b3fff640 1 --2- 172.21.15.102:0/2440927828 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f62b40ad780 0x7f62b415f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:43.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.924+0000 7f62b3fff640 1 -- 172.21.15.102:0/2440927828 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b4156620 con 0x7f62b415fb60 2023-10-14T09:38:43.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.924+0000 7f62b3fff640 1 --2- 172.21.15.102:0/2440927828 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62b415fb60 0x7f62b4150e20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f62b406b8b0 tx=0x7f62ac009dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:43.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.925+0000 7f62b0ff9640 1 -- 172.21.15.102:0/2440927828 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac007db0 con 0x7f62b415fb60 2023-10-14T09:38:43.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.925+0000 7f62b0ff9640 1 -- 172.21.15.102:0/2440927828 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ac014400 con 0x7f62b415fb60 2023-10-14T09:38:43.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.925+0000 7f62b9d01640 1 -- 172.21.15.102:0/2440927828 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b4156900 con 0x7f62b415fb60 2023-10-14T09:38:43.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.925+0000 7f62b0ff9640 1 -- 172.21.15.102:0/2440927828 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac0147b0 con 0x7f62b415fb60 2023-10-14T09:38:43.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.925+0000 7f62b9d01640 1 -- 172.21.15.102:0/2440927828 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b40c3700 con 0x7f62b415fb60 2023-10-14T09:38:43.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.926+0000 7f62b9d01640 1 -- 172.21.15.102:0/2440927828 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62b404e160 con 0x7f62b415fb60 2023-10-14T09:38:43.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.927+0000 7f62b0ff9640 1 -- 172.21.15.102:0/2440927828 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f62ac01d3b0 con 0x7f62b415fb60 2023-10-14T09:38:43.941 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.928+0000 7f62b0ff9640 1 --2- 172.21.15.102:0/2440927828 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f629406ae70 0x7f629406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:43.941 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.928+0000 7f62b0ff9640 1 -- 172.21.15.102:0/2440927828 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f62ac089410 con 0x7f62b415fb60 2023-10-14T09:38:43.941 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.928+0000 7f62b37fe640 1 --2- 172.21.15.102:0/2440927828 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f629406ae70 0x7f629406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:43.941 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.929+0000 7f62b37fe640 1 --2- 172.21.15.102:0/2440927828 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f629406ae70 0x7f629406d330 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f62a40011e0 tx=0x7f62a40014e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:43.942 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:43.933+0000 7f62b0ff9640 1 -- 172.21.15.102:0/2440927828 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f62ac054490 con 0x7f62b415fb60 2023-10-14T09:38:44.130 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.125+0000 7f62b9d01640 1 -- 172.21.15.102:0/2440927828 --> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f62b40acd10 con 0x7f629406ae70 2023-10-14T09:38:44.131 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.126+0000 7f62b0ff9640 1 -- 172.21.15.102:0/2440927828 <== mgr.4104 v2:172.21.15.102:6832/1125265706 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f62a4001d60 con 0x7f629406ae70 2023-10-14T09:38:44.131 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 0 to deep-scrub 2023-10-14T09:38:44.132 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.129+0000 7f62b9d01640 1 -- 172.21.15.102:0/2440927828 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f629406ae70 msgr2=0x7f629406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:44.132 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.129+0000 7f62b9d01640 1 --2- 172.21.15.102:0/2440927828 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f629406ae70 0x7f629406d330 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f62a40011e0 tx=0x7f62a40014e0 comp rx=0 tx=0).stop 2023-10-14T09:38:44.132 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.129+0000 7f62b9d01640 1 -- 172.21.15.102:0/2440927828 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62b415fb60 msgr2=0x7f62b4150e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:44.133 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.129+0000 7f62b9d01640 1 --2- 172.21.15.102:0/2440927828 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62b415fb60 0x7f62b4150e20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f62b406b8b0 tx=0x7f62ac009dc0 comp rx=0 tx=0).stop 2023-10-14T09:38:44.133 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.130+0000 7f62b9d01640 1 -- 172.21.15.102:0/2440927828 shutdown_connections 2023-10-14T09:38:44.133 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.130+0000 7f62b9d01640 1 --2- 172.21.15.102:0/2440927828 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f629406ae70 0x7f629406d330 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:44.133 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.130+0000 7f62b9d01640 1 --2- 172.21.15.102:0/2440927828 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62b415fb60 0x7f62b4150e20 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:44.134 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.130+0000 7f62b9d01640 1 --2- 172.21.15.102:0/2440927828 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f62b40ad780 0x7f62b415f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:44.134 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.130+0000 7f62b9d01640 1 --2- 172.21.15.102:0/2440927828 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f62a0003fd0 0x7f62b40c31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:44.134 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.130+0000 7f62b9d01640 1 -- 172.21.15.102:0/2440927828 >> 172.21.15.102:0/2440927828 conn(0x7f62b40cb8b0 msgr2=0x7f62b41536d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:44.135 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.130+0000 7f62b9d01640 1 -- 172.21.15.102:0/2440927828 shutdown_connections 2023-10-14T09:38:44.135 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.130+0000 7f62b9d01640 1 -- 172.21.15.102:0/2440927828 wait complete. 2023-10-14T09:38:44.149 INFO:tasks.ceph:Scrubbing osd.1 2023-10-14T09:38:44.150 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-14T09:38:44.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.366+0000 7f57defa4640 1 Processor -- start 2023-10-14T09:38:44.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.366+0000 7f57defa4640 1 -- start start 2023-10-14T09:38:44.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.368+0000 7f57defa4640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f57d815ac10 0x7f57d806c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:44.371 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.368+0000 7f57defa4640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f57d80b0360 0x7f57d80b07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:44.371 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.368+0000 7f57defa4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f57d80ca510 0x7f57d80ca940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:44.371 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.368+0000 7f57defa4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57d80b0d00 con 0x7f57d80ca510 2023-10-14T09:38:44.372 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.368+0000 7f57defa4640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57d815b310 con 0x7f57d815ac10 2023-10-14T09:38:44.372 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.368+0000 7f57defa4640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d806f640 con 0x7f57d80b0360 2023-10-14T09:38:44.372 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.368+0000 7f57dd541640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f57d80ca510 0x7f57d80ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:44.372 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.368+0000 7f57dd541640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f57d80ca510 0x7f57d80ca940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55638/0 (socket says 172.21.15.102:55638) 2023-10-14T09:38:44.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.368+0000 7f57dd541640 1 -- 172.21.15.102:0/2105462245 learned_addr learned my addr 172.21.15.102:0/2105462245 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:44.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.369+0000 7f57dcd40640 1 --2- 172.21.15.102:0/2105462245 >> v2:172.21.15.129:3300/0 conn(0x7f57d815ac10 0x7f57d806c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:44.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.369+0000 7f57dd541640 1 -- 172.21.15.102:0/2105462245 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f57d80b0360 msgr2=0x7f57d80b07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:44.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.369+0000 7f57dd541640 1 --2- 172.21.15.102:0/2105462245 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f57d80b0360 0x7f57d80b07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:44.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.369+0000 7f57dd541640 1 -- 172.21.15.102:0/2105462245 >> v2:172.21.15.129:3300/0 conn(0x7f57d815ac10 msgr2=0x7f57d806c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:44.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.369+0000 7f57dd541640 1 --2- 172.21.15.102:0/2105462245 >> v2:172.21.15.129:3300/0 conn(0x7f57d815ac10 0x7f57d806c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:44.375 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.369+0000 7f57dd541640 1 -- 172.21.15.102:0/2105462245 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d815b5b0 con 0x7f57d80ca510 2023-10-14T09:38:44.381 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.370+0000 7f57dd541640 1 --2- 172.21.15.102:0/2105462245 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57d80ca510 0x7f57d80ca940 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f57d806d540 tx=0x7f57d002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5853116f89f079ed server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:44.381 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.370+0000 7f57d77fe640 1 -- 172.21.15.102:0/2105462245 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d002c9e0 con 0x7f57d80ca510 2023-10-14T09:38:44.382 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.370+0000 7f57d77fe640 1 -- 172.21.15.102:0/2105462245 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d002cb40 con 0x7f57d80ca510 2023-10-14T09:38:44.382 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.370+0000 7f57d77fe640 1 -- 172.21.15.102:0/2105462245 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d00343f0 con 0x7f57d80ca510 2023-10-14T09:38:44.382 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.371+0000 7f57defa4640 1 -- 172.21.15.102:0/2105462245 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57d80ca510 msgr2=0x7f57d80ca940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:44.383 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.371+0000 7f57defa4640 1 --2- 172.21.15.102:0/2105462245 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57d80ca510 0x7f57d80ca940 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f57d806d540 tx=0x7f57d002be40 comp rx=0 tx=0).stop 2023-10-14T09:38:44.383 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.371+0000 7f57defa4640 1 -- 172.21.15.102:0/2105462245 shutdown_connections 2023-10-14T09:38:44.383 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.371+0000 7f57defa4640 1 --2- 172.21.15.102:0/2105462245 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57d80ca510 0x7f57d80ca940 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:44.383 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.371+0000 7f57defa4640 1 --2- 172.21.15.102:0/2105462245 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f57d80b0360 0x7f57d80b07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:44.384 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.371+0000 7f57defa4640 1 --2- 172.21.15.102:0/2105462245 >> v2:172.21.15.129:3300/0 conn(0x7f57d815ac10 0x7f57d806c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:44.384 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.371+0000 7f57defa4640 1 -- 172.21.15.102:0/2105462245 >> 172.21.15.102:0/2105462245 conn(0x7f57d80cb360 msgr2=0x7f57d80cb740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:44.384 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.371+0000 7f57defa4640 1 -- 172.21.15.102:0/2105462245 shutdown_connections 2023-10-14T09:38:44.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.371+0000 7f57defa4640 1 -- 172.21.15.102:0/2105462245 wait complete. 2023-10-14T09:38:44.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.372+0000 7f57defa4640 1 Processor -- start 2023-10-14T09:38:44.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.373+0000 7f57defa4640 1 -- start start 2023-10-14T09:38:44.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.374+0000 7f57defa4640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f57d80b0360 0x7f57d80accd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:44.386 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.374+0000 7f57defa4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57d80ca510 0x7f57d80cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:44.386 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.374+0000 7f57defa4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f57d815ac10 0x7f57d806afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:44.386 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.374+0000 7f57defa4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d80c6bd0 con 0x7f57d80ca510 2023-10-14T09:38:44.387 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.374+0000 7f57defa4640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d80c6eb0 con 0x7f57d815ac10 2023-10-14T09:38:44.387 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.374+0000 7f57defa4640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d80cd560 con 0x7f57d80b0360 2023-10-14T09:38:44.387 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.374+0000 7f57d7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57d80ca510 0x7f57d80cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:44.387 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.374+0000 7f57d7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57d80ca510 0x7f57d80cdd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55652/0 (socket says 172.21.15.102:55652) 2023-10-14T09:38:44.388 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.374+0000 7f57d7fff640 1 -- 172.21.15.102:0/1435857303 learned_addr learned my addr 172.21.15.102:0/1435857303 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:44.388 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.374+0000 7f57d7fff640 1 -- 172.21.15.102:0/1435857303 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f57d80b0360 msgr2=0x7f57d80accd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:44.388 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.374+0000 7f57d7fff640 1 --2- 172.21.15.102:0/1435857303 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f57d80b0360 0x7f57d80accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:44.388 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.374+0000 7f57d7fff640 1 -- 172.21.15.102:0/1435857303 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f57d815ac10 msgr2=0x7f57d806afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:44.389 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.374+0000 7f57d7fff640 1 --2- 172.21.15.102:0/1435857303 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f57d815ac10 0x7f57d806afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:44.389 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.374+0000 7f57d7fff640 1 -- 172.21.15.102:0/1435857303 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d0009b30 con 0x7f57d80ca510 2023-10-14T09:38:44.389 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.375+0000 7f57d7fff640 1 --2- 172.21.15.102:0/1435857303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57d80ca510 0x7f57d80cdd60 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f57c400b410 tx=0x7f57c400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:44.390 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.375+0000 7f57d57fa640 1 -- 172.21.15.102:0/1435857303 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c4011830 con 0x7f57d80ca510 2023-10-14T09:38:44.390 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.375+0000 7f57d57fa640 1 -- 172.21.15.102:0/1435857303 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c40119b0 con 0x7f57d80ca510 2023-10-14T09:38:44.390 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.375+0000 7f57d57fa640 1 -- 172.21.15.102:0/1435857303 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c4011d60 con 0x7f57d80ca510 2023-10-14T09:38:44.390 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.375+0000 7f57defa4640 1 -- 172.21.15.102:0/1435857303 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d80cd840 con 0x7f57d80ca510 2023-10-14T09:38:44.391 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.375+0000 7f57defa4640 1 -- 172.21.15.102:0/1435857303 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d80ad210 con 0x7f57d80ca510 2023-10-14T09:38:44.391 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.376+0000 7f57defa4640 1 -- 172.21.15.102:0/1435857303 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f57d815bb70 con 0x7f57d80ca510 2023-10-14T09:38:44.391 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.377+0000 7f57d57fa640 1 -- 172.21.15.102:0/1435857303 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f57c401a400 con 0x7f57d80ca510 2023-10-14T09:38:44.392 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.378+0000 7f57d57fa640 1 --2- 172.21.15.102:0/1435857303 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f57bc06ae70 0x7f57bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:44.392 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.378+0000 7f57d57fa640 1 -- 172.21.15.102:0/1435857303 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f57c4089850 con 0x7f57d80ca510 2023-10-14T09:38:44.392 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.378+0000 7f57dcd40640 1 --2- 172.21.15.102:0/1435857303 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f57bc06ae70 0x7f57bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:44.393 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.378+0000 7f57d57fa640 1 --2- 172.21.15.102:0/1435857303 >> [v2:172.21.15.102:6808/1095651107,v1:172.21.15.102:6809/1095651107] conn(0x7f57bc073070 0x7f57bc0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:44.393 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.378+0000 7f57d57fa640 1 -- 172.21.15.102:0/1435857303 --> [v2:172.21.15.102:6808/1095651107,v1:172.21.15.102:6809/1095651107] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f57bc075b80 con 0x7f57bc073070 2023-10-14T09:38:44.393 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.378+0000 7f57d57fa640 1 -- 172.21.15.102:0/1435857303 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57c408be30 con 0x7f57d80ca510 2023-10-14T09:38:44.394 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.379+0000 7f57dd541640 1 --2- 172.21.15.102:0/1435857303 >> [v2:172.21.15.102:6808/1095651107,v1:172.21.15.102:6809/1095651107] conn(0x7f57bc073070 0x7f57bc0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:44.394 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.379+0000 7f57dcd40640 1 --2- 172.21.15.102:0/1435857303 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f57bc06ae70 0x7f57bc06d330 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f57d80c1fa0 tx=0x7f57cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:44.394 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.379+0000 7f57dd541640 1 --2- 172.21.15.102:0/1435857303 >> [v2:172.21.15.102:6808/1095651107,v1:172.21.15.102:6809/1095651107] conn(0x7f57bc073070 0x7f57bc0754b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:44.395 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.380+0000 7f57d57fa640 1 -- 172.21.15.102:0/1435857303 <== osd.1 v2:172.21.15.102:6808/1095651107 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f57bc075b80 con 0x7f57bc073070 2023-10-14T09:38:44.395 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.394+0000 7f57defa4640 1 -- 172.21.15.102:0/1435857303 --> [v2:172.21.15.102:6808/1095651107,v1:172.21.15.102:6809/1095651107] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f57d815b890 con 0x7f57bc073070 2023-10-14T09:38:44.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.394+0000 7f57d57fa640 1 -- 172.21.15.102:0/1435857303 <== osd.1 v2:172.21.15.102:6808/1095651107 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f57d002c8b0 con 0x7f57bc073070 2023-10-14T09:38:44.396 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-10-14T09:38:44.397 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T09:38:44.397 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-10-14T09:38:44.398 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.395+0000 7f57defa4640 1 -- 172.21.15.102:0/1435857303 >> [v2:172.21.15.102:6808/1095651107,v1:172.21.15.102:6809/1095651107] conn(0x7f57bc073070 msgr2=0x7f57bc0754b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:44.399 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.395+0000 7f57defa4640 1 --2- 172.21.15.102:0/1435857303 >> [v2:172.21.15.102:6808/1095651107,v1:172.21.15.102:6809/1095651107] conn(0x7f57bc073070 0x7f57bc0754b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:44.399 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.395+0000 7f57defa4640 1 -- 172.21.15.102:0/1435857303 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f57bc06ae70 msgr2=0x7f57bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:44.399 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.395+0000 7f57defa4640 1 --2- 172.21.15.102:0/1435857303 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f57bc06ae70 0x7f57bc06d330 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f57d80c1fa0 tx=0x7f57cc008040 comp rx=0 tx=0).stop 2023-10-14T09:38:44.399 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.395+0000 7f57defa4640 1 -- 172.21.15.102:0/1435857303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57d80ca510 msgr2=0x7f57d80cdd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:44.400 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.395+0000 7f57defa4640 1 --2- 172.21.15.102:0/1435857303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57d80ca510 0x7f57d80cdd60 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f57c400b410 tx=0x7f57c400b8d0 comp rx=0 tx=0).stop 2023-10-14T09:38:44.400 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.395+0000 7f57dd541640 1 -- 172.21.15.102:0/1435857303 reap_dead start 2023-10-14T09:38:44.400 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.395+0000 7f57defa4640 1 -- 172.21.15.102:0/1435857303 shutdown_connections 2023-10-14T09:38:44.401 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.395+0000 7f57defa4640 1 -- 172.21.15.102:0/1435857303 >> 172.21.15.102:0/1435857303 conn(0x7f57d80cb360 msgr2=0x7f57d80afbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:44.401 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.395+0000 7f57defa4640 1 -- 172.21.15.102:0/1435857303 shutdown_connections 2023-10-14T09:38:44.401 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.395+0000 7f57defa4640 1 -- 172.21.15.102:0/1435857303 wait complete. 2023-10-14T09:38:44.414 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-14T09:38:44.627 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.625+0000 7f6bd6ac2640 1 Processor -- start 2023-10-14T09:38:44.628 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.626+0000 7f6bd6ac2640 1 -- start start 2023-10-14T09:38:44.629 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.627+0000 7f6bd6ac2640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6bd0159ab0 0x7f6bd00ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:44.629 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.627+0000 7f6bd6ac2640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd0070360 con 0x7f6bd006c140 2023-10-14T09:38:44.630 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.627+0000 7f6bd6ac2640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd00cd1f0 con 0x7f6bd0159e90 2023-10-14T09:38:44.630 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.627+0000 7f6bd6ac2640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd015d890 con 0x7f6bd0159ab0 2023-10-14T09:38:44.630 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.628+0000 7f6bd505f640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f6bd006c140 0x7f6bd015dce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55554/0 (socket says 172.21.15.102:55554) 2023-10-14T09:38:44.630 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.628+0000 7f6bd505f640 1 -- 172.21.15.102:0/1129227111 learned_addr learned my addr 172.21.15.102:0/1129227111 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:44.633 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.628+0000 7f6bd485e640 1 --2- 172.21.15.102:0/1129227111 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6bd0159ab0 0x7f6bd00ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:44.634 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.628+0000 7f6bcf7fe640 1 -- 172.21.15.102:0/1129227111 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1952642645 0 0) 0x7f6bd0070360 con 0x7f6bd006c140 2023-10-14T09:38:44.634 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.628+0000 7f6bcf7fe640 1 -- 172.21.15.102:0/1129227111 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bbc003520 con 0x7f6bd006c140 2023-10-14T09:38:44.634 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.628+0000 7f6bcf7fe640 1 -- 172.21.15.102:0/1129227111 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3016595189 0 0) 0x7f6bbc003520 con 0x7f6bd006c140 2023-10-14T09:38:44.634 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.628+0000 7f6bcf7fe640 1 -- 172.21.15.102:0/1129227111 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6bd0159ab0 msgr2=0x7f6bd00ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:44.635 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.628+0000 7f6bcf7fe640 1 --2- 172.21.15.102:0/1129227111 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6bd0159ab0 0x7f6bd00ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:44.635 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.629+0000 7f6bcf7fe640 1 -- 172.21.15.102:0/1129227111 >> v1:172.21.15.129:6789/0 conn(0x7f6bd0159e90 legacy=0x7f6bd006fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:44.635 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.629+0000 7f6bcf7fe640 1 -- 172.21.15.102:0/1129227111 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd00cd4d0 con 0x7f6bd006c140 2023-10-14T09:38:44.636 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.629+0000 7f6bcf7fe640 1 -- 172.21.15.102:0/1129227111 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4030661168 0 0) 0x7f6bc8001670 con 0x7f6bd006c140 2023-10-14T09:38:44.636 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.629+0000 7f6bcf7fe640 1 -- 172.21.15.102:0/1129227111 >> v1:172.21.15.102:6789/0 conn(0x7f6bd006c140 legacy=0x7f6bd015dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:44.636 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.629+0000 7f6bcf7fe640 1 --2- 172.21.15.102:0/1129227111 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bbc0039a0 0x7f6bbc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:44.636 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.629+0000 7f6bcf7fe640 1 --2- 172.21.15.102:0/1129227111 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6bd0159ab0 0x7f6bbc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:44.637 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.629+0000 7f6bcf7fe640 1 --2- 172.21.15.102:0/1129227111 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6bbc004d00 0x7f6bbc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:44.637 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.629+0000 7f6bcf7fe640 1 -- 172.21.15.102:0/1129227111 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd015d890 con 0x7f6bbc0039a0 2023-10-14T09:38:44.637 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.629+0000 7f6bcf7fe640 1 -- 172.21.15.102:0/1129227111 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc00bb40 con 0x7f6bbc004d00 2023-10-14T09:38:44.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.629+0000 7f6bcf7fe640 1 -- 172.21.15.102:0/1129227111 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc00df10 con 0x7f6bd0159ab0 2023-10-14T09:38:44.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.629+0000 7f6bd485e640 1 --2- 172.21.15.102:0/1129227111 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bbc0039a0 0x7f6bbc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:44.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.629+0000 7f6bcffff640 1 --2- 172.21.15.102:0/1129227111 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6bd0159ab0 0x7f6bbc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:44.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.629+0000 7f6bd485e640 1 -- 172.21.15.102:0/1129227111 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6bd0159ab0 msgr2=0x7f6bbc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:44.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.629+0000 7f6bd485e640 1 --2- 172.21.15.102:0/1129227111 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6bd0159ab0 0x7f6bbc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:44.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.629+0000 7f6bd485e640 1 -- 172.21.15.102:0/1129227111 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6bbc004d00 msgr2=0x7f6bbc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:44.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.629+0000 7f6bd485e640 1 --2- 172.21.15.102:0/1129227111 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6bbc004d00 0x7f6bbc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:44.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.629+0000 7f6bd485e640 1 -- 172.21.15.102:0/1129227111 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bbc003520 con 0x7f6bbc0039a0 2023-10-14T09:38:44.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.631+0000 7f6bd485e640 1 --2- 172.21.15.102:0/1129227111 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bbc0039a0 0x7f6bbc003dc0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8009ac0 tx=0x7f6bbc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e7be109540b199 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:44.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.631+0000 7f6bcf7fe640 1 -- 172.21.15.102:0/1129227111 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb802c6b0 con 0x7f6bbc0039a0 2023-10-14T09:38:44.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.631+0000 7f6bcf7fe640 1 -- 172.21.15.102:0/1129227111 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb802c810 con 0x7f6bbc0039a0 2023-10-14T09:38:44.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.631+0000 7f6bcf7fe640 1 -- 172.21.15.102:0/1129227111 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb802cba0 con 0x7f6bbc0039a0 2023-10-14T09:38:44.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.631+0000 7f6bd6ac2640 1 -- 172.21.15.102:0/1129227111 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bbc0039a0 msgr2=0x7f6bbc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:44.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.631+0000 7f6bd6ac2640 1 --2- 172.21.15.102:0/1129227111 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bbc0039a0 0x7f6bbc003dc0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8009ac0 tx=0x7f6bbc0057f0 comp rx=0 tx=0).stop 2023-10-14T09:38:44.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.631+0000 7f6bd505f640 1 -- 172.21.15.102:0/1129227111 reap_dead start 2023-10-14T09:38:44.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.631+0000 7f6bd6ac2640 1 -- 172.21.15.102:0/1129227111 shutdown_connections 2023-10-14T09:38:44.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.631+0000 7f6bd6ac2640 1 -- 172.21.15.102:0/1129227111 >> 172.21.15.102:0/1129227111 conn(0x7f6bd00ce9b0 msgr2=0x7f6bd00cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:44.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.632+0000 7f6bd6ac2640 1 -- 172.21.15.102:0/1129227111 shutdown_connections 2023-10-14T09:38:44.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.632+0000 7f6bd6ac2640 1 -- 172.21.15.102:0/1129227111 wait complete. 2023-10-14T09:38:44.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.633+0000 7f6bd6ac2640 1 Processor -- start 2023-10-14T09:38:44.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.634+0000 7f6bd6ac2640 1 -- start start 2023-10-14T09:38:44.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.634+0000 7f6bd6ac2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bbc0039a0 0x7f6bd00c3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:44.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.634+0000 7f6bd6ac2640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6bd0159330 0x7f6bd015cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:44.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.634+0000 7f6bd6ac2640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6bd01560e0 0x7f6bd00c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:44.647 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.634+0000 7f6bd6ac2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd00c34e0 con 0x7f6bbc0039a0 2023-10-14T09:38:44.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.634+0000 7f6bd6ac2640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd0156560 con 0x7f6bd01560e0 2023-10-14T09:38:44.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.634+0000 7f6bd6ac2640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd00c2860 con 0x7f6bd0159330 2023-10-14T09:38:44.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.635+0000 7f6bd485e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bbc0039a0 0x7f6bd00c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:44.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.635+0000 7f6bd485e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bbc0039a0 0x7f6bd00c3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55680/0 (socket says 172.21.15.102:55680) 2023-10-14T09:38:44.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.635+0000 7f6bd485e640 1 -- 172.21.15.102:0/1609075772 learned_addr learned my addr 172.21.15.102:0/1609075772 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:44.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.635+0000 7f6bcffff640 1 --2- 172.21.15.102:0/1609075772 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6bd0159330 0x7f6bd015cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:44.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.635+0000 7f6bd485e640 1 -- 172.21.15.102:0/1609075772 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6bd0159330 msgr2=0x7f6bd015cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:44.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.635+0000 7f6bd485e640 1 --2- 172.21.15.102:0/1609075772 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6bd0159330 0x7f6bd015cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:44.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.635+0000 7f6bd485e640 1 -- 172.21.15.102:0/1609075772 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6bd01560e0 msgr2=0x7f6bd00c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:44.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.635+0000 7f6bd505f640 1 --2- 172.21.15.102:0/1609075772 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6bd01560e0 0x7f6bd00c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:44.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.635+0000 7f6bd485e640 1 --2- 172.21.15.102:0/1609075772 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6bd01560e0 0x7f6bd00c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:44.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.635+0000 7f6bd485e640 1 -- 172.21.15.102:0/1609075772 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd00c2b40 con 0x7f6bbc0039a0 2023-10-14T09:38:44.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.635+0000 7f6bd505f640 1 --2- 172.21.15.102:0/1609075772 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6bd01560e0 0x7f6bd00c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:44.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.636+0000 7f6bd485e640 1 --2- 172.21.15.102:0/1609075772 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bbc0039a0 0x7f6bd00c3900 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6bb802c250 tx=0x7f6bb8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:44.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.636+0000 7f6bcd7fa640 1 -- 172.21.15.102:0/1609075772 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8003810 con 0x7f6bbc0039a0 2023-10-14T09:38:44.653 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.636+0000 7f6bcd7fa640 1 -- 172.21.15.102:0/1609075772 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb8003970 con 0x7f6bbc0039a0 2023-10-14T09:38:44.653 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.636+0000 7f6bcd7fa640 1 -- 172.21.15.102:0/1609075772 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8003ce0 con 0x7f6bbc0039a0 2023-10-14T09:38:44.653 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.636+0000 7f6bd6ac2640 1 -- 172.21.15.102:0/1609075772 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd00c2e20 con 0x7f6bbc0039a0 2023-10-14T09:38:44.653 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.636+0000 7f6bd6ac2640 1 -- 172.21.15.102:0/1609075772 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd00c24e0 con 0x7f6bbc0039a0 2023-10-14T09:38:44.654 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.637+0000 7f6bd6ac2640 1 -- 172.21.15.102:0/1609075772 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bd004e160 con 0x7f6bbc0039a0 2023-10-14T09:38:44.654 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.638+0000 7f6bcd7fa640 1 -- 172.21.15.102:0/1609075772 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6bb8047450 con 0x7f6bbc0039a0 2023-10-14T09:38:44.654 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.639+0000 7f6bcd7fa640 1 --2- 172.21.15.102:0/1609075772 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f6bb006aef0 0x7f6bb006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:44.655 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.639+0000 7f6bcd7fa640 1 -- 172.21.15.102:0/1609075772 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f6bb80ab610 con 0x7f6bbc0039a0 2023-10-14T09:38:44.655 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.639+0000 7f6bcffff640 1 --2- 172.21.15.102:0/1609075772 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f6bb006aef0 0x7f6bb006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:44.655 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.640+0000 7f6bcffff640 1 --2- 172.21.15.102:0/1609075772 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f6bb006aef0 0x7f6bb006d3b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0007fd0 tx=0x7f6bc0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:44.656 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.644+0000 7f6bcd7fa640 1 -- 172.21.15.102:0/1609075772 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6bb80768c0 con 0x7f6bbc0039a0 2023-10-14T09:38:44.836 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.834+0000 7f6bd6ac2640 1 -- 172.21.15.102:0/1609075772 --> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f6bd00cda90 con 0x7f6bb006aef0 2023-10-14T09:38:44.836 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.834+0000 7f6bcd7fa640 1 -- 172.21.15.102:0/1609075772 <== mgr.4104 v2:172.21.15.102:6832/1125265706 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6bc000d050 con 0x7f6bb006aef0 2023-10-14T09:38:44.837 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 1 to deep-scrub 2023-10-14T09:38:44.839 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.837+0000 7f6bd6ac2640 1 -- 172.21.15.102:0/1609075772 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f6bb006aef0 msgr2=0x7f6bb006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:44.840 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.837+0000 7f6bd6ac2640 1 --2- 172.21.15.102:0/1609075772 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f6bb006aef0 0x7f6bb006d3b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0007fd0 tx=0x7f6bc0009040 comp rx=0 tx=0).stop 2023-10-14T09:38:44.840 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.837+0000 7f6bd6ac2640 1 -- 172.21.15.102:0/1609075772 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bbc0039a0 msgr2=0x7f6bd00c3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:44.840 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.837+0000 7f6bd6ac2640 1 --2- 172.21.15.102:0/1609075772 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bbc0039a0 0x7f6bd00c3900 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6bb802c250 tx=0x7f6bb8004730 comp rx=0 tx=0).stop 2023-10-14T09:38:44.841 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.838+0000 7f6bd6ac2640 1 -- 172.21.15.102:0/1609075772 shutdown_connections 2023-10-14T09:38:44.841 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.838+0000 7f6bd6ac2640 1 --2- 172.21.15.102:0/1609075772 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f6bb006aef0 0x7f6bb006d3b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:44.841 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.838+0000 7f6bd6ac2640 1 --2- 172.21.15.102:0/1609075772 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6bd01560e0 0x7f6bd00c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:44.841 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.838+0000 7f6bd6ac2640 1 --2- 172.21.15.102:0/1609075772 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6bd0159330 0x7f6bd015cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:44.842 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.838+0000 7f6bd6ac2640 1 --2- 172.21.15.102:0/1609075772 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bbc0039a0 0x7f6bd00c3900 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:44.842 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.838+0000 7f6bd6ac2640 1 -- 172.21.15.102:0/1609075772 >> 172.21.15.102:0/1609075772 conn(0x7f6bd00ce9b0 msgr2=0x7f6bd00c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:44.842 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.838+0000 7f6bd6ac2640 1 -- 172.21.15.102:0/1609075772 shutdown_connections 2023-10-14T09:38:44.843 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:44.838+0000 7f6bd6ac2640 1 -- 172.21.15.102:0/1609075772 wait complete. 2023-10-14T09:38:44.857 INFO:tasks.ceph:Scrubbing osd.2 2023-10-14T09:38:44.857 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-14T09:38:45.076 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.074+0000 7fcbe359e640 1 Processor -- start 2023-10-14T09:38:45.076 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.074+0000 7fcbe359e640 1 -- start start 2023-10-14T09:38:45.077 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.075+0000 7fcbe359e640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcbe406c040 0x7fcbe406c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:45.078 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.076+0000 7fcbe359e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe415f4a0 con 0x7fcbe40cda80 2023-10-14T09:38:45.078 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.076+0000 7fcbe359e640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe406c960 con 0x7fcbe40ad970 2023-10-14T09:38:45.078 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.076+0000 7fcbe359e640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe415b9d0 con 0x7fcbe406c040 2023-10-14T09:38:45.080 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.076+0000 7fcbe2d9d640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fcbe40cda80 0x7fcbe415ed90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55568/0 (socket says 172.21.15.102:55568) 2023-10-14T09:38:45.080 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.076+0000 7fcbe2d9d640 1 -- 172.21.15.102:0/830976267 learned_addr learned my addr 172.21.15.102:0/830976267 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:45.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.076+0000 7fcbe259c640 1 --2- 172.21.15.102:0/830976267 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcbe406c040 0x7fcbe406c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:45.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.077+0000 7fcbe159a640 1 -- 172.21.15.102:0/830976267 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 172190654 0 0) 0x7fcbe415f4a0 con 0x7fcbe40cda80 2023-10-14T09:38:45.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.077+0000 7fcbe159a640 1 -- 172.21.15.102:0/830976267 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbcc003520 con 0x7fcbe40cda80 2023-10-14T09:38:45.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.077+0000 7fcbe159a640 1 -- 172.21.15.102:0/830976267 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 308520460 0 0) 0x7fcbcc003520 con 0x7fcbe40cda80 2023-10-14T09:38:45.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.077+0000 7fcbe159a640 1 -- 172.21.15.102:0/830976267 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcbe406c040 msgr2=0x7fcbe406c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:45.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.077+0000 7fcbe159a640 1 --2- 172.21.15.102:0/830976267 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcbe406c040 0x7fcbe406c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:45.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.077+0000 7fcbe159a640 1 -- 172.21.15.102:0/830976267 >> v1:172.21.15.129:6789/0 conn(0x7fcbe40ad970 legacy=0x7fcbe415e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:45.083 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.077+0000 7fcbe159a640 1 -- 172.21.15.102:0/830976267 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe415bcb0 con 0x7fcbe40cda80 2023-10-14T09:38:45.083 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.077+0000 7fcbe159a640 1 -- 172.21.15.102:0/830976267 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4030661168 0 0) 0x7fcbdc0019f0 con 0x7fcbe40cda80 2023-10-14T09:38:45.083 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.077+0000 7fcbe159a640 1 -- 172.21.15.102:0/830976267 >> v1:172.21.15.102:6789/0 conn(0x7fcbe40cda80 legacy=0x7fcbe415ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:45.083 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.077+0000 7fcbe159a640 1 --2- 172.21.15.102:0/830976267 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbcc0039a0 0x7fcbcc003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:45.084 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.077+0000 7fcbe159a640 1 --2- 172.21.15.102:0/830976267 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcbe406c040 0x7fcbcc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:45.084 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.077+0000 7fcbe159a640 1 --2- 172.21.15.102:0/830976267 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcbcc004d00 0x7fcbcc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:45.084 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.077+0000 7fcbe159a640 1 -- 172.21.15.102:0/830976267 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe415b9d0 con 0x7fcbcc0039a0 2023-10-14T09:38:45.085 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.077+0000 7fcbe159a640 1 -- 172.21.15.102:0/830976267 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc00b980 con 0x7fcbcc004d00 2023-10-14T09:38:45.085 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.077+0000 7fcbe159a640 1 -- 172.21.15.102:0/830976267 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc00bb40 con 0x7fcbe406c040 2023-10-14T09:38:45.085 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.078+0000 7fcbe259c640 1 --2- 172.21.15.102:0/830976267 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbcc0039a0 0x7fcbcc003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:45.085 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.078+0000 7fcbe1d9b640 1 --2- 172.21.15.102:0/830976267 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcbe406c040 0x7fcbcc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:45.086 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.078+0000 7fcbe2d9d640 1 --2- 172.21.15.102:0/830976267 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcbcc004d00 0x7fcbcc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:45.086 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.078+0000 7fcbe259c640 1 -- 172.21.15.102:0/830976267 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcbe406c040 msgr2=0x7fcbcc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:45.086 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.078+0000 7fcbe259c640 1 --2- 172.21.15.102:0/830976267 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcbe406c040 0x7fcbcc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:45.087 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.078+0000 7fcbe259c640 1 -- 172.21.15.102:0/830976267 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcbcc004d00 msgr2=0x7fcbcc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:45.087 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.078+0000 7fcbe259c640 1 --2- 172.21.15.102:0/830976267 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcbcc004d00 0x7fcbcc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:45.087 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.078+0000 7fcbe259c640 1 -- 172.21.15.102:0/830976267 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbcc003520 con 0x7fcbcc0039a0 2023-10-14T09:38:45.091 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.079+0000 7fcbe259c640 1 --2- 172.21.15.102:0/830976267 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbcc0039a0 0x7fcbcc003d80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4009ac0 tx=0x7fcbcc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85886e77e9f9ab34 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:45.091 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.080+0000 7fcbe159a640 1 -- 172.21.15.102:0/830976267 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd402c600 con 0x7fcbcc0039a0 2023-10-14T09:38:45.092 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.080+0000 7fcbe159a640 1 -- 172.21.15.102:0/830976267 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd402c760 con 0x7fcbcc0039a0 2023-10-14T09:38:45.092 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.080+0000 7fcbe159a640 1 -- 172.21.15.102:0/830976267 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd402caf0 con 0x7fcbcc0039a0 2023-10-14T09:38:45.092 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.080+0000 7fcbe359e640 1 -- 172.21.15.102:0/830976267 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbcc0039a0 msgr2=0x7fcbcc003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:45.093 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.080+0000 7fcbe359e640 1 --2- 172.21.15.102:0/830976267 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbcc0039a0 0x7fcbcc003d80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4009ac0 tx=0x7fcbcc0057f0 comp rx=0 tx=0).stop 2023-10-14T09:38:45.093 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.080+0000 7fcbe2d9d640 1 -- 172.21.15.102:0/830976267 reap_dead start 2023-10-14T09:38:45.093 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.080+0000 7fcbe359e640 1 -- 172.21.15.102:0/830976267 shutdown_connections 2023-10-14T09:38:45.093 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.080+0000 7fcbe359e640 1 -- 172.21.15.102:0/830976267 >> 172.21.15.102:0/830976267 conn(0x7fcbe40ce6a0 msgr2=0x7fcbe40ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:45.094 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.081+0000 7fcbe359e640 1 -- 172.21.15.102:0/830976267 shutdown_connections 2023-10-14T09:38:45.094 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.081+0000 7fcbe359e640 1 -- 172.21.15.102:0/830976267 wait complete. 2023-10-14T09:38:45.094 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.082+0000 7fcbe359e640 1 Processor -- start 2023-10-14T09:38:45.094 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.082+0000 7fcbe359e640 1 -- start start 2023-10-14T09:38:45.095 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.083+0000 7fcbe359e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbcc0039a0 0x7fcbe40c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:45.095 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.083+0000 7fcbe359e640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcbe40c5770 0x7fcbe4156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:45.095 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.083+0000 7fcbe359e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcbe40b27f0 0x7fcbe40b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:45.095 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.083+0000 7fcbe359e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe40b31e0 con 0x7fcbcc0039a0 2023-10-14T09:38:45.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.083+0000 7fcbe359e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe40c73b0 con 0x7fcbe40b27f0 2023-10-14T09:38:45.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.083+0000 7fcbe359e640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe415a810 con 0x7fcbe40c5770 2023-10-14T09:38:45.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.084+0000 7fcbe259c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbcc0039a0 0x7fcbe40c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:45.097 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.084+0000 7fcbe259c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbcc0039a0 0x7fcbe40c6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55698/0 (socket says 172.21.15.102:55698) 2023-10-14T09:38:45.097 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.084+0000 7fcbe259c640 1 -- 172.21.15.102:0/3117610067 learned_addr learned my addr 172.21.15.102:0/3117610067 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:45.097 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.084+0000 7fcbe1d9b640 1 --2- 172.21.15.102:0/3117610067 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcbe40c5770 0x7fcbe4156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:45.097 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.084+0000 7fcbe2d9d640 1 --2- 172.21.15.102:0/3117610067 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcbe40b27f0 0x7fcbe40b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:45.098 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.084+0000 7fcbe259c640 1 -- 172.21.15.102:0/3117610067 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcbe40c5770 msgr2=0x7fcbe4156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:45.098 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.084+0000 7fcbe259c640 1 --2- 172.21.15.102:0/3117610067 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcbe40c5770 0x7fcbe4156920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:45.098 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.084+0000 7fcbe259c640 1 -- 172.21.15.102:0/3117610067 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcbe40b27f0 msgr2=0x7fcbe40b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:45.098 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.084+0000 7fcbe259c640 1 --2- 172.21.15.102:0/3117610067 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcbe40b27f0 0x7fcbe40b2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:45.099 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.084+0000 7fcbe259c640 1 -- 172.21.15.102:0/3117610067 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe4156e60 con 0x7fcbcc0039a0 2023-10-14T09:38:45.099 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.084+0000 7fcbe259c640 1 --2- 172.21.15.102:0/3117610067 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbcc0039a0 0x7fcbe40c6e70 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4037040 tx=0x7fcbd4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:45.099 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.085+0000 7fcbd2ffd640 1 -- 172.21.15.102:0/3117610067 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd4003810 con 0x7fcbcc0039a0 2023-10-14T09:38:45.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.085+0000 7fcbd2ffd640 1 -- 172.21.15.102:0/3117610067 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd4003970 con 0x7fcbcc0039a0 2023-10-14T09:38:45.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.085+0000 7fcbd2ffd640 1 -- 172.21.15.102:0/3117610067 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd4003ce0 con 0x7fcbcc0039a0 2023-10-14T09:38:45.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.085+0000 7fcbe359e640 1 -- 172.21.15.102:0/3117610067 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbe40c75e0 con 0x7fcbcc0039a0 2023-10-14T09:38:45.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.085+0000 7fcbe359e640 1 -- 172.21.15.102:0/3117610067 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe40c7ba0 con 0x7fcbcc0039a0 2023-10-14T09:38:45.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.086+0000 7fcbe359e640 1 -- 172.21.15.102:0/3117610067 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcbe40cc270 con 0x7fcbcc0039a0 2023-10-14T09:38:45.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.087+0000 7fcbd2ffd640 1 -- 172.21.15.102:0/3117610067 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcbd4034440 con 0x7fcbcc0039a0 2023-10-14T09:38:45.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.088+0000 7fcbd2ffd640 1 --2- 172.21.15.102:0/3117610067 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fcbc406aea0 0x7fcbc406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:45.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.088+0000 7fcbd2ffd640 1 -- 172.21.15.102:0/3117610067 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fcbd40ab540 con 0x7fcbcc0039a0 2023-10-14T09:38:45.102 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.088+0000 7fcbe1d9b640 1 --2- 172.21.15.102:0/3117610067 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fcbc406aea0 0x7fcbc406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:45.102 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.088+0000 7fcbd2ffd640 1 --2- 172.21.15.102:0/3117610067 >> [v2:172.21.15.102:6817/2198222556,v1:172.21.15.102:6820/2198222556] conn(0x7fcbc40730a0 0x7fcbc40754e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:45.102 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.088+0000 7fcbd2ffd640 1 -- 172.21.15.102:0/3117610067 --> [v2:172.21.15.102:6817/2198222556,v1:172.21.15.102:6820/2198222556] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcbc4075bb0 con 0x7fcbc40730a0 2023-10-14T09:38:45.103 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.088+0000 7fcbd2ffd640 1 -- 172.21.15.102:0/3117610067 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcbd40adbd0 con 0x7fcbcc0039a0 2023-10-14T09:38:45.103 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.088+0000 7fcbe2d9d640 1 --2- 172.21.15.102:0/3117610067 >> [v2:172.21.15.102:6817/2198222556,v1:172.21.15.102:6820/2198222556] conn(0x7fcbc40730a0 0x7fcbc40754e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:45.103 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.089+0000 7fcbe1d9b640 1 --2- 172.21.15.102:0/3117610067 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fcbc406aea0 0x7fcbc406d360 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8007fd0 tx=0x7fcbd8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:45.103 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.089+0000 7fcbe2d9d640 1 --2- 172.21.15.102:0/3117610067 >> [v2:172.21.15.102:6817/2198222556,v1:172.21.15.102:6820/2198222556] conn(0x7fcbc40730a0 0x7fcbc40754e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:45.104 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.090+0000 7fcbd2ffd640 1 -- 172.21.15.102:0/3117610067 <== osd.2 v2:172.21.15.102:6817/2198222556 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fcbc4075bb0 con 0x7fcbc40730a0 2023-10-14T09:38:45.105 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.104+0000 7fcbe359e640 1 -- 172.21.15.102:0/3117610067 --> [v2:172.21.15.102:6817/2198222556,v1:172.21.15.102:6820/2198222556] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcbe415bf90 con 0x7fcbc40730a0 2023-10-14T09:38:45.106 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.104+0000 7fcbd2ffd640 1 -- 172.21.15.102:0/3117610067 <== osd.2 v2:172.21.15.102:6817/2198222556 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fcbdc0020c0 con 0x7fcbc40730a0 2023-10-14T09:38:45.106 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-10-14T09:38:45.107 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T09:38:45.107 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-10-14T09:38:45.108 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.104+0000 7fcbe359e640 1 -- 172.21.15.102:0/3117610067 >> [v2:172.21.15.102:6817/2198222556,v1:172.21.15.102:6820/2198222556] conn(0x7fcbc40730a0 msgr2=0x7fcbc40754e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:45.108 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.104+0000 7fcbe359e640 1 --2- 172.21.15.102:0/3117610067 >> [v2:172.21.15.102:6817/2198222556,v1:172.21.15.102:6820/2198222556] conn(0x7fcbc40730a0 0x7fcbc40754e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:45.108 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.105+0000 7fcbe359e640 1 -- 172.21.15.102:0/3117610067 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fcbc406aea0 msgr2=0x7fcbc406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:45.109 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.105+0000 7fcbe359e640 1 --2- 172.21.15.102:0/3117610067 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fcbc406aea0 0x7fcbc406d360 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8007fd0 tx=0x7fcbd8009040 comp rx=0 tx=0).stop 2023-10-14T09:38:45.109 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.105+0000 7fcbe359e640 1 -- 172.21.15.102:0/3117610067 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbcc0039a0 msgr2=0x7fcbe40c6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:45.109 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.105+0000 7fcbe359e640 1 --2- 172.21.15.102:0/3117610067 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbcc0039a0 0x7fcbe40c6e70 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4037040 tx=0x7fcbd4004730 comp rx=0 tx=0).stop 2023-10-14T09:38:45.110 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.105+0000 7fcbe2d9d640 1 -- 172.21.15.102:0/3117610067 reap_dead start 2023-10-14T09:38:45.110 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.105+0000 7fcbe359e640 1 -- 172.21.15.102:0/3117610067 shutdown_connections 2023-10-14T09:38:45.110 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.105+0000 7fcbe359e640 1 -- 172.21.15.102:0/3117610067 >> 172.21.15.102:0/3117610067 conn(0x7fcbe40ce6a0 msgr2=0x7fcbe40ac890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:45.110 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.105+0000 7fcbe359e640 1 -- 172.21.15.102:0/3117610067 shutdown_connections 2023-10-14T09:38:45.111 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.105+0000 7fcbe359e640 1 -- 172.21.15.102:0/3117610067 wait complete. 2023-10-14T09:38:45.124 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-14T09:38:45.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.334+0000 7f43f1cd4640 1 Processor -- start 2023-10-14T09:38:45.337 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.335+0000 7f43f1cd4640 1 -- start start 2023-10-14T09:38:45.338 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.336+0000 7f43f1cd4640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f43ec15ad70 0x7f43ec069da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:45.339 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.336+0000 7f43f1cd4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f43ec0c9ca0 0x7f43ec06a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:45.339 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.336+0000 7f43f1cd4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43ec0cb030 con 0x7f43ec0ca3b0 2023-10-14T09:38:45.339 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.336+0000 7f43f1cd4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43ec0c91c0 con 0x7f43ec0c9ca0 2023-10-14T09:38:45.339 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.336+0000 7f43f1cd4640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43ec0c94a0 con 0x7f43ec15ad70 2023-10-14T09:38:45.340 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.336+0000 7f43ebfff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f43ec0ca3b0 0x7f43ec0ca840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55578/0 (socket says 172.21.15.102:55578) 2023-10-14T09:38:45.340 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.336+0000 7f43ebfff640 1 -- 172.21.15.102:0/7866869 learned_addr learned my addr 172.21.15.102:0/7866869 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:45.340 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.336+0000 7f43e3fff640 1 --2- 172.21.15.102:0/7866869 >> v2:172.21.15.102:3300/0 conn(0x7f43ec0c9ca0 0x7f43ec06a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:45.341 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.336+0000 7f43eb7fe640 1 --2- 172.21.15.102:0/7866869 >> v2:172.21.15.129:3300/0 conn(0x7f43ec15ad70 0x7f43ec069da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:45.341 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.336+0000 7f43eaffd640 1 -- 172.21.15.102:0/7866869 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2384333163 0 0) 0x7f43ec0cb030 con 0x7f43ec0ca3b0 2023-10-14T09:38:45.341 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.337+0000 7f43eaffd640 1 -- 172.21.15.102:0/7866869 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43d8003520 con 0x7f43ec0ca3b0 2023-10-14T09:38:45.341 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.337+0000 7f43e3fff640 1 -- 172.21.15.102:0/7866869 >> v2:172.21.15.129:3300/0 conn(0x7f43ec15ad70 msgr2=0x7f43ec069da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:45.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.337+0000 7f43e3fff640 1 --2- 172.21.15.102:0/7866869 >> v2:172.21.15.129:3300/0 conn(0x7f43ec15ad70 0x7f43ec069da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:45.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.337+0000 7f43e3fff640 1 -- 172.21.15.102:0/7866869 >> v1:172.21.15.102:6789/0 conn(0x7f43ec0ca3b0 legacy=0x7f43ec0ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:45.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.337+0000 7f43e3fff640 1 -- 172.21.15.102:0/7866869 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ec0c9780 con 0x7f43ec0c9ca0 2023-10-14T09:38:45.345 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.338+0000 7f43e3fff640 1 --2- 172.21.15.102:0/7866869 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43ec0c9ca0 0x7f43ec06a2e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f43ec0cf780 tx=0x7f43d402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5cf6ec873aa0b43 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:45.345 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.338+0000 7f43eaffd640 1 -- 172.21.15.102:0/7866869 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d4031830 con 0x7f43ec0c9ca0 2023-10-14T09:38:45.345 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.338+0000 7f43eaffd640 1 -- 172.21.15.102:0/7866869 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d4031990 con 0x7f43ec0c9ca0 2023-10-14T09:38:45.346 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.338+0000 7f43eaffd640 1 -- 172.21.15.102:0/7866869 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d4031d20 con 0x7f43ec0c9ca0 2023-10-14T09:38:45.346 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.339+0000 7f43f1cd4640 1 -- 172.21.15.102:0/7866869 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43ec0c9ca0 msgr2=0x7f43ec06a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:45.346 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.339+0000 7f43f1cd4640 1 --2- 172.21.15.102:0/7866869 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43ec0c9ca0 0x7f43ec06a2e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f43ec0cf780 tx=0x7f43d402b8d0 comp rx=0 tx=0).stop 2023-10-14T09:38:45.347 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.339+0000 7f43f1cd4640 1 -- 172.21.15.102:0/7866869 shutdown_connections 2023-10-14T09:38:45.347 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.339+0000 7f43f1cd4640 1 --2- 172.21.15.102:0/7866869 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43ec0c9ca0 0x7f43ec06a2e0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:45.347 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.339+0000 7f43f1cd4640 1 --2- 172.21.15.102:0/7866869 >> v2:172.21.15.129:3300/0 conn(0x7f43ec15ad70 0x7f43ec069da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:45.347 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.339+0000 7f43f1cd4640 1 -- 172.21.15.102:0/7866869 >> 172.21.15.102:0/7866869 conn(0x7f43ec0ce9b0 msgr2=0x7f43ec0cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:45.348 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.339+0000 7f43f1cd4640 1 -- 172.21.15.102:0/7866869 shutdown_connections 2023-10-14T09:38:45.348 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.339+0000 7f43f1cd4640 1 -- 172.21.15.102:0/7866869 wait complete. 2023-10-14T09:38:45.348 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.341+0000 7f43f1cd4640 1 Processor -- start 2023-10-14T09:38:45.348 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.341+0000 7f43f1cd4640 1 -- start start 2023-10-14T09:38:45.349 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.342+0000 7f43f1cd4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43ec0c9ca0 0x7f43ec0c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:45.349 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.342+0000 7f43f1cd4640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f43ec0ca3b0 0x7f43ec14d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:45.349 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.342+0000 7f43f1cd4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f43ec15ad70 0x7f43ec14d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:45.350 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.342+0000 7f43f1cd4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec0b15d0 con 0x7f43ec0c9ca0 2023-10-14T09:38:45.350 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.342+0000 7f43f1cd4640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec14dfd0 con 0x7f43ec15ad70 2023-10-14T09:38:45.350 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.342+0000 7f43f1cd4640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec14e2b0 con 0x7f43ec0ca3b0 2023-10-14T09:38:45.350 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.342+0000 7f43eb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43ec0c9ca0 0x7f43ec0c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:45.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.342+0000 7f43eb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43ec0c9ca0 0x7f43ec0c8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55724/0 (socket says 172.21.15.102:55724) 2023-10-14T09:38:45.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.342+0000 7f43eb7fe640 1 -- 172.21.15.102:0/2807586863 learned_addr learned my addr 172.21.15.102:0/2807586863 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:45.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.342+0000 7f43e3fff640 1 --2- 172.21.15.102:0/2807586863 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f43ec0ca3b0 0x7f43ec14d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:45.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.342+0000 7f43eb7fe640 1 -- 172.21.15.102:0/2807586863 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f43ec0ca3b0 msgr2=0x7f43ec14d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:45.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.342+0000 7f43eb7fe640 1 --2- 172.21.15.102:0/2807586863 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f43ec0ca3b0 0x7f43ec14d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:45.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.342+0000 7f43eb7fe640 1 -- 172.21.15.102:0/2807586863 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f43ec15ad70 msgr2=0x7f43ec14d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:45.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.342+0000 7f43eb7fe640 1 --2- 172.21.15.102:0/2807586863 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f43ec15ad70 0x7f43ec14d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:45.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.342+0000 7f43eb7fe640 1 -- 172.21.15.102:0/2807586863 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d4009400 con 0x7f43ec0c9ca0 2023-10-14T09:38:45.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.342+0000 7f43e3fff640 1 --2- 172.21.15.102:0/2807586863 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f43ec0ca3b0 0x7f43ec14d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:45.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.343+0000 7f43eb7fe640 1 --2- 172.21.15.102:0/2807586863 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43ec0c9ca0 0x7f43ec0c8ab0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f43dc00d5f0 tx=0x7f43dc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:45.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.343+0000 7f43e8ff9640 1 -- 172.21.15.102:0/2807586863 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc0125f0 con 0x7f43ec0c9ca0 2023-10-14T09:38:45.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.343+0000 7f43e8ff9640 1 -- 172.21.15.102:0/2807586863 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43dc012750 con 0x7f43ec0c9ca0 2023-10-14T09:38:45.354 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.343+0000 7f43e8ff9640 1 -- 172.21.15.102:0/2807586863 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc012b00 con 0x7f43ec0c9ca0 2023-10-14T09:38:45.354 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.343+0000 7f43f1cd4640 1 -- 172.21.15.102:0/2807586863 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43ec14e590 con 0x7f43ec0c9ca0 2023-10-14T09:38:45.354 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.343+0000 7f43f1cd4640 1 -- 172.21.15.102:0/2807586863 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43ec14dcd0 con 0x7f43ec0c9ca0 2023-10-14T09:38:45.355 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.344+0000 7f43f1cd4640 1 -- 172.21.15.102:0/2807586863 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43ec04e160 con 0x7f43ec0c9ca0 2023-10-14T09:38:45.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.345+0000 7f43e8ff9640 1 -- 172.21.15.102:0/2807586863 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f43dc012c60 con 0x7f43ec0c9ca0 2023-10-14T09:38:45.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.347+0000 7f43e8ff9640 1 --2- 172.21.15.102:0/2807586863 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f43cc06ae70 0x7f43cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:45.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.347+0000 7f43e8ff9640 1 -- 172.21.15.102:0/2807586863 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f43dc089b20 con 0x7f43ec0c9ca0 2023-10-14T09:38:45.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.347+0000 7f43e3fff640 1 --2- 172.21.15.102:0/2807586863 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f43cc06ae70 0x7f43cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:45.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.348+0000 7f43e3fff640 1 --2- 172.21.15.102:0/2807586863 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f43cc06ae70 0x7f43cc06d330 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f43d4036000 tx=0x7f43d4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:45.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.351+0000 7f43e8ff9640 1 -- 172.21.15.102:0/2807586863 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f43dc054bb0 con 0x7f43ec0c9ca0 2023-10-14T09:38:45.544 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.542+0000 7f43f1cd4640 1 -- 172.21.15.102:0/2807586863 --> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f43ec0ad4d0 con 0x7f43cc06ae70 2023-10-14T09:38:45.545 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.543+0000 7f43e8ff9640 1 -- 172.21.15.102:0/2807586863 <== mgr.4104 v2:172.21.15.102:6832/1125265706 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f43d4045400 con 0x7f43cc06ae70 2023-10-14T09:38:45.545 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 2 to deep-scrub 2023-10-14T09:38:45.548 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.546+0000 7f43f1cd4640 1 -- 172.21.15.102:0/2807586863 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f43cc06ae70 msgr2=0x7f43cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:45.548 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.546+0000 7f43f1cd4640 1 --2- 172.21.15.102:0/2807586863 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f43cc06ae70 0x7f43cc06d330 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f43d4036000 tx=0x7f43d4008030 comp rx=0 tx=0).stop 2023-10-14T09:38:45.548 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.546+0000 7f43f1cd4640 1 -- 172.21.15.102:0/2807586863 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43ec0c9ca0 msgr2=0x7f43ec0c8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:45.549 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.546+0000 7f43f1cd4640 1 --2- 172.21.15.102:0/2807586863 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43ec0c9ca0 0x7f43ec0c8ab0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f43dc00d5f0 tx=0x7f43dc00dab0 comp rx=0 tx=0).stop 2023-10-14T09:38:45.549 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.546+0000 7f43f1cd4640 1 -- 172.21.15.102:0/2807586863 shutdown_connections 2023-10-14T09:38:45.549 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.546+0000 7f43f1cd4640 1 --2- 172.21.15.102:0/2807586863 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f43cc06ae70 0x7f43cc06d330 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:45.550 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.546+0000 7f43f1cd4640 1 --2- 172.21.15.102:0/2807586863 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f43ec15ad70 0x7f43ec14d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:45.550 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.546+0000 7f43f1cd4640 1 --2- 172.21.15.102:0/2807586863 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f43ec0ca3b0 0x7f43ec14d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:45.550 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.546+0000 7f43f1cd4640 1 --2- 172.21.15.102:0/2807586863 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43ec0c9ca0 0x7f43ec0c8ab0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:45.550 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.546+0000 7f43f1cd4640 1 -- 172.21.15.102:0/2807586863 >> 172.21.15.102:0/2807586863 conn(0x7f43ec0ce9b0 msgr2=0x7f43ec070d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:45.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.546+0000 7f43f1cd4640 1 -- 172.21.15.102:0/2807586863 shutdown_connections 2023-10-14T09:38:45.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.546+0000 7f43f1cd4640 1 -- 172.21.15.102:0/2807586863 wait complete. 2023-10-14T09:38:45.566 INFO:tasks.ceph:Scrubbing osd.3 2023-10-14T09:38:45.567 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-14T09:38:45.774 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.773+0000 7f944d41a640 1 Processor -- start 2023-10-14T09:38:45.775 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.773+0000 7f944d41a640 1 -- start start 2023-10-14T09:38:45.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.774+0000 7f944d41a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f94480ad7a0 0x7f9448070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:45.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.774+0000 7f944d41a640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f94480adc30 0x7f9448070780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:45.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.774+0000 7f944d41a640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94480ae1a0 con 0x7f9448160c80 2023-10-14T09:38:45.778 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.774+0000 7f944d41a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94480ae480 con 0x7f94480ad7a0 2023-10-14T09:38:45.778 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.774+0000 7f944d41a640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94480ae760 con 0x7f94480adc30 2023-10-14T09:38:45.778 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.775+0000 7f94477fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f94480ad7a0 0x7f9448070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:45.779 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.775+0000 7f94477fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f94480ad7a0 0x7f9448070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55726/0 (socket says 172.21.15.102:55726) 2023-10-14T09:38:45.779 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.775+0000 7f94477fe640 1 -- 172.21.15.102:0/4034115014 learned_addr learned my addr 172.21.15.102:0/4034115014 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:45.779 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.775+0000 7f944cc19640 1 --2- 172.21.15.102:0/4034115014 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f94480adc30 0x7f9448070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:45.779 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.775+0000 7f94477fe640 1 -- 172.21.15.102:0/4034115014 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f94480adc30 msgr2=0x7f9448070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:45.780 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.775+0000 7f94477fe640 1 --2- 172.21.15.102:0/4034115014 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f94480adc30 0x7f9448070780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:45.780 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.775+0000 7f94477fe640 1 -- 172.21.15.102:0/4034115014 >> v1:172.21.15.129:6789/0 conn(0x7f9448160c80 legacy=0x7f9448161060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:45.780 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.775+0000 7f94477fe640 1 -- 172.21.15.102:0/4034115014 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94480aea40 con 0x7f94480ad7a0 2023-10-14T09:38:45.780 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.775+0000 7f944cc19640 1 --2- 172.21.15.102:0/4034115014 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f94480adc30 0x7f9448070780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:45.782 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.776+0000 7f94477fe640 1 --2- 172.21.15.102:0/4034115014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f94480ad7a0 0x7f9448070240 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9430009870 tx=0x7f943002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=276d6f9065b9dd03 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:45.783 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.777+0000 7f9446ffd640 1 -- 172.21.15.102:0/4034115014 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9430031640 con 0x7f94480ad7a0 2023-10-14T09:38:45.783 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.777+0000 7f9446ffd640 1 -- 172.21.15.102:0/4034115014 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94300317a0 con 0x7f94480ad7a0 2023-10-14T09:38:45.783 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.777+0000 7f9446ffd640 1 -- 172.21.15.102:0/4034115014 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9430031b30 con 0x7f94480ad7a0 2023-10-14T09:38:45.784 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.777+0000 7f944d41a640 1 -- 172.21.15.102:0/4034115014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f94480ad7a0 msgr2=0x7f9448070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:45.784 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.777+0000 7f944d41a640 1 --2- 172.21.15.102:0/4034115014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f94480ad7a0 0x7f9448070240 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9430009870 tx=0x7f943002b8f0 comp rx=0 tx=0).stop 2023-10-14T09:38:45.784 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.777+0000 7f944d41a640 1 -- 172.21.15.102:0/4034115014 shutdown_connections 2023-10-14T09:38:45.784 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.777+0000 7f944d41a640 1 --2- 172.21.15.102:0/4034115014 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f94480adc30 0x7f9448070780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:45.785 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.777+0000 7f944d41a640 1 --2- 172.21.15.102:0/4034115014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f94480ad7a0 0x7f9448070240 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:45.785 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.777+0000 7f944d41a640 1 -- 172.21.15.102:0/4034115014 >> 172.21.15.102:0/4034115014 conn(0x7f94480cc230 msgr2=0x7f94480cc610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:45.785 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.778+0000 7f944d41a640 1 -- 172.21.15.102:0/4034115014 shutdown_connections 2023-10-14T09:38:45.785 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.778+0000 7f944d41a640 1 -- 172.21.15.102:0/4034115014 wait complete. 2023-10-14T09:38:45.786 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.779+0000 7f944d41a640 1 Processor -- start 2023-10-14T09:38:45.786 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.779+0000 7f944d41a640 1 -- start start 2023-10-14T09:38:45.786 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.780+0000 7f944d41a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f94480ad7a0 0x7f944815b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:45.786 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.780+0000 7f944d41a640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f94480adc30 0x7f94481e6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:45.787 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.780+0000 7f944d41a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9448160c80 0x7f94481422e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:45.787 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.780+0000 7f944d41a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94481e7b10 con 0x7f9448160c80 2023-10-14T09:38:45.787 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.780+0000 7f944d41a640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94481e7270 con 0x7f94480ad7a0 2023-10-14T09:38:45.788 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.780+0000 7f944d41a640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94481e7550 con 0x7f94480adc30 2023-10-14T09:38:45.788 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.781+0000 7f944cc19640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9448160c80 0x7f94481422e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:45.788 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.781+0000 7f944cc19640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9448160c80 0x7f94481422e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55730/0 (socket says 172.21.15.102:55730) 2023-10-14T09:38:45.789 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.781+0000 7f944cc19640 1 -- 172.21.15.102:0/744782701 learned_addr learned my addr 172.21.15.102:0/744782701 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:45.789 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.781+0000 7f94477fe640 1 --2- 172.21.15.102:0/744782701 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f94480adc30 0x7f94481e6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:45.789 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.781+0000 7f9447fff640 1 --2- 172.21.15.102:0/744782701 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f94480ad7a0 0x7f944815b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:45.791 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.781+0000 7f944cc19640 1 -- 172.21.15.102:0/744782701 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f94480adc30 msgr2=0x7f94481e6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:45.792 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.781+0000 7f944cc19640 1 --2- 172.21.15.102:0/744782701 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f94480adc30 0x7f94481e6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:45.792 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.781+0000 7f944cc19640 1 -- 172.21.15.102:0/744782701 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f94480ad7a0 msgr2=0x7f944815b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:45.792 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.781+0000 7f944cc19640 1 --2- 172.21.15.102:0/744782701 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f94480ad7a0 0x7f944815b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:45.792 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.781+0000 7f944cc19640 1 -- 172.21.15.102:0/744782701 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94300094d0 con 0x7f9448160c80 2023-10-14T09:38:45.793 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.782+0000 7f944cc19640 1 --2- 172.21.15.102:0/744782701 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9448160c80 0x7f94481422e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f944000c7f0 tx=0x7f944000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:45.793 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.782+0000 7f9444ff9640 1 -- 172.21.15.102:0/744782701 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9440007820 con 0x7f9448160c80 2023-10-14T09:38:45.793 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.782+0000 7f9444ff9640 1 -- 172.21.15.102:0/744782701 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9440007980 con 0x7f9448160c80 2023-10-14T09:38:45.794 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.782+0000 7f9444ff9640 1 -- 172.21.15.102:0/744782701 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9440007d70 con 0x7f9448160c80 2023-10-14T09:38:45.794 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.782+0000 7f944d41a640 1 -- 172.21.15.102:0/744782701 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94481e7830 con 0x7f9448160c80 2023-10-14T09:38:45.794 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.782+0000 7f944d41a640 1 -- 172.21.15.102:0/744782701 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f944815b9d0 con 0x7f9448160c80 2023-10-14T09:38:45.794 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.783+0000 7f944d41a640 1 -- 172.21.15.102:0/744782701 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f94480aed20 con 0x7f9448160c80 2023-10-14T09:38:45.795 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.784+0000 7f9444ff9640 1 -- 172.21.15.102:0/744782701 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f94400113f0 con 0x7f9448160c80 2023-10-14T09:38:45.795 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.785+0000 7f9444ff9640 1 --2- 172.21.15.102:0/744782701 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f942806ae70 0x7f942806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:45.795 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.785+0000 7f9444ff9640 1 -- 172.21.15.102:0/744782701 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f9440089a00 con 0x7f9448160c80 2023-10-14T09:38:45.795 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.785+0000 7f9447fff640 1 --2- 172.21.15.102:0/744782701 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f942806ae70 0x7f942806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:45.796 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.786+0000 7f9444ff9640 1 --2- 172.21.15.102:0/744782701 >> [v2:172.21.15.102:6816/654726740,v1:172.21.15.102:6818/654726740] conn(0x7f9428073070 0x7f94280754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:45.796 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.786+0000 7f9444ff9640 1 -- 172.21.15.102:0/744782701 --> [v2:172.21.15.102:6816/654726740,v1:172.21.15.102:6818/654726740] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9428075b80 con 0x7f9428073070 2023-10-14T09:38:45.796 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.786+0000 7f9444ff9640 1 -- 172.21.15.102:0/744782701 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f944008e2a0 con 0x7f9448160c80 2023-10-14T09:38:45.796 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.786+0000 7f94477fe640 1 --2- 172.21.15.102:0/744782701 >> [v2:172.21.15.102:6816/654726740,v1:172.21.15.102:6818/654726740] conn(0x7f9428073070 0x7f94280754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:45.797 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.786+0000 7f9447fff640 1 --2- 172.21.15.102:0/744782701 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f942806ae70 0x7f942806d330 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9438009f20 tx=0x7f94380094d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:45.797 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.786+0000 7f94477fe640 1 --2- 172.21.15.102:0/744782701 >> [v2:172.21.15.102:6816/654726740,v1:172.21.15.102:6818/654726740] conn(0x7f9428073070 0x7f94280754b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:45.797 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.787+0000 7f9444ff9640 1 -- 172.21.15.102:0/744782701 <== osd.3 v2:172.21.15.102:6816/654726740 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f9428075b80 con 0x7f9428073070 2023-10-14T09:38:45.803 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.801+0000 7f944d41a640 1 -- 172.21.15.102:0/744782701 --> [v2:172.21.15.102:6816/654726740,v1:172.21.15.102:6818/654726740] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f94481f2940 con 0x7f9428073070 2023-10-14T09:38:45.804 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.802+0000 7f9444ff9640 1 -- 172.21.15.102:0/744782701 <== osd.3 v2:172.21.15.102:6816/654726740 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f94481f2940 con 0x7f9428073070 2023-10-14T09:38:45.804 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-10-14T09:38:45.804 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T09:38:45.805 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-10-14T09:38:45.806 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.802+0000 7f944d41a640 1 -- 172.21.15.102:0/744782701 >> [v2:172.21.15.102:6816/654726740,v1:172.21.15.102:6818/654726740] conn(0x7f9428073070 msgr2=0x7f94280754b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:45.806 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.802+0000 7f944d41a640 1 --2- 172.21.15.102:0/744782701 >> [v2:172.21.15.102:6816/654726740,v1:172.21.15.102:6818/654726740] conn(0x7f9428073070 0x7f94280754b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:45.807 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.803+0000 7f944d41a640 1 -- 172.21.15.102:0/744782701 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f942806ae70 msgr2=0x7f942806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:45.807 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.803+0000 7f944d41a640 1 --2- 172.21.15.102:0/744782701 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f942806ae70 0x7f942806d330 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9438009f20 tx=0x7f94380094d0 comp rx=0 tx=0).stop 2023-10-14T09:38:45.807 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.803+0000 7f944d41a640 1 -- 172.21.15.102:0/744782701 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9448160c80 msgr2=0x7f94481422e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:45.807 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.803+0000 7f944d41a640 1 --2- 172.21.15.102:0/744782701 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9448160c80 0x7f94481422e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f944000c7f0 tx=0x7f944000ccb0 comp rx=0 tx=0).stop 2023-10-14T09:38:45.808 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.803+0000 7f944cc19640 1 -- 172.21.15.102:0/744782701 reap_dead start 2023-10-14T09:38:45.808 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.803+0000 7f944d41a640 1 -- 172.21.15.102:0/744782701 shutdown_connections 2023-10-14T09:38:45.808 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.803+0000 7f944d41a640 1 -- 172.21.15.102:0/744782701 >> 172.21.15.102:0/744782701 conn(0x7f94480cc230 msgr2=0x7f944815d280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:45.809 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.803+0000 7f944d41a640 1 -- 172.21.15.102:0/744782701 shutdown_connections 2023-10-14T09:38:45.809 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:45.803+0000 7f944d41a640 1 -- 172.21.15.102:0/744782701 wait complete. 2023-10-14T09:38:45.822 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-14T09:38:46.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.033+0000 7f1c23fff640 1 Processor -- start 2023-10-14T09:38:46.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.033+0000 7f1c23fff640 1 -- start start 2023-10-14T09:38:46.037 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.035+0000 7f1c23fff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f1c24159950 0x7f1c2415a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:46.037 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.035+0000 7f1c23fff640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c2415aef0 con 0x7f1c24070450 2023-10-14T09:38:46.037 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.035+0000 7f1c23fff640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c2415d910 con 0x7f1c2406c810 2023-10-14T09:38:46.037 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.035+0000 7f1c23fff640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c2415e490 con 0x7f1c24159950 2023-10-14T09:38:46.038 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.035+0000 7f1c227fc640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f1c24070450 0x7f1c2406c100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55594/0 (socket says 172.21.15.102:55594) 2023-10-14T09:38:46.038 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.035+0000 7f1c227fc640 1 -- 172.21.15.102:0/1591363663 learned_addr learned my addr 172.21.15.102:0/1591363663 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:46.038 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.035+0000 7f1c22ffd640 1 --2- 172.21.15.102:0/1591363663 >> v2:172.21.15.129:3300/0 conn(0x7f1c24159950 0x7f1c2415a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:46.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.036+0000 7f1c21ffb640 1 -- 172.21.15.102:0/1591363663 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3078180701 0 0) 0x7f1c18001110 con 0x7f1c24070450 2023-10-14T09:38:46.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.036+0000 7f1c21ffb640 1 -- 172.21.15.102:0/1591363663 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c0c003520 con 0x7f1c24070450 2023-10-14T09:38:46.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.036+0000 7f1c21ffb640 1 -- 172.21.15.102:0/1591363663 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3308154126 0 0) 0x7f1c0c003520 con 0x7f1c24070450 2023-10-14T09:38:46.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.036+0000 7f1c21ffb640 1 -- 172.21.15.102:0/1591363663 >> v2:172.21.15.129:3300/0 conn(0x7f1c24159950 msgr2=0x7f1c2415a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:46.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.036+0000 7f1c21ffb640 1 --2- 172.21.15.102:0/1591363663 >> v2:172.21.15.129:3300/0 conn(0x7f1c24159950 0x7f1c2415a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:46.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.036+0000 7f1c21ffb640 1 -- 172.21.15.102:0/1591363663 >> v1:172.21.15.129:6789/0 conn(0x7f1c2406c810 legacy=0x7f1c240c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:46.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.036+0000 7f1c21ffb640 1 -- 172.21.15.102:0/1591363663 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2415dbf0 con 0x7f1c24070450 2023-10-14T09:38:46.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.036+0000 7f1c21ffb640 1 -- 172.21.15.102:0/1591363663 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4030661168 0 0) 0x7f1c18001800 con 0x7f1c24070450 2023-10-14T09:38:46.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.036+0000 7f1c21ffb640 1 -- 172.21.15.102:0/1591363663 >> v1:172.21.15.102:6789/0 conn(0x7f1c24070450 legacy=0x7f1c2406c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:46.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.036+0000 7f1c21ffb640 1 --2- 172.21.15.102:0/1591363663 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1c0c0039c0 0x7f1c0c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:46.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.036+0000 7f1c21ffb640 1 --2- 172.21.15.102:0/1591363663 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c0c0047c0 0x7f1c0c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:46.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.036+0000 7f1c21ffb640 1 --2- 172.21.15.102:0/1591363663 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1c0c0051d0 0x7f1c0c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:46.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.036+0000 7f1c21ffb640 1 -- 172.21.15.102:0/1591363663 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2415e490 con 0x7f1c0c0047c0 2023-10-14T09:38:46.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.036+0000 7f1c21ffb640 1 -- 172.21.15.102:0/1591363663 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c00c120 con 0x7f1c0c0039c0 2023-10-14T09:38:46.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.036+0000 7f1c21ffb640 1 -- 172.21.15.102:0/1591363663 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c00c2e0 con 0x7f1c0c0051d0 2023-10-14T09:38:46.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.036+0000 7f1c227fc640 1 --2- 172.21.15.102:0/1591363663 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c0c0047c0 0x7f1c0c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:46.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.037+0000 7f1c22ffd640 1 --2- 172.21.15.102:0/1591363663 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1c0c0039c0 0x7f1c0c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:46.046 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.037+0000 7f1c227fc640 1 -- 172.21.15.102:0/1591363663 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1c0c0051d0 msgr2=0x7f1c0c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:46.046 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.037+0000 7f1c227fc640 1 --2- 172.21.15.102:0/1591363663 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1c0c0051d0 0x7f1c0c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:46.046 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.037+0000 7f1c227fc640 1 -- 172.21.15.102:0/1591363663 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1c0c0039c0 msgr2=0x7f1c0c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:46.046 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.037+0000 7f1c227fc640 1 --2- 172.21.15.102:0/1591363663 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1c0c0039c0 0x7f1c0c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:46.047 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.037+0000 7f1c227fc640 1 -- 172.21.15.102:0/1591363663 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0c003520 con 0x7f1c0c0047c0 2023-10-14T09:38:46.047 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.037+0000 7f1c237fe640 1 -- 172.21.15.102:0/1591363663 reap_dead start 2023-10-14T09:38:46.047 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.038+0000 7f1c227fc640 1 --2- 172.21.15.102:0/1591363663 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c0c0047c0 0x7f1c0c004c40 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1c18001eb0 tx=0x7f1c0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=539d4fc22b4ab071 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:46.047 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.038+0000 7f1c21ffb640 1 -- 172.21.15.102:0/1591363663 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c18005ad0 con 0x7f1c0c0047c0 2023-10-14T09:38:46.048 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.038+0000 7f1c21ffb640 1 -- 172.21.15.102:0/1591363663 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c18005c50 con 0x7f1c0c0047c0 2023-10-14T09:38:46.048 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.038+0000 7f1c21ffb640 1 -- 172.21.15.102:0/1591363663 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1802c7a0 con 0x7f1c0c0047c0 2023-10-14T09:38:46.048 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.039+0000 7f1c23fff640 1 -- 172.21.15.102:0/1591363663 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c0c0047c0 msgr2=0x7f1c0c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:46.048 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.039+0000 7f1c23fff640 1 --2- 172.21.15.102:0/1591363663 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c0c0047c0 0x7f1c0c004c40 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1c18001eb0 tx=0x7f1c0c0057f0 comp rx=0 tx=0).stop 2023-10-14T09:38:46.049 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.039+0000 7f1c23fff640 1 -- 172.21.15.102:0/1591363663 shutdown_connections 2023-10-14T09:38:46.049 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.039+0000 7f1c23fff640 1 --2- 172.21.15.102:0/1591363663 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c0c0047c0 0x7f1c0c004c40 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:46.049 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.039+0000 7f1c23fff640 1 -- 172.21.15.102:0/1591363663 >> 172.21.15.102:0/1591363663 conn(0x7f1c240ce6a0 msgr2=0x7f1c240ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:46.050 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.039+0000 7f1c23fff640 1 -- 172.21.15.102:0/1591363663 shutdown_connections 2023-10-14T09:38:46.050 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.039+0000 7f1c23fff640 1 -- 172.21.15.102:0/1591363663 wait complete. 2023-10-14T09:38:46.052 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.041+0000 7f1c23fff640 1 Processor -- start 2023-10-14T09:38:46.053 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.041+0000 7f1c23fff640 1 -- start start 2023-10-14T09:38:46.053 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.042+0000 7f1c23fff640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1c0c0047c0 0x7f1c240c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:46.053 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.042+0000 7f1c23fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c24150b60 0x7f1c240b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:46.054 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.042+0000 7f1c23fff640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1c240b2010 0x7f1c240c5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:46.054 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.042+0000 7f1c23fff640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c240b2490 con 0x7f1c24150b60 2023-10-14T09:38:46.054 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.042+0000 7f1c23fff640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c240c6830 con 0x7f1c0c0047c0 2023-10-14T09:38:46.055 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.042+0000 7f1c23fff640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c240c6b10 con 0x7f1c240b2010 2023-10-14T09:38:46.055 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.042+0000 7f1c227fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c24150b60 0x7f1c240b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:46.055 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.042+0000 7f1c227fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c24150b60 0x7f1c240b1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55740/0 (socket says 172.21.15.102:55740) 2023-10-14T09:38:46.055 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.042+0000 7f1c227fc640 1 -- 172.21.15.102:0/3767824613 learned_addr learned my addr 172.21.15.102:0/3767824613 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:46.056 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.042+0000 7f1c22ffd640 1 --2- 172.21.15.102:0/3767824613 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1c0c0047c0 0x7f1c240c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:46.056 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.043+0000 7f1c237fe640 1 --2- 172.21.15.102:0/3767824613 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1c240b2010 0x7f1c240c5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:46.056 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.043+0000 7f1c227fc640 1 -- 172.21.15.102:0/3767824613 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1c240b2010 msgr2=0x7f1c240c5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:46.056 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.043+0000 7f1c227fc640 1 --2- 172.21.15.102:0/3767824613 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1c240b2010 0x7f1c240c5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:46.057 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.043+0000 7f1c227fc640 1 -- 172.21.15.102:0/3767824613 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1c0c0047c0 msgr2=0x7f1c240c7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:46.057 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.043+0000 7f1c227fc640 1 --2- 172.21.15.102:0/3767824613 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1c0c0047c0 0x7f1c240c7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:46.057 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.043+0000 7f1c227fc640 1 -- 172.21.15.102:0/3767824613 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c240c6df0 con 0x7f1c24150b60 2023-10-14T09:38:46.058 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.043+0000 7f1c237fe640 1 --2- 172.21.15.102:0/3767824613 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1c240b2010 0x7f1c240c5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:46.058 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.043+0000 7f1c227fc640 1 --2- 172.21.15.102:0/3767824613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c24150b60 0x7f1c240b1ad0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1c1802c340 tx=0x7f1c1802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:46.058 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.043+0000 7f1c0bfff640 1 -- 172.21.15.102:0/3767824613 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1803c040 con 0x7f1c24150b60 2023-10-14T09:38:46.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.043+0000 7f1c0bfff640 1 -- 172.21.15.102:0/3767824613 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1802cbb0 con 0x7f1c24150b60 2023-10-14T09:38:46.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.043+0000 7f1c0bfff640 1 -- 172.21.15.102:0/3767824613 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c18007070 con 0x7f1c24150b60 2023-10-14T09:38:46.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.043+0000 7f1c23fff640 1 -- 172.21.15.102:0/3767824613 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c240c70d0 con 0x7f1c24150b60 2023-10-14T09:38:46.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.043+0000 7f1c23fff640 1 -- 172.21.15.102:0/3767824613 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c240c7690 con 0x7f1c24150b60 2023-10-14T09:38:46.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.045+0000 7f1c23fff640 1 -- 172.21.15.102:0/3767824613 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c240c7820 con 0x7f1c24150b60 2023-10-14T09:38:46.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.045+0000 7f1c0bfff640 1 -- 172.21.15.102:0/3767824613 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1c18032070 con 0x7f1c24150b60 2023-10-14T09:38:46.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.046+0000 7f1c0bfff640 1 --2- 172.21.15.102:0/3767824613 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1c1006ae70 0x7f1c1006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:46.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.046+0000 7f1c0bfff640 1 -- 172.21.15.102:0/3767824613 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f1c180aa260 con 0x7f1c24150b60 2023-10-14T09:38:46.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.047+0000 7f1c22ffd640 1 --2- 172.21.15.102:0/3767824613 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1c1006ae70 0x7f1c1006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:46.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.047+0000 7f1c22ffd640 1 --2- 172.21.15.102:0/3767824613 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1c1006ae70 0x7f1c1006d330 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1c14009a90 tx=0x7f1c14008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:46.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.051+0000 7f1c0bfff640 1 -- 172.21.15.102:0/3767824613 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1c18075250 con 0x7f1c24150b60 2023-10-14T09:38:46.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.241+0000 7f1c23fff640 1 -- 172.21.15.102:0/3767824613 --> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c2415e1b0 con 0x7f1c1006ae70 2023-10-14T09:38:46.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.242+0000 7f1c0bfff640 1 -- 172.21.15.102:0/3767824613 <== mgr.4104 v2:172.21.15.102:6832/1125265706 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1c14013a20 con 0x7f1c1006ae70 2023-10-14T09:38:46.244 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 3 to deep-scrub 2023-10-14T09:38:46.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.246+0000 7f1c23fff640 1 -- 172.21.15.102:0/3767824613 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1c1006ae70 msgr2=0x7f1c1006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:46.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.246+0000 7f1c23fff640 1 --2- 172.21.15.102:0/3767824613 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1c1006ae70 0x7f1c1006d330 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1c14009a90 tx=0x7f1c14008040 comp rx=0 tx=0).stop 2023-10-14T09:38:46.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.246+0000 7f1c23fff640 1 -- 172.21.15.102:0/3767824613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c24150b60 msgr2=0x7f1c240b1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:46.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.246+0000 7f1c23fff640 1 --2- 172.21.15.102:0/3767824613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c24150b60 0x7f1c240b1ad0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1c1802c340 tx=0x7f1c1802e070 comp rx=0 tx=0).stop 2023-10-14T09:38:46.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.246+0000 7f1c23fff640 1 -- 172.21.15.102:0/3767824613 shutdown_connections 2023-10-14T09:38:46.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.246+0000 7f1c23fff640 1 --2- 172.21.15.102:0/3767824613 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1c1006ae70 0x7f1c1006d330 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:46.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.246+0000 7f1c23fff640 1 --2- 172.21.15.102:0/3767824613 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1c240b2010 0x7f1c240c5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:46.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.246+0000 7f1c23fff640 1 --2- 172.21.15.102:0/3767824613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c24150b60 0x7f1c240b1ad0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:46.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.246+0000 7f1c23fff640 1 --2- 172.21.15.102:0/3767824613 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1c0c0047c0 0x7f1c240c7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:46.251 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.246+0000 7f1c23fff640 1 -- 172.21.15.102:0/3767824613 >> 172.21.15.102:0/3767824613 conn(0x7f1c240ce6a0 msgr2=0x7f1c24070830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:46.251 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.247+0000 7f1c23fff640 1 -- 172.21.15.102:0/3767824613 shutdown_connections 2023-10-14T09:38:46.251 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.247+0000 7f1c23fff640 1 -- 172.21.15.102:0/3767824613 wait complete. 2023-10-14T09:38:46.268 INFO:tasks.ceph:Scrubbing osd.4 2023-10-14T09:38:46.268 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-14T09:38:46.476 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.474+0000 7f8d0595e640 1 Processor -- start 2023-10-14T09:38:46.476 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.474+0000 7f8d0595e640 1 -- start start 2023-10-14T09:38:46.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.475+0000 7f8d0595e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8d0015ac10 0x7f8d0006c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:46.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.475+0000 7f8d0595e640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d000b0360 0x7f8d000b07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:46.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.475+0000 7f8d0595e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d000b0d00 con 0x7f8d000ca510 2023-10-14T09:38:46.479 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.475+0000 7f8d0595e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d0015f800 con 0x7f8d0015ac10 2023-10-14T09:38:46.479 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.475+0000 7f8d0595e640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0015b310 con 0x7f8d000b0360 2023-10-14T09:38:46.479 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.476+0000 7f8cfeffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8d0015ac10 0x7f8d0006c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:46.480 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.476+0000 7f8cfeffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8d0015ac10 0x7f8d0006c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55750/0 (socket says 172.21.15.102:55750) 2023-10-14T09:38:46.480 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.476+0000 7f8cfeffd640 1 -- 172.21.15.102:0/1027942405 learned_addr learned my addr 172.21.15.102:0/1027942405 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:46.480 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.476+0000 7f8cff7fe640 1 --1- 172.21.15.102:0/1027942405 >> v1:172.21.15.102:6789/0 conn(0x7f8d000ca510 0x7f8d000ca940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55598/0 (socket says 172.21.15.102:55598) 2023-10-14T09:38:46.481 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.476+0000 7f8cfe7fc640 1 --2- 172.21.15.102:0/1027942405 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d000b0360 0x7f8d000b07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:46.481 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.476+0000 7f8cfeffd640 1 -- 172.21.15.102:0/1027942405 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d000b0360 msgr2=0x7f8d000b07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:46.481 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.476+0000 7f8cfeffd640 1 --2- 172.21.15.102:0/1027942405 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d000b0360 0x7f8d000b07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:46.482 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.476+0000 7f8cfeffd640 1 -- 172.21.15.102:0/1027942405 >> v1:172.21.15.102:6789/0 conn(0x7f8d000ca510 legacy=0x7f8d000ca940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:46.482 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.476+0000 7f8cfeffd640 1 -- 172.21.15.102:0/1027942405 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0006f640 con 0x7f8d0015ac10 2023-10-14T09:38:46.482 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.476+0000 7f8cfe7fc640 1 --2- 172.21.15.102:0/1027942405 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d000b0360 0x7f8d000b07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:46.482 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.476+0000 7f8cfdffb640 1 -- 172.21.15.102:0/1027942405 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2147050883 0 0) 0x7f8d000b0d00 con 0x7f8d000ca510 2023-10-14T09:38:46.485 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.477+0000 7f8cfeffd640 1 --2- 172.21.15.102:0/1027942405 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d0015ac10 0x7f8d0006c730 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0009870 tx=0x7f8cf002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b8d5a35ac2e45f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:46.485 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.477+0000 7f8cfdffb640 1 -- 172.21.15.102:0/1027942405 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0031860 con 0x7f8d0015ac10 2023-10-14T09:38:46.486 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.478+0000 7f8cfdffb640 1 -- 172.21.15.102:0/1027942405 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf00319c0 con 0x7f8d0015ac10 2023-10-14T09:38:46.486 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.478+0000 7f8cfdffb640 1 -- 172.21.15.102:0/1027942405 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0031d50 con 0x7f8d0015ac10 2023-10-14T09:38:46.486 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.478+0000 7f8d0595e640 1 -- 172.21.15.102:0/1027942405 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d0015ac10 msgr2=0x7f8d0006c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:46.486 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.478+0000 7f8d0595e640 1 --2- 172.21.15.102:0/1027942405 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d0015ac10 0x7f8d0006c730 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0009870 tx=0x7f8cf002b900 comp rx=0 tx=0).stop 2023-10-14T09:38:46.487 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.478+0000 7f8d0595e640 1 -- 172.21.15.102:0/1027942405 shutdown_connections 2023-10-14T09:38:46.487 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.478+0000 7f8d0595e640 1 --2- 172.21.15.102:0/1027942405 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d000b0360 0x7f8d000b07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:46.487 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.478+0000 7f8d0595e640 1 --2- 172.21.15.102:0/1027942405 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d0015ac10 0x7f8d0006c730 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:46.488 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.478+0000 7f8d0595e640 1 -- 172.21.15.102:0/1027942405 >> 172.21.15.102:0/1027942405 conn(0x7f8d000cb360 msgr2=0x7f8d000cb740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:46.488 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.478+0000 7f8d0595e640 1 -- 172.21.15.102:0/1027942405 shutdown_connections 2023-10-14T09:38:46.488 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.478+0000 7f8d0595e640 1 -- 172.21.15.102:0/1027942405 wait complete. 2023-10-14T09:38:46.488 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.480+0000 7f8d0595e640 1 Processor -- start 2023-10-14T09:38:46.489 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.480+0000 7f8d0595e640 1 -- start start 2023-10-14T09:38:46.489 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.481+0000 7f8d0595e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8d000b0360 0x7f8d001587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:46.489 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.481+0000 7f8d0595e640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d000ca510 0x7f8d000cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:46.489 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.481+0000 7f8d0595e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d0015ac10 0x7f8d000ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:46.490 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.481+0000 7f8d0595e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d00159a50 con 0x7f8d0015ac10 2023-10-14T09:38:46.490 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.481+0000 7f8d0595e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d001f3710 con 0x7f8d000b0360 2023-10-14T09:38:46.490 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.481+0000 7f8d0595e640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d00158cf0 con 0x7f8d000ca510 2023-10-14T09:38:46.490 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.482+0000 7f8cff7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d0015ac10 0x7f8d000ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:46.491 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.482+0000 7f8cff7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d0015ac10 0x7f8d000ac890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55760/0 (socket says 172.21.15.102:55760) 2023-10-14T09:38:46.491 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.482+0000 7f8cff7fe640 1 -- 172.21.15.102:0/2898964894 learned_addr learned my addr 172.21.15.102:0/2898964894 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:46.491 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.482+0000 7f8cfeffd640 1 --2- 172.21.15.102:0/2898964894 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8d000b0360 0x7f8d001587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:46.491 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.482+0000 7f8cfe7fc640 1 --2- 172.21.15.102:0/2898964894 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d000ca510 0x7f8d000cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:46.492 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.482+0000 7f8cff7fe640 1 -- 172.21.15.102:0/2898964894 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d000ca510 msgr2=0x7f8d000cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:46.492 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.482+0000 7f8cff7fe640 1 --2- 172.21.15.102:0/2898964894 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d000ca510 0x7f8d000cd6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:46.492 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.482+0000 7f8cff7fe640 1 -- 172.21.15.102:0/2898964894 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8d000b0360 msgr2=0x7f8d001587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:46.492 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.482+0000 7f8cff7fe640 1 --2- 172.21.15.102:0/2898964894 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8d000b0360 0x7f8d001587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:46.493 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.482+0000 7f8cff7fe640 1 -- 172.21.15.102:0/2898964894 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf00094d0 con 0x7f8d0015ac10 2023-10-14T09:38:46.493 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.482+0000 7f8cff7fe640 1 --2- 172.21.15.102:0/2898964894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d0015ac10 0x7f8d000ac890 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8cf800c3e0 tx=0x7f8cf800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:46.493 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.483+0000 7f8cf7fff640 1 -- 172.21.15.102:0/2898964894 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf80074e0 con 0x7f8d0015ac10 2023-10-14T09:38:46.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.483+0000 7f8cf7fff640 1 -- 172.21.15.102:0/2898964894 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf8007640 con 0x7f8d0015ac10 2023-10-14T09:38:46.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.483+0000 7f8cf7fff640 1 -- 172.21.15.102:0/2898964894 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf80049e0 con 0x7f8d0015ac10 2023-10-14T09:38:46.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.483+0000 7f8d0595e640 1 -- 172.21.15.102:0/2898964894 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d001579f0 con 0x7f8d0015ac10 2023-10-14T09:38:46.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.483+0000 7f8d0595e640 1 -- 172.21.15.102:0/2898964894 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d00157fb0 con 0x7f8d0015ac10 2023-10-14T09:38:46.496 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.484+0000 7f8d0595e640 1 -- 172.21.15.102:0/2898964894 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8d0015b5b0 con 0x7f8d0015ac10 2023-10-14T09:38:46.496 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.485+0000 7f8cf7fff640 1 -- 172.21.15.102:0/2898964894 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8cf8004b40 con 0x7f8d0015ac10 2023-10-14T09:38:46.496 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.486+0000 7f8cf7fff640 1 --2- 172.21.15.102:0/2898964894 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f8ce006ae70 0x7f8ce006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:46.497 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.486+0000 7f8cf7fff640 1 -- 172.21.15.102:0/2898964894 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f8cf8089380 con 0x7f8d0015ac10 2023-10-14T09:38:46.497 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.486+0000 7f8cfeffd640 1 --2- 172.21.15.102:0/2898964894 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f8ce006ae70 0x7f8ce006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:46.497 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.486+0000 7f8cf7fff640 1 --2- 172.21.15.102:0/2898964894 >> [v2:172.21.15.129:6816/507586170,v1:172.21.15.129:6817/507586170] conn(0x7f8ce0073070 0x7f8ce00754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:46.498 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.486+0000 7f8cf7fff640 1 -- 172.21.15.102:0/2898964894 --> [v2:172.21.15.129:6816/507586170,v1:172.21.15.129:6817/507586170] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8ce0075b80 con 0x7f8ce0073070 2023-10-14T09:38:46.498 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.486+0000 7f8cf7fff640 1 -- 172.21.15.102:0/2898964894 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8cf808ba40 con 0x7f8d0015ac10 2023-10-14T09:38:46.498 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.487+0000 7f8cfeffd640 1 --2- 172.21.15.102:0/2898964894 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f8ce006ae70 0x7f8ce006d330 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0036000 tx=0x7f8cf003c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:46.498 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.487+0000 7f8cfe7fc640 1 --2- 172.21.15.102:0/2898964894 >> [v2:172.21.15.129:6816/507586170,v1:172.21.15.129:6817/507586170] conn(0x7f8ce0073070 0x7f8ce00754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:46.499 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.488+0000 7f8cfe7fc640 1 --2- 172.21.15.102:0/2898964894 >> [v2:172.21.15.129:6816/507586170,v1:172.21.15.129:6817/507586170] conn(0x7f8ce0073070 0x7f8ce00754b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:46.499 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.490+0000 7f8cf7fff640 1 -- 172.21.15.102:0/2898964894 <== osd.4 v2:172.21.15.129:6816/507586170 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f8ce0075b80 con 0x7f8ce0073070 2023-10-14T09:38:46.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.504+0000 7f8d0595e640 1 -- 172.21.15.102:0/2898964894 --> [v2:172.21.15.129:6816/507586170,v1:172.21.15.129:6817/507586170] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8d000cb050 con 0x7f8ce0073070 2023-10-14T09:38:46.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.505+0000 7f8cf7fff640 1 -- 172.21.15.102:0/2898964894 <== osd.4 v2:172.21.15.129:6816/507586170 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8ce800f450 con 0x7f8ce0073070 2023-10-14T09:38:46.507 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-10-14T09:38:46.507 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T09:38:46.507 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-10-14T09:38:46.508 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.505+0000 7f8d0595e640 1 -- 172.21.15.102:0/2898964894 >> [v2:172.21.15.129:6816/507586170,v1:172.21.15.129:6817/507586170] conn(0x7f8ce0073070 msgr2=0x7f8ce00754b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:46.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.505+0000 7f8d0595e640 1 --2- 172.21.15.102:0/2898964894 >> [v2:172.21.15.129:6816/507586170,v1:172.21.15.129:6817/507586170] conn(0x7f8ce0073070 0x7f8ce00754b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:46.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.505+0000 7f8d0595e640 1 -- 172.21.15.102:0/2898964894 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f8ce006ae70 msgr2=0x7f8ce006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:46.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.505+0000 7f8d0595e640 1 --2- 172.21.15.102:0/2898964894 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f8ce006ae70 0x7f8ce006d330 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0036000 tx=0x7f8cf003c040 comp rx=0 tx=0).stop 2023-10-14T09:38:46.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.505+0000 7f8d0595e640 1 -- 172.21.15.102:0/2898964894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d0015ac10 msgr2=0x7f8d000ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:46.510 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.505+0000 7f8d0595e640 1 --2- 172.21.15.102:0/2898964894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d0015ac10 0x7f8d000ac890 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8cf800c3e0 tx=0x7f8cf800c8a0 comp rx=0 tx=0).stop 2023-10-14T09:38:46.510 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.505+0000 7f8cff7fe640 1 -- 172.21.15.102:0/2898964894 reap_dead start 2023-10-14T09:38:46.510 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.505+0000 7f8d0595e640 1 -- 172.21.15.102:0/2898964894 shutdown_connections 2023-10-14T09:38:46.511 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.505+0000 7f8d0595e640 1 -- 172.21.15.102:0/2898964894 >> 172.21.15.102:0/2898964894 conn(0x7f8d000cb360 msgr2=0x7f8d0006b960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:46.511 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.505+0000 7f8d0595e640 1 -- 172.21.15.102:0/2898964894 shutdown_connections 2023-10-14T09:38:46.511 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.505+0000 7f8d0595e640 1 -- 172.21.15.102:0/2898964894 wait complete. 2023-10-14T09:38:46.523 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-14T09:38:46.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.729+0000 7f90f755a640 1 Processor -- start 2023-10-14T09:38:46.732 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.730+0000 7f90f755a640 1 -- start start 2023-10-14T09:38:46.733 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.731+0000 7f90f755a640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90f01618b0 0x7f90f0065ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:46.733 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.731+0000 7f90f755a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f0066420 con 0x7f90f0065ff0 2023-10-14T09:38:46.733 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.731+0000 7f90f755a640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f006cee0 con 0x7f90f015d330 2023-10-14T09:38:46.734 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.731+0000 7f90f755a640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f006b1e0 con 0x7f90f01618b0 2023-10-14T09:38:46.736 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.732+0000 7f90f5af7640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f90f0065ff0 0x7f90f00ce9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55604/0 (socket says 172.21.15.102:55604) 2023-10-14T09:38:46.737 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.732+0000 7f90f5af7640 1 -- 172.21.15.102:0/638339285 learned_addr learned my addr 172.21.15.102:0/638339285 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:46.737 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.732+0000 7f90f4af5640 1 --2- 172.21.15.102:0/638339285 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90f01618b0 0x7f90f0065ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:46.737 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.732+0000 7f90effff640 1 -- 172.21.15.102:0/638339285 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 648203094 0 0) 0x7f90f0066420 con 0x7f90f0065ff0 2023-10-14T09:38:46.737 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.732+0000 7f90effff640 1 -- 172.21.15.102:0/638339285 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90d8003520 con 0x7f90f0065ff0 2023-10-14T09:38:46.738 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.732+0000 7f90effff640 1 -- 172.21.15.102:0/638339285 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2443009157 0 0) 0x7f90d8003520 con 0x7f90f0065ff0 2023-10-14T09:38:46.738 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.732+0000 7f90effff640 1 -- 172.21.15.102:0/638339285 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90f01618b0 msgr2=0x7f90f0065ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:46.738 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.732+0000 7f90effff640 1 --2- 172.21.15.102:0/638339285 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90f01618b0 0x7f90f0065ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:46.738 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.732+0000 7f90effff640 1 -- 172.21.15.102:0/638339285 >> v1:172.21.15.129:6789/0 conn(0x7f90f015d330 legacy=0x7f90f006c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:46.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.732+0000 7f90effff640 1 -- 172.21.15.102:0/638339285 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f00d0890 con 0x7f90f0065ff0 2023-10-14T09:38:46.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.733+0000 7f90effff640 1 -- 172.21.15.102:0/638339285 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4030661168 0 0) 0x7f90e80019f0 con 0x7f90f0065ff0 2023-10-14T09:38:46.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.733+0000 7f90effff640 1 -- 172.21.15.102:0/638339285 >> v1:172.21.15.102:6789/0 conn(0x7f90f0065ff0 legacy=0x7f90f00ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:46.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.733+0000 7f90effff640 1 --2- 172.21.15.102:0/638339285 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90f01618b0 0x7f90d80039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:46.740 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.733+0000 7f90effff640 1 --2- 172.21.15.102:0/638339285 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90d8003f20 0x7f90d80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:46.740 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.733+0000 7f90effff640 1 --2- 172.21.15.102:0/638339285 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90d8004d00 0x7f90d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:46.740 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.733+0000 7f90effff640 1 -- 172.21.15.102:0/638339285 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f006b1e0 con 0x7f90d8004d00 2023-10-14T09:38:46.740 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.733+0000 7f90effff640 1 -- 172.21.15.102:0/638339285 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d800bb10 con 0x7f90d8003f20 2023-10-14T09:38:46.741 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.733+0000 7f90effff640 1 -- 172.21.15.102:0/638339285 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d800bcd0 con 0x7f90f01618b0 2023-10-14T09:38:46.741 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.733+0000 7f90f5af7640 1 --2- 172.21.15.102:0/638339285 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90d8004d00 0x7f90d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:46.741 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.733+0000 7f90f4af5640 1 --2- 172.21.15.102:0/638339285 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90d8003f20 0x7f90d80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:46.742 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.733+0000 7f90f52f6640 1 --2- 172.21.15.102:0/638339285 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90f01618b0 0x7f90d80039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:46.742 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.733+0000 7f90f5af7640 1 -- 172.21.15.102:0/638339285 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90f01618b0 msgr2=0x7f90d80039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:46.742 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.733+0000 7f90f5af7640 1 --2- 172.21.15.102:0/638339285 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90f01618b0 0x7f90d80039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:46.742 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.733+0000 7f90f5af7640 1 -- 172.21.15.102:0/638339285 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90d8003f20 msgr2=0x7f90d80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:46.743 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.733+0000 7f90f5af7640 1 --2- 172.21.15.102:0/638339285 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90d8003f20 0x7f90d80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:46.743 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.733+0000 7f90f5af7640 1 -- 172.21.15.102:0/638339285 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d8003520 con 0x7f90d8004d00 2023-10-14T09:38:46.743 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.733+0000 7f90f52f6640 1 --2- 172.21.15.102:0/638339285 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90f01618b0 0x7f90d80039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:46.743 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.733+0000 7f90f4af5640 1 --2- 172.21.15.102:0/638339285 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90d8003f20 0x7f90d80047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:46.744 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.734+0000 7f90f5af7640 1 --2- 172.21.15.102:0/638339285 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90d8004d00 0x7f90d8005180 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f90e800a830 tx=0x7f90d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eddcc5173aaf83c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:46.744 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.735+0000 7f90effff640 1 -- 172.21.15.102:0/638339285 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e80072d0 con 0x7f90d8004d00 2023-10-14T09:38:46.744 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.735+0000 7f90effff640 1 -- 172.21.15.102:0/638339285 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e802f070 con 0x7f90d8004d00 2023-10-14T09:38:46.744 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.735+0000 7f90effff640 1 -- 172.21.15.102:0/638339285 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e80076b0 con 0x7f90d8004d00 2023-10-14T09:38:46.747 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.735+0000 7f90f755a640 1 -- 172.21.15.102:0/638339285 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90d8004d00 msgr2=0x7f90d8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:46.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.735+0000 7f90f755a640 1 --2- 172.21.15.102:0/638339285 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90d8004d00 0x7f90d8005180 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f90e800a830 tx=0x7f90d80057f0 comp rx=0 tx=0).stop 2023-10-14T09:38:46.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.735+0000 7f90f5af7640 1 -- 172.21.15.102:0/638339285 reap_dead start 2023-10-14T09:38:46.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.735+0000 7f90f755a640 1 -- 172.21.15.102:0/638339285 shutdown_connections 2023-10-14T09:38:46.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.735+0000 7f90f755a640 1 -- 172.21.15.102:0/638339285 >> 172.21.15.102:0/638339285 conn(0x7f90f00d0ab0 msgr2=0x7f90f00d0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:46.749 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.735+0000 7f90f755a640 1 -- 172.21.15.102:0/638339285 shutdown_connections 2023-10-14T09:38:46.749 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.736+0000 7f90f755a640 1 -- 172.21.15.102:0/638339285 wait complete. 2023-10-14T09:38:46.749 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.737+0000 7f90f755a640 1 Processor -- start 2023-10-14T09:38:46.749 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.738+0000 7f90f755a640 1 -- start start 2023-10-14T09:38:46.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.739+0000 7f90f755a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90d8004d00 0x7f90f01590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:46.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.739+0000 7f90f755a640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90f01f6670 0x7f90f00c6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:46.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.739+0000 7f90f755a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90f01f6af0 0x7f90f00c6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:46.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.739+0000 7f90f755a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f00aecb0 con 0x7f90f01f6af0 2023-10-14T09:38:46.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.739+0000 7f90f755a640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f0159610 con 0x7f90d8004d00 2023-10-14T09:38:46.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.739+0000 7f90f755a640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f00af0d0 con 0x7f90f01f6670 2023-10-14T09:38:46.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.739+0000 7f90f5af7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90f01f6af0 0x7f90f00c6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:46.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.739+0000 7f90f5af7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90f01f6af0 0x7f90f00c6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55778/0 (socket says 172.21.15.102:55778) 2023-10-14T09:38:46.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.739+0000 7f90f5af7640 1 -- 172.21.15.102:0/3438038648 learned_addr learned my addr 172.21.15.102:0/3438038648 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:46.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.740+0000 7f90f52f6640 1 --2- 172.21.15.102:0/3438038648 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90d8004d00 0x7f90f01590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:46.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.740+0000 7f90f4af5640 1 --2- 172.21.15.102:0/3438038648 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90f01f6670 0x7f90f00c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:46.753 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.740+0000 7f90f5af7640 1 -- 172.21.15.102:0/3438038648 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90f01f6670 msgr2=0x7f90f00c6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:46.753 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.740+0000 7f90f5af7640 1 --2- 172.21.15.102:0/3438038648 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90f01f6670 0x7f90f00c6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:46.753 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.740+0000 7f90f5af7640 1 -- 172.21.15.102:0/3438038648 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90d8004d00 msgr2=0x7f90f01590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:46.753 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.740+0000 7f90f5af7640 1 --2- 172.21.15.102:0/3438038648 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90d8004d00 0x7f90f01590d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:46.754 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.740+0000 7f90f5af7640 1 -- 172.21.15.102:0/3438038648 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f00ae030 con 0x7f90f01f6af0 2023-10-14T09:38:46.754 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.740+0000 7f90f52f6640 1 --2- 172.21.15.102:0/3438038648 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90d8004d00 0x7f90f01590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:46.754 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.740+0000 7f90f4af5640 1 --2- 172.21.15.102:0/3438038648 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90f01f6670 0x7f90f00c6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:46.754 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.740+0000 7f90f5af7640 1 --2- 172.21.15.102:0/3438038648 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90f01f6af0 0x7f90f00c6ec0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f90e800a950 tx=0x7f90e8001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:46.755 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.740+0000 7f90edffb640 1 -- 172.21.15.102:0/3438038648 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e8004d60 con 0x7f90f01f6af0 2023-10-14T09:38:46.755 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.741+0000 7f90edffb640 1 -- 172.21.15.102:0/3438038648 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e8001250 con 0x7f90f01f6af0 2023-10-14T09:38:46.755 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.741+0000 7f90edffb640 1 -- 172.21.15.102:0/3438038648 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e80072d0 con 0x7f90f01f6af0 2023-10-14T09:38:46.756 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.741+0000 7f90f755a640 1 -- 172.21.15.102:0/3438038648 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f00ae310 con 0x7f90f01f6af0 2023-10-14T09:38:46.756 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.741+0000 7f90f755a640 1 -- 172.21.15.102:0/3438038648 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f00ae8d0 con 0x7f90f01f6af0 2023-10-14T09:38:46.756 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.742+0000 7f90f755a640 1 -- 172.21.15.102:0/3438038648 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f00d0530 con 0x7f90f01f6af0 2023-10-14T09:38:46.756 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.743+0000 7f90edffb640 1 -- 172.21.15.102:0/3438038648 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f90e8031030 con 0x7f90f01f6af0 2023-10-14T09:38:46.757 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.744+0000 7f90edffb640 1 --2- 172.21.15.102:0/3438038648 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f90dc06aea0 0x7f90dc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:46.757 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.744+0000 7f90edffb640 1 -- 172.21.15.102:0/3438038648 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f90e80aa6d0 con 0x7f90f01f6af0 2023-10-14T09:38:46.757 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.744+0000 7f90f52f6640 1 --2- 172.21.15.102:0/3438038648 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f90dc06aea0 0x7f90dc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:46.758 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.744+0000 7f90f52f6640 1 --2- 172.21.15.102:0/3438038648 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f90dc06aea0 0x7f90dc06d360 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f90e00016f0 tx=0x7f90e0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:46.758 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.748+0000 7f90edffb640 1 -- 172.21.15.102:0/3438038648 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f90e80757f0 con 0x7f90f01f6af0 2023-10-14T09:38:46.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.937+0000 7f90f755a640 1 -- 172.21.15.102:0/3438038648 --> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f90f0160dd0 con 0x7f90dc06aea0 2023-10-14T09:38:46.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.938+0000 7f90edffb640 1 -- 172.21.15.102:0/3438038648 <== mgr.4104 v2:172.21.15.102:6832/1125265706 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f90e000d040 con 0x7f90dc06aea0 2023-10-14T09:38:46.940 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 4 to deep-scrub 2023-10-14T09:38:46.943 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.941+0000 7f90f755a640 1 -- 172.21.15.102:0/3438038648 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f90dc06aea0 msgr2=0x7f90dc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:46.943 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.941+0000 7f90f755a640 1 --2- 172.21.15.102:0/3438038648 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f90dc06aea0 0x7f90dc06d360 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f90e00016f0 tx=0x7f90e0009040 comp rx=0 tx=0).stop 2023-10-14T09:38:46.944 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.941+0000 7f90f755a640 1 -- 172.21.15.102:0/3438038648 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90f01f6af0 msgr2=0x7f90f00c6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:46.944 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.941+0000 7f90f755a640 1 --2- 172.21.15.102:0/3438038648 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90f01f6af0 0x7f90f00c6ec0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f90e800a950 tx=0x7f90e8001d80 comp rx=0 tx=0).stop 2023-10-14T09:38:46.944 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.941+0000 7f90f755a640 1 -- 172.21.15.102:0/3438038648 shutdown_connections 2023-10-14T09:38:46.944 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.941+0000 7f90f755a640 1 --2- 172.21.15.102:0/3438038648 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f90dc06aea0 0x7f90dc06d360 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:46.945 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.941+0000 7f90f755a640 1 --2- 172.21.15.102:0/3438038648 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90f01f6af0 0x7f90f00c6ec0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:46.945 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.941+0000 7f90f755a640 1 --2- 172.21.15.102:0/3438038648 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90f01f6670 0x7f90f00c6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:46.945 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.941+0000 7f90f755a640 1 --2- 172.21.15.102:0/3438038648 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90d8004d00 0x7f90f01590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:46.946 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.941+0000 7f90f755a640 1 -- 172.21.15.102:0/3438038648 >> 172.21.15.102:0/3438038648 conn(0x7f90f00d0ab0 msgr2=0x7f90f00ce9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:46.946 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.942+0000 7f90f755a640 1 -- 172.21.15.102:0/3438038648 shutdown_connections 2023-10-14T09:38:46.946 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:46.942+0000 7f90f755a640 1 -- 172.21.15.102:0/3438038648 wait complete. 2023-10-14T09:38:46.961 INFO:tasks.ceph:Scrubbing osd.5 2023-10-14T09:38:46.962 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-14T09:38:47.182 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.180+0000 7fc50a2f2640 1 Processor -- start 2023-10-14T09:38:47.183 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.181+0000 7fc50a2f2640 1 -- start start 2023-10-14T09:38:47.184 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.182+0000 7fc50a2f2640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fc5040b8a10 0x7fc5040d2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:47.184 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.182+0000 7fc50a2f2640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc5040b4750 0x7fc5040b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:47.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.182+0000 7fc50a2f2640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5040d1420 con 0x7fc50415cf50 2023-10-14T09:38:47.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.182+0000 7fc50a2f2640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5040b50b0 con 0x7fc5040b4750 2023-10-14T09:38:47.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.182+0000 7fc50a2f2640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc50415d330 con 0x7fc5040b8a10 2023-10-14T09:38:47.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.182+0000 7fc50888f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc5040b4750 0x7fc5040b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:47.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.182+0000 7fc50888f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc5040b4750 0x7fc5040b4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55786/0 (socket says 172.21.15.102:55786) 2023-10-14T09:38:47.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.182+0000 7fc50888f640 1 -- 172.21.15.102:0/3379748471 learned_addr learned my addr 172.21.15.102:0/3379748471 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:47.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.182+0000 7fc503fff640 1 --1- 172.21.15.102:0/3379748471 >> v1:172.21.15.102:6789/0 conn(0x7fc50415cf50 0x7fc5040d0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55612/0 (socket says 172.21.15.102:55612) 2023-10-14T09:38:47.188 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.183+0000 7fc5037fe640 1 --2- 172.21.15.102:0/3379748471 >> v2:172.21.15.129:3300/0 conn(0x7fc5040b8a10 0x7fc5040d2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:47.188 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.183+0000 7fc50888f640 1 -- 172.21.15.102:0/3379748471 >> v2:172.21.15.129:3300/0 conn(0x7fc5040b8a10 msgr2=0x7fc5040d2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:47.188 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.183+0000 7fc50888f640 1 --2- 172.21.15.102:0/3379748471 >> v2:172.21.15.129:3300/0 conn(0x7fc5040b8a10 0x7fc5040d2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:47.189 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.183+0000 7fc50888f640 1 -- 172.21.15.102:0/3379748471 >> v1:172.21.15.102:6789/0 conn(0x7fc50415cf50 legacy=0x7fc5040d0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:47.189 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.183+0000 7fc50888f640 1 -- 172.21.15.102:0/3379748471 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5040d1680 con 0x7fc5040b4750 2023-10-14T09:38:47.189 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.183+0000 7fc5037fe640 1 --2- 172.21.15.102:0/3379748471 >> v2:172.21.15.129:3300/0 conn(0x7fc5040b8a10 0x7fc5040d2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:47.189 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.184+0000 7fc50888f640 1 --2- 172.21.15.102:0/3379748471 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5040b4750 0x7fc5040b4b70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc5040745a0 tx=0x7fc4fc02b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ea2078224c7e8c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:47.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.185+0000 7fc502ffd640 1 -- 172.21.15.102:0/3379748471 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc030870 con 0x7fc5040b4750 2023-10-14T09:38:47.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.185+0000 7fc502ffd640 1 -- 172.21.15.102:0/3379748471 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4fc0309d0 con 0x7fc5040b4750 2023-10-14T09:38:47.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.185+0000 7fc502ffd640 1 -- 172.21.15.102:0/3379748471 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc030d60 con 0x7fc5040b4750 2023-10-14T09:38:47.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.185+0000 7fc50a2f2640 1 -- 172.21.15.102:0/3379748471 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5040b4750 msgr2=0x7fc5040b4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:47.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.185+0000 7fc50a2f2640 1 --2- 172.21.15.102:0/3379748471 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5040b4750 0x7fc5040b4b70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc5040745a0 tx=0x7fc4fc02b9b0 comp rx=0 tx=0).stop 2023-10-14T09:38:47.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.185+0000 7fc50a2f2640 1 -- 172.21.15.102:0/3379748471 shutdown_connections 2023-10-14T09:38:47.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.185+0000 7fc50a2f2640 1 --2- 172.21.15.102:0/3379748471 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5040b4750 0x7fc5040b4b70 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:47.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.185+0000 7fc50a2f2640 1 --2- 172.21.15.102:0/3379748471 >> v2:172.21.15.129:3300/0 conn(0x7fc5040b8a10 0x7fc5040d2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:47.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.185+0000 7fc50a2f2640 1 -- 172.21.15.102:0/3379748471 >> 172.21.15.102:0/3379748471 conn(0x7fc5040cf750 msgr2=0x7fc5040cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:47.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.185+0000 7fc50a2f2640 1 -- 172.21.15.102:0/3379748471 shutdown_connections 2023-10-14T09:38:47.193 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.185+0000 7fc50a2f2640 1 -- 172.21.15.102:0/3379748471 wait complete. 2023-10-14T09:38:47.196 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.187+0000 7fc50a2f2640 1 Processor -- start 2023-10-14T09:38:47.196 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.187+0000 7fc50a2f2640 1 -- start start 2023-10-14T09:38:47.196 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.188+0000 7fc50a2f2640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc5040b4750 0x7fc5040c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:47.197 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.188+0000 7fc50a2f2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5040b8a10 0x7fc5041f58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:47.197 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.188+0000 7fc50a2f2640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc50415cf50 0x7fc5041f5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:47.197 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.188+0000 7fc50a2f2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5041f6740 con 0x7fc5040b8a10 2023-10-14T09:38:47.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.188+0000 7fc50a2f2640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5040c8d50 con 0x7fc50415cf50 2023-10-14T09:38:47.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.188+0000 7fc50a2f2640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5040cbfc0 con 0x7fc5040b4750 2023-10-14T09:38:47.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.188+0000 7fc5037fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5040b8a10 0x7fc5041f58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:47.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.188+0000 7fc5037fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5040b8a10 0x7fc5041f58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55796/0 (socket says 172.21.15.102:55796) 2023-10-14T09:38:47.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.188+0000 7fc5037fe640 1 -- 172.21.15.102:0/169412117 learned_addr learned my addr 172.21.15.102:0/169412117 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:47.202 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.189+0000 7fc503fff640 1 --2- 172.21.15.102:0/169412117 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc5040b4750 0x7fc5040c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:47.202 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.189+0000 7fc5037fe640 1 -- 172.21.15.102:0/169412117 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc5040b4750 msgr2=0x7fc5040c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:47.202 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.189+0000 7fc5037fe640 1 --2- 172.21.15.102:0/169412117 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc5040b4750 0x7fc5040c8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:47.203 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.189+0000 7fc50888f640 1 --2- 172.21.15.102:0/169412117 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc50415cf50 0x7fc5041f5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:47.203 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.189+0000 7fc5037fe640 1 -- 172.21.15.102:0/169412117 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc50415cf50 msgr2=0x7fc5041f5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:47.203 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.189+0000 7fc5037fe640 1 --2- 172.21.15.102:0/169412117 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc50415cf50 0x7fc5041f5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:47.203 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.189+0000 7fc5037fe640 1 -- 172.21.15.102:0/169412117 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4fc0094d0 con 0x7fc5040b8a10 2023-10-14T09:38:47.204 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.189+0000 7fc5037fe640 1 --2- 172.21.15.102:0/169412117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5040b8a10 0x7fc5041f58e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec00c7f0 tx=0x7fc4ec00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:47.204 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.189+0000 7fc500ff9640 1 -- 172.21.15.102:0/169412117 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec007a30 con 0x7fc5040b8a10 2023-10-14T09:38:47.204 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.189+0000 7fc500ff9640 1 -- 172.21.15.102:0/169412117 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ec007b90 con 0x7fc5040b8a10 2023-10-14T09:38:47.205 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.189+0000 7fc500ff9640 1 -- 172.21.15.102:0/169412117 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec00ce40 con 0x7fc5040b8a10 2023-10-14T09:38:47.205 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.189+0000 7fc50a2f2640 1 -- 172.21.15.102:0/169412117 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5040cc2a0 con 0x7fc5040b8a10 2023-10-14T09:38:47.205 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.189+0000 7fc50a2f2640 1 -- 172.21.15.102:0/169412117 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5040cc860 con 0x7fc5040b8a10 2023-10-14T09:38:47.205 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.190+0000 7fc50a2f2640 1 -- 172.21.15.102:0/169412117 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc5040d1c40 con 0x7fc5040b8a10 2023-10-14T09:38:47.206 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.192+0000 7fc500ff9640 1 -- 172.21.15.102:0/169412117 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc4ec0113f0 con 0x7fc5040b8a10 2023-10-14T09:38:47.206 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.192+0000 7fc500ff9640 1 --2- 172.21.15.102:0/169412117 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc4e406ae70 0x7fc4e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:47.206 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.193+0000 7fc500ff9640 1 -- 172.21.15.102:0/169412117 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fc4ec089800 con 0x7fc5040b8a10 2023-10-14T09:38:47.206 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.193+0000 7fc503fff640 1 --2- 172.21.15.102:0/169412117 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc4e406ae70 0x7fc4e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:47.207 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.193+0000 7fc500ff9640 1 --2- 172.21.15.102:0/169412117 >> [v2:172.21.15.129:6800/1913451073,v1:172.21.15.129:6801/1913451073] conn(0x7fc4e4073070 0x7fc4e40754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:47.207 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.193+0000 7fc500ff9640 1 -- 172.21.15.102:0/169412117 --> [v2:172.21.15.129:6800/1913451073,v1:172.21.15.129:6801/1913451073] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc4e4075b80 con 0x7fc4e4073070 2023-10-14T09:38:47.207 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.193+0000 7fc500ff9640 1 -- 172.21.15.102:0/169412117 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4ec08be60 con 0x7fc5040b8a10 2023-10-14T09:38:47.207 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.194+0000 7fc503fff640 1 --2- 172.21.15.102:0/169412117 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc4e406ae70 0x7fc4e406d330 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc4f40012e0 tx=0x7fc4f4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:47.208 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.194+0000 7fc50888f640 1 --2- 172.21.15.102:0/169412117 >> [v2:172.21.15.129:6800/1913451073,v1:172.21.15.129:6801/1913451073] conn(0x7fc4e4073070 0x7fc4e40754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:47.209 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.195+0000 7fc50888f640 1 --2- 172.21.15.102:0/169412117 >> [v2:172.21.15.129:6800/1913451073,v1:172.21.15.129:6801/1913451073] conn(0x7fc4e4073070 0x7fc4e40754b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:47.209 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.197+0000 7fc500ff9640 1 -- 172.21.15.102:0/169412117 <== osd.5 v2:172.21.15.129:6800/1913451073 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fc4e4075b80 con 0x7fc4e4073070 2023-10-14T09:38:47.212 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.210+0000 7fc50a2f2640 1 -- 172.21.15.102:0/169412117 --> [v2:172.21.15.129:6800/1913451073,v1:172.21.15.129:6801/1913451073] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc5040d1960 con 0x7fc4e4073070 2023-10-14T09:38:47.213 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.212+0000 7fc500ff9640 1 -- 172.21.15.102:0/169412117 <== osd.5 v2:172.21.15.129:6800/1913451073 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc4fc030b40 con 0x7fc4e4073070 2023-10-14T09:38:47.214 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-10-14T09:38:47.214 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T09:38:47.214 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-10-14T09:38:47.216 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.212+0000 7fc50a2f2640 1 -- 172.21.15.102:0/169412117 >> [v2:172.21.15.129:6800/1913451073,v1:172.21.15.129:6801/1913451073] conn(0x7fc4e4073070 msgr2=0x7fc4e40754b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:47.216 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.212+0000 7fc50a2f2640 1 --2- 172.21.15.102:0/169412117 >> [v2:172.21.15.129:6800/1913451073,v1:172.21.15.129:6801/1913451073] conn(0x7fc4e4073070 0x7fc4e40754b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:47.216 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.212+0000 7fc50a2f2640 1 -- 172.21.15.102:0/169412117 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc4e406ae70 msgr2=0x7fc4e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:47.217 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.212+0000 7fc50a2f2640 1 --2- 172.21.15.102:0/169412117 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fc4e406ae70 0x7fc4e406d330 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc4f40012e0 tx=0x7fc4f4009040 comp rx=0 tx=0).stop 2023-10-14T09:38:47.217 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.212+0000 7fc50a2f2640 1 -- 172.21.15.102:0/169412117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5040b8a10 msgr2=0x7fc5041f58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:47.217 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.212+0000 7fc50a2f2640 1 --2- 172.21.15.102:0/169412117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5040b8a10 0x7fc5041f58e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec00c7f0 tx=0x7fc4ec00cbf0 comp rx=0 tx=0).stop 2023-10-14T09:38:47.217 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.212+0000 7fc50888f640 1 -- 172.21.15.102:0/169412117 reap_dead start 2023-10-14T09:38:47.218 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.213+0000 7fc50a2f2640 1 -- 172.21.15.102:0/169412117 shutdown_connections 2023-10-14T09:38:47.218 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.213+0000 7fc50a2f2640 1 -- 172.21.15.102:0/169412117 >> 172.21.15.102:0/169412117 conn(0x7fc5040cf750 msgr2=0x7fc50415a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:47.218 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.213+0000 7fc50a2f2640 1 -- 172.21.15.102:0/169412117 shutdown_connections 2023-10-14T09:38:47.218 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.213+0000 7fc50a2f2640 1 -- 172.21.15.102:0/169412117 wait complete. 2023-10-14T09:38:47.233 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-14T09:38:47.444 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.442+0000 7f1fee787640 1 Processor -- start 2023-10-14T09:38:47.445 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.443+0000 7f1fee787640 1 -- start start 2023-10-14T09:38:47.446 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.444+0000 7f1fee787640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1fe815cc80 0x7f1fe80cd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:47.446 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.444+0000 7f1fee787640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1fe8072170 0x7f1fe806aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:47.447 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.444+0000 7f1fee787640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fe80d12f0 con 0x7f1fe80cdd60 2023-10-14T09:38:47.447 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.444+0000 7f1fee787640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe80d0500 con 0x7f1fe815cc80 2023-10-14T09:38:47.447 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.444+0000 7f1fee787640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe80ce1f0 con 0x7f1fe8072170 2023-10-14T09:38:47.447 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.444+0000 7f1fed785640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1fe815cc80 0x7f1fe80cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:47.448 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.444+0000 7f1fed785640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1fe815cc80 0x7f1fe80cd820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55806/0 (socket says 172.21.15.102:55806) 2023-10-14T09:38:47.448 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.444+0000 7f1fecf84640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f1fe80cdd60 0x7f1fe8071a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55624/0 (socket says 172.21.15.102:55624) 2023-10-14T09:38:47.448 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.444+0000 7f1fed785640 1 -- 172.21.15.102:0/3456878782 learned_addr learned my addr 172.21.15.102:0/3456878782 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:47.450 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.445+0000 7f1fedf86640 1 --2- 172.21.15.102:0/3456878782 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1fe8072170 0x7f1fe806aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:47.450 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.445+0000 7f1fed785640 1 -- 172.21.15.102:0/3456878782 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1fe8072170 msgr2=0x7f1fe806aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:47.450 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.445+0000 7f1fed785640 1 --2- 172.21.15.102:0/3456878782 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1fe8072170 0x7f1fe806aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:47.451 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.445+0000 7f1fed785640 1 -- 172.21.15.102:0/3456878782 >> v1:172.21.15.102:6789/0 conn(0x7f1fe80cdd60 legacy=0x7f1fe8071a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:47.451 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.445+0000 7f1fed785640 1 -- 172.21.15.102:0/3456878782 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe80d06e0 con 0x7f1fe815cc80 2023-10-14T09:38:47.451 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.445+0000 7f1fedf86640 1 --2- 172.21.15.102:0/3456878782 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1fe8072170 0x7f1fe806aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:47.451 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.445+0000 7f1fdffff640 1 -- 172.21.15.102:0/3456878782 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1273414093 0 0) 0x7f1fe80d12f0 con 0x7f1fe80cdd60 2023-10-14T09:38:47.452 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.446+0000 7f1fed785640 1 --2- 172.21.15.102:0/3456878782 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fe815cc80 0x7f1fe80cd820 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4009870 tx=0x7f1fe402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e3348fa192cbf8c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:47.452 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.446+0000 7f1fdffff640 1 -- 172.21.15.102:0/3456878782 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe4030840 con 0x7f1fe815cc80 2023-10-14T09:38:47.452 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.446+0000 7f1fdffff640 1 -- 172.21.15.102:0/3456878782 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe40309a0 con 0x7f1fe815cc80 2023-10-14T09:38:47.453 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.446+0000 7f1fdffff640 1 -- 172.21.15.102:0/3456878782 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe4030d30 con 0x7f1fe815cc80 2023-10-14T09:38:47.453 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.447+0000 7f1fee787640 1 -- 172.21.15.102:0/3456878782 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fe815cc80 msgr2=0x7f1fe80cd820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:47.453 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.447+0000 7f1fee787640 1 --2- 172.21.15.102:0/3456878782 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fe815cc80 0x7f1fe80cd820 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4009870 tx=0x7f1fe402b980 comp rx=0 tx=0).stop 2023-10-14T09:38:47.453 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.447+0000 7f1fee787640 1 -- 172.21.15.102:0/3456878782 shutdown_connections 2023-10-14T09:38:47.454 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.447+0000 7f1fee787640 1 --2- 172.21.15.102:0/3456878782 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1fe8072170 0x7f1fe806aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:47.454 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.447+0000 7f1fee787640 1 --2- 172.21.15.102:0/3456878782 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fe815cc80 0x7f1fe80cd820 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:47.454 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.447+0000 7f1fee787640 1 -- 172.21.15.102:0/3456878782 >> 172.21.15.102:0/3456878782 conn(0x7f1fe8065ed0 msgr2=0x7f1fe80662e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:47.455 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.447+0000 7f1fee787640 1 -- 172.21.15.102:0/3456878782 shutdown_connections 2023-10-14T09:38:47.455 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.447+0000 7f1fee787640 1 -- 172.21.15.102:0/3456878782 wait complete. 2023-10-14T09:38:47.457 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.449+0000 7f1fee787640 1 Processor -- start 2023-10-14T09:38:47.458 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.449+0000 7f1fee787640 1 -- start start 2023-10-14T09:38:47.458 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.450+0000 7f1fee787640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1fe8072170 0x7f1fe8149150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:47.458 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.450+0000 7f1fee787640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fe80cdd60 0x7f1fe80c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:47.459 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.450+0000 7f1fee787640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1fe815cc80 0x7f1fe80b5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:47.459 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.450+0000 7f1fee787640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe8149690 con 0x7f1fe80cdd60 2023-10-14T09:38:47.459 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.450+0000 7f1fee787640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe80b4920 con 0x7f1fe8072170 2023-10-14T09:38:47.459 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.450+0000 7f1fee787640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe80c6370 con 0x7f1fe815cc80 2023-10-14T09:38:47.460 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.450+0000 7f1fecf84640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fe80cdd60 0x7f1fe80c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:47.460 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.450+0000 7f1fecf84640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fe80cdd60 0x7f1fe80c5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55822/0 (socket says 172.21.15.102:55822) 2023-10-14T09:38:47.460 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.450+0000 7f1fecf84640 1 -- 172.21.15.102:0/3426241576 learned_addr learned my addr 172.21.15.102:0/3426241576 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:47.460 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.450+0000 7f1fecf84640 1 -- 172.21.15.102:0/3426241576 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1fe815cc80 msgr2=0x7f1fe80b5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:47.461 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.450+0000 7f1fecf84640 1 --2- 172.21.15.102:0/3426241576 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1fe815cc80 0x7f1fe80b5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:47.461 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.450+0000 7f1fecf84640 1 -- 172.21.15.102:0/3426241576 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1fe8072170 msgr2=0x7f1fe8149150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:47.461 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.450+0000 7f1fecf84640 1 --2- 172.21.15.102:0/3426241576 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1fe8072170 0x7f1fe8149150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:47.461 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.450+0000 7f1fecf84640 1 -- 172.21.15.102:0/3426241576 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe40094d0 con 0x7f1fe80cdd60 2023-10-14T09:38:47.462 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.451+0000 7f1fecf84640 1 --2- 172.21.15.102:0/3426241576 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fe80cdd60 0x7f1fe80c5e30 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1fd800c4d0 tx=0x7f1fd800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:47.462 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.451+0000 7f1fddffb640 1 -- 172.21.15.102:0/3426241576 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd80074e0 con 0x7f1fe80cdd60 2023-10-14T09:38:47.462 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.451+0000 7f1fddffb640 1 -- 172.21.15.102:0/3426241576 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd8007660 con 0x7f1fe80cdd60 2023-10-14T09:38:47.463 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.451+0000 7f1fee787640 1 -- 172.21.15.102:0/3426241576 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe80b4ba0 con 0x7f1fe80cdd60 2023-10-14T09:38:47.463 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.451+0000 7f1fddffb640 1 -- 172.21.15.102:0/3426241576 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8004a20 con 0x7f1fe80cdd60 2023-10-14T09:38:47.463 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.451+0000 7f1fee787640 1 -- 172.21.15.102:0/3426241576 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe80b5160 con 0x7f1fe80cdd60 2023-10-14T09:38:47.463 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.452+0000 7f1fee787640 1 -- 172.21.15.102:0/3426241576 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fe804e9b0 con 0x7f1fe80cdd60 2023-10-14T09:38:47.464 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.453+0000 7f1fddffb640 1 -- 172.21.15.102:0/3426241576 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1fd8004b80 con 0x7f1fe80cdd60 2023-10-14T09:38:47.464 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.454+0000 7f1fddffb640 1 --2- 172.21.15.102:0/3426241576 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1fcc06ae70 0x7f1fcc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:47.464 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.454+0000 7f1fddffb640 1 -- 172.21.15.102:0/3426241576 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f1fd8088b70 con 0x7f1fe80cdd60 2023-10-14T09:38:47.464 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.455+0000 7f1fed785640 1 --2- 172.21.15.102:0/3426241576 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1fcc06ae70 0x7f1fcc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:47.465 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.455+0000 7f1fed785640 1 --2- 172.21.15.102:0/3426241576 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1fcc06ae70 0x7f1fcc06d330 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4036000 tx=0x7f1fe403b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:47.465 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.459+0000 7f1fddffb640 1 -- 172.21.15.102:0/3426241576 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1fd8053bf0 con 0x7f1fe80cdd60 2023-10-14T09:38:47.653 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.652+0000 7f1fee787640 1 -- 172.21.15.102:0/3426241576 --> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f1fe80d0ca0 con 0x7f1fcc06ae70 2023-10-14T09:38:47.654 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.653+0000 7f1fddffb640 1 -- 172.21.15.102:0/3426241576 <== mgr.4104 v2:172.21.15.102:6832/1125265706 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1fe4030b90 con 0x7f1fcc06ae70 2023-10-14T09:38:47.655 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 5 to deep-scrub 2023-10-14T09:38:47.657 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.655+0000 7f1fee787640 1 -- 172.21.15.102:0/3426241576 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1fcc06ae70 msgr2=0x7f1fcc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:47.657 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.655+0000 7f1fee787640 1 --2- 172.21.15.102:0/3426241576 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1fcc06ae70 0x7f1fcc06d330 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4036000 tx=0x7f1fe403b040 comp rx=0 tx=0).stop 2023-10-14T09:38:47.658 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.655+0000 7f1fee787640 1 -- 172.21.15.102:0/3426241576 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fe80cdd60 msgr2=0x7f1fe80c5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:47.658 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.655+0000 7f1fee787640 1 --2- 172.21.15.102:0/3426241576 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fe80cdd60 0x7f1fe80c5e30 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1fd800c4d0 tx=0x7f1fd800c990 comp rx=0 tx=0).stop 2023-10-14T09:38:47.658 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.655+0000 7f1fee787640 1 -- 172.21.15.102:0/3426241576 shutdown_connections 2023-10-14T09:38:47.658 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.655+0000 7f1fee787640 1 --2- 172.21.15.102:0/3426241576 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1fcc06ae70 0x7f1fcc06d330 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:47.659 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.655+0000 7f1fee787640 1 --2- 172.21.15.102:0/3426241576 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1fe815cc80 0x7f1fe80b5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:47.659 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.655+0000 7f1fee787640 1 --2- 172.21.15.102:0/3426241576 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fe80cdd60 0x7f1fe80c5e30 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:47.659 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.655+0000 7f1fee787640 1 --2- 172.21.15.102:0/3426241576 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1fe8072170 0x7f1fe8149150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:47.660 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.655+0000 7f1fee787640 1 -- 172.21.15.102:0/3426241576 >> 172.21.15.102:0/3426241576 conn(0x7f1fe8065ed0 msgr2=0x7f1fe80afa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:47.660 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.656+0000 7f1fee787640 1 -- 172.21.15.102:0/3426241576 shutdown_connections 2023-10-14T09:38:47.660 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.656+0000 7f1fee787640 1 -- 172.21.15.102:0/3426241576 wait complete. 2023-10-14T09:38:47.676 INFO:tasks.ceph:Scrubbing osd.6 2023-10-14T09:38:47.677 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-14T09:38:47.883 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.880+0000 7f0067f1d640 1 Processor -- start 2023-10-14T09:38:47.883 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.881+0000 7f0067f1d640 1 -- start start 2023-10-14T09:38:47.884 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.882+0000 7f0067f1d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f006015cf60 0x7f006006f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:47.885 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.882+0000 7f0067f1d640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f006006f9d0 0x7f00600c9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:47.885 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.882+0000 7f0067f1d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00600c9620 con 0x7f00600c9ff0 2023-10-14T09:38:47.885 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.882+0000 7f0067f1d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f006015d340 con 0x7f006015cf60 2023-10-14T09:38:47.886 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.882+0000 7f0067f1d640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00600cc860 con 0x7f006006f9d0 2023-10-14T09:38:47.886 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.883+0000 7f0065cb9640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f006015cf60 0x7f006006f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:47.886 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.883+0000 7f0065cb9640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f006015cf60 0x7f006006f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55838/0 (socket says 172.21.15.102:55838) 2023-10-14T09:38:47.886 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.883+0000 7f0065cb9640 1 -- 172.21.15.102:0/1752112834 learned_addr learned my addr 172.21.15.102:0/1752112834 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:47.887 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.883+0000 7f00654b8640 1 --2- 172.21.15.102:0/1752112834 >> v2:172.21.15.129:3300/0 conn(0x7f006006f9d0 0x7f00600c9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:47.888 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.883+0000 7f0065cb9640 1 -- 172.21.15.102:0/1752112834 >> v2:172.21.15.129:3300/0 conn(0x7f006006f9d0 msgr2=0x7f00600c9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:47.888 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.883+0000 7f0065cb9640 1 --2- 172.21.15.102:0/1752112834 >> v2:172.21.15.129:3300/0 conn(0x7f006006f9d0 0x7f00600c9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:47.889 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.883+0000 7f0065cb9640 1 -- 172.21.15.102:0/1752112834 >> v1:172.21.15.102:6789/0 conn(0x7f00600c9ff0 legacy=0x7f00600b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:47.889 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.883+0000 7f0065cb9640 1 -- 172.21.15.102:0/1752112834 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00600ad4a0 con 0x7f006015cf60 2023-10-14T09:38:47.889 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.884+0000 7f0065cb9640 1 --2- 172.21.15.102:0/1752112834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f006015cf60 0x7f006006f490 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f005c009e50 tx=0x7f005c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ae41a183f70450 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:47.890 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.884+0000 7f0064cb7640 1 -- 172.21.15.102:0/1752112834 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c02cb00 con 0x7f006015cf60 2023-10-14T09:38:47.890 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.885+0000 7f0064cb7640 1 -- 172.21.15.102:0/1752112834 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005c02cc60 con 0x7f006015cf60 2023-10-14T09:38:47.890 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.885+0000 7f0064cb7640 1 -- 172.21.15.102:0/1752112834 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c0343f0 con 0x7f006015cf60 2023-10-14T09:38:47.890 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.885+0000 7f0067f1d640 1 -- 172.21.15.102:0/1752112834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f006015cf60 msgr2=0x7f006006f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:47.891 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.885+0000 7f0067f1d640 1 --2- 172.21.15.102:0/1752112834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f006015cf60 0x7f006006f490 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f005c009e50 tx=0x7f005c02bf60 comp rx=0 tx=0).stop 2023-10-14T09:38:47.891 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.885+0000 7f0067f1d640 1 -- 172.21.15.102:0/1752112834 shutdown_connections 2023-10-14T09:38:47.891 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.885+0000 7f0067f1d640 1 --2- 172.21.15.102:0/1752112834 >> v2:172.21.15.129:3300/0 conn(0x7f006006f9d0 0x7f00600c9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:47.892 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.885+0000 7f0067f1d640 1 --2- 172.21.15.102:0/1752112834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f006015cf60 0x7f006006f490 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:47.892 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.885+0000 7f0067f1d640 1 -- 172.21.15.102:0/1752112834 >> 172.21.15.102:0/1752112834 conn(0x7f00600cb360 msgr2=0x7f00600cb740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:47.892 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.885+0000 7f0067f1d640 1 -- 172.21.15.102:0/1752112834 shutdown_connections 2023-10-14T09:38:47.892 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.885+0000 7f0067f1d640 1 -- 172.21.15.102:0/1752112834 wait complete. 2023-10-14T09:38:47.895 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.887+0000 7f0067f1d640 1 Processor -- start 2023-10-14T09:38:47.896 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.887+0000 7f0067f1d640 1 -- start start 2023-10-14T09:38:47.896 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.888+0000 7f0067f1d640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f006006f9d0 0x7f00601544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:47.896 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.888+0000 7f0067f1d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00600c9ff0 0x7f00600c71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:47.896 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.888+0000 7f0067f1d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f006015cf60 0x7f00600c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:47.897 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.888+0000 7f0067f1d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00600c2b00 con 0x7f00600c9ff0 2023-10-14T09:38:47.897 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.888+0000 7f0067f1d640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00600c48c0 con 0x7f006015cf60 2023-10-14T09:38:47.897 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.888+0000 7f0067f1d640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00601f6960 con 0x7f006006f9d0 2023-10-14T09:38:47.898 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.888+0000 7f00654b8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00600c9ff0 0x7f00600c71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:47.898 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.888+0000 7f00654b8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00600c9ff0 0x7f00600c71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55848/0 (socket says 172.21.15.102:55848) 2023-10-14T09:38:47.898 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.888+0000 7f00654b8640 1 -- 172.21.15.102:0/4129591387 learned_addr learned my addr 172.21.15.102:0/4129591387 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:47.898 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.889+0000 7f0065cb9640 1 --2- 172.21.15.102:0/4129591387 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f006006f9d0 0x7f00601544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:47.899 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.889+0000 7f00664ba640 1 --2- 172.21.15.102:0/4129591387 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f006015cf60 0x7f00600c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:47.899 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.889+0000 7f00654b8640 1 -- 172.21.15.102:0/4129591387 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f006006f9d0 msgr2=0x7f00601544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:47.899 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.889+0000 7f00654b8640 1 --2- 172.21.15.102:0/4129591387 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f006006f9d0 0x7f00601544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:47.900 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.889+0000 7f00654b8640 1 -- 172.21.15.102:0/4129591387 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f006015cf60 msgr2=0x7f00600c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:47.900 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.889+0000 7f00654b8640 1 --2- 172.21.15.102:0/4129591387 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f006015cf60 0x7f00600c76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:47.900 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.889+0000 7f00654b8640 1 -- 172.21.15.102:0/4129591387 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005c009b30 con 0x7f00600c9ff0 2023-10-14T09:38:47.900 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.889+0000 7f00654b8640 1 --2- 172.21.15.102:0/4129591387 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00600c9ff0 0x7f00600c71b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f005000d5f0 tx=0x7f005000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:47.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.889+0000 7f00567fc640 1 -- 172.21.15.102:0/4129591387 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00500125f0 con 0x7f00600c9ff0 2023-10-14T09:38:47.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.889+0000 7f00567fc640 1 -- 172.21.15.102:0/4129591387 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0050012750 con 0x7f00600c9ff0 2023-10-14T09:38:47.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.889+0000 7f00567fc640 1 -- 172.21.15.102:0/4129591387 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0050012b00 con 0x7f00600c9ff0 2023-10-14T09:38:47.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.889+0000 7f0067f1d640 1 -- 172.21.15.102:0/4129591387 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00601f6c40 con 0x7f00600c9ff0 2023-10-14T09:38:47.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.890+0000 7f0067f1d640 1 -- 172.21.15.102:0/4129591387 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00600c2790 con 0x7f00600c9ff0 2023-10-14T09:38:47.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.890+0000 7f0067f1d640 1 -- 172.21.15.102:0/4129591387 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f00600c92b0 con 0x7f00600c9ff0 2023-10-14T09:38:47.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.892+0000 7f00567fc640 1 -- 172.21.15.102:0/4129591387 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0050012c60 con 0x7f00600c9ff0 2023-10-14T09:38:47.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.892+0000 7f00567fc640 1 --2- 172.21.15.102:0/4129591387 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f004406aea0 0x7f004406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:47.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.893+0000 7f00567fc640 1 -- 172.21.15.102:0/4129591387 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f0050089b10 con 0x7f00600c9ff0 2023-10-14T09:38:47.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.893+0000 7f0065cb9640 1 --2- 172.21.15.102:0/4129591387 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f004406aea0 0x7f004406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:47.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.893+0000 7f00567fc640 1 --2- 172.21.15.102:0/4129591387 >> [v2:172.21.15.129:6808/2853291511,v1:172.21.15.129:6809/2853291511] conn(0x7f00440730a0 0x7f00440754e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:47.904 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.893+0000 7f00567fc640 1 -- 172.21.15.102:0/4129591387 --> [v2:172.21.15.129:6808/2853291511,v1:172.21.15.129:6809/2853291511] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0044075bb0 con 0x7f00440730a0 2023-10-14T09:38:47.904 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.893+0000 7f00567fc640 1 -- 172.21.15.102:0/4129591387 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f005008e2a0 con 0x7f00600c9ff0 2023-10-14T09:38:47.904 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.893+0000 7f0065cb9640 1 --2- 172.21.15.102:0/4129591387 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f004406aea0 0x7f004406d360 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f005c035000 tx=0x7f005c030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:47.904 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.893+0000 7f00664ba640 1 --2- 172.21.15.102:0/4129591387 >> [v2:172.21.15.129:6808/2853291511,v1:172.21.15.129:6809/2853291511] conn(0x7f00440730a0 0x7f00440754e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:47.905 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.894+0000 7f00664ba640 1 --2- 172.21.15.102:0/4129591387 >> [v2:172.21.15.129:6808/2853291511,v1:172.21.15.129:6809/2853291511] conn(0x7f00440730a0 0x7f00440754e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:47.905 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.896+0000 7f00567fc640 1 -- 172.21.15.102:0/4129591387 <== osd.6 v2:172.21.15.129:6808/2853291511 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f0044075bb0 con 0x7f00440730a0 2023-10-14T09:38:47.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.911+0000 7f0067f1d640 1 -- 172.21.15.102:0/4129591387 --> [v2:172.21.15.129:6808/2853291511,v1:172.21.15.129:6809/2853291511] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f00600c8fd0 con 0x7f00440730a0 2023-10-14T09:38:47.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.912+0000 7f00567fc640 1 -- 172.21.15.102:0/4129591387 <== osd.6 v2:172.21.15.129:6808/2853291511 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f00580050f0 con 0x7f00440730a0 2023-10-14T09:38:47.914 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-10-14T09:38:47.914 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T09:38:47.915 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-10-14T09:38:47.916 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.912+0000 7f0067f1d640 1 -- 172.21.15.102:0/4129591387 >> [v2:172.21.15.129:6808/2853291511,v1:172.21.15.129:6809/2853291511] conn(0x7f00440730a0 msgr2=0x7f00440754e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:47.916 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.912+0000 7f0067f1d640 1 --2- 172.21.15.102:0/4129591387 >> [v2:172.21.15.129:6808/2853291511,v1:172.21.15.129:6809/2853291511] conn(0x7f00440730a0 0x7f00440754e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:47.916 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.913+0000 7f0067f1d640 1 -- 172.21.15.102:0/4129591387 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f004406aea0 msgr2=0x7f004406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:47.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.913+0000 7f0067f1d640 1 --2- 172.21.15.102:0/4129591387 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f004406aea0 0x7f004406d360 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f005c035000 tx=0x7f005c030000 comp rx=0 tx=0).stop 2023-10-14T09:38:47.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.913+0000 7f0067f1d640 1 -- 172.21.15.102:0/4129591387 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00600c9ff0 msgr2=0x7f00600c71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:47.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.913+0000 7f0067f1d640 1 --2- 172.21.15.102:0/4129591387 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00600c9ff0 0x7f00600c71b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f005000d5f0 tx=0x7f005000dab0 comp rx=0 tx=0).stop 2023-10-14T09:38:47.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.913+0000 7f00664ba640 1 -- 172.21.15.102:0/4129591387 reap_dead start 2023-10-14T09:38:47.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.913+0000 7f0067f1d640 1 -- 172.21.15.102:0/4129591387 shutdown_connections 2023-10-14T09:38:47.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.913+0000 7f0067f1d640 1 -- 172.21.15.102:0/4129591387 >> 172.21.15.102:0/4129591387 conn(0x7f00600cb360 msgr2=0x7f006006fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:47.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.913+0000 7f0067f1d640 1 -- 172.21.15.102:0/4129591387 shutdown_connections 2023-10-14T09:38:47.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:47.913+0000 7f0067f1d640 1 -- 172.21.15.102:0/4129591387 wait complete. 2023-10-14T09:38:47.931 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-14T09:38:48.141 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.139+0000 7fbd528c9640 1 Processor -- start 2023-10-14T09:38:48.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.140+0000 7fbd528c9640 1 -- start start 2023-10-14T09:38:48.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.141+0000 7fbd528c9640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fbd4c159ab0 0x7fbd4c0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:48.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.141+0000 7fbd528c9640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbd4c159e90 0x7fbd4c06fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:48.144 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.141+0000 7fbd528c9640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd4c0cd1f0 con 0x7fbd4c06c140 2023-10-14T09:38:48.144 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.141+0000 7fbd528c9640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd4c15d890 con 0x7fbd4c159e90 2023-10-14T09:38:48.144 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.141+0000 7fbd528c9640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd4c0cd4d0 con 0x7fbd4c159ab0 2023-10-14T09:38:48.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.141+0000 7fbd43fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbd4c159e90 0x7fbd4c06fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:48.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.141+0000 7fbd43fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbd4c159e90 0x7fbd4c06fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55864/0 (socket says 172.21.15.102:55864) 2023-10-14T09:38:48.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.141+0000 7fbd43fff640 1 -- 172.21.15.102:0/3322411174 learned_addr learned my addr 172.21.15.102:0/3322411174 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:48.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.142+0000 7fbd4bfff640 1 --2- 172.21.15.102:0/3322411174 >> v2:172.21.15.129:3300/0 conn(0x7fbd4c159ab0 0x7fbd4c0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:48.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.142+0000 7fbd43fff640 1 -- 172.21.15.102:0/3322411174 >> v2:172.21.15.129:3300/0 conn(0x7fbd4c159ab0 msgr2=0x7fbd4c0ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:48.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.142+0000 7fbd43fff640 1 --2- 172.21.15.102:0/3322411174 >> v2:172.21.15.129:3300/0 conn(0x7fbd4c159ab0 0x7fbd4c0ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:48.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.142+0000 7fbd43fff640 1 -- 172.21.15.102:0/3322411174 >> v1:172.21.15.102:6789/0 conn(0x7fbd4c06c140 legacy=0x7fbd4c15dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:48.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.142+0000 7fbd43fff640 1 -- 172.21.15.102:0/3322411174 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4c0cd7b0 con 0x7fbd4c159e90 2023-10-14T09:38:48.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.143+0000 7fbd43fff640 1 --2- 172.21.15.102:0/3322411174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd4c159e90 0x7fbd4c06fc50 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c0cfa00 tx=0x7fbd3402e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb44721da83123f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:48.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.143+0000 7fbd4b7fe640 1 -- 172.21.15.102:0/3322411174 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3402ee00 con 0x7fbd4c159e90 2023-10-14T09:38:48.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.143+0000 7fbd4b7fe640 1 -- 172.21.15.102:0/3322411174 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd34036440 con 0x7fbd4c159e90 2023-10-14T09:38:48.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.143+0000 7fbd4b7fe640 1 -- 172.21.15.102:0/3322411174 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd340367d0 con 0x7fbd4c159e90 2023-10-14T09:38:48.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.144+0000 7fbd528c9640 1 -- 172.21.15.102:0/3322411174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd4c159e90 msgr2=0x7fbd4c06fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:48.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.144+0000 7fbd528c9640 1 --2- 172.21.15.102:0/3322411174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd4c159e90 0x7fbd4c06fc50 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c0cfa00 tx=0x7fbd3402e050 comp rx=0 tx=0).stop 2023-10-14T09:38:48.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.144+0000 7fbd528c9640 1 -- 172.21.15.102:0/3322411174 shutdown_connections 2023-10-14T09:38:48.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.144+0000 7fbd528c9640 1 --2- 172.21.15.102:0/3322411174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd4c159e90 0x7fbd4c06fc50 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:48.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.144+0000 7fbd528c9640 1 --2- 172.21.15.102:0/3322411174 >> v2:172.21.15.129:3300/0 conn(0x7fbd4c159ab0 0x7fbd4c0ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:48.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.144+0000 7fbd528c9640 1 -- 172.21.15.102:0/3322411174 >> 172.21.15.102:0/3322411174 conn(0x7fbd4c0ce9b0 msgr2=0x7fbd4c0cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:48.152 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.144+0000 7fbd528c9640 1 -- 172.21.15.102:0/3322411174 shutdown_connections 2023-10-14T09:38:48.152 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.144+0000 7fbd528c9640 1 -- 172.21.15.102:0/3322411174 wait complete. 2023-10-14T09:38:48.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.146+0000 7fbd528c9640 1 Processor -- start 2023-10-14T09:38:48.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.147+0000 7fbd528c9640 1 -- start start 2023-10-14T09:38:48.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.148+0000 7fbd528c9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbd4c06c140 0x7fbd4c15a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:48.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.148+0000 7fbd528c9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd4c159ab0 0x7fbd4c0ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:48.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.148+0000 7fbd528c9640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbd4c159e90 0x7fbd4c0acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:48.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.148+0000 7fbd528c9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c15af80 con 0x7fbd4c159ab0 2023-10-14T09:38:48.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.148+0000 7fbd528c9640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c0b20a0 con 0x7fbd4c06c140 2023-10-14T09:38:48.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.148+0000 7fbd528c9640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c0b2380 con 0x7fbd4c159e90 2023-10-14T09:38:48.158 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.148+0000 7fbd43fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd4c159ab0 0x7fbd4c0ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:48.158 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.148+0000 7fbd43fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd4c159ab0 0x7fbd4c0ac890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55870/0 (socket says 172.21.15.102:55870) 2023-10-14T09:38:48.158 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.148+0000 7fbd43fff640 1 -- 172.21.15.102:0/559567175 learned_addr learned my addr 172.21.15.102:0/559567175 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:48.158 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.148+0000 7fbd4bfff640 1 --2- 172.21.15.102:0/559567175 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbd4c06c140 0x7fbd4c15a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:48.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.149+0000 7fbd50e66640 1 --2- 172.21.15.102:0/559567175 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbd4c159e90 0x7fbd4c0acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:48.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.149+0000 7fbd43fff640 1 -- 172.21.15.102:0/559567175 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbd4c159e90 msgr2=0x7fbd4c0acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:48.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.149+0000 7fbd43fff640 1 --2- 172.21.15.102:0/559567175 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbd4c159e90 0x7fbd4c0acdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:48.160 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.149+0000 7fbd43fff640 1 -- 172.21.15.102:0/559567175 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbd4c06c140 msgr2=0x7fbd4c15a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:48.160 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.149+0000 7fbd43fff640 1 --2- 172.21.15.102:0/559567175 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbd4c06c140 0x7fbd4c15a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:48.160 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.149+0000 7fbd43fff640 1 -- 172.21.15.102:0/559567175 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd3400b770 con 0x7fbd4c159ab0 2023-10-14T09:38:48.161 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.149+0000 7fbd4bfff640 1 --2- 172.21.15.102:0/559567175 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbd4c06c140 0x7fbd4c15a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:48.161 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.149+0000 7fbd43fff640 1 --2- 172.21.15.102:0/559567175 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd4c159ab0 0x7fbd4c0ac890 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fbd3402e090 tx=0x7fbd34004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:48.161 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.149+0000 7fbd497fa640 1 -- 172.21.15.102:0/559567175 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd340407f0 con 0x7fbd4c159ab0 2023-10-14T09:38:48.162 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.149+0000 7fbd497fa640 1 -- 172.21.15.102:0/559567175 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd34040950 con 0x7fbd4c159ab0 2023-10-14T09:38:48.162 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.149+0000 7fbd528c9640 1 -- 172.21.15.102:0/559567175 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd4c0b2660 con 0x7fbd4c159ab0 2023-10-14T09:38:48.162 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.149+0000 7fbd497fa640 1 -- 172.21.15.102:0/559567175 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd34040d00 con 0x7fbd4c159ab0 2023-10-14T09:38:48.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.150+0000 7fbd528c9640 1 -- 172.21.15.102:0/559567175 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd4c15d3a0 con 0x7fbd4c159ab0 2023-10-14T09:38:48.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.151+0000 7fbd528c9640 1 -- 172.21.15.102:0/559567175 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd4c0b24c0 con 0x7fbd4c159ab0 2023-10-14T09:38:48.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.151+0000 7fbd497fa640 1 -- 172.21.15.102:0/559567175 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbd34041480 con 0x7fbd4c159ab0 2023-10-14T09:38:48.164 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.152+0000 7fbd497fa640 1 --2- 172.21.15.102:0/559567175 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fbd2c06ae70 0x7fbd2c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:48.164 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.152+0000 7fbd497fa640 1 -- 172.21.15.102:0/559567175 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fbd340ac580 con 0x7fbd4c159ab0 2023-10-14T09:38:48.164 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.153+0000 7fbd4bfff640 1 --2- 172.21.15.102:0/559567175 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fbd2c06ae70 0x7fbd2c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:48.165 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.153+0000 7fbd4bfff640 1 --2- 172.21.15.102:0/559567175 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fbd2c06ae70 0x7fbd2c06d330 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c008890 tx=0x7fbd3c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:48.165 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.156+0000 7fbd497fa640 1 -- 172.21.15.102:0/559567175 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbd4c0b24c0 con 0x7fbd4c159ab0 2023-10-14T09:38:48.348 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.346+0000 7fbd528c9640 1 -- 172.21.15.102:0/559567175 --> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd4c0adf70 con 0x7fbd2c06ae70 2023-10-14T09:38:48.349 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.347+0000 7fbd497fa640 1 -- 172.21.15.102:0/559567175 <== mgr.4104 v2:172.21.15.102:6832/1125265706 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbd3c00c040 con 0x7fbd2c06ae70 2023-10-14T09:38:48.349 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 6 to deep-scrub 2023-10-14T09:38:48.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.349+0000 7fbd528c9640 1 -- 172.21.15.102:0/559567175 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fbd2c06ae70 msgr2=0x7fbd2c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:48.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.349+0000 7fbd528c9640 1 --2- 172.21.15.102:0/559567175 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fbd2c06ae70 0x7fbd2c06d330 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c008890 tx=0x7fbd3c008040 comp rx=0 tx=0).stop 2023-10-14T09:38:48.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.349+0000 7fbd528c9640 1 -- 172.21.15.102:0/559567175 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd4c159ab0 msgr2=0x7fbd4c0ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:48.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.349+0000 7fbd528c9640 1 --2- 172.21.15.102:0/559567175 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd4c159ab0 0x7fbd4c0ac890 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fbd3402e090 tx=0x7fbd34004730 comp rx=0 tx=0).stop 2023-10-14T09:38:48.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.349+0000 7fbd528c9640 1 -- 172.21.15.102:0/559567175 shutdown_connections 2023-10-14T09:38:48.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.349+0000 7fbd528c9640 1 --2- 172.21.15.102:0/559567175 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fbd2c06ae70 0x7fbd2c06d330 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:48.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.349+0000 7fbd528c9640 1 --2- 172.21.15.102:0/559567175 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbd4c159e90 0x7fbd4c0acdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:48.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.349+0000 7fbd528c9640 1 --2- 172.21.15.102:0/559567175 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd4c159ab0 0x7fbd4c0ac890 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:48.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.349+0000 7fbd528c9640 1 --2- 172.21.15.102:0/559567175 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbd4c06c140 0x7fbd4c15a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:48.354 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.349+0000 7fbd528c9640 1 -- 172.21.15.102:0/559567175 >> 172.21.15.102:0/559567175 conn(0x7fbd4c0ce9b0 msgr2=0x7fbd4c0ae310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:48.354 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.350+0000 7fbd528c9640 1 -- 172.21.15.102:0/559567175 shutdown_connections 2023-10-14T09:38:48.354 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.350+0000 7fbd528c9640 1 -- 172.21.15.102:0/559567175 wait complete. 2023-10-14T09:38:48.369 INFO:tasks.ceph:Scrubbing osd.7 2023-10-14T09:38:48.370 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-14T09:38:48.588 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.586+0000 7fa68b59e640 1 Processor -- start 2023-10-14T09:38:48.629 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.586+0000 7fa68b59e640 1 -- start start 2023-10-14T09:38:48.636 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.588+0000 7fa68b59e640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fa68c06c040 0x7fa68c06c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:48.636 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.588+0000 7fa68b59e640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa68c0ad970 0x7fa68c15e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:48.636 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.588+0000 7fa68b59e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa68c06c960 con 0x7fa68c15ebc0 2023-10-14T09:38:48.636 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.588+0000 7fa68b59e640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa68c15b9d0 con 0x7fa68c06c040 2023-10-14T09:38:48.637 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.588+0000 7fa68b59e640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c15bcb0 con 0x7fa68c0ad970 2023-10-14T09:38:48.637 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.588+0000 7fa68ad9d640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fa68c15ebc0 0x7fa68c0cca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55656/0 (socket says 172.21.15.102:55656) 2023-10-14T09:38:48.637 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.588+0000 7fa68ad9d640 1 -- 172.21.15.102:0/3449677536 learned_addr learned my addr 172.21.15.102:0/3449677536 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:38:48.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.588+0000 7fa68a59c640 1 --2- 172.21.15.102:0/3449677536 >> v2:172.21.15.129:3300/0 conn(0x7fa68c06c040 0x7fa68c06c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:48.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.588+0000 7fa689d9b640 1 --2- 172.21.15.102:0/3449677536 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa68c0ad970 0x7fa68c15e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:48.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.589+0000 7fa68959a640 1 -- 172.21.15.102:0/3449677536 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1440191020 0 0) 0x7fa68c06c960 con 0x7fa68c15ebc0 2023-10-14T09:38:48.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.589+0000 7fa68959a640 1 -- 172.21.15.102:0/3449677536 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa674003520 con 0x7fa68c15ebc0 2023-10-14T09:38:48.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.589+0000 7fa68959a640 1 -- 172.21.15.102:0/3449677536 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 896013786 0 0) 0x7fa674003520 con 0x7fa68c15ebc0 2023-10-14T09:38:48.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.589+0000 7fa68959a640 1 -- 172.21.15.102:0/3449677536 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa68c0ad970 msgr2=0x7fa68c15e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:48.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.589+0000 7fa68959a640 1 --2- 172.21.15.102:0/3449677536 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa68c0ad970 0x7fa68c15e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:48.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.589+0000 7fa68959a640 1 -- 172.21.15.102:0/3449677536 >> v2:172.21.15.129:3300/0 conn(0x7fa68c06c040 msgr2=0x7fa68c06c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:48.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.589+0000 7fa68959a640 1 --2- 172.21.15.102:0/3449677536 >> v2:172.21.15.129:3300/0 conn(0x7fa68c06c040 0x7fa68c06c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:48.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.589+0000 7fa68959a640 1 -- 172.21.15.102:0/3449677536 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa68c15bf90 con 0x7fa68c15ebc0 2023-10-14T09:38:48.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.589+0000 7fa68959a640 1 -- 172.21.15.102:0/3449677536 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4030661168 0 0) 0x7fa6840019f0 con 0x7fa68c15ebc0 2023-10-14T09:38:48.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.589+0000 7fa68959a640 1 -- 172.21.15.102:0/3449677536 >> v1:172.21.15.102:6789/0 conn(0x7fa68c15ebc0 legacy=0x7fa68c0cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:48.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.589+0000 7fa68959a640 1 --2- 172.21.15.102:0/3449677536 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa68c0ad970 0x7fa674003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:48.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.589+0000 7fa68959a640 1 --2- 172.21.15.102:0/3449677536 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa674003ef0 0x7fa6740047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:48.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.589+0000 7fa68959a640 1 --2- 172.21.15.102:0/3449677536 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa674004d00 0x7fa674005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:48.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.589+0000 7fa68959a640 1 -- 172.21.15.102:0/3449677536 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c15b9d0 con 0x7fa674003ef0 2023-10-14T09:38:48.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.589+0000 7fa68959a640 1 -- 172.21.15.102:0/3449677536 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c15bcb0 con 0x7fa674004d00 2023-10-14T09:38:48.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.589+0000 7fa68959a640 1 -- 172.21.15.102:0/3449677536 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa67400b980 con 0x7fa68c0ad970 2023-10-14T09:38:48.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.589+0000 7fa689d9b640 1 --2- 172.21.15.102:0/3449677536 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa674003ef0 0x7fa6740047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:48.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.590+0000 7fa68ad9d640 1 --2- 172.21.15.102:0/3449677536 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa674004d00 0x7fa674005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:48.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.590+0000 7fa689d9b640 1 -- 172.21.15.102:0/3449677536 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa68c0ad970 msgr2=0x7fa674003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:48.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.590+0000 7fa689d9b640 1 --2- 172.21.15.102:0/3449677536 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa68c0ad970 0x7fa674003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:48.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.590+0000 7fa689d9b640 1 -- 172.21.15.102:0/3449677536 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa674004d00 msgr2=0x7fa674005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:48.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.590+0000 7fa689d9b640 1 --2- 172.21.15.102:0/3449677536 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa674004d00 0x7fa674005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:48.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.590+0000 7fa689d9b640 1 -- 172.21.15.102:0/3449677536 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa674003520 con 0x7fa674003ef0 2023-10-14T09:38:48.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.591+0000 7fa689d9b640 1 --2- 172.21.15.102:0/3449677536 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa674003ef0 0x7fa6740047c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa680009ac0 tx=0x7fa6740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4a758c4baceec62 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:48.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.591+0000 7fa68959a640 1 -- 172.21.15.102:0/3449677536 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68002c6d0 con 0x7fa674003ef0 2023-10-14T09:38:48.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.591+0000 7fa68959a640 1 -- 172.21.15.102:0/3449677536 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68002c830 con 0x7fa674003ef0 2023-10-14T09:38:48.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.591+0000 7fa68959a640 1 -- 172.21.15.102:0/3449677536 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68002cbc0 con 0x7fa674003ef0 2023-10-14T09:38:48.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.592+0000 7fa68b59e640 1 -- 172.21.15.102:0/3449677536 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa674003ef0 msgr2=0x7fa6740047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:48.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.592+0000 7fa68b59e640 1 --2- 172.21.15.102:0/3449677536 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa674003ef0 0x7fa6740047c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa680009ac0 tx=0x7fa6740057f0 comp rx=0 tx=0).stop 2023-10-14T09:38:48.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.592+0000 7fa68ad9d640 1 -- 172.21.15.102:0/3449677536 reap_dead start 2023-10-14T09:38:48.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.592+0000 7fa68b59e640 1 -- 172.21.15.102:0/3449677536 shutdown_connections 2023-10-14T09:38:48.647 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.592+0000 7fa68b59e640 1 -- 172.21.15.102:0/3449677536 >> 172.21.15.102:0/3449677536 conn(0x7fa68c0ce6a0 msgr2=0x7fa68c0ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:48.647 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.592+0000 7fa68b59e640 1 -- 172.21.15.102:0/3449677536 shutdown_connections 2023-10-14T09:38:48.647 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.592+0000 7fa68b59e640 1 -- 172.21.15.102:0/3449677536 wait complete. 2023-10-14T09:38:48.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.594+0000 7fa68b59e640 1 Processor -- start 2023-10-14T09:38:48.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.594+0000 7fa68b59e640 1 -- start start 2023-10-14T09:38:48.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.595+0000 7fa68b59e640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa674003ef0 0x7fa68c156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:48.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.595+0000 7fa68b59e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa68c0c69b0 0x7fa68c0c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:48.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.595+0000 7fa68b59e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa68c0cd6d0 0x7fa68c0cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:48.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.595+0000 7fa68b59e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c0ce0a0 con 0x7fa68c0c69b0 2023-10-14T09:38:48.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.595+0000 7fa68b59e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c0c5910 con 0x7fa68c0cd6d0 2023-10-14T09:38:48.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.595+0000 7fa68b59e640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c0c5bf0 con 0x7fa674003ef0 2023-10-14T09:38:48.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.595+0000 7fa689d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa68c0c69b0 0x7fa68c0c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:48.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.595+0000 7fa689d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa68c0c69b0 0x7fa68c0c9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55886/0 (socket says 172.21.15.102:55886) 2023-10-14T09:38:48.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.595+0000 7fa689d9b640 1 -- 172.21.15.102:0/1651438731 learned_addr learned my addr 172.21.15.102:0/1651438731 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:48.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.595+0000 7fa689d9b640 1 -- 172.21.15.102:0/1651438731 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa674003ef0 msgr2=0x7fa68c156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:48.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.595+0000 7fa689d9b640 1 --2- 172.21.15.102:0/1651438731 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa674003ef0 0x7fa68c156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:48.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.595+0000 7fa689d9b640 1 -- 172.21.15.102:0/1651438731 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa68c0cd6d0 msgr2=0x7fa68c0cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:48.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.595+0000 7fa689d9b640 1 --2- 172.21.15.102:0/1651438731 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa68c0cd6d0 0x7fa68c0cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:48.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.595+0000 7fa689d9b640 1 -- 172.21.15.102:0/1651438731 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa68c0c5ed0 con 0x7fa68c0c69b0 2023-10-14T09:38:48.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.595+0000 7fa689d9b640 1 --2- 172.21.15.102:0/1651438731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa68c0c69b0 0x7fa68c0c9e20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa68002c2d0 tx=0x7fa680004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:48.653 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.596+0000 7fa67affd640 1 -- 172.21.15.102:0/1651438731 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa680003810 con 0x7fa68c0c69b0 2023-10-14T09:38:48.653 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.596+0000 7fa67affd640 1 -- 172.21.15.102:0/1651438731 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa680003970 con 0x7fa68c0c69b0 2023-10-14T09:38:48.653 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.596+0000 7fa67affd640 1 -- 172.21.15.102:0/1651438731 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa680003d00 con 0x7fa68c0c69b0 2023-10-14T09:38:48.654 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.596+0000 7fa68b59e640 1 -- 172.21.15.102:0/1651438731 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa68c0c61b0 con 0x7fa68c0c69b0 2023-10-14T09:38:48.654 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.596+0000 7fa68b59e640 1 -- 172.21.15.102:0/1651438731 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa68c0ca360 con 0x7fa68c0c69b0 2023-10-14T09:38:48.654 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.597+0000 7fa68b59e640 1 -- 172.21.15.102:0/1651438731 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa68c0cc550 con 0x7fa68c0c69b0 2023-10-14T09:38:48.654 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.598+0000 7fa67affd640 1 -- 172.21.15.102:0/1651438731 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa680034440 con 0x7fa68c0c69b0 2023-10-14T09:38:48.655 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.599+0000 7fa67affd640 1 --2- 172.21.15.102:0/1651438731 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa66c06ae70 0x7fa66c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:48.655 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.599+0000 7fa67affd640 1 -- 172.21.15.102:0/1651438731 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fa6800ab770 con 0x7fa68c0c69b0 2023-10-14T09:38:48.655 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.599+0000 7fa68a59c640 1 --2- 172.21.15.102:0/1651438731 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa66c06ae70 0x7fa66c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:48.656 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.599+0000 7fa67affd640 1 --2- 172.21.15.102:0/1651438731 >> [v2:172.21.15.129:6822/2933886914,v1:172.21.15.129:6824/2933886914] conn(0x7fa66c073070 0x7fa66c0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:48.656 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.599+0000 7fa67affd640 1 -- 172.21.15.102:0/1651438731 --> [v2:172.21.15.129:6822/2933886914,v1:172.21.15.129:6824/2933886914] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa66c075b80 con 0x7fa66c073070 2023-10-14T09:38:48.656 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.599+0000 7fa67affd640 1 -- 172.21.15.102:0/1651438731 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6800adcf0 con 0x7fa68c0c69b0 2023-10-14T09:38:48.656 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.600+0000 7fa68a59c640 1 --2- 172.21.15.102:0/1651438731 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa66c06ae70 0x7fa66c06d330 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa67c006e80 tx=0x7fa67c006dd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:48.657 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.600+0000 7fa68ad9d640 1 --2- 172.21.15.102:0/1651438731 >> [v2:172.21.15.129:6822/2933886914,v1:172.21.15.129:6824/2933886914] conn(0x7fa66c073070 0x7fa66c0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:48.657 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.601+0000 7fa68ad9d640 1 --2- 172.21.15.102:0/1651438731 >> [v2:172.21.15.129:6822/2933886914,v1:172.21.15.129:6824/2933886914] conn(0x7fa66c073070 0x7fa66c0754b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:48.657 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.603+0000 7fa67affd640 1 -- 172.21.15.102:0/1651438731 <== osd.7 v2:172.21.15.129:6822/2933886914 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fa66c075b80 con 0x7fa66c073070 2023-10-14T09:38:48.657 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.617+0000 7fa68b59e640 1 -- 172.21.15.102:0/1651438731 --> [v2:172.21.15.129:6822/2933886914,v1:172.21.15.129:6824/2933886914] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa68c0cc270 con 0x7fa66c073070 2023-10-14T09:38:48.658 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.618+0000 7fa67affd640 1 -- 172.21.15.102:0/1651438731 <== osd.7 v2:172.21.15.129:6822/2933886914 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa6840017f0 con 0x7fa66c073070 2023-10-14T09:38:48.658 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-10-14T09:38:48.659 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T09:38:48.659 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-10-14T09:38:48.660 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.618+0000 7fa68b59e640 1 -- 172.21.15.102:0/1651438731 >> [v2:172.21.15.129:6822/2933886914,v1:172.21.15.129:6824/2933886914] conn(0x7fa66c073070 msgr2=0x7fa66c0754b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:48.661 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.618+0000 7fa68b59e640 1 --2- 172.21.15.102:0/1651438731 >> [v2:172.21.15.129:6822/2933886914,v1:172.21.15.129:6824/2933886914] conn(0x7fa66c073070 0x7fa66c0754b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:48.661 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.618+0000 7fa68b59e640 1 -- 172.21.15.102:0/1651438731 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa66c06ae70 msgr2=0x7fa66c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:48.661 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.618+0000 7fa68b59e640 1 --2- 172.21.15.102:0/1651438731 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7fa66c06ae70 0x7fa66c06d330 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa67c006e80 tx=0x7fa67c006dd0 comp rx=0 tx=0).stop 2023-10-14T09:38:48.662 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.618+0000 7fa68b59e640 1 -- 172.21.15.102:0/1651438731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa68c0c69b0 msgr2=0x7fa68c0c9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:48.662 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.618+0000 7fa68b59e640 1 --2- 172.21.15.102:0/1651438731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa68c0c69b0 0x7fa68c0c9e20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa68002c2d0 tx=0x7fa680004730 comp rx=0 tx=0).stop 2023-10-14T09:38:48.662 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.618+0000 7fa68ad9d640 1 -- 172.21.15.102:0/1651438731 reap_dead start 2023-10-14T09:38:48.662 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.618+0000 7fa68b59e640 1 -- 172.21.15.102:0/1651438731 shutdown_connections 2023-10-14T09:38:48.663 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.618+0000 7fa68b59e640 1 -- 172.21.15.102:0/1651438731 >> 172.21.15.102:0/1651438731 conn(0x7fa68c0ce6a0 msgr2=0x7fa68c069e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:48.663 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.618+0000 7fa68b59e640 1 -- 172.21.15.102:0/1651438731 shutdown_connections 2023-10-14T09:38:48.663 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.619+0000 7fa68b59e640 1 -- 172.21.15.102:0/1651438731 wait complete. 2023-10-14T09:38:48.664 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-14T09:38:48.885 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.883+0000 7f13671d0640 1 Processor -- start 2023-10-14T09:38:48.886 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.884+0000 7f13671d0640 1 -- start start 2023-10-14T09:38:48.888 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.885+0000 7f13671d0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f13601618b0 0x7f1360065ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:48.889 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.885+0000 7f13671d0640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136006cee0 con 0x7f1360065ff0 2023-10-14T09:38:48.889 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.885+0000 7f13671d0640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13600663d0 con 0x7f136015d330 2023-10-14T09:38:48.889 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.885+0000 7f13671d0640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136006b1e0 con 0x7f13601618b0 2023-10-14T09:38:48.889 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.885+0000 7f135ffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f13601618b0 0x7f1360065ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:48.890 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.885+0000 7f135ffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f13601618b0 0x7f1360065ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55898/0 (socket says 172.21.15.102:55898) 2023-10-14T09:38:48.890 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.885+0000 7f135ffff640 1 -- 172.21.15.102:0/655812753 learned_addr learned my addr 172.21.15.102:0/655812753 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:48.890 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.886+0000 7f135ffff640 1 -- 172.21.15.102:0/655812753 >> v1:172.21.15.129:6789/0 conn(0x7f136015d330 legacy=0x7f136006c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:48.891 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.886+0000 7f135ffff640 1 -- 172.21.15.102:0/655812753 >> v1:172.21.15.102:6789/0 conn(0x7f1360065ff0 legacy=0x7f13600ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:48.891 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.886+0000 7f135ffff640 1 -- 172.21.15.102:0/655812753 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13600d0890 con 0x7f13601618b0 2023-10-14T09:38:48.894 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.887+0000 7f135ffff640 1 --2- 172.21.15.102:0/655812753 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13601618b0 0x7f1360065ab0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1348009870 tx=0x7f134802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9805813ec2f10f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:48.894 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.887+0000 7f135f7fe640 1 -- 172.21.15.102:0/655812753 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1348031870 con 0x7f13601618b0 2023-10-14T09:38:48.895 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.887+0000 7f135f7fe640 1 -- 172.21.15.102:0/655812753 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13480319d0 con 0x7f13601618b0 2023-10-14T09:38:48.895 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.887+0000 7f135f7fe640 1 -- 172.21.15.102:0/655812753 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1348031d60 con 0x7f13601618b0 2023-10-14T09:38:48.895 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.888+0000 7f13671d0640 1 -- 172.21.15.102:0/655812753 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13601618b0 msgr2=0x7f1360065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:48.896 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.888+0000 7f13671d0640 1 --2- 172.21.15.102:0/655812753 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13601618b0 0x7f1360065ab0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1348009870 tx=0x7f134802b910 comp rx=0 tx=0).stop 2023-10-14T09:38:48.896 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.888+0000 7f13671d0640 1 -- 172.21.15.102:0/655812753 shutdown_connections 2023-10-14T09:38:48.896 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.888+0000 7f13671d0640 1 --2- 172.21.15.102:0/655812753 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13601618b0 0x7f1360065ab0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:48.896 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.888+0000 7f13671d0640 1 -- 172.21.15.102:0/655812753 >> 172.21.15.102:0/655812753 conn(0x7f13600d0ab0 msgr2=0x7f13600d0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:48.897 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.888+0000 7f13671d0640 1 -- 172.21.15.102:0/655812753 shutdown_connections 2023-10-14T09:38:48.897 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.888+0000 7f13671d0640 1 -- 172.21.15.102:0/655812753 wait complete. 2023-10-14T09:38:48.897 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.890+0000 7f13671d0640 1 Processor -- start 2023-10-14T09:38:48.898 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.890+0000 7f13671d0640 1 -- start start 2023-10-14T09:38:48.898 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.891+0000 7f13671d0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1360065ff0 0x7f13600b2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:48.898 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.891+0000 7f13671d0640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f136015d330 0x7f13601f5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:48.899 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.891+0000 7f13671d0640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f13601618b0 0x7f13600b03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:48.899 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.891+0000 7f13671d0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13601f64b0 con 0x7f1360065ff0 2023-10-14T09:38:48.899 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.891+0000 7f13671d0640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13600ad490 con 0x7f13601618b0 2023-10-14T09:38:48.900 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.891+0000 7f13671d0640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13601f6750 con 0x7f136015d330 2023-10-14T09:38:48.900 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.891+0000 7f1364f6c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1360065ff0 0x7f13600b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:48.900 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.891+0000 7f1364f6c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1360065ff0 0x7f13600b2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55904/0 (socket says 172.21.15.102:55904) 2023-10-14T09:38:48.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.891+0000 7f1364f6c640 1 -- 172.21.15.102:0/1567080772 learned_addr learned my addr 172.21.15.102:0/1567080772 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:48.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.892+0000 7f136576d640 1 --2- 172.21.15.102:0/1567080772 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f13601618b0 0x7f13600b03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:48.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.892+0000 7f1364f6c640 1 -- 172.21.15.102:0/1567080772 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f136015d330 msgr2=0x7f13601f5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:48.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.892+0000 7f1364f6c640 1 --2- 172.21.15.102:0/1567080772 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f136015d330 0x7f13601f5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:48.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.892+0000 7f1364f6c640 1 -- 172.21.15.102:0/1567080772 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f13601618b0 msgr2=0x7f13600b03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:48.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.892+0000 7f1364f6c640 1 --2- 172.21.15.102:0/1567080772 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f13601618b0 0x7f13600b03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:48.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.892+0000 7f1364f6c640 1 -- 172.21.15.102:0/1567080772 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13480094d0 con 0x7f1360065ff0 2023-10-14T09:38:48.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.892+0000 7f136576d640 1 --2- 172.21.15.102:0/1567080772 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f13601618b0 0x7f13600b03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:38:48.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.892+0000 7f1364f6c640 1 --2- 172.21.15.102:0/1567080772 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1360065ff0 0x7f13600b2560 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f135000ba50 tx=0x7f135000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:48.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.892+0000 7f135d7fa640 1 -- 172.21.15.102:0/1567080772 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135000cbe0 con 0x7f1360065ff0 2023-10-14T09:38:48.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.892+0000 7f135d7fa640 1 -- 172.21.15.102:0/1567080772 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135000cd80 con 0x7f1360065ff0 2023-10-14T09:38:48.904 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.892+0000 7f135d7fa640 1 -- 172.21.15.102:0/1567080772 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1350014680 con 0x7f1360065ff0 2023-10-14T09:38:48.904 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.892+0000 7f13671d0640 1 -- 172.21.15.102:0/1567080772 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13601f6a30 con 0x7f1360065ff0 2023-10-14T09:38:48.904 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.892+0000 7f13671d0640 1 -- 172.21.15.102:0/1567080772 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13600ad750 con 0x7f1360065ff0 2023-10-14T09:38:48.905 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.894+0000 7f13671d0640 1 -- 172.21.15.102:0/1567080772 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f136004e160 con 0x7f1360065ff0 2023-10-14T09:38:48.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.895+0000 7f135d7fa640 1 -- 172.21.15.102:0/1567080772 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f13500147e0 con 0x7f1360065ff0 2023-10-14T09:38:48.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.895+0000 7f135d7fa640 1 --2- 172.21.15.102:0/1567080772 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f134006ae70 0x7f134006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:48.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.895+0000 7f135d7fa640 1 -- 172.21.15.102:0/1567080772 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f1350089490 con 0x7f1360065ff0 2023-10-14T09:38:48.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.896+0000 7f135ffff640 1 --2- 172.21.15.102:0/1567080772 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f134006ae70 0x7f134006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:48.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.896+0000 7f135ffff640 1 --2- 172.21.15.102:0/1567080772 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f134006ae70 0x7f134006d330 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1348036000 tx=0x7f1348030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:48.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:48.900+0000 7f135d7fa640 1 -- 172.21.15.102:0/1567080772 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1350054660 con 0x7f1360065ff0 2023-10-14T09:38:49.094 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.092+0000 7f13671d0640 1 -- 172.21.15.102:0/1567080772 --> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f1360160dd0 con 0x7f134006ae70 2023-10-14T09:38:49.095 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.093+0000 7f135d7fa640 1 -- 172.21.15.102:0/1567080772 <== mgr.4104 v2:172.21.15.102:6832/1125265706 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1348031c40 con 0x7f134006ae70 2023-10-14T09:38:49.095 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 7 to deep-scrub 2023-10-14T09:38:49.098 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.096+0000 7f13671d0640 1 -- 172.21.15.102:0/1567080772 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f134006ae70 msgr2=0x7f134006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:49.099 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.096+0000 7f13671d0640 1 --2- 172.21.15.102:0/1567080772 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f134006ae70 0x7f134006d330 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1348036000 tx=0x7f1348030000 comp rx=0 tx=0).stop 2023-10-14T09:38:49.099 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.096+0000 7f13671d0640 1 -- 172.21.15.102:0/1567080772 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1360065ff0 msgr2=0x7f13600b2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:49.099 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.096+0000 7f13671d0640 1 --2- 172.21.15.102:0/1567080772 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1360065ff0 0x7f13600b2560 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f135000ba50 tx=0x7f135000bf10 comp rx=0 tx=0).stop 2023-10-14T09:38:49.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.096+0000 7f13671d0640 1 -- 172.21.15.102:0/1567080772 shutdown_connections 2023-10-14T09:38:49.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.096+0000 7f13671d0640 1 --2- 172.21.15.102:0/1567080772 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f134006ae70 0x7f134006d330 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:49.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.096+0000 7f13671d0640 1 --2- 172.21.15.102:0/1567080772 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f13601618b0 0x7f13600b03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:49.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.096+0000 7f13671d0640 1 --2- 172.21.15.102:0/1567080772 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f136015d330 0x7f13601f5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:49.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.096+0000 7f13671d0640 1 --2- 172.21.15.102:0/1567080772 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1360065ff0 0x7f13600b2560 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:49.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.096+0000 7f13671d0640 1 -- 172.21.15.102:0/1567080772 >> 172.21.15.102:0/1567080772 conn(0x7f13600d0ab0 msgr2=0x7f136015a010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:49.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.096+0000 7f13671d0640 1 -- 172.21.15.102:0/1567080772 shutdown_connections 2023-10-14T09:38:49.102 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.096+0000 7f13671d0640 1 -- 172.21.15.102:0/1567080772 wait complete. 2023-10-14T09:38:49.117 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:38:49.329 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.327+0000 7f1d701e7640 1 Processor -- start 2023-10-14T09:38:49.329 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.327+0000 7f1d701e7640 1 -- start start 2023-10-14T09:38:49.331 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.329+0000 7f1d701e7640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f1d6815aaa0 0x7f1d6815e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:49.331 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.329+0000 7f1d701e7640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1d6815ae80 0x7f1d680cc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:49.331 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.329+0000 7f1d701e7640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d6815ed60 con 0x7f1d680ccaa0 2023-10-14T09:38:49.332 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.329+0000 7f1d701e7640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d6806b810 con 0x7f1d6815ae80 2023-10-14T09:38:49.332 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.329+0000 7f1d701e7640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d680707e0 con 0x7f1d6815aaa0 2023-10-14T09:38:49.332 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.329+0000 7f1d6d782640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1d6815ae80 0x7f1d680cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:49.332 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.329+0000 7f1d6d782640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1d6815ae80 0x7f1d680cc560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55910/0 (socket says 172.21.15.102:55910) 2023-10-14T09:38:49.333 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.329+0000 7f1d6d782640 1 -- 172.21.15.102:0/2820932157 learned_addr learned my addr 172.21.15.102:0/2820932157 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:49.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.329+0000 7f1d6d782640 1 -- 172.21.15.102:0/2820932157 >> v2:172.21.15.129:3300/0 conn(0x7f1d6815aaa0 msgr2=0x7f1d6815e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:38:49.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.329+0000 7f1d6d782640 1 --2- 172.21.15.102:0/2820932157 >> v2:172.21.15.129:3300/0 conn(0x7f1d6815aaa0 0x7f1d6815e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:49.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.329+0000 7f1d6d782640 1 -- 172.21.15.102:0/2820932157 >> v1:172.21.15.102:6789/0 conn(0x7f1d680ccaa0 legacy=0x7f1d68070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:49.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.329+0000 7f1d6d782640 1 -- 172.21.15.102:0/2820932157 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d6815ef90 con 0x7f1d6815ae80 2023-10-14T09:38:49.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.331+0000 7f1d6d782640 1 --2- 172.21.15.102:0/2820932157 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d6815ae80 0x7f1d680cc560 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1d680cd990 tx=0x7f1d5802b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbdbd591ebd8d3cd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:49.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.331+0000 7f1d6cf81640 1 -- 172.21.15.102:0/2820932157 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d58030880 con 0x7f1d6815ae80 2023-10-14T09:38:49.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.331+0000 7f1d6cf81640 1 -- 172.21.15.102:0/2820932157 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d580309e0 con 0x7f1d6815ae80 2023-10-14T09:38:49.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.331+0000 7f1d6cf81640 1 -- 172.21.15.102:0/2820932157 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d58030d70 con 0x7f1d6815ae80 2023-10-14T09:38:49.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.331+0000 7f1d701e7640 1 -- 172.21.15.102:0/2820932157 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d6815ae80 msgr2=0x7f1d680cc560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:49.337 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.331+0000 7f1d701e7640 1 --2- 172.21.15.102:0/2820932157 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d6815ae80 0x7f1d680cc560 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1d680cd990 tx=0x7f1d5802b9c0 comp rx=0 tx=0).stop 2023-10-14T09:38:49.337 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.332+0000 7f1d701e7640 1 -- 172.21.15.102:0/2820932157 shutdown_connections 2023-10-14T09:38:49.337 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.332+0000 7f1d701e7640 1 --2- 172.21.15.102:0/2820932157 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d6815ae80 0x7f1d680cc560 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:49.338 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.332+0000 7f1d701e7640 1 --2- 172.21.15.102:0/2820932157 >> v2:172.21.15.129:3300/0 conn(0x7f1d6815aaa0 0x7f1d6815e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:49.338 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.332+0000 7f1d701e7640 1 -- 172.21.15.102:0/2820932157 >> 172.21.15.102:0/2820932157 conn(0x7f1d680cb410 msgr2=0x7f1d680cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:49.338 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.332+0000 7f1d701e7640 1 -- 172.21.15.102:0/2820932157 shutdown_connections 2023-10-14T09:38:49.339 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.332+0000 7f1d701e7640 1 -- 172.21.15.102:0/2820932157 wait complete. 2023-10-14T09:38:49.341 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.333+0000 7f1d701e7640 1 Processor -- start 2023-10-14T09:38:49.341 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.334+0000 7f1d701e7640 1 -- start start 2023-10-14T09:38:49.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.334+0000 7f1d701e7640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1d680ccaa0 0x7f1d68156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:49.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.334+0000 7f1d701e7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d6815aaa0 0x7f1d6815c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:49.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.334+0000 7f1d701e7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d6815ae80 0x7f1d680c2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:49.343 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.334+0000 7f1d701e7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6815db00 con 0x7f1d6815aaa0 2023-10-14T09:38:49.343 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.334+0000 7f1d701e7640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6815ce80 con 0x7f1d6815ae80 2023-10-14T09:38:49.343 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.334+0000 7f1d701e7640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6815d160 con 0x7f1d680ccaa0 2023-10-14T09:38:49.343 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.335+0000 7f1d6d782640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d6815aaa0 0x7f1d6815c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:49.344 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.335+0000 7f1d6d782640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d6815aaa0 0x7f1d6815c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55926/0 (socket says 172.21.15.102:55926) 2023-10-14T09:38:49.344 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.335+0000 7f1d6d782640 1 -- 172.21.15.102:0/4013871169 learned_addr learned my addr 172.21.15.102:0/4013871169 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:38:49.344 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.335+0000 7f1d6d782640 1 -- 172.21.15.102:0/4013871169 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1d680ccaa0 msgr2=0x7f1d68156010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:49.345 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.335+0000 7f1d6d782640 1 --2- 172.21.15.102:0/4013871169 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1d680ccaa0 0x7f1d68156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:49.345 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.335+0000 7f1d6d782640 1 -- 172.21.15.102:0/4013871169 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d6815ae80 msgr2=0x7f1d680c2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:49.345 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.335+0000 7f1d6d782640 1 --2- 172.21.15.102:0/4013871169 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d6815ae80 0x7f1d680c2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:49.345 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.335+0000 7f1d6d782640 1 -- 172.21.15.102:0/4013871169 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d580094d0 con 0x7f1d6815aaa0 2023-10-14T09:38:49.346 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.335+0000 7f1d6d782640 1 --2- 172.21.15.102:0/4013871169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d6815aaa0 0x7f1d6815c430 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1d58000c00 tx=0x7f1d58004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:49.346 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.336+0000 7f1d5e7fc640 1 -- 172.21.15.102:0/4013871169 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d58030850 con 0x7f1d6815aaa0 2023-10-14T09:38:49.346 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.336+0000 7f1d5e7fc640 1 -- 172.21.15.102:0/4013871169 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d58039d90 con 0x7f1d6815aaa0 2023-10-14T09:38:49.347 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.336+0000 7f1d5e7fc640 1 -- 172.21.15.102:0/4013871169 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d58043630 con 0x7f1d6815aaa0 2023-10-14T09:38:49.347 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.336+0000 7f1d701e7640 1 -- 172.21.15.102:0/4013871169 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d6815d440 con 0x7f1d6815aaa0 2023-10-14T09:38:49.347 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.336+0000 7f1d701e7640 1 -- 172.21.15.102:0/4013871169 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d680c50d0 con 0x7f1d6815aaa0 2023-10-14T09:38:49.348 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.337+0000 7f1d701e7640 1 -- 172.21.15.102:0/4013871169 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d6804e160 con 0x7f1d6815aaa0 2023-10-14T09:38:49.348 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.338+0000 7f1d5e7fc640 1 -- 172.21.15.102:0/4013871169 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1d5802f3d0 con 0x7f1d6815aaa0 2023-10-14T09:38:49.348 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.339+0000 7f1d5e7fc640 1 --2- 172.21.15.102:0/4013871169 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1d4c06ae70 0x7f1d4c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:38:49.349 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.339+0000 7f1d5e7fc640 1 -- 172.21.15.102:0/4013871169 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f1d580abb30 con 0x7f1d6815aaa0 2023-10-14T09:38:49.349 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.339+0000 7f1d6df83640 1 --2- 172.21.15.102:0/4013871169 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1d4c06ae70 0x7f1d4c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:38:49.350 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.340+0000 7f1d6df83640 1 --2- 172.21.15.102:0/4013871169 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1d4c06ae70 0x7f1d4c06d330 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1d64009710 tx=0x7f1d64006c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:38:49.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.343+0000 7f1d5e7fc640 1 -- 172.21.15.102:0/4013871169 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1d58076bb0 con 0x7f1d6815aaa0 2023-10-14T09:38:49.531 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.529+0000 7f1d701e7640 1 -- 172.21.15.102:0/4013871169 --> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1d6815f550 con 0x7f1d4c06ae70 2023-10-14T09:38:49.554 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.553+0000 7f1d5e7fc640 1 -- 172.21.15.102:0/4013871169 <== mgr.4104 v2:172.21.15.102:6832/1125265706 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286930 (secure 0 0 0) 0x7f1d6400b480 con 0x7f1d4c06ae70 2023-10-14T09:38:49.556 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:38:49.561 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2023-10-14T09:38:49.563 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.560+0000 7f1d701e7640 1 -- 172.21.15.102:0/4013871169 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1d4c06ae70 msgr2=0x7f1d4c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:49.563 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.560+0000 7f1d701e7640 1 --2- 172.21.15.102:0/4013871169 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1d4c06ae70 0x7f1d4c06d330 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1d64009710 tx=0x7f1d64006c90 comp rx=0 tx=0).stop 2023-10-14T09:38:49.563 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.560+0000 7f1d701e7640 1 -- 172.21.15.102:0/4013871169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d6815aaa0 msgr2=0x7f1d6815c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:38:49.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.560+0000 7f1d701e7640 1 --2- 172.21.15.102:0/4013871169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d6815aaa0 0x7f1d6815c430 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1d58000c00 tx=0x7f1d58004730 comp rx=0 tx=0).stop 2023-10-14T09:38:49.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.560+0000 7f1d701e7640 1 -- 172.21.15.102:0/4013871169 shutdown_connections 2023-10-14T09:38:49.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.560+0000 7f1d701e7640 1 --2- 172.21.15.102:0/4013871169 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1d4c06ae70 0x7f1d4c06d330 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:49.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.560+0000 7f1d701e7640 1 --2- 172.21.15.102:0/4013871169 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d6815ae80 0x7f1d680c2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:49.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.560+0000 7f1d701e7640 1 --2- 172.21.15.102:0/4013871169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d6815aaa0 0x7f1d6815c430 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:49.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.560+0000 7f1d701e7640 1 --2- 172.21.15.102:0/4013871169 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1d680ccaa0 0x7f1d68156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:38:49.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.560+0000 7f1d701e7640 1 -- 172.21.15.102:0/4013871169 >> 172.21.15.102:0/4013871169 conn(0x7f1d680cb410 msgr2=0x7f1d680cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:38:49.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.560+0000 7f1d701e7640 1 -- 172.21.15.102:0/4013871169 shutdown_connections 2023-10-14T09:38:49.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:38:49.560+0000 7f1d701e7640 1 -- 172.21.15.102:0/4013871169 wait complete. 2023-10-14T09:38:49.581 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2023-10-14T09:38:47.902609+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220536,"kb_used_data":4360,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754184,"statfs":{"total":773094113280,"available":772868284416,"internally_reserved":0,"allocated":4464640,"data_stored":2453460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003633"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.019582+0000","last_change":"2023-10-14T09:38:31.026111+0000","last_active":"2023-10-14T09:38:32.019582+0000","last_peered":"2023-10-14T09:38:32.019582+0000","last_clean":"2023-10-14T09:38:32.019582+0000","last_became_active":"2023-10-14T09:38:31.023780+0000","last_became_peered":"2023-10-14T09:38:31.023780+0000","last_unstale":"2023-10-14T09:38:32.019582+0000","last_undegraded":"2023-10-14T09:38:32.019582+0000","last_fullsized":"2023-10-14T09:38:32.019582+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:13:06.090004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344563+0000","last_change":"2023-10-14T09:38:31.028205+0000","last_active":"2023-10-14T09:38:32.344563+0000","last_peered":"2023-10-14T09:38:32.344563+0000","last_clean":"2023-10-14T09:38:32.344563+0000","last_became_active":"2023-10-14T09:38:31.027820+0000","last_became_peered":"2023-10-14T09:38:31.027820+0000","last_unstale":"2023-10-14T09:38:32.344563+0000","last_undegraded":"2023-10-14T09:38:32.344563+0000","last_fullsized":"2023-10-14T09:38:32.344563+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:30:53.824363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344137+0000","last_change":"2023-10-14T09:38:31.020589+0000","last_active":"2023-10-14T09:38:32.344137+0000","last_peered":"2023-10-14T09:38:32.344137+0000","last_clean":"2023-10-14T09:38:32.344137+0000","last_became_active":"2023-10-14T09:38:31.019892+0000","last_became_peered":"2023-10-14T09:38:31.019892+0000","last_unstale":"2023-10-14T09:38:32.344137+0000","last_undegraded":"2023-10-14T09:38:32.344137+0000","last_fullsized":"2023-10-14T09:38:32.344137+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:30:59.177841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.926556+0000","last_change":"2023-10-14T09:38:31.035562+0000","last_active":"2023-10-14T09:38:34.926556+0000","last_peered":"2023-10-14T09:38:34.926556+0000","last_clean":"2023-10-14T09:38:34.926556+0000","last_became_active":"2023-10-14T09:38:31.035189+0000","last_became_peered":"2023-10-14T09:38:31.035189+0000","last_unstale":"2023-10-14T09:38:34.926556+0000","last_undegraded":"2023-10-14T09:38:34.926556+0000","last_fullsized":"2023-10-14T09:38:34.926556+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341193+0000","last_change":"2023-10-14T09:38:31.023485+0000","last_active":"2023-10-14T09:38:32.341193+0000","last_peered":"2023-10-14T09:38:32.341193+0000","last_clean":"2023-10-14T09:38:32.341193+0000","last_became_active":"2023-10-14T09:38:31.020777+0000","last_became_peered":"2023-10-14T09:38:31.020777+0000","last_unstale":"2023-10-14T09:38:32.341193+0000","last_undegraded":"2023-10-14T09:38:32.341193+0000","last_fullsized":"2023-10-14T09:38:32.341193+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:38:27.480319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342439+0000","last_change":"2023-10-14T09:38:31.028808+0000","last_active":"2023-10-14T09:38:32.342439+0000","last_peered":"2023-10-14T09:38:32.342439+0000","last_clean":"2023-10-14T09:38:32.342439+0000","last_became_active":"2023-10-14T09:38:31.027342+0000","last_became_peered":"2023-10-14T09:38:31.027342+0000","last_unstale":"2023-10-14T09:38:32.342439+0000","last_undegraded":"2023-10-14T09:38:32.342439+0000","last_fullsized":"2023-10-14T09:38:32.342439+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:41:28.301486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342132+0000","last_change":"2023-10-14T09:38:31.035347+0000","last_active":"2023-10-14T09:38:32.342132+0000","last_peered":"2023-10-14T09:38:32.342132+0000","last_clean":"2023-10-14T09:38:32.342132+0000","last_became_active":"2023-10-14T09:38:31.033760+0000","last_became_peered":"2023-10-14T09:38:31.033760+0000","last_unstale":"2023-10-14T09:38:32.342132+0000","last_undegraded":"2023-10-14T09:38:32.342132+0000","last_fullsized":"2023-10-14T09:38:32.342132+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:02:20.930526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341844+0000","last_change":"2023-10-14T09:38:31.024987+0000","last_active":"2023-10-14T09:38:32.341844+0000","last_peered":"2023-10-14T09:38:32.341844+0000","last_clean":"2023-10-14T09:38:32.341844+0000","last_became_active":"2023-10-14T09:38:31.024702+0000","last_became_peered":"2023-10-14T09:38:31.024702+0000","last_unstale":"2023-10-14T09:38:32.341844+0000","last_undegraded":"2023-10-14T09:38:32.341844+0000","last_fullsized":"2023-10-14T09:38:32.341844+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:23:43.555148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.019168+0000","last_change":"2023-10-14T09:38:31.024329+0000","last_active":"2023-10-14T09:38:32.019168+0000","last_peered":"2023-10-14T09:38:32.019168+0000","last_clean":"2023-10-14T09:38:32.019168+0000","last_became_active":"2023-10-14T09:38:31.023498+0000","last_became_peered":"2023-10-14T09:38:31.023498+0000","last_unstale":"2023-10-14T09:38:32.019168+0000","last_undegraded":"2023-10-14T09:38:32.019168+0000","last_fullsized":"2023-10-14T09:38:32.019168+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:46.045245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.926733+0000","last_change":"2023-10-14T09:38:31.029616+0000","last_active":"2023-10-14T09:38:34.926733+0000","last_peered":"2023-10-14T09:38:34.926733+0000","last_clean":"2023-10-14T09:38:34.926733+0000","last_became_active":"2023-10-14T09:38:31.029268+0000","last_became_peered":"2023-10-14T09:38:31.029268+0000","last_unstale":"2023-10-14T09:38:34.926733+0000","last_undegraded":"2023-10-14T09:38:34.926733+0000","last_fullsized":"2023-10-14T09:38:34.926733+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343128+0000","last_change":"2023-10-14T09:38:31.035514+0000","last_active":"2023-10-14T09:38:32.343128+0000","last_peered":"2023-10-14T09:38:32.343128+0000","last_clean":"2023-10-14T09:38:32.343128+0000","last_became_active":"2023-10-14T09:38:31.033343+0000","last_became_peered":"2023-10-14T09:38:31.033343+0000","last_unstale":"2023-10-14T09:38:32.343128+0000","last_undegraded":"2023-10-14T09:38:32.343128+0000","last_fullsized":"2023-10-14T09:38:32.343128+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:55:53.322273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344359+0000","last_change":"2023-10-14T09:38:31.018326+0000","last_active":"2023-10-14T09:38:32.344359+0000","last_peered":"2023-10-14T09:38:32.344359+0000","last_clean":"2023-10-14T09:38:32.344359+0000","last_became_active":"2023-10-14T09:38:31.017971+0000","last_became_peered":"2023-10-14T09:38:31.017971+0000","last_unstale":"2023-10-14T09:38:32.344359+0000","last_undegraded":"2023-10-14T09:38:32.344359+0000","last_fullsized":"2023-10-14T09:38:32.344359+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:08.018148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341372+0000","last_change":"2023-10-14T09:38:31.019474+0000","last_active":"2023-10-14T09:38:32.341372+0000","last_peered":"2023-10-14T09:38:32.341372+0000","last_clean":"2023-10-14T09:38:32.341372+0000","last_became_active":"2023-10-14T09:38:31.019186+0000","last_became_peered":"2023-10-14T09:38:31.019186+0000","last_unstale":"2023-10-14T09:38:32.341372+0000","last_undegraded":"2023-10-14T09:38:32.341372+0000","last_fullsized":"2023-10-14T09:38:32.341372+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:36:21.378536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342644+0000","last_change":"2023-10-14T09:38:31.020718+0000","last_active":"2023-10-14T09:38:32.342644+0000","last_peered":"2023-10-14T09:38:32.342644+0000","last_clean":"2023-10-14T09:38:32.342644+0000","last_became_active":"2023-10-14T09:38:31.020409+0000","last_became_peered":"2023-10-14T09:38:31.020409+0000","last_unstale":"2023-10-14T09:38:32.342644+0000","last_undegraded":"2023-10-14T09:38:32.342644+0000","last_fullsized":"2023-10-14T09:38:32.342644+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:43:03.012824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342558+0000","last_change":"2023-10-14T09:38:31.025489+0000","last_active":"2023-10-14T09:38:32.342558+0000","last_peered":"2023-10-14T09:38:32.342558+0000","last_clean":"2023-10-14T09:38:32.342558+0000","last_became_active":"2023-10-14T09:38:31.025155+0000","last_became_peered":"2023-10-14T09:38:31.025155+0000","last_unstale":"2023-10-14T09:38:32.342558+0000","last_undegraded":"2023-10-14T09:38:32.342558+0000","last_fullsized":"2023-10-14T09:38:32.342558+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:14:59.816409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342426+0000","last_change":"2023-10-14T09:38:31.034136+0000","last_active":"2023-10-14T09:38:32.342426+0000","last_peered":"2023-10-14T09:38:32.342426+0000","last_clean":"2023-10-14T09:38:32.342426+0000","last_became_active":"2023-10-14T09:38:31.033869+0000","last_became_peered":"2023-10-14T09:38:31.033869+0000","last_unstale":"2023-10-14T09:38:32.342426+0000","last_undegraded":"2023-10-14T09:38:32.342426+0000","last_fullsized":"2023-10-14T09:38:32.342426+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:44.513959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343361+0000","last_change":"2023-10-14T09:38:31.030416+0000","last_active":"2023-10-14T09:38:32.343361+0000","last_peered":"2023-10-14T09:38:32.343361+0000","last_clean":"2023-10-14T09:38:32.343361+0000","last_became_active":"2023-10-14T09:38:31.029457+0000","last_became_peered":"2023-10-14T09:38:31.029457+0000","last_unstale":"2023-10-14T09:38:32.343361+0000","last_undegraded":"2023-10-14T09:38:32.343361+0000","last_fullsized":"2023-10-14T09:38:32.343361+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:41:28.301486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344776+0000","last_change":"2023-10-14T09:38:31.033346+0000","last_active":"2023-10-14T09:38:32.344776+0000","last_peered":"2023-10-14T09:38:32.344776+0000","last_clean":"2023-10-14T09:38:32.344776+0000","last_became_active":"2023-10-14T09:38:31.033040+0000","last_became_peered":"2023-10-14T09:38:31.033040+0000","last_unstale":"2023-10-14T09:38:32.344776+0000","last_undegraded":"2023-10-14T09:38:32.344776+0000","last_fullsized":"2023-10-14T09:38:32.344776+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:54:57.182070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343534+0000","last_change":"2023-10-14T09:38:31.026010+0000","last_active":"2023-10-14T09:38:32.343534+0000","last_peered":"2023-10-14T09:38:32.343534+0000","last_clean":"2023-10-14T09:38:32.343534+0000","last_became_active":"2023-10-14T09:38:31.025735+0000","last_became_peered":"2023-10-14T09:38:31.025735+0000","last_unstale":"2023-10-14T09:38:32.343534+0000","last_undegraded":"2023-10-14T09:38:32.343534+0000","last_fullsized":"2023-10-14T09:38:32.343534+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:07:02.738518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341225+0000","last_change":"2023-10-14T09:38:31.011800+0000","last_active":"2023-10-14T09:38:32.341225+0000","last_peered":"2023-10-14T09:38:32.341225+0000","last_clean":"2023-10-14T09:38:32.341225+0000","last_became_active":"2023-10-14T09:38:31.011363+0000","last_became_peered":"2023-10-14T09:38:31.011363+0000","last_unstale":"2023-10-14T09:38:32.341225+0000","last_undegraded":"2023-10-14T09:38:32.341225+0000","last_fullsized":"2023-10-14T09:38:32.341225+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:32:10.952099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.018172+0000","last_change":"2023-10-14T09:38:31.021882+0000","last_active":"2023-10-14T09:38:32.018172+0000","last_peered":"2023-10-14T09:38:32.018172+0000","last_clean":"2023-10-14T09:38:32.018172+0000","last_became_active":"2023-10-14T09:38:31.021555+0000","last_became_peered":"2023-10-14T09:38:31.021555+0000","last_unstale":"2023-10-14T09:38:32.018172+0000","last_undegraded":"2023-10-14T09:38:32.018172+0000","last_fullsized":"2023-10-14T09:38:32.018172+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:22.613894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.018500+0000","last_change":"2023-10-14T09:38:31.029992+0000","last_active":"2023-10-14T09:38:32.018500+0000","last_peered":"2023-10-14T09:38:32.018500+0000","last_clean":"2023-10-14T09:38:32.018500+0000","last_became_active":"2023-10-14T09:38:31.029712+0000","last_became_peered":"2023-10-14T09:38:31.029712+0000","last_unstale":"2023-10-14T09:38:32.018500+0000","last_undegraded":"2023-10-14T09:38:32.018500+0000","last_fullsized":"2023-10-14T09:38:32.018500+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:12.059563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345293+0000","last_change":"2023-10-14T09:38:31.023504+0000","last_active":"2023-10-14T09:38:32.345293+0000","last_peered":"2023-10-14T09:38:32.345293+0000","last_clean":"2023-10-14T09:38:32.345293+0000","last_became_active":"2023-10-14T09:38:31.023251+0000","last_became_peered":"2023-10-14T09:38:31.023251+0000","last_unstale":"2023-10-14T09:38:32.345293+0000","last_undegraded":"2023-10-14T09:38:32.345293+0000","last_fullsized":"2023-10-14T09:38:32.345293+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:29.053068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342651+0000","last_change":"2023-10-14T09:38:31.011612+0000","last_active":"2023-10-14T09:38:32.342651+0000","last_peered":"2023-10-14T09:38:32.342651+0000","last_clean":"2023-10-14T09:38:32.342651+0000","last_became_active":"2023-10-14T09:38:31.010860+0000","last_became_peered":"2023-10-14T09:38:31.010860+0000","last_unstale":"2023-10-14T09:38:32.342651+0000","last_undegraded":"2023-10-14T09:38:32.342651+0000","last_fullsized":"2023-10-14T09:38:32.342651+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:54:32.085213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.926771+0000","last_change":"2023-10-14T09:38:31.023722+0000","last_active":"2023-10-14T09:38:34.926771+0000","last_peered":"2023-10-14T09:38:34.926771+0000","last_clean":"2023-10-14T09:38:34.926771+0000","last_became_active":"2023-10-14T09:38:31.023469+0000","last_became_peered":"2023-10-14T09:38:31.023469+0000","last_unstale":"2023-10-14T09:38:34.926771+0000","last_undegraded":"2023-10-14T09:38:34.926771+0000","last_fullsized":"2023-10-14T09:38:34.926771+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344738+0000","last_change":"2023-10-14T09:38:31.028525+0000","last_active":"2023-10-14T09:38:32.344738+0000","last_peered":"2023-10-14T09:38:32.344738+0000","last_clean":"2023-10-14T09:38:32.344738+0000","last_became_active":"2023-10-14T09:38:31.026660+0000","last_became_peered":"2023-10-14T09:38:31.026660+0000","last_unstale":"2023-10-14T09:38:32.344738+0000","last_undegraded":"2023-10-14T09:38:32.344738+0000","last_fullsized":"2023-10-14T09:38:32.344738+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:29:12.633954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.926654+0000","last_change":"2023-10-14T09:38:31.026064+0000","last_active":"2023-10-14T09:38:34.926654+0000","last_peered":"2023-10-14T09:38:34.926654+0000","last_clean":"2023-10-14T09:38:34.926654+0000","last_became_active":"2023-10-14T09:38:31.025680+0000","last_became_peered":"2023-10-14T09:38:31.025680+0000","last_unstale":"2023-10-14T09:38:34.926654+0000","last_undegraded":"2023-10-14T09:38:34.926654+0000","last_fullsized":"2023-10-14T09:38:34.926654+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343991+0000","last_change":"2023-10-14T09:38:31.022957+0000","last_active":"2023-10-14T09:38:32.343991+0000","last_peered":"2023-10-14T09:38:32.343991+0000","last_clean":"2023-10-14T09:38:32.343991+0000","last_became_active":"2023-10-14T09:38:31.022641+0000","last_became_peered":"2023-10-14T09:38:31.022641+0000","last_unstale":"2023-10-14T09:38:32.343991+0000","last_undegraded":"2023-10-14T09:38:32.343991+0000","last_fullsized":"2023-10-14T09:38:32.343991+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:08:08.601763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.018402+0000","last_change":"2023-10-14T09:38:31.031585+0000","last_active":"2023-10-14T09:38:32.018402+0000","last_peered":"2023-10-14T09:38:32.018402+0000","last_clean":"2023-10-14T09:38:32.018402+0000","last_became_active":"2023-10-14T09:38:31.031302+0000","last_became_peered":"2023-10-14T09:38:31.031302+0000","last_unstale":"2023-10-14T09:38:32.018402+0000","last_undegraded":"2023-10-14T09:38:32.018402+0000","last_fullsized":"2023-10-14T09:38:32.018402+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:37:07.904425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341801+0000","last_change":"2023-10-14T09:38:31.029845+0000","last_active":"2023-10-14T09:38:32.341801+0000","last_peered":"2023-10-14T09:38:32.341801+0000","last_clean":"2023-10-14T09:38:32.341801+0000","last_became_active":"2023-10-14T09:38:31.029493+0000","last_became_peered":"2023-10-14T09:38:31.029493+0000","last_unstale":"2023-10-14T09:38:32.341801+0000","last_undegraded":"2023-10-14T09:38:32.341801+0000","last_fullsized":"2023-10-14T09:38:32.341801+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:05:14.584003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.020011+0000","last_change":"2023-10-14T09:38:31.025533+0000","last_active":"2023-10-14T09:38:32.020011+0000","last_peered":"2023-10-14T09:38:32.020011+0000","last_clean":"2023-10-14T09:38:32.020011+0000","last_became_active":"2023-10-14T09:38:31.025243+0000","last_became_peered":"2023-10-14T09:38:31.025243+0000","last_unstale":"2023-10-14T09:38:32.020011+0000","last_undegraded":"2023-10-14T09:38:32.020011+0000","last_fullsized":"2023-10-14T09:38:32.020011+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:32:55.434705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341995+0000","last_change":"2023-10-14T09:38:31.028763+0000","last_active":"2023-10-14T09:38:32.341995+0000","last_peered":"2023-10-14T09:38:32.341995+0000","last_clean":"2023-10-14T09:38:32.341995+0000","last_became_active":"2023-10-14T09:38:31.028420+0000","last_became_peered":"2023-10-14T09:38:31.028420+0000","last_unstale":"2023-10-14T09:38:32.341995+0000","last_undegraded":"2023-10-14T09:38:32.341995+0000","last_fullsized":"2023-10-14T09:38:32.341995+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:26:03.834483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345961+0000","last_change":"2023-10-14T09:38:31.024908+0000","last_active":"2023-10-14T09:38:32.345961+0000","last_peered":"2023-10-14T09:38:32.345961+0000","last_clean":"2023-10-14T09:38:32.345961+0000","last_became_active":"2023-10-14T09:38:31.023482+0000","last_became_peered":"2023-10-14T09:38:31.023482+0000","last_unstale":"2023-10-14T09:38:32.345961+0000","last_undegraded":"2023-10-14T09:38:32.345961+0000","last_fullsized":"2023-10-14T09:38:32.345961+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:14:59.816409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"35'4","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.048326+0000","last_change":"2023-10-14T09:38:30.031689+0000","last_active":"2023-10-14T09:38:31.048326+0000","last_peered":"2023-10-14T09:38:31.048326+0000","last_clean":"2023-10-14T09:38:31.048326+0000","last_became_active":"2023-10-14T09:38:30.031374+0000","last_became_peered":"2023-10-14T09:38:30.031374+0000","last_unstale":"2023-10-14T09:38:31.048326+0000","last_undegraded":"2023-10-14T09:38:31.048326+0000","last_fullsized":"2023-10-14T09:38:31.048326+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:32.881121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.019773+0000","last_change":"2023-10-14T09:38:31.026729+0000","last_active":"2023-10-14T09:38:32.019773+0000","last_peered":"2023-10-14T09:38:32.019773+0000","last_clean":"2023-10-14T09:38:32.019773+0000","last_became_active":"2023-10-14T09:38:31.026414+0000","last_became_peered":"2023-10-14T09:38:31.026414+0000","last_unstale":"2023-10-14T09:38:32.019773+0000","last_undegraded":"2023-10-14T09:38:32.019773+0000","last_fullsized":"2023-10-14T09:38:32.019773+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:09.182708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"35'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345785+0000","last_change":"2023-10-14T09:38:30.025206+0000","last_active":"2023-10-14T09:38:32.345785+0000","last_peered":"2023-10-14T09:38:32.345785+0000","last_clean":"2023-10-14T09:38:32.345785+0000","last_became_active":"2023-10-14T09:38:30.024910+0000","last_became_peered":"2023-10-14T09:38:30.024910+0000","last_unstale":"2023-10-14T09:38:32.345785+0000","last_undegraded":"2023-10-14T09:38:32.345785+0000","last_fullsized":"2023-10-14T09:38:32.345785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:35:31.581556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.018785+0000","last_change":"2023-10-14T09:38:31.030098+0000","last_active":"2023-10-14T09:38:32.018785+0000","last_peered":"2023-10-14T09:38:32.018785+0000","last_clean":"2023-10-14T09:38:32.018785+0000","last_became_active":"2023-10-14T09:38:31.029815+0000","last_became_peered":"2023-10-14T09:38:31.029815+0000","last_unstale":"2023-10-14T09:38:32.018785+0000","last_undegraded":"2023-10-14T09:38:32.018785+0000","last_fullsized":"2023-10-14T09:38:32.018785+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:23:27.986420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.041830+0000","last_change":"2023-10-14T09:38:30.017782+0000","last_active":"2023-10-14T09:38:31.041830+0000","last_peered":"2023-10-14T09:38:31.041830+0000","last_clean":"2023-10-14T09:38:31.041830+0000","last_became_active":"2023-10-14T09:38:30.017602+0000","last_became_peered":"2023-10-14T09:38:30.017602+0000","last_unstale":"2023-10-14T09:38:31.041830+0000","last_undegraded":"2023-10-14T09:38:31.041830+0000","last_fullsized":"2023-10-14T09:38:31.041830+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:34.119874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.926694+0000","last_change":"2023-10-14T09:38:31.028602+0000","last_active":"2023-10-14T09:38:34.926694+0000","last_peered":"2023-10-14T09:38:34.926694+0000","last_clean":"2023-10-14T09:38:34.926694+0000","last_became_active":"2023-10-14T09:38:31.025645+0000","last_became_peered":"2023-10-14T09:38:31.025645+0000","last_unstale":"2023-10-14T09:38:34.926694+0000","last_undegraded":"2023-10-14T09:38:34.926694+0000","last_fullsized":"2023-10-14T09:38:34.926694+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.043829+0000","last_change":"2023-10-14T09:38:30.031331+0000","last_active":"2023-10-14T09:38:31.043829+0000","last_peered":"2023-10-14T09:38:31.043829+0000","last_clean":"2023-10-14T09:38:31.043829+0000","last_became_active":"2023-10-14T09:38:30.030556+0000","last_became_peered":"2023-10-14T09:38:30.030556+0000","last_unstale":"2023-10-14T09:38:31.043829+0000","last_undegraded":"2023-10-14T09:38:31.043829+0000","last_fullsized":"2023-10-14T09:38:31.043829+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:00:27.300436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342154+0000","last_change":"2023-10-14T09:38:31.029169+0000","last_active":"2023-10-14T09:38:32.342154+0000","last_peered":"2023-10-14T09:38:32.342154+0000","last_clean":"2023-10-14T09:38:32.342154+0000","last_became_active":"2023-10-14T09:38:31.028887+0000","last_became_peered":"2023-10-14T09:38:31.028887+0000","last_unstale":"2023-10-14T09:38:32.342154+0000","last_undegraded":"2023-10-14T09:38:32.342154+0000","last_fullsized":"2023-10-14T09:38:32.342154+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:05:40.247862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.043614+0000","last_change":"2023-10-14T09:38:30.026023+0000","last_active":"2023-10-14T09:38:31.043614+0000","last_peered":"2023-10-14T09:38:31.043614+0000","last_clean":"2023-10-14T09:38:31.043614+0000","last_became_active":"2023-10-14T09:38:30.025732+0000","last_became_peered":"2023-10-14T09:38:30.025732+0000","last_unstale":"2023-10-14T09:38:31.043614+0000","last_undegraded":"2023-10-14T09:38:31.043614+0000","last_fullsized":"2023-10-14T09:38:31.043614+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:30:03.089452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343662+0000","last_change":"2023-10-14T09:38:31.020554+0000","last_active":"2023-10-14T09:38:32.343662+0000","last_peered":"2023-10-14T09:38:32.343662+0000","last_clean":"2023-10-14T09:38:32.343662+0000","last_became_active":"2023-10-14T09:38:31.020184+0000","last_became_peered":"2023-10-14T09:38:31.020184+0000","last_unstale":"2023-10-14T09:38:32.343662+0000","last_undegraded":"2023-10-14T09:38:32.343662+0000","last_fullsized":"2023-10-14T09:38:32.343662+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:26:34.407953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.043817+0000","last_change":"2023-10-14T09:38:30.031642+0000","last_active":"2023-10-14T09:38:31.043817+0000","last_peered":"2023-10-14T09:38:31.043817+0000","last_clean":"2023-10-14T09:38:31.043817+0000","last_became_active":"2023-10-14T09:38:30.031356+0000","last_became_peered":"2023-10-14T09:38:30.031356+0000","last_unstale":"2023-10-14T09:38:31.043817+0000","last_undegraded":"2023-10-14T09:38:31.043817+0000","last_fullsized":"2023-10-14T09:38:31.043817+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:36:20.364439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.017009+0000","last_change":"2023-10-14T09:38:31.024293+0000","last_active":"2023-10-14T09:38:32.017009+0000","last_peered":"2023-10-14T09:38:32.017009+0000","last_clean":"2023-10-14T09:38:32.017009+0000","last_became_active":"2023-10-14T09:38:31.023990+0000","last_became_peered":"2023-10-14T09:38:31.023990+0000","last_unstale":"2023-10-14T09:38:32.017009+0000","last_undegraded":"2023-10-14T09:38:32.017009+0000","last_fullsized":"2023-10-14T09:38:32.017009+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:18.314768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.010745+0000","last_change":"2023-10-14T09:38:30.021813+0000","last_active":"2023-10-14T09:38:31.010745+0000","last_peered":"2023-10-14T09:38:31.010745+0000","last_clean":"2023-10-14T09:38:31.010745+0000","last_became_active":"2023-10-14T09:38:30.019461+0000","last_became_peered":"2023-10-14T09:38:30.019461+0000","last_unstale":"2023-10-14T09:38:31.010745+0000","last_undegraded":"2023-10-14T09:38:31.010745+0000","last_fullsized":"2023-10-14T09:38:31.010745+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:04:04.485468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.926415+0000","last_change":"2023-10-14T09:38:31.016796+0000","last_active":"2023-10-14T09:38:34.926415+0000","last_peered":"2023-10-14T09:38:34.926415+0000","last_clean":"2023-10-14T09:38:34.926415+0000","last_became_active":"2023-10-14T09:38:31.016514+0000","last_became_peered":"2023-10-14T09:38:31.016514+0000","last_unstale":"2023-10-14T09:38:34.926415+0000","last_undegraded":"2023-10-14T09:38:34.926415+0000","last_fullsized":"2023-10-14T09:38:34.926415+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.006074+0000","last_change":"2023-10-14T09:38:30.035807+0000","last_active":"2023-10-14T09:38:31.006074+0000","last_peered":"2023-10-14T09:38:31.006074+0000","last_clean":"2023-10-14T09:38:31.006074+0000","last_became_active":"2023-10-14T09:38:30.035470+0000","last_became_peered":"2023-10-14T09:38:30.035470+0000","last_unstale":"2023-10-14T09:38:31.006074+0000","last_undegraded":"2023-10-14T09:38:31.006074+0000","last_fullsized":"2023-10-14T09:38:31.006074+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:38:26.466223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344016+0000","last_change":"2023-10-14T09:38:31.026082+0000","last_active":"2023-10-14T09:38:32.344016+0000","last_peered":"2023-10-14T09:38:32.344016+0000","last_clean":"2023-10-14T09:38:32.344016+0000","last_became_active":"2023-10-14T09:38:31.025794+0000","last_became_peered":"2023-10-14T09:38:31.025794+0000","last_unstale":"2023-10-14T09:38:32.344016+0000","last_undegraded":"2023-10-14T09:38:32.344016+0000","last_fullsized":"2023-10-14T09:38:32.344016+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:08:12.498616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.013494+0000","last_change":"2023-10-14T09:38:30.014502+0000","last_active":"2023-10-14T09:38:31.013494+0000","last_peered":"2023-10-14T09:38:31.013494+0000","last_clean":"2023-10-14T09:38:31.013494+0000","last_became_active":"2023-10-14T09:38:30.014042+0000","last_became_peered":"2023-10-14T09:38:30.014042+0000","last_unstale":"2023-10-14T09:38:31.013494+0000","last_undegraded":"2023-10-14T09:38:31.013494+0000","last_fullsized":"2023-10-14T09:38:31.013494+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:02:19.916430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343306+0000","last_change":"2023-10-14T09:38:31.021923+0000","last_active":"2023-10-14T09:38:32.343306+0000","last_peered":"2023-10-14T09:38:32.343306+0000","last_clean":"2023-10-14T09:38:32.343306+0000","last_became_active":"2023-10-14T09:38:31.021662+0000","last_became_peered":"2023-10-14T09:38:31.021662+0000","last_unstale":"2023-10-14T09:38:32.343306+0000","last_undegraded":"2023-10-14T09:38:32.343306+0000","last_fullsized":"2023-10-14T09:38:32.343306+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:18:08.718330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345934+0000","last_change":"2023-10-14T09:38:30.028000+0000","last_active":"2023-10-14T09:38:32.345934+0000","last_peered":"2023-10-14T09:38:32.345934+0000","last_clean":"2023-10-14T09:38:32.345934+0000","last_became_active":"2023-10-14T09:38:30.027696+0000","last_became_peered":"2023-10-14T09:38:30.027696+0000","last_unstale":"2023-10-14T09:38:32.345934+0000","last_undegraded":"2023-10-14T09:38:32.345934+0000","last_fullsized":"2023-10-14T09:38:32.345934+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:11.668342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343027+0000","last_change":"2023-10-14T09:38:31.026933+0000","last_active":"2023-10-14T09:38:32.343027+0000","last_peered":"2023-10-14T09:38:32.343027+0000","last_clean":"2023-10-14T09:38:32.343027+0000","last_became_active":"2023-10-14T09:38:31.026676+0000","last_became_peered":"2023-10-14T09:38:31.026676+0000","last_unstale":"2023-10-14T09:38:32.343027+0000","last_undegraded":"2023-10-14T09:38:32.343027+0000","last_fullsized":"2023-10-14T09:38:32.343027+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:39:19.700408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"35'3","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344090+0000","last_change":"2023-10-14T09:38:30.032207+0000","last_active":"2023-10-14T09:38:32.344090+0000","last_peered":"2023-10-14T09:38:32.344090+0000","last_clean":"2023-10-14T09:38:32.344090+0000","last_became_active":"2023-10-14T09:38:30.031907+0000","last_became_peered":"2023-10-14T09:38:30.031907+0000","last_unstale":"2023-10-14T09:38:32.344090+0000","last_undegraded":"2023-10-14T09:38:32.344090+0000","last_fullsized":"2023-10-14T09:38:32.344090+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:59:09.031590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.343866+0000","last_change":"2023-10-14T09:38:31.021126+0000","last_active":"2023-10-14T09:38:32.343866+0000","last_peered":"2023-10-14T09:38:32.343866+0000","last_clean":"2023-10-14T09:38:32.343866+0000","last_became_active":"2023-10-14T09:38:31.020267+0000","last_became_peered":"2023-10-14T09:38:31.020267+0000","last_unstale":"2023-10-14T09:38:32.343866+0000","last_undegraded":"2023-10-14T09:38:32.343866+0000","last_fullsized":"2023-10-14T09:38:32.343866+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:29:07.359293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"35'6","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.048294+0000","last_change":"2023-10-14T09:38:30.020149+0000","last_active":"2023-10-14T09:38:31.048294+0000","last_peered":"2023-10-14T09:38:31.048294+0000","last_clean":"2023-10-14T09:38:31.048294+0000","last_became_active":"2023-10-14T09:38:30.019839+0000","last_became_peered":"2023-10-14T09:38:30.019839+0000","last_unstale":"2023-10-14T09:38:31.048294+0000","last_undegraded":"2023-10-14T09:38:31.048294+0000","last_fullsized":"2023-10-14T09:38:31.048294+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:54.807431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.926469+0000","last_change":"2023-10-14T09:38:31.020699+0000","last_active":"2023-10-14T09:38:34.926469+0000","last_peered":"2023-10-14T09:38:34.926469+0000","last_clean":"2023-10-14T09:38:34.926469+0000","last_became_active":"2023-10-14T09:38:31.020347+0000","last_became_peered":"2023-10-14T09:38:31.020347+0000","last_unstale":"2023-10-14T09:38:34.926469+0000","last_undegraded":"2023-10-14T09:38:34.926469+0000","last_fullsized":"2023-10-14T09:38:34.926469+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.042951+0000","last_change":"2023-10-14T09:38:30.035740+0000","last_active":"2023-10-14T09:38:31.042951+0000","last_peered":"2023-10-14T09:38:31.042951+0000","last_clean":"2023-10-14T09:38:31.042951+0000","last_became_active":"2023-10-14T09:38:30.035424+0000","last_became_peered":"2023-10-14T09:38:30.035424+0000","last_unstale":"2023-10-14T09:38:31.042951+0000","last_undegraded":"2023-10-14T09:38:31.042951+0000","last_fullsized":"2023-10-14T09:38:31.042951+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:13:05.075908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342770+0000","last_change":"2023-10-14T09:38:31.028147+0000","last_active":"2023-10-14T09:38:32.342770+0000","last_peered":"2023-10-14T09:38:32.342770+0000","last_clean":"2023-10-14T09:38:32.342770+0000","last_became_active":"2023-10-14T09:38:31.027759+0000","last_became_peered":"2023-10-14T09:38:31.027759+0000","last_unstale":"2023-10-14T09:38:32.342770+0000","last_undegraded":"2023-10-14T09:38:32.342770+0000","last_fullsized":"2023-10-14T09:38:32.342770+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:28.333786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342638+0000","last_change":"2023-10-14T09:38:30.025921+0000","last_active":"2023-10-14T09:38:32.342638+0000","last_peered":"2023-10-14T09:38:32.342638+0000","last_clean":"2023-10-14T09:38:32.342638+0000","last_became_active":"2023-10-14T09:38:30.025712+0000","last_became_peered":"2023-10-14T09:38:30.025712+0000","last_unstale":"2023-10-14T09:38:32.342638+0000","last_undegraded":"2023-10-14T09:38:32.342638+0000","last_fullsized":"2023-10-14T09:38:32.342638+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342190+0000","last_change":"2023-10-14T09:38:31.037744+0000","last_active":"2023-10-14T09:38:32.342190+0000","last_peered":"2023-10-14T09:38:32.342190+0000","last_clean":"2023-10-14T09:38:32.342190+0000","last_became_active":"2023-10-14T09:38:31.036628+0000","last_became_peered":"2023-10-14T09:38:31.036628+0000","last_unstale":"2023-10-14T09:38:32.342190+0000","last_undegraded":"2023-10-14T09:38:32.342190+0000","last_fullsized":"2023-10-14T09:38:32.342190+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:55.821527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.010492+0000","last_change":"2023-10-14T09:38:30.022460+0000","last_active":"2023-10-14T09:38:31.010492+0000","last_peered":"2023-10-14T09:38:31.010492+0000","last_clean":"2023-10-14T09:38:31.010492+0000","last_became_active":"2023-10-14T09:38:30.022182+0000","last_became_peered":"2023-10-14T09:38:30.022182+0000","last_unstale":"2023-10-14T09:38:31.010492+0000","last_undegraded":"2023-10-14T09:38:31.010492+0000","last_fullsized":"2023-10-14T09:38:31.010492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:45.031149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.020009+0000","last_change":"2023-10-14T09:38:31.039814+0000","last_active":"2023-10-14T09:38:32.020009+0000","last_peered":"2023-10-14T09:38:32.020009+0000","last_clean":"2023-10-14T09:38:32.020009+0000","last_became_active":"2023-10-14T09:38:31.039518+0000","last_became_peered":"2023-10-14T09:38:31.039518+0000","last_unstale":"2023-10-14T09:38:32.020009+0000","last_undegraded":"2023-10-14T09:38:32.020009+0000","last_fullsized":"2023-10-14T09:38:32.020009+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:22.613894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"35'8","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.046908+0000","last_change":"2023-10-14T09:38:30.015580+0000","last_active":"2023-10-14T09:38:31.046908+0000","last_peered":"2023-10-14T09:38:31.046908+0000","last_clean":"2023-10-14T09:38:31.046908+0000","last_became_active":"2023-10-14T09:38:30.014562+0000","last_became_peered":"2023-10-14T09:38:30.014562+0000","last_unstale":"2023-10-14T09:38:31.046908+0000","last_undegraded":"2023-10-14T09:38:31.046908+0000","last_fullsized":"2023-10-14T09:38:31.046908+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:27.669263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.018236+0000","last_change":"2023-10-14T09:38:31.026009+0000","last_active":"2023-10-14T09:38:32.018236+0000","last_peered":"2023-10-14T09:38:32.018236+0000","last_clean":"2023-10-14T09:38:32.018236+0000","last_became_active":"2023-10-14T09:38:31.025665+0000","last_became_peered":"2023-10-14T09:38:31.025665+0000","last_unstale":"2023-10-14T09:38:32.018236+0000","last_undegraded":"2023-10-14T09:38:32.018236+0000","last_fullsized":"2023-10-14T09:38:32.018236+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:16:06.675198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"35'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344988+0000","last_change":"2023-10-14T09:38:30.027344+0000","last_active":"2023-10-14T09:38:32.344988+0000","last_peered":"2023-10-14T09:38:32.344988+0000","last_clean":"2023-10-14T09:38:32.344988+0000","last_became_active":"2023-10-14T09:38:30.025331+0000","last_became_peered":"2023-10-14T09:38:30.025331+0000","last_unstale":"2023-10-14T09:38:32.344988+0000","last_undegraded":"2023-10-14T09:38:32.344988+0000","last_fullsized":"2023-10-14T09:38:32.344988+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344384+0000","last_change":"2023-10-14T09:38:31.033233+0000","last_active":"2023-10-14T09:38:32.344384+0000","last_peered":"2023-10-14T09:38:32.344384+0000","last_clean":"2023-10-14T09:38:32.344384+0000","last_became_active":"2023-10-14T09:38:31.032912+0000","last_became_peered":"2023-10-14T09:38:31.032912+0000","last_unstale":"2023-10-14T09:38:32.344384+0000","last_undegraded":"2023-10-14T09:38:32.344384+0000","last_fullsized":"2023-10-14T09:38:32.344384+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:52:28.791327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.043036+0000","last_change":"2023-10-14T09:38:30.035623+0000","last_active":"2023-10-14T09:38:31.043036+0000","last_peered":"2023-10-14T09:38:31.043036+0000","last_clean":"2023-10-14T09:38:31.043036+0000","last_became_active":"2023-10-14T09:38:30.035283+0000","last_became_peered":"2023-10-14T09:38:30.035283+0000","last_unstale":"2023-10-14T09:38:31.043036+0000","last_undegraded":"2023-10-14T09:38:31.043036+0000","last_fullsized":"2023-10-14T09:38:31.043036+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:32:09.938003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.926594+0000","last_change":"2023-10-14T09:38:31.035370+0000","last_active":"2023-10-14T09:38:34.926594+0000","last_peered":"2023-10-14T09:38:34.926594+0000","last_clean":"2023-10-14T09:38:34.926594+0000","last_became_active":"2023-10-14T09:38:31.034768+0000","last_became_peered":"2023-10-14T09:38:31.034768+0000","last_unstale":"2023-10-14T09:38:34.926594+0000","last_undegraded":"2023-10-14T09:38:34.926594+0000","last_fullsized":"2023-10-14T09:38:34.926594+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.045638+0000","last_change":"2023-10-14T09:38:30.032461+0000","last_active":"2023-10-14T09:38:31.045638+0000","last_peered":"2023-10-14T09:38:31.045638+0000","last_clean":"2023-10-14T09:38:31.045638+0000","last_became_active":"2023-10-14T09:38:30.030927+0000","last_became_peered":"2023-10-14T09:38:30.030927+0000","last_unstale":"2023-10-14T09:38:31.045638+0000","last_undegraded":"2023-10-14T09:38:31.045638+0000","last_fullsized":"2023-10-14T09:38:31.045638+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:18:05.378855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341272+0000","last_change":"2023-10-14T09:38:31.026882+0000","last_active":"2023-10-14T09:38:32.341272+0000","last_peered":"2023-10-14T09:38:32.341272+0000","last_clean":"2023-10-14T09:38:32.341272+0000","last_became_active":"2023-10-14T09:38:31.026615+0000","last_became_peered":"2023-10-14T09:38:31.026615+0000","last_unstale":"2023-10-14T09:38:32.341272+0000","last_undegraded":"2023-10-14T09:38:32.341272+0000","last_fullsized":"2023-10-14T09:38:32.341272+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:39:04.991127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.013395+0000","last_change":"2023-10-14T09:38:30.028028+0000","last_active":"2023-10-14T09:38:31.013395+0000","last_peered":"2023-10-14T09:38:31.013395+0000","last_clean":"2023-10-14T09:38:31.013395+0000","last_became_active":"2023-10-14T09:38:30.026795+0000","last_became_peered":"2023-10-14T09:38:30.026795+0000","last_unstale":"2023-10-14T09:38:31.013395+0000","last_undegraded":"2023-10-14T09:38:31.013395+0000","last_fullsized":"2023-10-14T09:38:31.013395+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:33:08.168611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341771+0000","last_change":"2023-10-14T09:38:31.032201+0000","last_active":"2023-10-14T09:38:32.341771+0000","last_peered":"2023-10-14T09:38:32.341771+0000","last_clean":"2023-10-14T09:38:32.341771+0000","last_became_active":"2023-10-14T09:38:31.031921+0000","last_became_peered":"2023-10-14T09:38:31.031921+0000","last_unstale":"2023-10-14T09:38:32.341771+0000","last_undegraded":"2023-10-14T09:38:32.341771+0000","last_fullsized":"2023-10-14T09:38:32.341771+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:30:04.103548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345526+0000","last_change":"2023-10-14T09:38:30.021600+0000","last_active":"2023-10-14T09:38:32.345526+0000","last_peered":"2023-10-14T09:38:32.345526+0000","last_clean":"2023-10-14T09:38:32.345526+0000","last_became_active":"2023-10-14T09:38:30.021312+0000","last_became_peered":"2023-10-14T09:38:30.021312+0000","last_unstale":"2023-10-14T09:38:32.345526+0000","last_undegraded":"2023-10-14T09:38:32.345526+0000","last_fullsized":"2023-10-14T09:38:32.345526+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:55:23.928233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341541+0000","last_change":"2023-10-14T09:38:31.023661+0000","last_active":"2023-10-14T09:38:32.341541+0000","last_peered":"2023-10-14T09:38:32.341541+0000","last_clean":"2023-10-14T09:38:32.341541+0000","last_became_active":"2023-10-14T09:38:31.023340+0000","last_became_peered":"2023-10-14T09:38:31.023340+0000","last_unstale":"2023-10-14T09:38:32.341541+0000","last_undegraded":"2023-10-14T09:38:32.341541+0000","last_fullsized":"2023-10-14T09:38:32.341541+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:49:04.384325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.016548+0000","last_change":"2023-10-14T09:38:30.033606+0000","last_active":"2023-10-14T09:38:31.016548+0000","last_peered":"2023-10-14T09:38:31.016548+0000","last_clean":"2023-10-14T09:38:31.016548+0000","last_became_active":"2023-10-14T09:38:30.033284+0000","last_became_peered":"2023-10-14T09:38:30.033284+0000","last_unstale":"2023-10-14T09:38:31.016548+0000","last_undegraded":"2023-10-14T09:38:31.016548+0000","last_fullsized":"2023-10-14T09:38:31.016548+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:26:23.409048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341209+0000","last_change":"2023-10-14T09:38:31.020259+0000","last_active":"2023-10-14T09:38:32.341209+0000","last_peered":"2023-10-14T09:38:32.341209+0000","last_clean":"2023-10-14T09:38:32.341209+0000","last_became_active":"2023-10-14T09:38:31.019732+0000","last_became_peered":"2023-10-14T09:38:31.019732+0000","last_unstale":"2023-10-14T09:38:32.341209+0000","last_undegraded":"2023-10-14T09:38:32.341209+0000","last_fullsized":"2023-10-14T09:38:32.341209+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:39:13.767140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.009471+0000","last_change":"2023-10-14T09:38:30.032802+0000","last_active":"2023-10-14T09:38:31.009471+0000","last_peered":"2023-10-14T09:38:31.009471+0000","last_clean":"2023-10-14T09:38:31.009471+0000","last_became_active":"2023-10-14T09:38:30.032500+0000","last_became_peered":"2023-10-14T09:38:30.032500+0000","last_unstale":"2023-10-14T09:38:31.009471+0000","last_undegraded":"2023-10-14T09:38:31.009471+0000","last_fullsized":"2023-10-14T09:38:31.009471+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:32.881121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342037+0000","last_change":"2023-10-14T09:38:31.030686+0000","last_active":"2023-10-14T09:38:32.342037+0000","last_peered":"2023-10-14T09:38:32.342037+0000","last_clean":"2023-10-14T09:38:32.342037+0000","last_became_active":"2023-10-14T09:38:31.030399+0000","last_became_peered":"2023-10-14T09:38:31.030399+0000","last_unstale":"2023-10-14T09:38:32.342037+0000","last_undegraded":"2023-10-14T09:38:32.342037+0000","last_fullsized":"2023-10-14T09:38:32.342037+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:35.133971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342880+0000","last_change":"2023-10-14T09:38:30.029157+0000","last_active":"2023-10-14T09:38:32.342880+0000","last_peered":"2023-10-14T09:38:32.342880+0000","last_clean":"2023-10-14T09:38:32.342880+0000","last_became_active":"2023-10-14T09:38:30.028540+0000","last_became_peered":"2023-10-14T09:38:30.028540+0000","last_unstale":"2023-10-14T09:38:32.342880+0000","last_undegraded":"2023-10-14T09:38:32.342880+0000","last_fullsized":"2023-10-14T09:38:32.342880+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:11.668342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341394+0000","last_change":"2023-10-14T09:38:31.016140+0000","last_active":"2023-10-14T09:38:32.341394+0000","last_peered":"2023-10-14T09:38:32.341394+0000","last_clean":"2023-10-14T09:38:32.341394+0000","last_became_active":"2023-10-14T09:38:31.015654+0000","last_became_peered":"2023-10-14T09:38:31.015654+0000","last_unstale":"2023-10-14T09:38:32.341394+0000","last_undegraded":"2023-10-14T09:38:32.341394+0000","last_fullsized":"2023-10-14T09:38:32.341394+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:13:35.685099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345030+0000","last_change":"2023-10-14T09:38:30.030703+0000","last_active":"2023-10-14T09:38:32.345030+0000","last_peered":"2023-10-14T09:38:32.345030+0000","last_clean":"2023-10-14T09:38:32.345030+0000","last_became_active":"2023-10-14T09:38:30.030387+0000","last_became_peered":"2023-10-14T09:38:30.030387+0000","last_unstale":"2023-10-14T09:38:32.345030+0000","last_undegraded":"2023-10-14T09:38:32.345030+0000","last_fullsized":"2023-10-14T09:38:32.345030+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344251+0000","last_change":"2023-10-14T09:38:31.024132+0000","last_active":"2023-10-14T09:38:32.344251+0000","last_peered":"2023-10-14T09:38:32.344251+0000","last_clean":"2023-10-14T09:38:32.344251+0000","last_became_active":"2023-10-14T09:38:31.023043+0000","last_became_peered":"2023-10-14T09:38:31.023043+0000","last_unstale":"2023-10-14T09:38:32.344251+0000","last_undegraded":"2023-10-14T09:38:32.344251+0000","last_fullsized":"2023-10-14T09:38:32.344251+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:26:18.683878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:33.929347+0000","last_change":"2023-10-14T09:38:30.024854+0000","last_active":"2023-10-14T09:38:33.929347+0000","last_peered":"2023-10-14T09:38:33.929347+0000","last_clean":"2023-10-14T09:38:33.929347+0000","last_became_active":"2023-10-14T09:38:30.024536+0000","last_became_peered":"2023-10-14T09:38:30.024536+0000","last_unstale":"2023-10-14T09:38:33.929347+0000","last_undegraded":"2023-10-14T09:38:33.929347+0000","last_fullsized":"2023-10-14T09:38:33.929347+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:47:13.277147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345881+0000","last_change":"2023-10-14T09:38:31.024182+0000","last_active":"2023-10-14T09:38:32.345881+0000","last_peered":"2023-10-14T09:38:32.345881+0000","last_clean":"2023-10-14T09:38:32.345881+0000","last_became_active":"2023-10-14T09:38:31.023855+0000","last_became_peered":"2023-10-14T09:38:31.023855+0000","last_unstale":"2023-10-14T09:38:32.345881+0000","last_undegraded":"2023-10-14T09:38:32.345881+0000","last_fullsized":"2023-10-14T09:38:32.345881+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:59:10.045687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344664+0000","last_change":"2023-10-14T09:38:30.023306+0000","last_active":"2023-10-14T09:38:32.344664+0000","last_peered":"2023-10-14T09:38:32.344664+0000","last_clean":"2023-10-14T09:38:32.344664+0000","last_became_active":"2023-10-14T09:38:30.023068+0000","last_became_peered":"2023-10-14T09:38:30.023068+0000","last_unstale":"2023-10-14T09:38:32.344664+0000","last_undegraded":"2023-10-14T09:38:32.344664+0000","last_fullsized":"2023-10-14T09:38:32.344664+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.019849+0000","last_change":"2023-10-14T09:38:31.027123+0000","last_active":"2023-10-14T09:38:32.019849+0000","last_peered":"2023-10-14T09:38:32.019849+0000","last_clean":"2023-10-14T09:38:32.019849+0000","last_became_active":"2023-10-14T09:38:31.026838+0000","last_became_peered":"2023-10-14T09:38:31.026838+0000","last_unstale":"2023-10-14T09:38:32.019849+0000","last_undegraded":"2023-10-14T09:38:32.019849+0000","last_fullsized":"2023-10-14T09:38:32.019849+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:18.314768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345598+0000","last_change":"2023-10-14T09:38:30.029783+0000","last_active":"2023-10-14T09:38:32.345598+0000","last_peered":"2023-10-14T09:38:32.345598+0000","last_clean":"2023-10-14T09:38:32.345598+0000","last_became_active":"2023-10-14T09:38:30.029514+0000","last_became_peered":"2023-10-14T09:38:30.029514+0000","last_unstale":"2023-10-14T09:38:32.345598+0000","last_undegraded":"2023-10-14T09:38:32.345598+0000","last_fullsized":"2023-10-14T09:38:32.345598+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:12:06.845824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345460+0000","last_change":"2023-10-14T09:38:31.030071+0000","last_active":"2023-10-14T09:38:32.345460+0000","last_peered":"2023-10-14T09:38:32.345460+0000","last_clean":"2023-10-14T09:38:32.345460+0000","last_became_active":"2023-10-14T09:38:31.029521+0000","last_became_peered":"2023-10-14T09:38:31.029521+0000","last_unstale":"2023-10-14T09:38:32.345460+0000","last_undegraded":"2023-10-14T09:38:32.345460+0000","last_fullsized":"2023-10-14T09:38:32.345460+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:45:03.414149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342701+0000","last_change":"2023-10-14T09:38:30.030457+0000","last_active":"2023-10-14T09:38:32.342701+0000","last_peered":"2023-10-14T09:38:32.342701+0000","last_clean":"2023-10-14T09:38:32.342701+0000","last_became_active":"2023-10-14T09:38:30.029517+0000","last_became_peered":"2023-10-14T09:38:30.029517+0000","last_unstale":"2023-10-14T09:38:32.342701+0000","last_undegraded":"2023-10-14T09:38:32.342701+0000","last_fullsized":"2023-10-14T09:38:32.342701+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.341965+0000","last_change":"2023-10-14T09:38:31.034569+0000","last_active":"2023-10-14T09:38:32.341965+0000","last_peered":"2023-10-14T09:38:32.341965+0000","last_clean":"2023-10-14T09:38:32.341965+0000","last_became_active":"2023-10-14T09:38:31.034300+0000","last_became_peered":"2023-10-14T09:38:31.034300+0000","last_unstale":"2023-10-14T09:38:32.341965+0000","last_undegraded":"2023-10-14T09:38:32.341965+0000","last_fullsized":"2023-10-14T09:38:32.341965+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:55:53.322273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.009658+0000","last_change":"2023-10-14T09:38:30.030715+0000","last_active":"2023-10-14T09:38:31.009658+0000","last_peered":"2023-10-14T09:38:31.009658+0000","last_clean":"2023-10-14T09:38:31.009658+0000","last_became_active":"2023-10-14T09:38:30.030374+0000","last_became_peered":"2023-10-14T09:38:30.030374+0000","last_unstale":"2023-10-14T09:38:31.009658+0000","last_undegraded":"2023-10-14T09:38:31.009658+0000","last_fullsized":"2023-10-14T09:38:31.009658+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:26:23.409048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.017240+0000","last_change":"2023-10-14T09:38:31.033069+0000","last_active":"2023-10-14T09:38:32.017240+0000","last_peered":"2023-10-14T09:38:32.017240+0000","last_clean":"2023-10-14T09:38:32.017240+0000","last_became_active":"2023-10-14T09:38:31.032648+0000","last_became_peered":"2023-10-14T09:38:31.032648+0000","last_unstale":"2023-10-14T09:38:32.017240+0000","last_undegraded":"2023-10-14T09:38:32.017240+0000","last_fullsized":"2023-10-14T09:38:32.017240+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:32:55.434705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.010423+0000","last_change":"2023-10-14T09:38:30.020581+0000","last_active":"2023-10-14T09:38:31.010423+0000","last_peered":"2023-10-14T09:38:31.010423+0000","last_clean":"2023-10-14T09:38:31.010423+0000","last_became_active":"2023-10-14T09:38:30.020321+0000","last_became_peered":"2023-10-14T09:38:30.020321+0000","last_unstale":"2023-10-14T09:38:31.010423+0000","last_undegraded":"2023-10-14T09:38:31.010423+0000","last_fullsized":"2023-10-14T09:38:31.010423+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:23:26.972323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342673+0000","last_change":"2023-10-14T09:38:31.024792+0000","last_active":"2023-10-14T09:38:32.342673+0000","last_peered":"2023-10-14T09:38:32.342673+0000","last_clean":"2023-10-14T09:38:32.342673+0000","last_became_active":"2023-10-14T09:38:31.024478+0000","last_became_peered":"2023-10-14T09:38:31.024478+0000","last_unstale":"2023-10-14T09:38:32.342673+0000","last_undegraded":"2023-10-14T09:38:32.342673+0000","last_fullsized":"2023-10-14T09:38:32.342673+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:49:22.040318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.015743+0000","last_change":"2023-10-14T09:38:30.033668+0000","last_active":"2023-10-14T09:38:31.015743+0000","last_peered":"2023-10-14T09:38:31.015743+0000","last_clean":"2023-10-14T09:38:31.015743+0000","last_became_active":"2023-10-14T09:38:30.033358+0000","last_became_peered":"2023-10-14T09:38:30.033358+0000","last_unstale":"2023-10-14T09:38:31.015743+0000","last_undegraded":"2023-10-14T09:38:31.015743+0000","last_fullsized":"2023-10-14T09:38:31.015743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:30:03.089452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":177,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:38:31.016331+0000","last_change":"2023-10-14T09:37:12.368000+0000","last_active":"2023-10-14T09:38:31.016331+0000","last_peered":"2023-10-14T09:38:31.016331+0000","last_clean":"2023-10-14T09:38:31.016331+0000","last_became_active":"2023-10-14T09:37:12.364623+0000","last_became_peered":"2023-10-14T09:37:12.364623+0000","last_unstale":"2023-10-14T09:38:31.016331+0000","last_undegraded":"2023-10-14T09:38:31.016331+0000","last_fullsized":"2023-10-14T09:38:31.016331+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:37:10.796841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:37:10.796841+0000","last_clean_scrub_stamp":"2023-10-14T09:37:10.796841+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:48.940536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":999424,"data_stored":748946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":1.4750000000000001},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":1.2070000000000001}]},{"osd":1,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.5549999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":1.6950000000000001}]},{"osd":3,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":1.431},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.9060000000000001,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":1.768}]},{"osd":4,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.633},{"interface":"front","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.52}]},{"osd":5,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":3.0129999999999999,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":1.603},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.387}]},{"osd":6,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.4260000000000002,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":1.7410000000000001},{"interface":"front","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.0710000000000002,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.6699999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509463,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":409600,"data_stored":159104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.84399999999999997}]},{"osd":1,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.0900000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.4540000000000002,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.2},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.248}]},{"osd":3,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":4.5419999999999998,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":4.2839999999999998,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":1.0389999999999999}]},{"osd":4,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":1.5720000000000001}]},{"osd":5,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.7069999999999999,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":1.149},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":1.5269999999999999}]},{"osd":7,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.645},{"interface":"front","average":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.5899999999999999,"5min":2.5899999999999999,"15min":2.5899999999999999},"last":1.472}]}]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":409600,"data_stored":158592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":1.621,"5min":1.621,"15min":1.621},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":13.404,"5min":13.404,"15min":13.404},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":9.4640000000000004,"5min":9.4640000000000004,"15min":9.4640000000000004},"last":0.72599999999999998}]},{"osd":1,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":6.734,"5min":6.734,"15min":6.734},"last":0.998},{"interface":"front","average":{"1min":1.504,"5min":1.504,"15min":1.504},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":7.8860000000000001,"5min":7.8860000000000001,"15min":7.8860000000000001},"last":0.82799999999999996}]},{"osd":2,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":1.591,"5min":1.591,"15min":1.591},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":7.8520000000000003,"5min":7.8520000000000003,"15min":7.8520000000000003},"last":1.056},{"interface":"front","average":{"1min":1.889,"5min":1.889,"15min":1.889},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":14.609,"5min":14.609,"15min":14.609},"last":1.296}]},{"osd":3,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":1.964,"5min":1.964,"15min":1.964},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":15.856,"5min":15.856,"15min":15.856},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":6.1970000000000001,"5min":6.1970000000000001,"15min":6.1970000000000001},"last":1.1180000000000001}]},{"osd":5,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":16.547000000000001,"5min":16.547000000000001,"15min":16.547000000000001},"last":1.2470000000000001},{"interface":"front","average":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":15.913,"5min":15.913,"15min":15.913},"last":1.6240000000000001}]},{"osd":6,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":2.3029999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":16.481999999999999,"5min":16.481999999999999,"15min":16.481999999999999},"last":1.3460000000000001},{"interface":"front","average":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":15.956,"5min":15.956,"15min":15.956},"last":1.5660000000000001}]},{"osd":7,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":6.6520000000000001,"5min":6.6520000000000001,"15min":6.6520000000000001},"last":1.3959999999999999},{"interface":"front","average":{"1min":2.073,"5min":2.073,"15min":2.073},"min":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":10.314,"5min":10.314,"15min":10.314},"last":1.6539999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509462,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":160122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.61499999999999999}]},{"osd":1,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.7349999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":1.147}]},{"osd":2,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":2.77,"5min":2.77,"15min":2.77},"last":1.238}]},{"osd":4,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":0.872},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":2.153,"5min":2.153,"15min":2.153},"last":1.734}]},{"osd":5,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":3.6469999999999998,"5min":3.6469999999999998,"15min":3.6469999999999998},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.0029999999999999}]},{"osd":6,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.988},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":3.6930000000000001,"5min":3.6930000000000001,"15min":3.6930000000000001},"last":1.329}]},{"osd":7,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.4249999999999998,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.107},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.845}]}]},{"osd":2,"up_from":15,"seq":64424509463,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":158558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.7789999999999999,"5min":2.7789999999999999,"15min":2.7789999999999999},"last":0.437},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.36199999999999999}]},{"osd":1,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.3490000000000002,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.505}]},{"osd":3,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.4700000000000002,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.54400000000000004}]},{"osd":4,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.5960000000000001,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":3.1469999999999998,"5min":3.1469999999999998,"15min":3.1469999999999998},"last":0.91300000000000003}]},{"osd":5,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":4.0800000000000001,"5min":4.0800000000000001,"15min":4.0800000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":3.6709999999999998,"5min":3.6709999999999998,"15min":3.6709999999999998},"last":1.105}]},{"osd":6,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.9249999999999998,"5min":2.9249999999999998,"15min":2.9249999999999998},"last":1.048},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":3.081,"5min":3.081,"15min":3.081},"last":0.76700000000000002}]},{"osd":7,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":5.0650000000000004,"5min":5.0650000000000004,"15min":5.0650000000000004},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":3.8849999999999998,"5min":3.8849999999999998,"15min":3.8849999999999998},"last":1.071}]}]},{"osd":1,"up_from":15,"seq":64424509463,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":160122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":1.331},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.3640000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.4490000000000001},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.90100000000000002}]},{"osd":3,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":3.1499999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.5129999999999999},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.087}]},{"osd":4,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":3.7320000000000002,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.03}]},{"osd":5,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":3.02,"5min":3.02,"15min":3.02},"last":1.298},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":3.827,"5min":3.827,"15min":3.827},"last":1.5660000000000001}]},{"osd":6,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":3.3250000000000002,"5min":3.3250000000000002,"15min":3.3250000000000002},"last":1.216}]},{"osd":7,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":3.9100000000000001,"5min":3.9100000000000001,"15min":3.9100000000000001},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":3.105,"5min":3.105,"15min":3.105},"last":1.486}]}]},{"osd":5,"up_from":14,"seq":60129542166,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":159160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.88},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.302}]},{"osd":1,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":1.1870000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":4.4610000000000003,"5min":4.4610000000000003,"15min":4.4610000000000003},"last":1.119},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.91600000000000004}]},{"osd":3,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":1.014},{"interface":"front","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.236}]},{"osd":4,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":1.417},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.494}]},{"osd":6,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":1.5489999999999999}]},{"osd":7,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":2.387,"5min":2.387,"15min":2.387},"last":1.5760000000000001},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.46}]}]},{"osd":0,"up_from":14,"seq":60129542166,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":995328,"data_stored":748856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":3.0750000000000002,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.2919999999999998,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.45600000000000002}]},{"osd":2,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":4.2210000000000001,"5min":4.2210000000000001,"15min":4.2210000000000001},"last":0.432}]},{"osd":3,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":3.6070000000000002,"5min":3.6070000000000002,"15min":3.6070000000000002},"last":0.57699999999999996},{"interface":"front","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.50900000000000001}]},{"osd":4,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":4.1609999999999996,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":2.391,"5min":2.391,"15min":2.391},"last":0.69199999999999995}]},{"osd":5,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":3.8620000000000001,"5min":3.8620000000000001,"15min":3.8620000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":2.4220000000000002,"5min":2.4220000000000002,"15min":2.4220000000000002},"last":0.84499999999999997}]},{"osd":6,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":3.8210000000000002,"5min":3.8210000000000002,"15min":3.8210000000000002},"last":0.626},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"min":{"1min":0.997,"5min":0.997,"15min":0.997},"max":{"1min":4.0999999999999996,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":0.73999999999999999}]},{"osd":7,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":1.581,"15min":1.581},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":4.1920000000000002,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":0.76900000000000002},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.0269999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T09:38:49.590 INFO:tasks.ceph:pgid 5.3f last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.590 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.591 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.591 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.591 INFO:tasks.ceph:pgid 5.3b last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.592 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.592 INFO:tasks.ceph:pgid 5.39 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.592 INFO:tasks.ceph:pgid 5.38 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.593 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.593 INFO:tasks.ceph:pgid 5.36 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.594 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.594 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.594 INFO:tasks.ceph:pgid 5.33 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.595 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.595 INFO:tasks.ceph:pgid 5.31 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.596 INFO:tasks.ceph:pgid 5.30 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.596 INFO:tasks.ceph:pgid 5.2f last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.596 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.597 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.597 INFO:tasks.ceph:pgid 5.2c last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.597 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.598 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.598 INFO:tasks.ceph:pgid 5.29 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.599 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.599 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.599 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.600 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.600 INFO:tasks.ceph:pgid 5.24 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.600 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.601 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.601 INFO:tasks.ceph:pgid 5.21 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.601 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.602 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.602 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-10-14T09:38:28.965497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=28, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.603 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.603 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-10-14T09:38:28.965497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=28, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.603 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.604 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-10-14T09:38:28.965497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=28, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.604 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.604 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-10-14T09:38:28.965497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=28, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.605 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.605 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-10-14T09:38:28.965497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=28, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.605 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.606 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-10-14T09:38:28.965497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=28, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.606 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.607 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-10-14T09:38:28.965497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=28, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.607 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.608 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-10-14T09:38:28.965497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=28, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.608 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.608 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-10-14T09:38:28.965497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=28, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.609 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.609 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-10-14T09:38:28.965497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=28, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.610 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.610 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-10-14T09:38:28.965497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=28, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.610 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.611 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-10-14T09:38:28.965497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=28, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.611 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.612 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-10-14T09:38:28.965497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=28, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.612 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.612 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-10-14T09:38:28.965497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=28, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.613 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.613 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-10-14T09:38:28.965497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=28, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.614 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.614 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-10-14T09:38:28.965497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=28, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.614 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.615 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-10-14T09:38:28.965497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=28, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.615 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.615 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-10-14T09:38:28.965497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=28, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.616 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.616 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-10-14T09:38:28.965497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=28, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.617 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.617 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-10-14T09:38:28.965497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=28, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.617 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.618 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-10-14T09:38:28.965497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=28, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.618 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.619 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-10-14T09:38:28.965497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=28, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.619 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.619 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-10-14T09:38:28.965497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=28, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.620 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.620 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-10-14T09:38:28.965497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=28, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.620 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.621 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-10-14T09:38:28.965497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=28, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.621 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.622 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-10-14T09:38:28.965497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=28, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.622 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.622 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-10-14T09:38:28.965497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=28, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.623 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.623 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-10-14T09:38:28.965497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=28, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.624 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.624 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-10-14T09:38:28.965497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=28, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.624 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.625 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-10-14T09:38:28.965497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=28, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.625 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.626 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-10-14T09:38:28.965497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=28, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.626 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.626 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-10-14T09:38:28.965497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=28, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.627 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T09:37:10.796841+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=37, tm_sec=10, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:38:49.627 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:39:01.730 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T09:39:01.740 DEBUG:teuthology.orchestra.run.smithi129:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T09:39:09.628 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:39:09.850 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.848+0000 7f2399c83640 1 Processor -- start 2023-10-14T09:39:09.850 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.848+0000 7f2399c83640 1 -- start start 2023-10-14T09:39:09.851 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.849+0000 7f2399c83640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2394159f00 0x7f23940b0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:39:09.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.849+0000 7f2399c83640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f239415d880 0x7f23940b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:39:09.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.849+0000 7f2399c83640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f239406f7f0 con 0x7f2394159b20 2023-10-14T09:39:09.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.849+0000 7f2399c83640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f239406c5e0 con 0x7f239415d880 2023-10-14T09:39:09.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.849+0000 7f2399c83640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f239406c8c0 con 0x7f2394159f00 2023-10-14T09:39:09.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.850+0000 7f2393fff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f239415d880 0x7f23940b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:39:09.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.850+0000 7f238affd640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2394159f00 0x7f23940b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:39:09.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.850+0000 7f2393fff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f239415d880 0x7f23940b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.102:34394/0 (socket says 172.21.15.102:34394) 2023-10-14T09:39:09.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.850+0000 7f238affd640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2394159f00 0x7f23940b0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.102:47082/0 (socket says 172.21.15.102:47082) 2023-10-14T09:39:09.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.850+0000 7f2393fff640 1 -- 172.21.15.102:0/1795976169 learned_addr learned my addr 172.21.15.102:0/1795976169 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:39:09.855 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.851+0000 7f238affd640 1 -- 172.21.15.102:0/1795976169 >> v2:172.21.15.129:3300/0 conn(0x7f239415d880 msgr2=0x7f23940b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:39:09.857 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.851+0000 7f238affd640 1 --2- 172.21.15.102:0/1795976169 >> v2:172.21.15.129:3300/0 conn(0x7f239415d880 0x7f23940b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:39:09.857 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.851+0000 7f238affd640 1 -- 172.21.15.102:0/1795976169 >> v1:172.21.15.129:6789/0 conn(0x7f2394159b20 legacy=0x7f239406bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:39:09.857 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.851+0000 7f238affd640 1 -- 172.21.15.102:0/1795976169 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f239406cba0 con 0x7f2394159f00 2023-10-14T09:39:09.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.852+0000 7f238affd640 1 --2- 172.21.15.102:0/1795976169 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2394159f00 0x7f23940b0410 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f237c0097a0 tx=0x7f237c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ceb5923aaa74ada server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:39:09.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.853+0000 7f2392ffd640 1 -- 172.21.15.102:0/1795976169 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c031830 con 0x7f2394159f00 2023-10-14T09:39:09.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.853+0000 7f2392ffd640 1 -- 172.21.15.102:0/1795976169 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237c031990 con 0x7f2394159f00 2023-10-14T09:39:09.859 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.853+0000 7f2392ffd640 1 -- 172.21.15.102:0/1795976169 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c031d20 con 0x7f2394159f00 2023-10-14T09:39:09.859 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.853+0000 7f2399c83640 1 -- 172.21.15.102:0/1795976169 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2394159f00 msgr2=0x7f23940b0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:39:09.859 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.853+0000 7f2399c83640 1 --2- 172.21.15.102:0/1795976169 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2394159f00 0x7f23940b0410 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f237c0097a0 tx=0x7f237c02b8d0 comp rx=0 tx=0).stop 2023-10-14T09:39:09.859 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.853+0000 7f2399c83640 1 -- 172.21.15.102:0/1795976169 shutdown_connections 2023-10-14T09:39:09.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.853+0000 7f2399c83640 1 --2- 172.21.15.102:0/1795976169 >> v2:172.21.15.129:3300/0 conn(0x7f239415d880 0x7f23940b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:39:09.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.853+0000 7f2399c83640 1 --2- 172.21.15.102:0/1795976169 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2394159f00 0x7f23940b0410 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:39:09.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.853+0000 7f2399c83640 1 -- 172.21.15.102:0/1795976169 >> 172.21.15.102:0/1795976169 conn(0x7f23940cb410 msgr2=0x7f23940cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:39:09.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.854+0000 7f2399c83640 1 -- 172.21.15.102:0/1795976169 shutdown_connections 2023-10-14T09:39:09.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.854+0000 7f2399c83640 1 -- 172.21.15.102:0/1795976169 wait complete. 2023-10-14T09:39:09.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.855+0000 7f2399c83640 1 Processor -- start 2023-10-14T09:39:09.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.855+0000 7f2399c83640 1 -- start start 2023-10-14T09:39:09.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.856+0000 7f2399c83640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2394159b20 0x7f2394153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:39:09.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.856+0000 7f2399c83640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2394159f00 0x7f239414fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:39:09.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.856+0000 7f2399c83640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f239415d880 0x7f23940af710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:39:09.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.856+0000 7f2399c83640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23940b3800 con 0x7f239415d880 2023-10-14T09:39:09.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.856+0000 7f2399c83640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23940b3240 con 0x7f2394159f00 2023-10-14T09:39:09.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.856+0000 7f2399c83640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23940b3520 con 0x7f2394159b20 2023-10-14T09:39:09.866 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.857+0000 7f2393fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f239415d880 0x7f23940af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:39:09.866 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.857+0000 7f2393fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f239415d880 0x7f23940af710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47246/0 (socket says 172.21.15.102:47246) 2023-10-14T09:39:09.866 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.857+0000 7f2393fff640 1 -- 172.21.15.102:0/2787894444 learned_addr learned my addr 172.21.15.102:0/2787894444 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:39:09.866 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.857+0000 7f238affd640 1 --2- 172.21.15.102:0/2787894444 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2394159f00 0x7f239414fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:39:09.867 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.857+0000 7f23937fe640 1 --2- 172.21.15.102:0/2787894444 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2394159b20 0x7f2394153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:39:09.867 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.857+0000 7f2393fff640 1 -- 172.21.15.102:0/2787894444 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2394159b20 msgr2=0x7f2394153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:39:09.867 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.857+0000 7f2393fff640 1 --2- 172.21.15.102:0/2787894444 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2394159b20 0x7f2394153190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:39:09.868 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.857+0000 7f2393fff640 1 -- 172.21.15.102:0/2787894444 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2394159f00 msgr2=0x7f239414fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:39:09.868 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.857+0000 7f2393fff640 1 --2- 172.21.15.102:0/2787894444 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2394159f00 0x7f239414fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:39:09.868 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.857+0000 7f2393fff640 1 -- 172.21.15.102:0/2787894444 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f237c009400 con 0x7f239415d880 2023-10-14T09:39:09.868 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.857+0000 7f23937fe640 1 --2- 172.21.15.102:0/2787894444 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2394159b20 0x7f2394153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:39:09.869 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.858+0000 7f2393fff640 1 --2- 172.21.15.102:0/2787894444 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f239415d880 0x7f23940af710 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f238c00efc0 tx=0x7f238c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:39:09.869 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.858+0000 7f2390ff9640 1 -- 172.21.15.102:0/2787894444 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c009b60 con 0x7f239415d880 2023-10-14T09:39:09.869 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.858+0000 7f2390ff9640 1 -- 172.21.15.102:0/2787894444 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238c00f040 con 0x7f239415d880 2023-10-14T09:39:09.870 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.858+0000 7f2390ff9640 1 -- 172.21.15.102:0/2787894444 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c003990 con 0x7f239415d880 2023-10-14T09:39:09.870 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.858+0000 7f2399c83640 1 -- 172.21.15.102:0/2787894444 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2394157070 con 0x7f239415d880 2023-10-14T09:39:09.870 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.858+0000 7f2399c83640 1 -- 172.21.15.102:0/2787894444 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23941536d0 con 0x7f239415d880 2023-10-14T09:39:09.870 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.859+0000 7f2399c83640 1 -- 172.21.15.102:0/2787894444 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2394157590 con 0x7f239415d880 2023-10-14T09:39:09.871 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.860+0000 7f2390ff9640 1 -- 172.21.15.102:0/2787894444 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f238c003af0 con 0x7f239415d880 2023-10-14T09:39:09.871 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.861+0000 7f2390ff9640 1 --2- 172.21.15.102:0/2787894444 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f237406ae70 0x7f237406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:39:09.871 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.861+0000 7f2390ff9640 1 -- 172.21.15.102:0/2787894444 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f238c089c20 con 0x7f239415d880 2023-10-14T09:39:09.871 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.862+0000 7f23937fe640 1 --2- 172.21.15.102:0/2787894444 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f237406ae70 0x7f237406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:39:09.872 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.862+0000 7f23937fe640 1 --2- 172.21.15.102:0/2787894444 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f237406ae70 0x7f237406d330 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2384001680 tx=0x7f2384009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:39:09.872 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:09.868+0000 7f2390ff9640 1 -- 172.21.15.102:0/2787894444 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2394157590 con 0x7f239415d880 2023-10-14T09:39:10.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:10.058+0000 7f2399c83640 1 -- 172.21.15.102:0/2787894444 --> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f239406c2f0 con 0x7f237406ae70 2023-10-14T09:39:10.073 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:10.071+0000 7f2390ff9640 1 -- 172.21.15.102:0/2787894444 <== mgr.4104 v2:172.21.15.102:6832/1125265706 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286944 (secure 0 0 0) 0x7f2384001c60 con 0x7f237406ae70 2023-10-14T09:39:10.077 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:39:10.078 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2023-10-14T09:39:10.080 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:10.077+0000 7f2399c83640 1 -- 172.21.15.102:0/2787894444 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f237406ae70 msgr2=0x7f237406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:39:10.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:10.077+0000 7f2399c83640 1 --2- 172.21.15.102:0/2787894444 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f237406ae70 0x7f237406d330 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2384001680 tx=0x7f2384009040 comp rx=0 tx=0).stop 2023-10-14T09:39:10.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:10.077+0000 7f2399c83640 1 -- 172.21.15.102:0/2787894444 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f239415d880 msgr2=0x7f23940af710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:39:10.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:10.077+0000 7f2399c83640 1 --2- 172.21.15.102:0/2787894444 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f239415d880 0x7f23940af710 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f238c00efc0 tx=0x7f238c00c490 comp rx=0 tx=0).stop 2023-10-14T09:39:10.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:10.077+0000 7f2399c83640 1 -- 172.21.15.102:0/2787894444 shutdown_connections 2023-10-14T09:39:10.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:10.077+0000 7f2399c83640 1 --2- 172.21.15.102:0/2787894444 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f237406ae70 0x7f237406d330 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:39:10.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:10.077+0000 7f2399c83640 1 --2- 172.21.15.102:0/2787894444 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f239415d880 0x7f23940af710 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:39:10.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:10.077+0000 7f2399c83640 1 --2- 172.21.15.102:0/2787894444 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2394159f00 0x7f239414fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:39:10.083 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:10.077+0000 7f2399c83640 1 --2- 172.21.15.102:0/2787894444 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2394159b20 0x7f2394153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:39:10.083 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:10.077+0000 7f2399c83640 1 -- 172.21.15.102:0/2787894444 >> 172.21.15.102:0/2787894444 conn(0x7f23940cb410 msgr2=0x7f23940cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:39:10.083 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:10.077+0000 7f2399c83640 1 -- 172.21.15.102:0/2787894444 shutdown_connections 2023-10-14T09:39:10.084 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:10.077+0000 7f2399c83640 1 -- 172.21.15.102:0/2787894444 wait complete. 2023-10-14T09:39:10.097 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2023-10-14T09:39:09.910707+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220488,"kb_used_data":4360,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754232,"statfs":{"total":773094113280,"available":772868333568,"internally_reserved":0,"allocated":4464640,"data_stored":2453460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004299"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.933564+0000","last_change":"2023-10-14T09:38:31.026111+0000","last_active":"2023-10-14T09:38:34.933564+0000","last_peered":"2023-10-14T09:38:34.933564+0000","last_clean":"2023-10-14T09:38:34.933564+0000","last_became_active":"2023-10-14T09:38:31.023780+0000","last_became_peered":"2023-10-14T09:38:31.023780+0000","last_unstale":"2023-10-14T09:38:34.933564+0000","last_undegraded":"2023-10-14T09:38:34.933564+0000","last_fullsized":"2023-10-14T09:38:34.933564+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.925742+0000","last_change":"2023-10-14T09:38:31.028205+0000","last_active":"2023-10-14T09:38:34.925742+0000","last_peered":"2023-10-14T09:38:34.925742+0000","last_clean":"2023-10-14T09:38:34.925742+0000","last_became_active":"2023-10-14T09:38:31.027820+0000","last_became_peered":"2023-10-14T09:38:31.027820+0000","last_unstale":"2023-10-14T09:38:34.925742+0000","last_undegraded":"2023-10-14T09:38:34.925742+0000","last_fullsized":"2023-10-14T09:38:34.925742+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:04.176269+0000","last_change":"2023-10-14T09:39:04.176464+0000","last_active":"2023-10-14T09:39:04.176269+0000","last_peered":"2023-10-14T09:39:04.176269+0000","last_clean":"2023-10-14T09:39:04.176269+0000","last_became_active":"2023-10-14T09:38:31.019892+0000","last_became_peered":"2023-10-14T09:38:31.019892+0000","last_unstale":"2023-10-14T09:39:04.176269+0000","last_undegraded":"2023-10-14T09:39:04.176269+0000","last_fullsized":"2023-10-14T09:39:04.176269+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:04.176059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:04.176059+0000","last_clean_scrub_stamp":"2023-10-14T09:39:04.176059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:01.866021+0000","scrub_duration":0.0038494269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.926556+0000","last_change":"2023-10-14T09:38:31.035562+0000","last_active":"2023-10-14T09:38:34.926556+0000","last_peered":"2023-10-14T09:38:34.926556+0000","last_clean":"2023-10-14T09:38:34.926556+0000","last_became_active":"2023-10-14T09:38:31.035189+0000","last_became_peered":"2023-10-14T09:38:31.035189+0000","last_unstale":"2023-10-14T09:38:34.926556+0000","last_undegraded":"2023-10-14T09:38:34.926556+0000","last_fullsized":"2023-10-14T09:38:34.926556+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.927247+0000","last_change":"2023-10-14T09:38:31.023485+0000","last_active":"2023-10-14T09:38:34.927247+0000","last_peered":"2023-10-14T09:38:34.927247+0000","last_clean":"2023-10-14T09:38:34.927247+0000","last_became_active":"2023-10-14T09:38:31.020777+0000","last_became_peered":"2023-10-14T09:38:31.020777+0000","last_unstale":"2023-10-14T09:38:34.927247+0000","last_undegraded":"2023-10-14T09:38:34.927247+0000","last_fullsized":"2023-10-14T09:38:34.927247+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.925590+0000","last_change":"2023-10-14T09:38:31.028808+0000","last_active":"2023-10-14T09:38:34.925590+0000","last_peered":"2023-10-14T09:38:34.925590+0000","last_clean":"2023-10-14T09:38:34.925590+0000","last_became_active":"2023-10-14T09:38:31.027342+0000","last_became_peered":"2023-10-14T09:38:31.027342+0000","last_unstale":"2023-10-14T09:38:34.925590+0000","last_undegraded":"2023-10-14T09:38:34.925590+0000","last_fullsized":"2023-10-14T09:38:34.925590+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.938312+0000","last_change":"2023-10-14T09:38:31.035347+0000","last_active":"2023-10-14T09:38:34.938312+0000","last_peered":"2023-10-14T09:38:34.938312+0000","last_clean":"2023-10-14T09:38:34.938312+0000","last_became_active":"2023-10-14T09:38:31.033760+0000","last_became_peered":"2023-10-14T09:38:31.033760+0000","last_unstale":"2023-10-14T09:38:34.938312+0000","last_undegraded":"2023-10-14T09:38:34.938312+0000","last_fullsized":"2023-10-14T09:38:34.938312+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:53.242083+0000","last_change":"2023-10-14T09:38:53.242193+0000","last_active":"2023-10-14T09:38:53.242083+0000","last_peered":"2023-10-14T09:38:53.242083+0000","last_clean":"2023-10-14T09:38:53.242083+0000","last_became_active":"2023-10-14T09:38:31.024702+0000","last_became_peered":"2023-10-14T09:38:31.024702+0000","last_unstale":"2023-10-14T09:38:53.242083+0000","last_undegraded":"2023-10-14T09:38:53.242083+0000","last_fullsized":"2023-10-14T09:38:53.242083+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:53.241901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:53.241901+0000","last_clean_scrub_stamp":"2023-10-14T09:38:53.241901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:24:15.099376+0000","scrub_duration":0.0037239859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.932636+0000","last_change":"2023-10-14T09:38:31.024329+0000","last_active":"2023-10-14T09:38:34.932636+0000","last_peered":"2023-10-14T09:38:34.932636+0000","last_clean":"2023-10-14T09:38:34.932636+0000","last_became_active":"2023-10-14T09:38:31.023498+0000","last_became_peered":"2023-10-14T09:38:31.023498+0000","last_unstale":"2023-10-14T09:38:34.932636+0000","last_undegraded":"2023-10-14T09:38:34.932636+0000","last_fullsized":"2023-10-14T09:38:34.932636+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.926733+0000","last_change":"2023-10-14T09:38:31.029616+0000","last_active":"2023-10-14T09:38:34.926733+0000","last_peered":"2023-10-14T09:38:34.926733+0000","last_clean":"2023-10-14T09:38:34.926733+0000","last_became_active":"2023-10-14T09:38:31.029268+0000","last_became_peered":"2023-10-14T09:38:31.029268+0000","last_unstale":"2023-10-14T09:38:34.926733+0000","last_undegraded":"2023-10-14T09:38:34.926733+0000","last_fullsized":"2023-10-14T09:38:34.926733+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:54.281412+0000","last_change":"2023-10-14T09:38:54.281549+0000","last_active":"2023-10-14T09:38:54.281412+0000","last_peered":"2023-10-14T09:38:54.281412+0000","last_clean":"2023-10-14T09:38:54.281412+0000","last_became_active":"2023-10-14T09:38:31.033343+0000","last_became_peered":"2023-10-14T09:38:31.033343+0000","last_unstale":"2023-10-14T09:38:54.281412+0000","last_undegraded":"2023-10-14T09:38:54.281412+0000","last_fullsized":"2023-10-14T09:38:54.281412+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:54.281200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:54.281200+0000","last_clean_scrub_stamp":"2023-10-14T09:38:54.281200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:56:08.772956+0000","scrub_duration":0.003963818,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:02.146816+0000","last_change":"2023-10-14T09:39:02.146946+0000","last_active":"2023-10-14T09:39:02.146816+0000","last_peered":"2023-10-14T09:39:02.146816+0000","last_clean":"2023-10-14T09:39:02.146816+0000","last_became_active":"2023-10-14T09:38:31.017971+0000","last_became_peered":"2023-10-14T09:38:31.017971+0000","last_unstale":"2023-10-14T09:39:02.146816+0000","last_undegraded":"2023-10-14T09:39:02.146816+0000","last_fullsized":"2023-10-14T09:39:02.146816+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:02.146634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:02.146634+0000","last_clean_scrub_stamp":"2023-10-14T09:39:02.146634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:38:25.497182+0000","scrub_duration":0.0038723500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:49.533192+0000","last_change":"2023-10-14T09:38:49.533292+0000","last_active":"2023-10-14T09:38:49.533192+0000","last_peered":"2023-10-14T09:38:49.533192+0000","last_clean":"2023-10-14T09:38:49.533192+0000","last_became_active":"2023-10-14T09:38:31.019186+0000","last_became_peered":"2023-10-14T09:38:31.019186+0000","last_unstale":"2023-10-14T09:38:49.533192+0000","last_undegraded":"2023-10-14T09:38:49.533192+0000","last_fullsized":"2023-10-14T09:38:49.533192+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:49.532907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:49.532907+0000","last_clean_scrub_stamp":"2023-10-14T09:38:49.532907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:50:05.598559+0000","scrub_duration":0.0024617720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.925631+0000","last_change":"2023-10-14T09:38:31.020718+0000","last_active":"2023-10-14T09:38:34.925631+0000","last_peered":"2023-10-14T09:38:34.925631+0000","last_clean":"2023-10-14T09:38:34.925631+0000","last_became_active":"2023-10-14T09:38:31.020409+0000","last_became_peered":"2023-10-14T09:38:31.020409+0000","last_unstale":"2023-10-14T09:38:34.925631+0000","last_undegraded":"2023-10-14T09:38:34.925631+0000","last_fullsized":"2023-10-14T09:38:34.925631+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:33.928622+0000","last_change":"2023-10-14T09:38:31.025489+0000","last_active":"2023-10-14T09:38:33.928622+0000","last_peered":"2023-10-14T09:38:33.928622+0000","last_clean":"2023-10-14T09:38:33.928622+0000","last_became_active":"2023-10-14T09:38:31.025155+0000","last_became_peered":"2023-10-14T09:38:31.025155+0000","last_unstale":"2023-10-14T09:38:33.928622+0000","last_undegraded":"2023-10-14T09:38:33.928622+0000","last_fullsized":"2023-10-14T09:38:33.928622+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:00.295754+0000","last_change":"2023-10-14T09:39:00.295945+0000","last_active":"2023-10-14T09:39:00.295754+0000","last_peered":"2023-10-14T09:39:00.295754+0000","last_clean":"2023-10-14T09:39:00.295754+0000","last_became_active":"2023-10-14T09:38:31.033869+0000","last_became_peered":"2023-10-14T09:38:31.033869+0000","last_unstale":"2023-10-14T09:39:00.295754+0000","last_undegraded":"2023-10-14T09:39:00.295754+0000","last_fullsized":"2023-10-14T09:39:00.295754+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:00.295522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:00.295522+0000","last_clean_scrub_stamp":"2023-10-14T09:39:00.295522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:12:26.055534+0000","scrub_duration":0.0036621850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:58.255288+0000","last_change":"2023-10-14T09:38:58.255392+0000","last_active":"2023-10-14T09:38:58.255288+0000","last_peered":"2023-10-14T09:38:58.255288+0000","last_clean":"2023-10-14T09:38:58.255288+0000","last_became_active":"2023-10-14T09:38:31.029457+0000","last_became_peered":"2023-10-14T09:38:31.029457+0000","last_unstale":"2023-10-14T09:38:58.255288+0000","last_undegraded":"2023-10-14T09:38:58.255288+0000","last_fullsized":"2023-10-14T09:38:58.255288+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:58.255108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:58.255108+0000","last_clean_scrub_stamp":"2023-10-14T09:38:58.255108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:10:17.655904+0000","scrub_duration":0.0033634659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.925763+0000","last_change":"2023-10-14T09:38:31.033346+0000","last_active":"2023-10-14T09:38:34.925763+0000","last_peered":"2023-10-14T09:38:34.925763+0000","last_clean":"2023-10-14T09:38:34.925763+0000","last_became_active":"2023-10-14T09:38:31.033040+0000","last_became_peered":"2023-10-14T09:38:31.033040+0000","last_unstale":"2023-10-14T09:38:34.925763+0000","last_undegraded":"2023-10-14T09:38:34.925763+0000","last_fullsized":"2023-10-14T09:38:34.925763+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.925710+0000","last_change":"2023-10-14T09:38:31.026010+0000","last_active":"2023-10-14T09:38:34.925710+0000","last_peered":"2023-10-14T09:38:34.925710+0000","last_clean":"2023-10-14T09:38:34.925710+0000","last_became_active":"2023-10-14T09:38:31.025735+0000","last_became_peered":"2023-10-14T09:38:31.025735+0000","last_unstale":"2023-10-14T09:38:34.925710+0000","last_undegraded":"2023-10-14T09:38:34.925710+0000","last_fullsized":"2023-10-14T09:38:34.925710+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:59.645885+0000","last_change":"2023-10-14T09:38:59.645989+0000","last_active":"2023-10-14T09:38:59.645885+0000","last_peered":"2023-10-14T09:38:59.645885+0000","last_clean":"2023-10-14T09:38:59.645885+0000","last_became_active":"2023-10-14T09:38:31.011363+0000","last_became_peered":"2023-10-14T09:38:31.011363+0000","last_unstale":"2023-10-14T09:38:59.645885+0000","last_undegraded":"2023-10-14T09:38:59.645885+0000","last_fullsized":"2023-10-14T09:38:59.645885+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:59.645701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:59.645701+0000","last_clean_scrub_stamp":"2023-10-14T09:38:59.645701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:06:09.913970+0000","scrub_duration":0.0038696870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.932338+0000","last_change":"2023-10-14T09:38:31.021882+0000","last_active":"2023-10-14T09:38:34.932338+0000","last_peered":"2023-10-14T09:38:34.932338+0000","last_clean":"2023-10-14T09:38:34.932338+0000","last_became_active":"2023-10-14T09:38:31.021555+0000","last_became_peered":"2023-10-14T09:38:31.021555+0000","last_unstale":"2023-10-14T09:38:34.932338+0000","last_undegraded":"2023-10-14T09:38:34.932338+0000","last_fullsized":"2023-10-14T09:38:34.932338+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.932301+0000","last_change":"2023-10-14T09:38:31.029992+0000","last_active":"2023-10-14T09:38:34.932301+0000","last_peered":"2023-10-14T09:38:34.932301+0000","last_clean":"2023-10-14T09:38:34.932301+0000","last_became_active":"2023-10-14T09:38:31.029712+0000","last_became_peered":"2023-10-14T09:38:31.029712+0000","last_unstale":"2023-10-14T09:38:34.932301+0000","last_undegraded":"2023-10-14T09:38:34.932301+0000","last_fullsized":"2023-10-14T09:38:34.932301+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:57.630740+0000","last_change":"2023-10-14T09:38:57.630848+0000","last_active":"2023-10-14T09:38:57.630740+0000","last_peered":"2023-10-14T09:38:57.630740+0000","last_clean":"2023-10-14T09:38:57.630740+0000","last_became_active":"2023-10-14T09:38:31.023251+0000","last_became_peered":"2023-10-14T09:38:31.023251+0000","last_unstale":"2023-10-14T09:38:57.630740+0000","last_undegraded":"2023-10-14T09:38:57.630740+0000","last_fullsized":"2023-10-14T09:38:57.630740+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:57.630577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:57.630577+0000","last_clean_scrub_stamp":"2023-10-14T09:38:57.630577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:23:32.551600+0000","scrub_duration":0.0038587109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:33.928556+0000","last_change":"2023-10-14T09:38:31.011612+0000","last_active":"2023-10-14T09:38:33.928556+0000","last_peered":"2023-10-14T09:38:33.928556+0000","last_clean":"2023-10-14T09:38:33.928556+0000","last_became_active":"2023-10-14T09:38:31.010860+0000","last_became_peered":"2023-10-14T09:38:31.010860+0000","last_unstale":"2023-10-14T09:38:33.928556+0000","last_undegraded":"2023-10-14T09:38:33.928556+0000","last_fullsized":"2023-10-14T09:38:33.928556+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.926771+0000","last_change":"2023-10-14T09:38:31.023722+0000","last_active":"2023-10-14T09:38:34.926771+0000","last_peered":"2023-10-14T09:38:34.926771+0000","last_clean":"2023-10-14T09:38:34.926771+0000","last_became_active":"2023-10-14T09:38:31.023469+0000","last_became_peered":"2023-10-14T09:38:31.023469+0000","last_unstale":"2023-10-14T09:38:34.926771+0000","last_undegraded":"2023-10-14T09:38:34.926771+0000","last_fullsized":"2023-10-14T09:38:34.926771+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.925843+0000","last_change":"2023-10-14T09:38:31.028525+0000","last_active":"2023-10-14T09:38:34.925843+0000","last_peered":"2023-10-14T09:38:34.925843+0000","last_clean":"2023-10-14T09:38:34.925843+0000","last_became_active":"2023-10-14T09:38:31.026660+0000","last_became_peered":"2023-10-14T09:38:31.026660+0000","last_unstale":"2023-10-14T09:38:34.925843+0000","last_undegraded":"2023-10-14T09:38:34.925843+0000","last_fullsized":"2023-10-14T09:38:34.925843+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.926654+0000","last_change":"2023-10-14T09:38:31.026064+0000","last_active":"2023-10-14T09:38:34.926654+0000","last_peered":"2023-10-14T09:38:34.926654+0000","last_clean":"2023-10-14T09:38:34.926654+0000","last_became_active":"2023-10-14T09:38:31.025680+0000","last_became_peered":"2023-10-14T09:38:31.025680+0000","last_unstale":"2023-10-14T09:38:34.926654+0000","last_undegraded":"2023-10-14T09:38:34.926654+0000","last_fullsized":"2023-10-14T09:38:34.926654+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:33.928728+0000","last_change":"2023-10-14T09:38:31.022957+0000","last_active":"2023-10-14T09:38:33.928728+0000","last_peered":"2023-10-14T09:38:33.928728+0000","last_clean":"2023-10-14T09:38:33.928728+0000","last_became_active":"2023-10-14T09:38:31.022641+0000","last_became_peered":"2023-10-14T09:38:31.022641+0000","last_unstale":"2023-10-14T09:38:33.928728+0000","last_undegraded":"2023-10-14T09:38:33.928728+0000","last_fullsized":"2023-10-14T09:38:33.928728+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.932360+0000","last_change":"2023-10-14T09:38:31.031585+0000","last_active":"2023-10-14T09:38:34.932360+0000","last_peered":"2023-10-14T09:38:34.932360+0000","last_clean":"2023-10-14T09:38:34.932360+0000","last_became_active":"2023-10-14T09:38:31.031302+0000","last_became_peered":"2023-10-14T09:38:31.031302+0000","last_unstale":"2023-10-14T09:38:34.932360+0000","last_undegraded":"2023-10-14T09:38:34.932360+0000","last_fullsized":"2023-10-14T09:38:34.932360+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:01.297360+0000","last_change":"2023-10-14T09:39:01.297588+0000","last_active":"2023-10-14T09:39:01.297360+0000","last_peered":"2023-10-14T09:39:01.297360+0000","last_clean":"2023-10-14T09:39:01.297360+0000","last_became_active":"2023-10-14T09:38:31.029493+0000","last_became_peered":"2023-10-14T09:38:31.029493+0000","last_unstale":"2023-10-14T09:39:01.297360+0000","last_undegraded":"2023-10-14T09:39:01.297360+0000","last_fullsized":"2023-10-14T09:39:01.297360+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:01.297099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:01.297099+0000","last_clean_scrub_stamp":"2023-10-14T09:39:01.297099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:00:00.912022+0000","scrub_duration":0.0036701279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:01.810535+0000","last_change":"2023-10-14T09:39:01.810634+0000","last_active":"2023-10-14T09:39:01.810535+0000","last_peered":"2023-10-14T09:39:01.810535+0000","last_clean":"2023-10-14T09:39:01.810535+0000","last_became_active":"2023-10-14T09:38:31.025243+0000","last_became_peered":"2023-10-14T09:38:31.025243+0000","last_unstale":"2023-10-14T09:39:01.810535+0000","last_undegraded":"2023-10-14T09:39:01.810535+0000","last_fullsized":"2023-10-14T09:39:01.810535+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:01.810343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:01.810343+0000","last_clean_scrub_stamp":"2023-10-14T09:39:01.810343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:07:34.569268+0000","scrub_duration":0.0028920640000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.938208+0000","last_change":"2023-10-14T09:38:31.028763+0000","last_active":"2023-10-14T09:38:34.938208+0000","last_peered":"2023-10-14T09:38:34.938208+0000","last_clean":"2023-10-14T09:38:34.938208+0000","last_became_active":"2023-10-14T09:38:31.028420+0000","last_became_peered":"2023-10-14T09:38:31.028420+0000","last_unstale":"2023-10-14T09:38:34.938208+0000","last_undegraded":"2023-10-14T09:38:34.938208+0000","last_fullsized":"2023-10-14T09:38:34.938208+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:56.608953+0000","last_change":"2023-10-14T09:38:56.609079+0000","last_active":"2023-10-14T09:38:56.608953+0000","last_peered":"2023-10-14T09:38:56.608953+0000","last_clean":"2023-10-14T09:38:56.608953+0000","last_became_active":"2023-10-14T09:38:31.023482+0000","last_became_peered":"2023-10-14T09:38:31.023482+0000","last_unstale":"2023-10-14T09:38:56.608953+0000","last_undegraded":"2023-10-14T09:38:56.608953+0000","last_fullsized":"2023-10-14T09:38:56.608953+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:56.608786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:56.608786+0000","last_clean_scrub_stamp":"2023-10-14T09:38:56.608786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:22:18.269819+0000","scrub_duration":0.0034962940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"35'4","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:50.611267+0000","last_change":"2023-10-14T09:38:50.611392+0000","last_active":"2023-10-14T09:38:50.611267+0000","last_peered":"2023-10-14T09:38:50.611267+0000","last_clean":"2023-10-14T09:38:50.611267+0000","last_became_active":"2023-10-14T09:38:30.031374+0000","last_became_peered":"2023-10-14T09:38:30.031374+0000","last_unstale":"2023-10-14T09:38:50.611267+0000","last_undegraded":"2023-10-14T09:38:50.611267+0000","last_fullsized":"2023-10-14T09:38:50.611267+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2023-10-14T09:38:50.611077+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2023-10-14T09:38:50.611077+0000","last_clean_scrub_stamp":"2023-10-14T09:38:50.611077+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:06:00.879346+0000","scrub_duration":0.0046609240000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:02.766644+0000","last_change":"2023-10-14T09:39:02.766721+0000","last_active":"2023-10-14T09:39:02.766644+0000","last_peered":"2023-10-14T09:39:02.766644+0000","last_clean":"2023-10-14T09:39:02.766644+0000","last_became_active":"2023-10-14T09:38:31.026414+0000","last_became_peered":"2023-10-14T09:38:31.026414+0000","last_unstale":"2023-10-14T09:39:02.766644+0000","last_undegraded":"2023-10-14T09:39:02.766644+0000","last_fullsized":"2023-10-14T09:39:02.766644+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:02.766528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:02.766528+0000","last_clean_scrub_stamp":"2023-10-14T09:39:02.766528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:29:45.420889+0000","scrub_duration":0.003473659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"35'1","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:49.679590+0000","last_change":"2023-10-14T09:38:49.679696+0000","last_active":"2023-10-14T09:38:49.679590+0000","last_peered":"2023-10-14T09:38:49.679590+0000","last_clean":"2023-10-14T09:38:49.679590+0000","last_became_active":"2023-10-14T09:38:30.024910+0000","last_became_peered":"2023-10-14T09:38:30.024910+0000","last_unstale":"2023-10-14T09:38:49.679590+0000","last_undegraded":"2023-10-14T09:38:49.679590+0000","last_fullsized":"2023-10-14T09:38:49.679590+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'1","last_scrub_stamp":"2023-10-14T09:38:49.679411+0000","last_deep_scrub":"35'1","last_deep_scrub_stamp":"2023-10-14T09:38:49.679411+0000","last_clean_scrub_stamp":"2023-10-14T09:38:49.679411+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:15:55.728284+0000","scrub_duration":0.003799359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.932406+0000","last_change":"2023-10-14T09:38:31.030098+0000","last_active":"2023-10-14T09:38:34.932406+0000","last_peered":"2023-10-14T09:38:34.932406+0000","last_clean":"2023-10-14T09:38:34.932406+0000","last_became_active":"2023-10-14T09:38:31.029815+0000","last_became_peered":"2023-10-14T09:38:31.029815+0000","last_unstale":"2023-10-14T09:38:34.932406+0000","last_undegraded":"2023-10-14T09:38:34.932406+0000","last_fullsized":"2023-10-14T09:38:34.932406+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"36'3","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:03.074723+0000","last_change":"2023-10-14T09:39:03.074797+0000","last_active":"2023-10-14T09:39:03.074723+0000","last_peered":"2023-10-14T09:39:03.074723+0000","last_clean":"2023-10-14T09:39:03.074723+0000","last_became_active":"2023-10-14T09:38:30.017602+0000","last_became_peered":"2023-10-14T09:38:30.017602+0000","last_unstale":"2023-10-14T09:39:03.074723+0000","last_undegraded":"2023-10-14T09:39:03.074723+0000","last_fullsized":"2023-10-14T09:39:03.074723+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2023-10-14T09:39:03.074613+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2023-10-14T09:39:03.074613+0000","last_clean_scrub_stamp":"2023-10-14T09:39:03.074613+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:42:38.051760+0000","scrub_duration":0.0041427089999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.926694+0000","last_change":"2023-10-14T09:38:31.028602+0000","last_active":"2023-10-14T09:38:34.926694+0000","last_peered":"2023-10-14T09:38:34.926694+0000","last_clean":"2023-10-14T09:38:34.926694+0000","last_became_active":"2023-10-14T09:38:31.025645+0000","last_became_peered":"2023-10-14T09:38:31.025645+0000","last_unstale":"2023-10-14T09:38:34.926694+0000","last_undegraded":"2023-10-14T09:38:34.926694+0000","last_fullsized":"2023-10-14T09:38:34.926694+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"35'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:46.533770+0000","last_change":"2023-10-14T09:38:46.533816+0000","last_active":"2023-10-14T09:38:46.533770+0000","last_peered":"2023-10-14T09:38:46.533770+0000","last_clean":"2023-10-14T09:38:46.533770+0000","last_became_active":"2023-10-14T09:38:30.030556+0000","last_became_peered":"2023-10-14T09:38:30.030556+0000","last_unstale":"2023-10-14T09:38:46.533770+0000","last_undegraded":"2023-10-14T09:38:46.533770+0000","last_fullsized":"2023-10-14T09:38:46.533770+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2023-10-14T09:38:46.533705+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2023-10-14T09:38:46.533705+0000","last_clean_scrub_stamp":"2023-10-14T09:38:46.533705+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:33:11.988817+0000","scrub_duration":0.0026943039999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:02.272352+0000","last_change":"2023-10-14T09:39:02.272488+0000","last_active":"2023-10-14T09:39:02.272352+0000","last_peered":"2023-10-14T09:39:02.272352+0000","last_clean":"2023-10-14T09:39:02.272352+0000","last_became_active":"2023-10-14T09:38:31.028887+0000","last_became_peered":"2023-10-14T09:38:31.028887+0000","last_unstale":"2023-10-14T09:39:02.272352+0000","last_undegraded":"2023-10-14T09:39:02.272352+0000","last_fullsized":"2023-10-14T09:39:02.272352+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:02.272167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:02.272167+0000","last_clean_scrub_stamp":"2023-10-14T09:39:02.272167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:46:37.273684+0000","scrub_duration":0.0035637300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"35'1","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:57.786144+0000","last_change":"2023-10-14T09:38:57.786255+0000","last_active":"2023-10-14T09:38:57.786144+0000","last_peered":"2023-10-14T09:38:57.786144+0000","last_clean":"2023-10-14T09:38:57.786144+0000","last_became_active":"2023-10-14T09:38:30.025732+0000","last_became_peered":"2023-10-14T09:38:30.025732+0000","last_unstale":"2023-10-14T09:38:57.786144+0000","last_undegraded":"2023-10-14T09:38:57.786144+0000","last_fullsized":"2023-10-14T09:38:57.786144+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'1","last_scrub_stamp":"2023-10-14T09:38:57.785957+0000","last_deep_scrub":"35'1","last_deep_scrub_stamp":"2023-10-14T09:38:57.785957+0000","last_clean_scrub_stamp":"2023-10-14T09:38:57.785957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:18:36.524694+0000","scrub_duration":0.003769901,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:58.078771+0000","last_change":"2023-10-14T09:38:58.078887+0000","last_active":"2023-10-14T09:38:58.078771+0000","last_peered":"2023-10-14T09:38:58.078771+0000","last_clean":"2023-10-14T09:38:58.078771+0000","last_became_active":"2023-10-14T09:38:31.020184+0000","last_became_peered":"2023-10-14T09:38:31.020184+0000","last_unstale":"2023-10-14T09:38:58.078771+0000","last_undegraded":"2023-10-14T09:38:58.078771+0000","last_fullsized":"2023-10-14T09:38:58.078771+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:58.078588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:58.078588+0000","last_clean_scrub_stamp":"2023-10-14T09:38:58.078588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:19:22.355681+0000","scrub_duration":0.0039430919999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"35'1","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:02.624254+0000","last_change":"2023-10-14T09:39:02.624369+0000","last_active":"2023-10-14T09:39:02.624254+0000","last_peered":"2023-10-14T09:39:02.624254+0000","last_clean":"2023-10-14T09:39:02.624254+0000","last_became_active":"2023-10-14T09:38:30.031356+0000","last_became_peered":"2023-10-14T09:38:30.031356+0000","last_unstale":"2023-10-14T09:39:02.624254+0000","last_undegraded":"2023-10-14T09:39:02.624254+0000","last_fullsized":"2023-10-14T09:39:02.624254+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'1","last_scrub_stamp":"2023-10-14T09:39:02.624081+0000","last_deep_scrub":"35'1","last_deep_scrub_stamp":"2023-10-14T09:39:02.624081+0000","last_clean_scrub_stamp":"2023-10-14T09:39:02.624081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:56:17.115836+0000","scrub_duration":0.003185327,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.932205+0000","last_change":"2023-10-14T09:38:31.024293+0000","last_active":"2023-10-14T09:38:34.932205+0000","last_peered":"2023-10-14T09:38:34.932205+0000","last_clean":"2023-10-14T09:38:34.932205+0000","last_became_active":"2023-10-14T09:38:31.023990+0000","last_became_peered":"2023-10-14T09:38:31.023990+0000","last_unstale":"2023-10-14T09:38:34.932205+0000","last_undegraded":"2023-10-14T09:38:34.932205+0000","last_fullsized":"2023-10-14T09:38:34.932205+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:58.127909+0000","last_change":"2023-10-14T09:38:58.128101+0000","last_active":"2023-10-14T09:38:58.127909+0000","last_peered":"2023-10-14T09:38:58.127909+0000","last_clean":"2023-10-14T09:38:58.127909+0000","last_became_active":"2023-10-14T09:38:30.019461+0000","last_became_peered":"2023-10-14T09:38:30.019461+0000","last_unstale":"2023-10-14T09:38:58.127909+0000","last_undegraded":"2023-10-14T09:38:58.127909+0000","last_fullsized":"2023-10-14T09:38:58.127909+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:58.127652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:58.127652+0000","last_clean_scrub_stamp":"2023-10-14T09:38:58.127652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:12.463977+0000","scrub_duration":0.003828265,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.926415+0000","last_change":"2023-10-14T09:38:31.016796+0000","last_active":"2023-10-14T09:38:34.926415+0000","last_peered":"2023-10-14T09:38:34.926415+0000","last_clean":"2023-10-14T09:38:34.926415+0000","last_became_active":"2023-10-14T09:38:31.016514+0000","last_became_peered":"2023-10-14T09:38:31.016514+0000","last_unstale":"2023-10-14T09:38:34.926415+0000","last_undegraded":"2023-10-14T09:38:34.926415+0000","last_fullsized":"2023-10-14T09:38:34.926415+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:01.637044+0000","last_change":"2023-10-14T09:39:01.637150+0000","last_active":"2023-10-14T09:39:01.637044+0000","last_peered":"2023-10-14T09:39:01.637044+0000","last_clean":"2023-10-14T09:39:01.637044+0000","last_became_active":"2023-10-14T09:38:30.035470+0000","last_became_peered":"2023-10-14T09:38:30.035470+0000","last_unstale":"2023-10-14T09:39:01.637044+0000","last_undegraded":"2023-10-14T09:39:01.637044+0000","last_fullsized":"2023-10-14T09:39:01.637044+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:01.636840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:01.636840+0000","last_clean_scrub_stamp":"2023-10-14T09:39:01.636840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:24:23.494315+0000","scrub_duration":0.003674194,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:33.928879+0000","last_change":"2023-10-14T09:38:31.026082+0000","last_active":"2023-10-14T09:38:33.928879+0000","last_peered":"2023-10-14T09:38:33.928879+0000","last_clean":"2023-10-14T09:38:33.928879+0000","last_became_active":"2023-10-14T09:38:31.025794+0000","last_became_peered":"2023-10-14T09:38:31.025794+0000","last_unstale":"2023-10-14T09:38:33.928879+0000","last_undegraded":"2023-10-14T09:38:33.928879+0000","last_fullsized":"2023-10-14T09:38:33.928879+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:59.100371+0000","last_change":"2023-10-14T09:38:59.100482+0000","last_active":"2023-10-14T09:38:59.100371+0000","last_peered":"2023-10-14T09:38:59.100371+0000","last_clean":"2023-10-14T09:38:59.100371+0000","last_became_active":"2023-10-14T09:38:30.014042+0000","last_became_peered":"2023-10-14T09:38:30.014042+0000","last_unstale":"2023-10-14T09:38:59.100371+0000","last_undegraded":"2023-10-14T09:38:59.100371+0000","last_fullsized":"2023-10-14T09:38:59.100371+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:59.100189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:59.100189+0000","last_clean_scrub_stamp":"2023-10-14T09:38:59.100189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:03:57.444366+0000","scrub_duration":0.0039772050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.925882+0000","last_change":"2023-10-14T09:38:31.021923+0000","last_active":"2023-10-14T09:38:34.925882+0000","last_peered":"2023-10-14T09:38:34.925882+0000","last_clean":"2023-10-14T09:38:34.925882+0000","last_became_active":"2023-10-14T09:38:31.021662+0000","last_became_peered":"2023-10-14T09:38:31.021662+0000","last_unstale":"2023-10-14T09:38:34.925882+0000","last_undegraded":"2023-10-14T09:38:34.925882+0000","last_fullsized":"2023-10-14T09:38:34.925882+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:48.679147+0000","last_change":"2023-10-14T09:38:48.679274+0000","last_active":"2023-10-14T09:38:48.679147+0000","last_peered":"2023-10-14T09:38:48.679147+0000","last_clean":"2023-10-14T09:38:48.679147+0000","last_became_active":"2023-10-14T09:38:30.027696+0000","last_became_peered":"2023-10-14T09:38:30.027696+0000","last_unstale":"2023-10-14T09:38:48.679147+0000","last_undegraded":"2023-10-14T09:38:48.679147+0000","last_fullsized":"2023-10-14T09:38:48.679147+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:48.678929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:48.678929+0000","last_clean_scrub_stamp":"2023-10-14T09:38:48.678929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:06:16.707833+0000","scrub_duration":0.003213816,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:48.148306+0000","last_change":"2023-10-14T09:38:48.148375+0000","last_active":"2023-10-14T09:38:48.148306+0000","last_peered":"2023-10-14T09:38:48.148306+0000","last_clean":"2023-10-14T09:38:48.148306+0000","last_became_active":"2023-10-14T09:38:31.026676+0000","last_became_peered":"2023-10-14T09:38:31.026676+0000","last_unstale":"2023-10-14T09:38:48.148306+0000","last_undegraded":"2023-10-14T09:38:48.148306+0000","last_fullsized":"2023-10-14T09:38:48.148306+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:48.148221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:48.148221+0000","last_clean_scrub_stamp":"2023-10-14T09:38:48.148221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:01:40.381456+0000","scrub_duration":0.0028294069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"35'3","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:55.075403+0000","last_change":"2023-10-14T09:38:55.075551+0000","last_active":"2023-10-14T09:38:55.075403+0000","last_peered":"2023-10-14T09:38:55.075403+0000","last_clean":"2023-10-14T09:38:55.075403+0000","last_became_active":"2023-10-14T09:38:30.031907+0000","last_became_peered":"2023-10-14T09:38:30.031907+0000","last_unstale":"2023-10-14T09:38:55.075403+0000","last_undegraded":"2023-10-14T09:38:55.075403+0000","last_fullsized":"2023-10-14T09:38:55.075403+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2023-10-14T09:38:55.075222+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2023-10-14T09:38:55.075222+0000","last_clean_scrub_stamp":"2023-10-14T09:38:55.075222+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:49:52.115938+0000","scrub_duration":0.005129242,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:33.928760+0000","last_change":"2023-10-14T09:38:31.021126+0000","last_active":"2023-10-14T09:38:33.928760+0000","last_peered":"2023-10-14T09:38:33.928760+0000","last_clean":"2023-10-14T09:38:33.928760+0000","last_became_active":"2023-10-14T09:38:31.020267+0000","last_became_peered":"2023-10-14T09:38:31.020267+0000","last_unstale":"2023-10-14T09:38:33.928760+0000","last_undegraded":"2023-10-14T09:38:33.928760+0000","last_fullsized":"2023-10-14T09:38:33.928760+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"35'6","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:54.196331+0000","last_change":"2023-10-14T09:38:54.196449+0000","last_active":"2023-10-14T09:38:54.196331+0000","last_peered":"2023-10-14T09:38:54.196331+0000","last_clean":"2023-10-14T09:38:54.196331+0000","last_became_active":"2023-10-14T09:38:30.019839+0000","last_became_peered":"2023-10-14T09:38:30.019839+0000","last_unstale":"2023-10-14T09:38:54.196331+0000","last_undegraded":"2023-10-14T09:38:54.196331+0000","last_fullsized":"2023-10-14T09:38:54.196331+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2023-10-14T09:38:54.196133+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2023-10-14T09:38:54.196133+0000","last_clean_scrub_stamp":"2023-10-14T09:38:54.196133+0000","objects_scrubbed":4,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:12:19.956146+0000","scrub_duration":0.0055956779999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.926469+0000","last_change":"2023-10-14T09:38:31.020699+0000","last_active":"2023-10-14T09:38:34.926469+0000","last_peered":"2023-10-14T09:38:34.926469+0000","last_clean":"2023-10-14T09:38:34.926469+0000","last_became_active":"2023-10-14T09:38:31.020347+0000","last_became_peered":"2023-10-14T09:38:31.020347+0000","last_unstale":"2023-10-14T09:38:34.926469+0000","last_undegraded":"2023-10-14T09:38:34.926469+0000","last_fullsized":"2023-10-14T09:38:34.926469+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"35'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:47.937746+0000","last_change":"2023-10-14T09:38:47.937954+0000","last_active":"2023-10-14T09:38:47.937746+0000","last_peered":"2023-10-14T09:38:47.937746+0000","last_clean":"2023-10-14T09:38:47.937746+0000","last_became_active":"2023-10-14T09:38:30.035424+0000","last_became_peered":"2023-10-14T09:38:30.035424+0000","last_unstale":"2023-10-14T09:38:47.937746+0000","last_undegraded":"2023-10-14T09:38:47.937746+0000","last_fullsized":"2023-10-14T09:38:47.937746+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2023-10-14T09:38:47.937565+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2023-10-14T09:38:47.937565+0000","last_clean_scrub_stamp":"2023-10-14T09:38:47.937565+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:56:13.779499+0000","scrub_duration":0.0048754560000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.925653+0000","last_change":"2023-10-14T09:38:31.028147+0000","last_active":"2023-10-14T09:38:34.925653+0000","last_peered":"2023-10-14T09:38:34.925653+0000","last_clean":"2023-10-14T09:38:34.925653+0000","last_became_active":"2023-10-14T09:38:31.027759+0000","last_became_peered":"2023-10-14T09:38:31.027759+0000","last_unstale":"2023-10-14T09:38:34.925653+0000","last_undegraded":"2023-10-14T09:38:34.925653+0000","last_fullsized":"2023-10-14T09:38:34.925653+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:57.334723+0000","last_change":"2023-10-14T09:38:57.334855+0000","last_active":"2023-10-14T09:38:57.334723+0000","last_peered":"2023-10-14T09:38:57.334723+0000","last_clean":"2023-10-14T09:38:57.334723+0000","last_became_active":"2023-10-14T09:38:30.025712+0000","last_became_peered":"2023-10-14T09:38:30.025712+0000","last_unstale":"2023-10-14T09:38:57.334723+0000","last_undegraded":"2023-10-14T09:38:57.334723+0000","last_fullsized":"2023-10-14T09:38:57.334723+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:57.334543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:57.334543+0000","last_clean_scrub_stamp":"2023-10-14T09:38:57.334543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:07:30.093467+0000","scrub_duration":0.0039162900000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:56.234815+0000","last_change":"2023-10-14T09:38:56.234942+0000","last_active":"2023-10-14T09:38:56.234815+0000","last_peered":"2023-10-14T09:38:56.234815+0000","last_clean":"2023-10-14T09:38:56.234815+0000","last_became_active":"2023-10-14T09:38:31.036628+0000","last_became_peered":"2023-10-14T09:38:31.036628+0000","last_unstale":"2023-10-14T09:38:56.234815+0000","last_undegraded":"2023-10-14T09:38:56.234815+0000","last_fullsized":"2023-10-14T09:38:56.234815+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:56.234625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:56.234625+0000","last_clean_scrub_stamp":"2023-10-14T09:38:56.234625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:58:59.569769+0000","scrub_duration":0.0035426099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.342095+0000","last_change":"2023-10-14T09:38:30.022460+0000","last_active":"2023-10-14T09:38:32.342095+0000","last_peered":"2023-10-14T09:38:32.342095+0000","last_clean":"2023-10-14T09:38:32.342095+0000","last_became_active":"2023-10-14T09:38:30.022182+0000","last_became_peered":"2023-10-14T09:38:30.022182+0000","last_unstale":"2023-10-14T09:38:32.342095+0000","last_undegraded":"2023-10-14T09:38:32.342095+0000","last_fullsized":"2023-10-14T09:38:32.342095+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:54.645085+0000","last_change":"2023-10-14T09:38:54.645278+0000","last_active":"2023-10-14T09:38:54.645085+0000","last_peered":"2023-10-14T09:38:54.645085+0000","last_clean":"2023-10-14T09:38:54.645085+0000","last_became_active":"2023-10-14T09:38:31.039518+0000","last_became_peered":"2023-10-14T09:38:31.039518+0000","last_unstale":"2023-10-14T09:38:54.645085+0000","last_undegraded":"2023-10-14T09:38:54.645085+0000","last_fullsized":"2023-10-14T09:38:54.645085+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:54.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:54.644882+0000","last_clean_scrub_stamp":"2023-10-14T09:38:54.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:49:46.705606+0000","scrub_duration":0.003904659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"35'8","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:52.142490+0000","last_change":"2023-10-14T09:38:52.142608+0000","last_active":"2023-10-14T09:38:52.142490+0000","last_peered":"2023-10-14T09:38:52.142490+0000","last_clean":"2023-10-14T09:38:52.142490+0000","last_became_active":"2023-10-14T09:38:30.014562+0000","last_became_peered":"2023-10-14T09:38:30.014562+0000","last_unstale":"2023-10-14T09:38:52.142490+0000","last_undegraded":"2023-10-14T09:38:52.142490+0000","last_fullsized":"2023-10-14T09:38:52.142490+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2023-10-14T09:38:52.142259+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2023-10-14T09:38:52.142259+0000","last_clean_scrub_stamp":"2023-10-14T09:38:52.142259+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:46:42.382320+0000","scrub_duration":0.0052490749999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.932601+0000","last_change":"2023-10-14T09:38:31.026009+0000","last_active":"2023-10-14T09:38:34.932601+0000","last_peered":"2023-10-14T09:38:34.932601+0000","last_clean":"2023-10-14T09:38:34.932601+0000","last_became_active":"2023-10-14T09:38:31.025665+0000","last_became_peered":"2023-10-14T09:38:31.025665+0000","last_unstale":"2023-10-14T09:38:34.932601+0000","last_undegraded":"2023-10-14T09:38:34.932601+0000","last_fullsized":"2023-10-14T09:38:34.932601+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"35'1","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:55.318266+0000","last_change":"2023-10-14T09:38:55.318388+0000","last_active":"2023-10-14T09:38:55.318266+0000","last_peered":"2023-10-14T09:38:55.318266+0000","last_clean":"2023-10-14T09:38:55.318266+0000","last_became_active":"2023-10-14T09:38:30.025331+0000","last_became_peered":"2023-10-14T09:38:30.025331+0000","last_unstale":"2023-10-14T09:38:55.318266+0000","last_undegraded":"2023-10-14T09:38:55.318266+0000","last_fullsized":"2023-10-14T09:38:55.318266+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'1","last_scrub_stamp":"2023-10-14T09:38:55.318087+0000","last_deep_scrub":"35'1","last_deep_scrub_stamp":"2023-10-14T09:38:55.318087+0000","last_clean_scrub_stamp":"2023-10-14T09:38:55.318087+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:39:45.038902+0000","scrub_duration":0.0045992630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:33.928907+0000","last_change":"2023-10-14T09:38:31.033233+0000","last_active":"2023-10-14T09:38:33.928907+0000","last_peered":"2023-10-14T09:38:33.928907+0000","last_clean":"2023-10-14T09:38:33.928907+0000","last_became_active":"2023-10-14T09:38:31.032912+0000","last_became_peered":"2023-10-14T09:38:31.032912+0000","last_unstale":"2023-10-14T09:38:33.928907+0000","last_undegraded":"2023-10-14T09:38:33.928907+0000","last_fullsized":"2023-10-14T09:38:33.928907+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.018310+0000","last_change":"2023-10-14T09:38:30.035623+0000","last_active":"2023-10-14T09:38:32.018310+0000","last_peered":"2023-10-14T09:38:32.018310+0000","last_clean":"2023-10-14T09:38:32.018310+0000","last_became_active":"2023-10-14T09:38:30.035283+0000","last_became_peered":"2023-10-14T09:38:30.035283+0000","last_unstale":"2023-10-14T09:38:32.018310+0000","last_undegraded":"2023-10-14T09:38:32.018310+0000","last_fullsized":"2023-10-14T09:38:32.018310+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.926594+0000","last_change":"2023-10-14T09:38:31.035370+0000","last_active":"2023-10-14T09:38:34.926594+0000","last_peered":"2023-10-14T09:38:34.926594+0000","last_clean":"2023-10-14T09:38:34.926594+0000","last_became_active":"2023-10-14T09:38:31.034768+0000","last_became_peered":"2023-10-14T09:38:31.034768+0000","last_unstale":"2023-10-14T09:38:34.926594+0000","last_undegraded":"2023-10-14T09:38:34.926594+0000","last_fullsized":"2023-10-14T09:38:34.926594+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"35'1","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:00.677692+0000","last_change":"2023-10-14T09:39:00.677818+0000","last_active":"2023-10-14T09:39:00.677692+0000","last_peered":"2023-10-14T09:39:00.677692+0000","last_clean":"2023-10-14T09:39:00.677692+0000","last_became_active":"2023-10-14T09:38:30.030927+0000","last_became_peered":"2023-10-14T09:38:30.030927+0000","last_unstale":"2023-10-14T09:39:00.677692+0000","last_undegraded":"2023-10-14T09:39:00.677692+0000","last_fullsized":"2023-10-14T09:39:00.677692+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'1","last_scrub_stamp":"2023-10-14T09:39:00.677510+0000","last_deep_scrub":"35'1","last_deep_scrub_stamp":"2023-10-14T09:39:00.677510+0000","last_clean_scrub_stamp":"2023-10-14T09:39:00.677510+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:55:27.879986+0000","scrub_duration":0.0052586550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:52.540354+0000","last_change":"2023-10-14T09:38:52.540470+0000","last_active":"2023-10-14T09:38:52.540354+0000","last_peered":"2023-10-14T09:38:52.540354+0000","last_clean":"2023-10-14T09:38:52.540354+0000","last_became_active":"2023-10-14T09:38:31.026615+0000","last_became_peered":"2023-10-14T09:38:31.026615+0000","last_unstale":"2023-10-14T09:38:52.540354+0000","last_undegraded":"2023-10-14T09:38:52.540354+0000","last_fullsized":"2023-10-14T09:38:52.540354+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:52.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:52.540176+0000","last_clean_scrub_stamp":"2023-10-14T09:38:52.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:24:06.115731+0000","scrub_duration":0.0037872090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:55.712392+0000","last_change":"2023-10-14T09:38:55.712533+0000","last_active":"2023-10-14T09:38:55.712392+0000","last_peered":"2023-10-14T09:38:55.712392+0000","last_clean":"2023-10-14T09:38:55.712392+0000","last_became_active":"2023-10-14T09:38:30.026795+0000","last_became_peered":"2023-10-14T09:38:30.026795+0000","last_unstale":"2023-10-14T09:38:55.712392+0000","last_undegraded":"2023-10-14T09:38:55.712392+0000","last_fullsized":"2023-10-14T09:38:55.712392+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:55.712204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:55.712204+0000","last_clean_scrub_stamp":"2023-10-14T09:38:55.712204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:41:54.034096+0000","scrub_duration":0.003589709,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:47.540406+0000","last_change":"2023-10-14T09:38:47.540516+0000","last_active":"2023-10-14T09:38:47.540406+0000","last_peered":"2023-10-14T09:38:47.540406+0000","last_clean":"2023-10-14T09:38:47.540406+0000","last_became_active":"2023-10-14T09:38:31.031921+0000","last_became_peered":"2023-10-14T09:38:31.031921+0000","last_unstale":"2023-10-14T09:38:47.540406+0000","last_undegraded":"2023-10-14T09:38:47.540406+0000","last_fullsized":"2023-10-14T09:38:47.540406+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:47.540230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:47.540230+0000","last_clean_scrub_stamp":"2023-10-14T09:38:47.540230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:37:25.465061+0000","scrub_duration":0.003744247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"35'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:46.628250+0000","last_change":"2023-10-14T09:38:46.628305+0000","last_active":"2023-10-14T09:38:46.628250+0000","last_peered":"2023-10-14T09:38:46.628250+0000","last_clean":"2023-10-14T09:38:46.628250+0000","last_became_active":"2023-10-14T09:38:30.021312+0000","last_became_peered":"2023-10-14T09:38:30.021312+0000","last_unstale":"2023-10-14T09:38:46.628250+0000","last_undegraded":"2023-10-14T09:38:46.628250+0000","last_fullsized":"2023-10-14T09:38:46.628250+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2023-10-14T09:38:46.628156+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2023-10-14T09:38:46.628156+0000","last_clean_scrub_stamp":"2023-10-14T09:38:46.628156+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:52:45.439890+0000","scrub_duration":0.002195682,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.927331+0000","last_change":"2023-10-14T09:38:31.023661+0000","last_active":"2023-10-14T09:38:34.927331+0000","last_peered":"2023-10-14T09:38:34.927331+0000","last_clean":"2023-10-14T09:38:34.927331+0000","last_became_active":"2023-10-14T09:38:31.023340+0000","last_became_peered":"2023-10-14T09:38:31.023340+0000","last_unstale":"2023-10-14T09:38:34.927331+0000","last_undegraded":"2023-10-14T09:38:34.927331+0000","last_fullsized":"2023-10-14T09:38:34.927331+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:48.556599+0000","last_change":"2023-10-14T09:38:48.556714+0000","last_active":"2023-10-14T09:38:48.556599+0000","last_peered":"2023-10-14T09:38:48.556599+0000","last_clean":"2023-10-14T09:38:48.556599+0000","last_became_active":"2023-10-14T09:38:30.033284+0000","last_became_peered":"2023-10-14T09:38:30.033284+0000","last_unstale":"2023-10-14T09:38:48.556599+0000","last_undegraded":"2023-10-14T09:38:48.556599+0000","last_fullsized":"2023-10-14T09:38:48.556599+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:48.556379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:48.556379+0000","last_clean_scrub_stamp":"2023-10-14T09:38:48.556379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:24:02.131934+0000","scrub_duration":0.0035783490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.927141+0000","last_change":"2023-10-14T09:38:31.020259+0000","last_active":"2023-10-14T09:38:34.927141+0000","last_peered":"2023-10-14T09:38:34.927141+0000","last_clean":"2023-10-14T09:38:34.927141+0000","last_became_active":"2023-10-14T09:38:31.019732+0000","last_became_peered":"2023-10-14T09:38:31.019732+0000","last_unstale":"2023-10-14T09:38:34.927141+0000","last_undegraded":"2023-10-14T09:38:34.927141+0000","last_fullsized":"2023-10-14T09:38:34.927141+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:56.739921+0000","last_change":"2023-10-14T09:38:56.740115+0000","last_active":"2023-10-14T09:38:56.739921+0000","last_peered":"2023-10-14T09:38:56.739921+0000","last_clean":"2023-10-14T09:38:56.739921+0000","last_became_active":"2023-10-14T09:38:30.032500+0000","last_became_peered":"2023-10-14T09:38:30.032500+0000","last_unstale":"2023-10-14T09:38:56.739921+0000","last_undegraded":"2023-10-14T09:38:56.739921+0000","last_fullsized":"2023-10-14T09:38:56.739921+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:56.739717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:56.739717+0000","last_clean_scrub_stamp":"2023-10-14T09:38:56.739717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:55.093910+0000","scrub_duration":0.0038890359999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.938290+0000","last_change":"2023-10-14T09:38:31.030686+0000","last_active":"2023-10-14T09:38:34.938290+0000","last_peered":"2023-10-14T09:38:34.938290+0000","last_clean":"2023-10-14T09:38:34.938290+0000","last_became_active":"2023-10-14T09:38:31.030399+0000","last_became_peered":"2023-10-14T09:38:31.030399+0000","last_unstale":"2023-10-14T09:38:34.938290+0000","last_undegraded":"2023-10-14T09:38:34.938290+0000","last_fullsized":"2023-10-14T09:38:34.938290+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:51.044759+0000","last_change":"2023-10-14T09:38:51.044863+0000","last_active":"2023-10-14T09:38:51.044759+0000","last_peered":"2023-10-14T09:38:51.044759+0000","last_clean":"2023-10-14T09:38:51.044759+0000","last_became_active":"2023-10-14T09:38:30.028540+0000","last_became_peered":"2023-10-14T09:38:30.028540+0000","last_unstale":"2023-10-14T09:38:51.044759+0000","last_undegraded":"2023-10-14T09:38:51.044759+0000","last_fullsized":"2023-10-14T09:38:51.044759+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:51.044578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:51.044578+0000","last_clean_scrub_stamp":"2023-10-14T09:38:51.044578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:49:06.337666+0000","scrub_duration":0.0033480110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:50.515103+0000","last_change":"2023-10-14T09:38:50.515213+0000","last_active":"2023-10-14T09:38:50.515103+0000","last_peered":"2023-10-14T09:38:50.515103+0000","last_clean":"2023-10-14T09:38:50.515103+0000","last_became_active":"2023-10-14T09:38:31.015654+0000","last_became_peered":"2023-10-14T09:38:31.015654+0000","last_unstale":"2023-10-14T09:38:50.515103+0000","last_undegraded":"2023-10-14T09:38:50.515103+0000","last_fullsized":"2023-10-14T09:38:50.515103+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:50.514814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:50.514814+0000","last_clean_scrub_stamp":"2023-10-14T09:38:50.514814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:04:26.034786+0000","scrub_duration":0.0037886759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.345030+0000","last_change":"2023-10-14T09:38:30.030703+0000","last_active":"2023-10-14T09:38:32.345030+0000","last_peered":"2023-10-14T09:38:32.345030+0000","last_clean":"2023-10-14T09:38:32.345030+0000","last_became_active":"2023-10-14T09:38:30.030387+0000","last_became_peered":"2023-10-14T09:38:30.030387+0000","last_unstale":"2023-10-14T09:38:32.345030+0000","last_undegraded":"2023-10-14T09:38:32.345030+0000","last_fullsized":"2023-10-14T09:38:32.345030+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:33.928927+0000","last_change":"2023-10-14T09:38:31.024132+0000","last_active":"2023-10-14T09:38:33.928927+0000","last_peered":"2023-10-14T09:38:33.928927+0000","last_clean":"2023-10-14T09:38:33.928927+0000","last_became_active":"2023-10-14T09:38:31.023043+0000","last_became_peered":"2023-10-14T09:38:31.023043+0000","last_unstale":"2023-10-14T09:38:33.928927+0000","last_undegraded":"2023-10-14T09:38:33.928927+0000","last_fullsized":"2023-10-14T09:38:33.928927+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"36'1","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:47.634220+0000","last_change":"2023-10-14T09:38:47.634416+0000","last_active":"2023-10-14T09:38:47.634220+0000","last_peered":"2023-10-14T09:38:47.634220+0000","last_clean":"2023-10-14T09:38:47.634220+0000","last_became_active":"2023-10-14T09:38:30.024536+0000","last_became_peered":"2023-10-14T09:38:30.024536+0000","last_unstale":"2023-10-14T09:38:47.634220+0000","last_undegraded":"2023-10-14T09:38:47.634220+0000","last_fullsized":"2023-10-14T09:38:47.634220+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'1","last_scrub_stamp":"2023-10-14T09:38:47.633984+0000","last_deep_scrub":"36'1","last_deep_scrub_stamp":"2023-10-14T09:38:47.633984+0000","last_clean_scrub_stamp":"2023-10-14T09:38:47.633984+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:40:54.811008+0000","scrub_duration":0.0036899749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:54.649440+0000","last_change":"2023-10-14T09:38:54.649556+0000","last_active":"2023-10-14T09:38:54.649440+0000","last_peered":"2023-10-14T09:38:54.649440+0000","last_clean":"2023-10-14T09:38:54.649440+0000","last_became_active":"2023-10-14T09:38:31.023855+0000","last_became_peered":"2023-10-14T09:38:31.023855+0000","last_unstale":"2023-10-14T09:38:54.649440+0000","last_undegraded":"2023-10-14T09:38:54.649440+0000","last_fullsized":"2023-10-14T09:38:54.649440+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:54.649211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:54.649211+0000","last_clean_scrub_stamp":"2023-10-14T09:38:54.649211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:49:09.942300+0000","scrub_duration":0.0033030020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:32.344664+0000","last_change":"2023-10-14T09:38:30.023306+0000","last_active":"2023-10-14T09:38:32.344664+0000","last_peered":"2023-10-14T09:38:32.344664+0000","last_clean":"2023-10-14T09:38:32.344664+0000","last_became_active":"2023-10-14T09:38:30.023068+0000","last_became_peered":"2023-10-14T09:38:30.023068+0000","last_unstale":"2023-10-14T09:38:32.344664+0000","last_undegraded":"2023-10-14T09:38:32.344664+0000","last_fullsized":"2023-10-14T09:38:32.344664+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:28.965497+0000","last_clean_scrub_stamp":"2023-10-14T09:38:28.965497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:59.729037+0000","last_change":"2023-10-14T09:38:59.729149+0000","last_active":"2023-10-14T09:38:59.729037+0000","last_peered":"2023-10-14T09:38:59.729037+0000","last_clean":"2023-10-14T09:38:59.729037+0000","last_became_active":"2023-10-14T09:38:31.026838+0000","last_became_peered":"2023-10-14T09:38:31.026838+0000","last_unstale":"2023-10-14T09:38:59.729037+0000","last_undegraded":"2023-10-14T09:38:59.729037+0000","last_fullsized":"2023-10-14T09:38:59.729037+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:59.728756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:59.728756+0000","last_clean_scrub_stamp":"2023-10-14T09:38:59.728756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:58.082949+0000","scrub_duration":0.00366154,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:45.578809+0000","last_change":"2023-10-14T09:38:45.578897+0000","last_active":"2023-10-14T09:38:45.578809+0000","last_peered":"2023-10-14T09:38:45.578809+0000","last_clean":"2023-10-14T09:38:45.578809+0000","last_became_active":"2023-10-14T09:38:30.029514+0000","last_became_peered":"2023-10-14T09:38:30.029514+0000","last_unstale":"2023-10-14T09:38:45.578809+0000","last_undegraded":"2023-10-14T09:38:45.578809+0000","last_fullsized":"2023-10-14T09:38:45.578809+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:45.578708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:45.578708+0000","last_clean_scrub_stamp":"2023-10-14T09:38:45.578708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:31:14.776956+0000","scrub_duration":0.0027720409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:00.622885+0000","last_change":"2023-10-14T09:39:00.623104+0000","last_active":"2023-10-14T09:39:00.622885+0000","last_peered":"2023-10-14T09:39:00.622885+0000","last_clean":"2023-10-14T09:39:00.622885+0000","last_became_active":"2023-10-14T09:38:31.029521+0000","last_became_peered":"2023-10-14T09:38:31.029521+0000","last_unstale":"2023-10-14T09:39:00.622885+0000","last_undegraded":"2023-10-14T09:39:00.622885+0000","last_fullsized":"2023-10-14T09:39:00.622885+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:00.622681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:00.622681+0000","last_clean_scrub_stamp":"2023-10-14T09:39:00.622681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:38:23.973228+0000","scrub_duration":0.0040747789999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:51.250186+0000","last_change":"2023-10-14T09:38:51.250374+0000","last_active":"2023-10-14T09:38:51.250186+0000","last_peered":"2023-10-14T09:38:51.250186+0000","last_clean":"2023-10-14T09:38:51.250186+0000","last_became_active":"2023-10-14T09:38:30.029517+0000","last_became_peered":"2023-10-14T09:38:30.029517+0000","last_unstale":"2023-10-14T09:38:51.250186+0000","last_undegraded":"2023-10-14T09:38:51.250186+0000","last_fullsized":"2023-10-14T09:38:51.250186+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:51.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:51.249926+0000","last_clean_scrub_stamp":"2023-10-14T09:38:51.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:49:43.310651+0000","scrub_duration":0.0038699889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.925421+0000","last_change":"2023-10-14T09:38:31.034569+0000","last_active":"2023-10-14T09:38:34.925421+0000","last_peered":"2023-10-14T09:38:34.925421+0000","last_clean":"2023-10-14T09:38:34.925421+0000","last_became_active":"2023-10-14T09:38:31.034300+0000","last_became_peered":"2023-10-14T09:38:31.034300+0000","last_unstale":"2023-10-14T09:38:34.925421+0000","last_undegraded":"2023-10-14T09:38:34.925421+0000","last_fullsized":"2023-10-14T09:38:34.925421+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:46.967921+0000","last_change":"2023-10-14T09:38:46.968047+0000","last_active":"2023-10-14T09:38:46.967921+0000","last_peered":"2023-10-14T09:38:46.967921+0000","last_clean":"2023-10-14T09:38:46.967921+0000","last_became_active":"2023-10-14T09:38:30.030374+0000","last_became_peered":"2023-10-14T09:38:30.030374+0000","last_unstale":"2023-10-14T09:38:46.967921+0000","last_undegraded":"2023-10-14T09:38:46.967921+0000","last_fullsized":"2023-10-14T09:38:46.967921+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:46.967740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:46.967740+0000","last_clean_scrub_stamp":"2023-10-14T09:38:46.967740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:02:37.918672+0000","scrub_duration":0.0037853489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.932254+0000","last_change":"2023-10-14T09:38:31.033069+0000","last_active":"2023-10-14T09:38:34.932254+0000","last_peered":"2023-10-14T09:38:34.932254+0000","last_clean":"2023-10-14T09:38:34.932254+0000","last_became_active":"2023-10-14T09:38:31.032648+0000","last_became_peered":"2023-10-14T09:38:31.032648+0000","last_unstale":"2023-10-14T09:38:34.932254+0000","last_undegraded":"2023-10-14T09:38:34.932254+0000","last_fullsized":"2023-10-14T09:38:34.932254+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:56.184606+0000","last_change":"2023-10-14T09:38:56.184716+0000","last_active":"2023-10-14T09:38:56.184606+0000","last_peered":"2023-10-14T09:38:56.184606+0000","last_clean":"2023-10-14T09:38:56.184606+0000","last_became_active":"2023-10-14T09:38:30.020321+0000","last_became_peered":"2023-10-14T09:38:30.020321+0000","last_unstale":"2023-10-14T09:38:56.184606+0000","last_undegraded":"2023-10-14T09:38:56.184606+0000","last_fullsized":"2023-10-14T09:38:56.184606+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:56.184416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:56.184416+0000","last_clean_scrub_stamp":"2023-10-14T09:38:56.184416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:59:55.799339+0000","scrub_duration":0.003775956,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:51.208601+0000","last_change":"2023-10-14T09:38:51.208788+0000","last_active":"2023-10-14T09:38:51.208601+0000","last_peered":"2023-10-14T09:38:51.208601+0000","last_clean":"2023-10-14T09:38:51.208601+0000","last_became_active":"2023-10-14T09:38:31.024478+0000","last_became_peered":"2023-10-14T09:38:31.024478+0000","last_unstale":"2023-10-14T09:38:51.208601+0000","last_undegraded":"2023-10-14T09:38:51.208601+0000","last_fullsized":"2023-10-14T09:38:51.208601+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:51.208358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:51.208358+0000","last_clean_scrub_stamp":"2023-10-14T09:38:51.208358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:55:18.410834+0000","scrub_duration":0.0035993549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:49.587807+0000","last_change":"2023-10-14T09:38:49.587913+0000","last_active":"2023-10-14T09:38:49.587807+0000","last_peered":"2023-10-14T09:38:49.587807+0000","last_clean":"2023-10-14T09:38:49.587807+0000","last_became_active":"2023-10-14T09:38:30.033358+0000","last_became_peered":"2023-10-14T09:38:30.033358+0000","last_unstale":"2023-10-14T09:38:49.587807+0000","last_undegraded":"2023-10-14T09:38:49.587807+0000","last_fullsized":"2023-10-14T09:38:49.587807+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:49.587584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:49.587584+0000","last_clean_scrub_stamp":"2023-10-14T09:38:49.587584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:54.741961+0000","scrub_duration":0.0034985849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"36'119","reported_seq":188,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:50.256613+0000","last_change":"2023-10-14T09:38:50.256743+0000","last_active":"2023-10-14T09:38:50.256613+0000","last_peered":"2023-10-14T09:38:50.256613+0000","last_clean":"2023-10-14T09:38:50.256613+0000","last_became_active":"2023-10-14T09:37:12.364623+0000","last_became_peered":"2023-10-14T09:37:12.364623+0000","last_unstale":"2023-10-14T09:38:50.256613+0000","last_undegraded":"2023-10-14T09:38:50.256613+0000","last_fullsized":"2023-10-14T09:38:50.256613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'119","last_scrub_stamp":"2023-10-14T09:38:50.256394+0000","last_deep_scrub":"36'119","last_deep_scrub_stamp":"2023-10-14T09:38:50.256394+0000","last_clean_scrub_stamp":"2023-10-14T09:38:50.256394+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:31:14.101164+0000","scrub_duration":0.014946450999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":999424,"data_stored":748946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.78100000000000003}]},{"osd":1,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.0780000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":1.4830000000000001}]},{"osd":3,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.9060000000000001,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":1.3799999999999999}]},{"osd":4,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.339}]},{"osd":5,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":3.0129999999999999,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.1830000000000001}]},{"osd":6,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.4260000000000002,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.0710000000000002,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.702}]}]},{"osd":6,"up_from":15,"seq":64424509467,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":409600,"data_stored":159104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.496}]},{"osd":1,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":1.159},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.2929999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.4540000000000002,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.042},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.617}]},{"osd":3,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":4.5419999999999998,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":4.2839999999999998,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":1.448}]},{"osd":4,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.206},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":1.5580000000000001}]},{"osd":5,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.7069999999999999,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":1.363}]},{"osd":7,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.669},{"interface":"front","average":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.5899999999999999,"5min":2.5899999999999999,"15min":2.5899999999999999},"last":1.5309999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509467,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":409600,"data_stored":158592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":1.621,"5min":1.621,"15min":1.621},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":13.404,"5min":13.404,"15min":13.404},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":9.4640000000000004,"5min":9.4640000000000004,"15min":9.4640000000000004},"last":1.0009999999999999}]},{"osd":1,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":6.734,"5min":6.734,"15min":6.734},"last":0.874},{"interface":"front","average":{"1min":1.504,"5min":1.504,"15min":1.504},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":7.8860000000000001,"5min":7.8860000000000001,"15min":7.8860000000000001},"last":1.3260000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":1.591,"5min":1.591,"15min":1.591},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":7.8520000000000003,"5min":7.8520000000000003,"15min":7.8520000000000003},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.889,"5min":1.889,"15min":1.889},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":14.609,"5min":14.609,"15min":14.609},"last":0.93700000000000006}]},{"osd":3,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":1.964,"5min":1.964,"15min":1.964},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":15.856,"5min":15.856,"15min":15.856},"last":1.042},{"interface":"front","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":6.1970000000000001,"5min":6.1970000000000001,"15min":6.1970000000000001},"last":1.1140000000000001}]},{"osd":5,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":16.547000000000001,"5min":16.547000000000001,"15min":16.547000000000001},"last":1.4470000000000001},{"interface":"front","average":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":15.913,"5min":15.913,"15min":15.913},"last":1.179}]},{"osd":6,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":2.3029999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":16.481999999999999,"5min":16.481999999999999,"15min":16.481999999999999},"last":1.494},{"interface":"front","average":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":15.956,"5min":15.956,"15min":15.956},"last":1.2949999999999999}]},{"osd":7,"last update":"Sat Oct 14 09:38:13 2023","interfaces":[{"interface":"back","average":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":6.6520000000000001,"5min":6.6520000000000001,"15min":6.6520000000000001},"last":1.218},{"interface":"front","average":{"1min":2.073,"5min":2.073,"15min":2.073},"min":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":10.314,"5min":10.314,"15min":10.314},"last":1.5529999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509466,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":417792,"data_stored":160122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":1.3069999999999999},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.80800000000000005}]},{"osd":1,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.7349999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":1.105}]},{"osd":2,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":2.77,"5min":2.77,"15min":2.77},"last":1.389}]},{"osd":4,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":2.153,"5min":2.153,"15min":2.153},"last":1.264}]},{"osd":5,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":3.6469999999999998,"5min":3.6469999999999998,"15min":3.6469999999999998},"last":1.5820000000000001},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.4259999999999999}]},{"osd":6,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":3.6930000000000001,"5min":3.6930000000000001,"15min":3.6930000000000001},"last":1.47}]},{"osd":7,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.4249999999999998,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.5349999999999999},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.1739999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509467,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":405504,"data_stored":158558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.7789999999999999,"5min":2.7789999999999999,"15min":2.7789999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.88700000000000001}]},{"osd":1,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.3490000000000002,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.65200000000000002}]},{"osd":3,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.417},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.4700000000000002,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":1.2789999999999999}]},{"osd":4,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.5960000000000001,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":1.157},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":3.1469999999999998,"5min":3.1469999999999998,"15min":3.1469999999999998},"last":0.99299999999999999}]},{"osd":5,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":4.0800000000000001,"5min":4.0800000000000001,"15min":4.0800000000000001},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":3.6709999999999998,"5min":3.6709999999999998,"15min":3.6709999999999998},"last":1.3640000000000001}]},{"osd":6,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.9249999999999998,"5min":2.9249999999999998,"15min":2.9249999999999998},"last":1.109},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":3.081,"5min":3.081,"15min":3.081},"last":1.3149999999999999}]},{"osd":7,"last update":"Sat Oct 14 09:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":5.0650000000000004,"5min":5.0650000000000004,"15min":5.0650000000000004},"last":1.077},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":3.8849999999999998,"5min":3.8849999999999998,"15min":3.8849999999999998},"last":1.446}]}]},{"osd":1,"up_from":15,"seq":64424509467,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":417792,"data_stored":160122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.177}]},{"osd":2,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":1.115}]},{"osd":3,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":3.1499999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.006}]},{"osd":4,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":3.7320000000000002,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":1.276},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.2310000000000001}]},{"osd":5,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":3.02,"5min":3.02,"15min":3.02},"last":1.361},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":3.827,"5min":3.827,"15min":3.827},"last":1.492}]},{"osd":6,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":3.3250000000000002,"5min":3.3250000000000002,"15min":3.3250000000000002},"last":1.4159999999999999}]},{"osd":7,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":3.9100000000000001,"5min":3.9100000000000001,"15min":3.9100000000000001},"last":1.5740000000000001},{"interface":"front","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":3.105,"5min":3.105,"15min":3.105},"last":1.3280000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542171,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":409600,"data_stored":159160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.232}]},{"osd":1,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.512},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":1.339}]},{"osd":2,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":4.4610000000000003,"5min":4.4610000000000003,"15min":4.4610000000000003},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.6259999999999999}]},{"osd":3,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.2809999999999999}]},{"osd":4,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.4450000000000001}]},{"osd":6,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.4750000000000001},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":1.54}]},{"osd":7,"last update":"Sat Oct 14 09:38:10 2023","interfaces":[{"interface":"back","average":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":2.387,"5min":2.387,"15min":2.387},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.5780000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542171,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":995328,"data_stored":748856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":3.0750000000000002,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":1.022},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.2919999999999998,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.73299999999999998}]},{"osd":2,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":1.05},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":4.2210000000000001,"5min":4.2210000000000001,"15min":4.2210000000000001},"last":1.2609999999999999}]},{"osd":3,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":3.6070000000000002,"5min":3.6070000000000002,"15min":3.6070000000000002},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.2170000000000001}]},{"osd":4,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":4.1609999999999996,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":1.089},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":2.391,"5min":2.391,"15min":2.391},"last":1.3300000000000001}]},{"osd":5,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":3.8620000000000001,"5min":3.8620000000000001,"15min":3.8620000000000001},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":2.4220000000000002,"5min":2.4220000000000002,"15min":2.4220000000000002},"last":1.5089999999999999}]},{"osd":6,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":3.8210000000000002,"5min":3.8210000000000002,"15min":3.8210000000000002},"last":1.381},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"min":{"1min":0.997,"5min":0.997,"15min":0.997},"max":{"1min":4.0999999999999996,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":1.4239999999999999}]},{"osd":7,"last update":"Sat Oct 14 09:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":1.581,"15min":1.581},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":4.1920000000000002,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":1.538},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.5720000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T09:39:10.104 INFO:tasks.ceph:pgid 5.3f last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.104 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.105 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.105 INFO:tasks.ceph:pgid 5.3b last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.105 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.106 INFO:tasks.ceph:pgid 5.39 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.106 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.107 INFO:tasks.ceph:pgid 5.36 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.107 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.107 INFO:tasks.ceph:pgid 5.31 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.108 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.108 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.108 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.109 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.109 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.109 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.110 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.110 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.111 INFO:tasks.ceph:pgid 5.24 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.111 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.111 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.112 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.112 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.113 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.113 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.113 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.114 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.114 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.115 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.115 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.115 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-10-14T09:38:28.965497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=28, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.116 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.116 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.117 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-10-14T09:38:28.965497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=28, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.117 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.118 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.119 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.119 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.120 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-10-14T09:38:28.965497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=28, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.120 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.121 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-10-14T09:38:28.965497+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=28, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.121 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.122 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:10.122 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:39:30.124 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:39:30.348 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.347+0000 7f4f67a75640 1 Processor -- start 2023-10-14T09:39:30.349 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.347+0000 7f4f67a75640 1 -- start start 2023-10-14T09:39:30.350 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.348+0000 7f4f67a75640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4f60159f00 0x7f4f600b0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:39:30.350 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.348+0000 7f4f67a75640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f6006f7f0 con 0x7f4f6015d880 2023-10-14T09:39:30.350 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.348+0000 7f4f67a75640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f6006c5e0 con 0x7f4f60159b20 2023-10-14T09:39:30.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.348+0000 7f4f67a75640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f6006c8c0 con 0x7f4f60159f00 2023-10-14T09:39:30.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.349+0000 7f4f66012640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f4f6015d880 0x7f4f6006fc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:52416/0 (socket says 172.21.15.102:52416) 2023-10-14T09:39:30.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.349+0000 7f4f66012640 1 -- 172.21.15.102:0/4227152924 learned_addr learned my addr 172.21.15.102:0/4227152924 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-10-14T09:39:30.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.349+0000 7f4f65010640 1 --2- 172.21.15.102:0/4227152924 >> v2:172.21.15.102:3300/0 conn(0x7f4f60159f00 0x7f4f600b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:39:30.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.349+0000 7f4f6480f640 1 -- 172.21.15.102:0/4227152924 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1646691485 0 0) 0x7f4f6006f7f0 con 0x7f4f6015d880 2023-10-14T09:39:30.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.349+0000 7f4f6480f640 1 -- 172.21.15.102:0/4227152924 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f4c005730 con 0x7f4f6015d880 2023-10-14T09:39:30.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.349+0000 7f4f65010640 1 -- 172.21.15.102:0/4227152924 >> v1:172.21.15.129:6789/0 conn(0x7f4f60159b20 legacy=0x7f4f6006bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:39:30.354 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.349+0000 7f4f65010640 1 -- 172.21.15.102:0/4227152924 >> v1:172.21.15.102:6789/0 conn(0x7f4f6015d880 legacy=0x7f4f6006fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:39:30.354 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.349+0000 7f4f65010640 1 -- 172.21.15.102:0/4227152924 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f6006cba0 con 0x7f4f60159f00 2023-10-14T09:39:30.354 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.350+0000 7f4f65010640 1 --2- 172.21.15.102:0/4227152924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f60159f00 0x7f4f600b0410 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4f500097a0 tx=0x7f4f5002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6613e997b24bbd3e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:39:30.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.351+0000 7f4f6480f640 1 -- 172.21.15.102:0/4227152924 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f50030610 con 0x7f4f60159f00 2023-10-14T09:39:30.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.351+0000 7f4f6480f640 1 -- 172.21.15.102:0/4227152924 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f50030770 con 0x7f4f60159f00 2023-10-14T09:39:30.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.351+0000 7f4f6480f640 1 -- 172.21.15.102:0/4227152924 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f50030b00 con 0x7f4f60159f00 2023-10-14T09:39:30.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.351+0000 7f4f67a75640 1 -- 172.21.15.102:0/4227152924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f60159f00 msgr2=0x7f4f600b0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:39:30.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.351+0000 7f4f67a75640 1 --2- 172.21.15.102:0/4227152924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f60159f00 0x7f4f600b0410 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4f500097a0 tx=0x7f4f5002b960 comp rx=0 tx=0).stop 2023-10-14T09:39:30.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.351+0000 7f4f67a75640 1 -- 172.21.15.102:0/4227152924 shutdown_connections 2023-10-14T09:39:30.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.351+0000 7f4f67a75640 1 --2- 172.21.15.102:0/4227152924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f60159f00 0x7f4f600b0410 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:39:30.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.351+0000 7f4f67a75640 1 -- 172.21.15.102:0/4227152924 >> 172.21.15.102:0/4227152924 conn(0x7f4f600cb410 msgr2=0x7f4f600cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:39:30.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.351+0000 7f4f67a75640 1 -- 172.21.15.102:0/4227152924 shutdown_connections 2023-10-14T09:39:30.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.352+0000 7f4f67a75640 1 -- 172.21.15.102:0/4227152924 wait complete. 2023-10-14T09:39:30.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.353+0000 7f4f67a75640 1 Processor -- start 2023-10-14T09:39:30.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.353+0000 7f4f67a75640 1 -- start start 2023-10-14T09:39:30.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.354+0000 7f4f67a75640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4f60159b20 0x7f4f601511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:39:30.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.354+0000 7f4f67a75640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f60159f00 0x7f4f601519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:39:30.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.354+0000 7f4f67a75640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4f6015d880 0x7f4f600c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:39:30.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.354+0000 7f4f67a75640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f60151720 con 0x7f4f60159f00 2023-10-14T09:39:30.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.354+0000 7f4f67a75640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6015a2e0 con 0x7f4f60159b20 2023-10-14T09:39:30.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.354+0000 7f4f67a75640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6015c410 con 0x7f4f6015d880 2023-10-14T09:39:30.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.355+0000 7f4f65010640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f60159f00 0x7f4f601519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:39:30.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.355+0000 7f4f65010640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f60159f00 0x7f4f601519b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44632/0 (socket says 172.21.15.102:44632) 2023-10-14T09:39:30.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.355+0000 7f4f65010640 1 -- 172.21.15.102:0/36532253 learned_addr learned my addr 172.21.15.102:0/36532253 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:39:30.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.355+0000 7f4f65010640 1 -- 172.21.15.102:0/36532253 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4f6015d880 msgr2=0x7f4f600c67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:39:30.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.355+0000 7f4f65811640 1 --2- 172.21.15.102:0/36532253 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4f60159b20 0x7f4f601511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:39:30.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.355+0000 7f4f66012640 1 --2- 172.21.15.102:0/36532253 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4f6015d880 0x7f4f600c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:39:30.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.355+0000 7f4f65010640 1 --2- 172.21.15.102:0/36532253 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4f6015d880 0x7f4f600c67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:39:30.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.355+0000 7f4f65010640 1 -- 172.21.15.102:0/36532253 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4f60159b20 msgr2=0x7f4f601511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:39:30.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.355+0000 7f4f65010640 1 --2- 172.21.15.102:0/36532253 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4f60159b20 0x7f4f601511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:39:30.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.355+0000 7f4f65010640 1 -- 172.21.15.102:0/36532253 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f50009400 con 0x7f4f60159f00 2023-10-14T09:39:30.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.355+0000 7f4f65811640 1 --2- 172.21.15.102:0/36532253 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4f60159b20 0x7f4f601511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:39:30.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.355+0000 7f4f65010640 1 --2- 172.21.15.102:0/36532253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f60159f00 0x7f4f601519b0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4f5002bf70 tx=0x7f4f50004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:39:30.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.356+0000 7f4f567fc640 1 -- 172.21.15.102:0/36532253 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5003e040 con 0x7f4f60159f00 2023-10-14T09:39:30.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.356+0000 7f4f567fc640 1 -- 172.21.15.102:0/36532253 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f50039cb0 con 0x7f4f60159f00 2023-10-14T09:39:30.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.356+0000 7f4f67a75640 1 -- 172.21.15.102:0/36532253 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f6015c6f0 con 0x7f4f60159f00 2023-10-14T09:39:30.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.356+0000 7f4f567fc640 1 -- 172.21.15.102:0/36532253 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f50044630 con 0x7f4f60159f00 2023-10-14T09:39:30.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.356+0000 7f4f67a75640 1 -- 172.21.15.102:0/36532253 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f6015a530 con 0x7f4f60159f00 2023-10-14T09:39:30.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.357+0000 7f4f67a75640 1 -- 172.21.15.102:0/36532253 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f6006c270 con 0x7f4f60159f00 2023-10-14T09:39:30.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.358+0000 7f4f567fc640 1 -- 172.21.15.102:0/36532253 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4f5004d3b0 con 0x7f4f60159f00 2023-10-14T09:39:30.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.359+0000 7f4f567fc640 1 --2- 172.21.15.102:0/36532253 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4f4406ae70 0x7f4f4406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:39:30.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.359+0000 7f4f567fc640 1 -- 172.21.15.102:0/36532253 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f4f500abc60 con 0x7f4f60159f00 2023-10-14T09:39:30.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.359+0000 7f4f65811640 1 --2- 172.21.15.102:0/36532253 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4f4406ae70 0x7f4f4406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:39:30.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.360+0000 7f4f65811640 1 --2- 172.21.15.102:0/36532253 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4f4406ae70 0x7f4f4406d330 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c000f60 tx=0x7f4f5c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:39:30.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.364+0000 7f4f567fc640 1 -- 172.21.15.102:0/36532253 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4f50076d80 con 0x7f4f60159f00 2023-10-14T09:39:30.549 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.548+0000 7f4f67a75640 1 -- 172.21.15.102:0/36532253 --> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4f6006ce80 con 0x7f4f4406ae70 2023-10-14T09:39:30.562 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.560+0000 7f4f567fc640 1 -- 172.21.15.102:0/36532253 <== mgr.4104 v2:172.21.15.102:6832/1125265706 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288234 (secure 0 0 0) 0x7f4f5c001c90 con 0x7f4f4406ae70 2023-10-14T09:39:30.566 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:39:30.568 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2023-10-14T09:39:30.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.567+0000 7f4f67a75640 1 -- 172.21.15.102:0/36532253 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4f4406ae70 msgr2=0x7f4f4406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:39:30.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.567+0000 7f4f67a75640 1 --2- 172.21.15.102:0/36532253 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4f4406ae70 0x7f4f4406d330 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c000f60 tx=0x7f4f5c009040 comp rx=0 tx=0).stop 2023-10-14T09:39:30.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.567+0000 7f4f67a75640 1 -- 172.21.15.102:0/36532253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f60159f00 msgr2=0x7f4f601519b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:39:30.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.567+0000 7f4f67a75640 1 --2- 172.21.15.102:0/36532253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f60159f00 0x7f4f601519b0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4f5002bf70 tx=0x7f4f50004730 comp rx=0 tx=0).stop 2023-10-14T09:39:30.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.567+0000 7f4f67a75640 1 -- 172.21.15.102:0/36532253 shutdown_connections 2023-10-14T09:39:30.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.567+0000 7f4f67a75640 1 --2- 172.21.15.102:0/36532253 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f4f4406ae70 0x7f4f4406d330 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:39:30.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.567+0000 7f4f67a75640 1 --2- 172.21.15.102:0/36532253 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4f6015d880 0x7f4f600c67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:39:30.572 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.567+0000 7f4f67a75640 1 --2- 172.21.15.102:0/36532253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f60159f00 0x7f4f601519b0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:39:30.572 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.567+0000 7f4f67a75640 1 --2- 172.21.15.102:0/36532253 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4f60159b20 0x7f4f601511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:39:30.572 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.567+0000 7f4f67a75640 1 -- 172.21.15.102:0/36532253 >> 172.21.15.102:0/36532253 conn(0x7f4f600cb410 msgr2=0x7f4f60158de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:39:30.572 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.568+0000 7f4f67a75640 1 -- 172.21.15.102:0/36532253 shutdown_connections 2023-10-14T09:39:30.573 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:30.568+0000 7f4f67a75640 1 -- 172.21.15.102:0/36532253 wait complete. 2023-10-14T09:39:30.588 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2023-10-14T09:39:29.918203+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220488,"kb_used_data":4360,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754232,"statfs":{"total":773094113280,"available":772868333568,"internally_reserved":0,"allocated":4464640,"data_stored":2453460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004533"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:08.679134+0000","last_change":"2023-10-14T09:39:08.679315+0000","last_active":"2023-10-14T09:39:08.679134+0000","last_peered":"2023-10-14T09:39:08.679134+0000","last_clean":"2023-10-14T09:39:08.679134+0000","last_became_active":"2023-10-14T09:38:31.023780+0000","last_became_peered":"2023-10-14T09:38:31.023780+0000","last_unstale":"2023-10-14T09:39:08.679134+0000","last_undegraded":"2023-10-14T09:39:08.679134+0000","last_fullsized":"2023-10-14T09:39:08.679134+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:08.678892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:08.678892+0000","last_clean_scrub_stamp":"2023-10-14T09:39:08.678892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:24:24.216542+0000","scrub_duration":0.003218533,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.925742+0000","last_change":"2023-10-14T09:38:31.028205+0000","last_active":"2023-10-14T09:38:34.925742+0000","last_peered":"2023-10-14T09:38:34.925742+0000","last_clean":"2023-10-14T09:38:34.925742+0000","last_became_active":"2023-10-14T09:38:31.027820+0000","last_became_peered":"2023-10-14T09:38:31.027820+0000","last_unstale":"2023-10-14T09:38:34.925742+0000","last_undegraded":"2023-10-14T09:38:34.925742+0000","last_fullsized":"2023-10-14T09:38:34.925742+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:04.176269+0000","last_change":"2023-10-14T09:39:04.176464+0000","last_active":"2023-10-14T09:39:04.176269+0000","last_peered":"2023-10-14T09:39:04.176269+0000","last_clean":"2023-10-14T09:39:04.176269+0000","last_became_active":"2023-10-14T09:38:31.019892+0000","last_became_peered":"2023-10-14T09:38:31.019892+0000","last_unstale":"2023-10-14T09:39:04.176269+0000","last_undegraded":"2023-10-14T09:39:04.176269+0000","last_fullsized":"2023-10-14T09:39:04.176269+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:04.176059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:04.176059+0000","last_clean_scrub_stamp":"2023-10-14T09:39:04.176059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:01.866021+0000","scrub_duration":0.0038494269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.926556+0000","last_change":"2023-10-14T09:38:31.035562+0000","last_active":"2023-10-14T09:38:34.926556+0000","last_peered":"2023-10-14T09:38:34.926556+0000","last_clean":"2023-10-14T09:38:34.926556+0000","last_became_active":"2023-10-14T09:38:31.035189+0000","last_became_peered":"2023-10-14T09:38:31.035189+0000","last_unstale":"2023-10-14T09:38:34.926556+0000","last_undegraded":"2023-10-14T09:38:34.926556+0000","last_fullsized":"2023-10-14T09:38:34.926556+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:11.711538+0000","last_change":"2023-10-14T09:39:11.711716+0000","last_active":"2023-10-14T09:39:11.711538+0000","last_peered":"2023-10-14T09:39:11.711538+0000","last_clean":"2023-10-14T09:39:11.711538+0000","last_became_active":"2023-10-14T09:38:31.020777+0000","last_became_peered":"2023-10-14T09:38:31.020777+0000","last_unstale":"2023-10-14T09:39:11.711538+0000","last_undegraded":"2023-10-14T09:39:11.711538+0000","last_fullsized":"2023-10-14T09:39:11.711538+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:11.711327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:11.711327+0000","last_clean_scrub_stamp":"2023-10-14T09:39:11.711327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:57:10.065520+0000","scrub_duration":0.0032876120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.925590+0000","last_change":"2023-10-14T09:38:31.028808+0000","last_active":"2023-10-14T09:38:34.925590+0000","last_peered":"2023-10-14T09:38:34.925590+0000","last_clean":"2023-10-14T09:38:34.925590+0000","last_became_active":"2023-10-14T09:38:31.027342+0000","last_became_peered":"2023-10-14T09:38:31.027342+0000","last_unstale":"2023-10-14T09:38:34.925590+0000","last_undegraded":"2023-10-14T09:38:34.925590+0000","last_fullsized":"2023-10-14T09:38:34.925590+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:09.340813+0000","last_change":"2023-10-14T09:39:09.340915+0000","last_active":"2023-10-14T09:39:09.340813+0000","last_peered":"2023-10-14T09:39:09.340813+0000","last_clean":"2023-10-14T09:39:09.340813+0000","last_became_active":"2023-10-14T09:38:31.033760+0000","last_became_peered":"2023-10-14T09:38:31.033760+0000","last_unstale":"2023-10-14T09:39:09.340813+0000","last_undegraded":"2023-10-14T09:39:09.340813+0000","last_fullsized":"2023-10-14T09:39:09.340813+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:09.340626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:09.340626+0000","last_clean_scrub_stamp":"2023-10-14T09:39:09.340626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:22:23.056489+0000","scrub_duration":0.0036686370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:53.242083+0000","last_change":"2023-10-14T09:38:53.242193+0000","last_active":"2023-10-14T09:38:53.242083+0000","last_peered":"2023-10-14T09:38:53.242083+0000","last_clean":"2023-10-14T09:38:53.242083+0000","last_became_active":"2023-10-14T09:38:31.024702+0000","last_became_peered":"2023-10-14T09:38:31.024702+0000","last_unstale":"2023-10-14T09:38:53.242083+0000","last_undegraded":"2023-10-14T09:38:53.242083+0000","last_fullsized":"2023-10-14T09:38:53.242083+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:53.241901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:53.241901+0000","last_clean_scrub_stamp":"2023-10-14T09:38:53.241901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:24:15.099376+0000","scrub_duration":0.0037239859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:21.534934+0000","last_change":"2023-10-14T09:39:21.535050+0000","last_active":"2023-10-14T09:39:21.534934+0000","last_peered":"2023-10-14T09:39:21.534934+0000","last_clean":"2023-10-14T09:39:21.534934+0000","last_became_active":"2023-10-14T09:38:31.023498+0000","last_became_peered":"2023-10-14T09:38:31.023498+0000","last_unstale":"2023-10-14T09:39:21.534934+0000","last_undegraded":"2023-10-14T09:39:21.534934+0000","last_fullsized":"2023-10-14T09:39:21.534934+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:21.534743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:21.534743+0000","last_clean_scrub_stamp":"2023-10-14T09:39:21.534743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:46:56.536260+0000","scrub_duration":0.0037966150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.926733+0000","last_change":"2023-10-14T09:38:31.029616+0000","last_active":"2023-10-14T09:38:34.926733+0000","last_peered":"2023-10-14T09:38:34.926733+0000","last_clean":"2023-10-14T09:38:34.926733+0000","last_became_active":"2023-10-14T09:38:31.029268+0000","last_became_peered":"2023-10-14T09:38:31.029268+0000","last_unstale":"2023-10-14T09:38:34.926733+0000","last_undegraded":"2023-10-14T09:38:34.926733+0000","last_fullsized":"2023-10-14T09:38:34.926733+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:54.281412+0000","last_change":"2023-10-14T09:38:54.281549+0000","last_active":"2023-10-14T09:38:54.281412+0000","last_peered":"2023-10-14T09:38:54.281412+0000","last_clean":"2023-10-14T09:38:54.281412+0000","last_became_active":"2023-10-14T09:38:31.033343+0000","last_became_peered":"2023-10-14T09:38:31.033343+0000","last_unstale":"2023-10-14T09:38:54.281412+0000","last_undegraded":"2023-10-14T09:38:54.281412+0000","last_fullsized":"2023-10-14T09:38:54.281412+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:54.281200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:54.281200+0000","last_clean_scrub_stamp":"2023-10-14T09:38:54.281200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:56:08.772956+0000","scrub_duration":0.003963818,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:02.146816+0000","last_change":"2023-10-14T09:39:02.146946+0000","last_active":"2023-10-14T09:39:02.146816+0000","last_peered":"2023-10-14T09:39:02.146816+0000","last_clean":"2023-10-14T09:39:02.146816+0000","last_became_active":"2023-10-14T09:38:31.017971+0000","last_became_peered":"2023-10-14T09:38:31.017971+0000","last_unstale":"2023-10-14T09:39:02.146816+0000","last_undegraded":"2023-10-14T09:39:02.146816+0000","last_fullsized":"2023-10-14T09:39:02.146816+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:02.146634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:02.146634+0000","last_clean_scrub_stamp":"2023-10-14T09:39:02.146634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:38:25.497182+0000","scrub_duration":0.0038723500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:49.533192+0000","last_change":"2023-10-14T09:38:49.533292+0000","last_active":"2023-10-14T09:38:49.533192+0000","last_peered":"2023-10-14T09:38:49.533192+0000","last_clean":"2023-10-14T09:38:49.533192+0000","last_became_active":"2023-10-14T09:38:31.019186+0000","last_became_peered":"2023-10-14T09:38:31.019186+0000","last_unstale":"2023-10-14T09:38:49.533192+0000","last_undegraded":"2023-10-14T09:38:49.533192+0000","last_fullsized":"2023-10-14T09:38:49.533192+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:49.532907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:49.532907+0000","last_clean_scrub_stamp":"2023-10-14T09:38:49.532907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:50:05.598559+0000","scrub_duration":0.0024617720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:21.034412+0000","last_change":"2023-10-14T09:39:21.034532+0000","last_active":"2023-10-14T09:39:21.034412+0000","last_peered":"2023-10-14T09:39:21.034412+0000","last_clean":"2023-10-14T09:39:21.034412+0000","last_became_active":"2023-10-14T09:38:31.020409+0000","last_became_peered":"2023-10-14T09:38:31.020409+0000","last_unstale":"2023-10-14T09:39:21.034412+0000","last_undegraded":"2023-10-14T09:39:21.034412+0000","last_fullsized":"2023-10-14T09:39:21.034412+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:21.034224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:21.034224+0000","last_clean_scrub_stamp":"2023-10-14T09:39:21.034224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:10:45.600855+0000","scrub_duration":0.0035651189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:13.063661+0000","last_change":"2023-10-14T09:39:13.063764+0000","last_active":"2023-10-14T09:39:13.063661+0000","last_peered":"2023-10-14T09:39:13.063661+0000","last_clean":"2023-10-14T09:39:13.063661+0000","last_became_active":"2023-10-14T09:38:31.025155+0000","last_became_peered":"2023-10-14T09:38:31.025155+0000","last_unstale":"2023-10-14T09:39:13.063661+0000","last_undegraded":"2023-10-14T09:39:13.063661+0000","last_fullsized":"2023-10-14T09:39:13.063661+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:13.063384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:13.063384+0000","last_clean_scrub_stamp":"2023-10-14T09:39:13.063384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:26.836471+0000","scrub_duration":0.0035710059999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:00.295754+0000","last_change":"2023-10-14T09:39:00.295945+0000","last_active":"2023-10-14T09:39:00.295754+0000","last_peered":"2023-10-14T09:39:00.295754+0000","last_clean":"2023-10-14T09:39:00.295754+0000","last_became_active":"2023-10-14T09:38:31.033869+0000","last_became_peered":"2023-10-14T09:38:31.033869+0000","last_unstale":"2023-10-14T09:39:00.295754+0000","last_undegraded":"2023-10-14T09:39:00.295754+0000","last_fullsized":"2023-10-14T09:39:00.295754+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:00.295522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:00.295522+0000","last_clean_scrub_stamp":"2023-10-14T09:39:00.295522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:12:26.055534+0000","scrub_duration":0.0036621850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:58.255288+0000","last_change":"2023-10-14T09:38:58.255392+0000","last_active":"2023-10-14T09:38:58.255288+0000","last_peered":"2023-10-14T09:38:58.255288+0000","last_clean":"2023-10-14T09:38:58.255288+0000","last_became_active":"2023-10-14T09:38:31.029457+0000","last_became_peered":"2023-10-14T09:38:31.029457+0000","last_unstale":"2023-10-14T09:38:58.255288+0000","last_undegraded":"2023-10-14T09:38:58.255288+0000","last_fullsized":"2023-10-14T09:38:58.255288+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:58.255108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:58.255108+0000","last_clean_scrub_stamp":"2023-10-14T09:38:58.255108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:10:17.655904+0000","scrub_duration":0.0033634659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.925763+0000","last_change":"2023-10-14T09:38:31.033346+0000","last_active":"2023-10-14T09:38:34.925763+0000","last_peered":"2023-10-14T09:38:34.925763+0000","last_clean":"2023-10-14T09:38:34.925763+0000","last_became_active":"2023-10-14T09:38:31.033040+0000","last_became_peered":"2023-10-14T09:38:31.033040+0000","last_unstale":"2023-10-14T09:38:34.925763+0000","last_undegraded":"2023-10-14T09:38:34.925763+0000","last_fullsized":"2023-10-14T09:38:34.925763+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:08.083614+0000","last_change":"2023-10-14T09:39:08.083715+0000","last_active":"2023-10-14T09:39:08.083614+0000","last_peered":"2023-10-14T09:39:08.083614+0000","last_clean":"2023-10-14T09:39:08.083614+0000","last_became_active":"2023-10-14T09:38:31.025735+0000","last_became_peered":"2023-10-14T09:38:31.025735+0000","last_unstale":"2023-10-14T09:39:08.083614+0000","last_undegraded":"2023-10-14T09:39:08.083614+0000","last_fullsized":"2023-10-14T09:39:08.083614+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:08.083434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:08.083434+0000","last_clean_scrub_stamp":"2023-10-14T09:39:08.083434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:13:04.453658+0000","scrub_duration":0.0033516599999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:59.645885+0000","last_change":"2023-10-14T09:38:59.645989+0000","last_active":"2023-10-14T09:38:59.645885+0000","last_peered":"2023-10-14T09:38:59.645885+0000","last_clean":"2023-10-14T09:38:59.645885+0000","last_became_active":"2023-10-14T09:38:31.011363+0000","last_became_peered":"2023-10-14T09:38:31.011363+0000","last_unstale":"2023-10-14T09:38:59.645885+0000","last_undegraded":"2023-10-14T09:38:59.645885+0000","last_fullsized":"2023-10-14T09:38:59.645885+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:59.645701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:59.645701+0000","last_clean_scrub_stamp":"2023-10-14T09:38:59.645701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:06:09.913970+0000","scrub_duration":0.0038696870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:11.540547+0000","last_change":"2023-10-14T09:39:11.540653+0000","last_active":"2023-10-14T09:39:11.540547+0000","last_peered":"2023-10-14T09:39:11.540547+0000","last_clean":"2023-10-14T09:39:11.540547+0000","last_became_active":"2023-10-14T09:38:31.021555+0000","last_became_peered":"2023-10-14T09:38:31.021555+0000","last_unstale":"2023-10-14T09:39:11.540547+0000","last_undegraded":"2023-10-14T09:39:11.540547+0000","last_fullsized":"2023-10-14T09:39:11.540547+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:11.540315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:11.540315+0000","last_clean_scrub_stamp":"2023-10-14T09:39:11.540315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:37:15.545521+0000","scrub_duration":0.0036936970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.932301+0000","last_change":"2023-10-14T09:38:31.029992+0000","last_active":"2023-10-14T09:38:34.932301+0000","last_peered":"2023-10-14T09:38:34.932301+0000","last_clean":"2023-10-14T09:38:34.932301+0000","last_became_active":"2023-10-14T09:38:31.029712+0000","last_became_peered":"2023-10-14T09:38:31.029712+0000","last_unstale":"2023-10-14T09:38:34.932301+0000","last_undegraded":"2023-10-14T09:38:34.932301+0000","last_fullsized":"2023-10-14T09:38:34.932301+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:57.630740+0000","last_change":"2023-10-14T09:38:57.630848+0000","last_active":"2023-10-14T09:38:57.630740+0000","last_peered":"2023-10-14T09:38:57.630740+0000","last_clean":"2023-10-14T09:38:57.630740+0000","last_became_active":"2023-10-14T09:38:31.023251+0000","last_became_peered":"2023-10-14T09:38:31.023251+0000","last_unstale":"2023-10-14T09:38:57.630740+0000","last_undegraded":"2023-10-14T09:38:57.630740+0000","last_fullsized":"2023-10-14T09:38:57.630740+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:57.630577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:57.630577+0000","last_clean_scrub_stamp":"2023-10-14T09:38:57.630577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:23:32.551600+0000","scrub_duration":0.0038587109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:15.975509+0000","last_change":"2023-10-14T09:39:15.975621+0000","last_active":"2023-10-14T09:39:15.975509+0000","last_peered":"2023-10-14T09:39:15.975509+0000","last_clean":"2023-10-14T09:39:15.975509+0000","last_became_active":"2023-10-14T09:38:31.010860+0000","last_became_peered":"2023-10-14T09:38:31.010860+0000","last_unstale":"2023-10-14T09:39:15.975509+0000","last_undegraded":"2023-10-14T09:39:15.975509+0000","last_fullsized":"2023-10-14T09:39:15.975509+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:15.975300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:15.975300+0000","last_clean_scrub_stamp":"2023-10-14T09:39:15.975300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:33:45.828182+0000","scrub_duration":0.0039747810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.926771+0000","last_change":"2023-10-14T09:38:31.023722+0000","last_active":"2023-10-14T09:38:34.926771+0000","last_peered":"2023-10-14T09:38:34.926771+0000","last_clean":"2023-10-14T09:38:34.926771+0000","last_became_active":"2023-10-14T09:38:31.023469+0000","last_became_peered":"2023-10-14T09:38:31.023469+0000","last_unstale":"2023-10-14T09:38:34.926771+0000","last_undegraded":"2023-10-14T09:38:34.926771+0000","last_fullsized":"2023-10-14T09:38:34.926771+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.925843+0000","last_change":"2023-10-14T09:38:31.028525+0000","last_active":"2023-10-14T09:38:34.925843+0000","last_peered":"2023-10-14T09:38:34.925843+0000","last_clean":"2023-10-14T09:38:34.925843+0000","last_became_active":"2023-10-14T09:38:31.026660+0000","last_became_peered":"2023-10-14T09:38:31.026660+0000","last_unstale":"2023-10-14T09:38:34.925843+0000","last_undegraded":"2023-10-14T09:38:34.925843+0000","last_fullsized":"2023-10-14T09:38:34.925843+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.926654+0000","last_change":"2023-10-14T09:38:31.026064+0000","last_active":"2023-10-14T09:38:34.926654+0000","last_peered":"2023-10-14T09:38:34.926654+0000","last_clean":"2023-10-14T09:38:34.926654+0000","last_became_active":"2023-10-14T09:38:31.025680+0000","last_became_peered":"2023-10-14T09:38:31.025680+0000","last_unstale":"2023-10-14T09:38:34.926654+0000","last_undegraded":"2023-10-14T09:38:34.926654+0000","last_fullsized":"2023-10-14T09:38:34.926654+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:09.104667+0000","last_change":"2023-10-14T09:39:09.104780+0000","last_active":"2023-10-14T09:39:09.104667+0000","last_peered":"2023-10-14T09:39:09.104667+0000","last_clean":"2023-10-14T09:39:09.104667+0000","last_became_active":"2023-10-14T09:38:31.022641+0000","last_became_peered":"2023-10-14T09:38:31.022641+0000","last_unstale":"2023-10-14T09:39:09.104667+0000","last_undegraded":"2023-10-14T09:39:09.104667+0000","last_fullsized":"2023-10-14T09:39:09.104667+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:09.104477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:09.104477+0000","last_clean_scrub_stamp":"2023-10-14T09:39:09.104477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:40:11.222798+0000","scrub_duration":0.0041570940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.932360+0000","last_change":"2023-10-14T09:38:31.031585+0000","last_active":"2023-10-14T09:38:34.932360+0000","last_peered":"2023-10-14T09:38:34.932360+0000","last_clean":"2023-10-14T09:38:34.932360+0000","last_became_active":"2023-10-14T09:38:31.031302+0000","last_became_peered":"2023-10-14T09:38:31.031302+0000","last_unstale":"2023-10-14T09:38:34.932360+0000","last_undegraded":"2023-10-14T09:38:34.932360+0000","last_fullsized":"2023-10-14T09:38:34.932360+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:01.297360+0000","last_change":"2023-10-14T09:39:01.297588+0000","last_active":"2023-10-14T09:39:01.297360+0000","last_peered":"2023-10-14T09:39:01.297360+0000","last_clean":"2023-10-14T09:39:01.297360+0000","last_became_active":"2023-10-14T09:38:31.029493+0000","last_became_peered":"2023-10-14T09:38:31.029493+0000","last_unstale":"2023-10-14T09:39:01.297360+0000","last_undegraded":"2023-10-14T09:39:01.297360+0000","last_fullsized":"2023-10-14T09:39:01.297360+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:01.297099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:01.297099+0000","last_clean_scrub_stamp":"2023-10-14T09:39:01.297099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:00:00.912022+0000","scrub_duration":0.0036701279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:01.810535+0000","last_change":"2023-10-14T09:39:01.810634+0000","last_active":"2023-10-14T09:39:01.810535+0000","last_peered":"2023-10-14T09:39:01.810535+0000","last_clean":"2023-10-14T09:39:01.810535+0000","last_became_active":"2023-10-14T09:38:31.025243+0000","last_became_peered":"2023-10-14T09:38:31.025243+0000","last_unstale":"2023-10-14T09:39:01.810535+0000","last_undegraded":"2023-10-14T09:39:01.810535+0000","last_fullsized":"2023-10-14T09:39:01.810535+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:01.810343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:01.810343+0000","last_clean_scrub_stamp":"2023-10-14T09:39:01.810343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:07:34.569268+0000","scrub_duration":0.0028920640000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:06.321798+0000","last_change":"2023-10-14T09:39:06.321903+0000","last_active":"2023-10-14T09:39:06.321798+0000","last_peered":"2023-10-14T09:39:06.321798+0000","last_clean":"2023-10-14T09:39:06.321798+0000","last_became_active":"2023-10-14T09:38:31.028420+0000","last_became_peered":"2023-10-14T09:38:31.028420+0000","last_unstale":"2023-10-14T09:39:06.321798+0000","last_undegraded":"2023-10-14T09:39:06.321798+0000","last_fullsized":"2023-10-14T09:39:06.321798+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:06.321596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:06.321596+0000","last_clean_scrub_stamp":"2023-10-14T09:39:06.321596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:04:04.665773+0000","scrub_duration":0.0036308410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:56.608953+0000","last_change":"2023-10-14T09:38:56.609079+0000","last_active":"2023-10-14T09:38:56.608953+0000","last_peered":"2023-10-14T09:38:56.608953+0000","last_clean":"2023-10-14T09:38:56.608953+0000","last_became_active":"2023-10-14T09:38:31.023482+0000","last_became_peered":"2023-10-14T09:38:31.023482+0000","last_unstale":"2023-10-14T09:38:56.608953+0000","last_undegraded":"2023-10-14T09:38:56.608953+0000","last_fullsized":"2023-10-14T09:38:56.608953+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:56.608786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:56.608786+0000","last_clean_scrub_stamp":"2023-10-14T09:38:56.608786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:22:18.269819+0000","scrub_duration":0.0034962940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"35'4","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:50.611267+0000","last_change":"2023-10-14T09:38:50.611392+0000","last_active":"2023-10-14T09:38:50.611267+0000","last_peered":"2023-10-14T09:38:50.611267+0000","last_clean":"2023-10-14T09:38:50.611267+0000","last_became_active":"2023-10-14T09:38:30.031374+0000","last_became_peered":"2023-10-14T09:38:30.031374+0000","last_unstale":"2023-10-14T09:38:50.611267+0000","last_undegraded":"2023-10-14T09:38:50.611267+0000","last_fullsized":"2023-10-14T09:38:50.611267+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2023-10-14T09:38:50.611077+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2023-10-14T09:38:50.611077+0000","last_clean_scrub_stamp":"2023-10-14T09:38:50.611077+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:06:00.879346+0000","scrub_duration":0.0046609240000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:02.766644+0000","last_change":"2023-10-14T09:39:02.766721+0000","last_active":"2023-10-14T09:39:02.766644+0000","last_peered":"2023-10-14T09:39:02.766644+0000","last_clean":"2023-10-14T09:39:02.766644+0000","last_became_active":"2023-10-14T09:38:31.026414+0000","last_became_peered":"2023-10-14T09:38:31.026414+0000","last_unstale":"2023-10-14T09:39:02.766644+0000","last_undegraded":"2023-10-14T09:39:02.766644+0000","last_fullsized":"2023-10-14T09:39:02.766644+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:02.766528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:02.766528+0000","last_clean_scrub_stamp":"2023-10-14T09:39:02.766528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:29:45.420889+0000","scrub_duration":0.003473659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"35'1","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:49.679590+0000","last_change":"2023-10-14T09:38:49.679696+0000","last_active":"2023-10-14T09:38:49.679590+0000","last_peered":"2023-10-14T09:38:49.679590+0000","last_clean":"2023-10-14T09:38:49.679590+0000","last_became_active":"2023-10-14T09:38:30.024910+0000","last_became_peered":"2023-10-14T09:38:30.024910+0000","last_unstale":"2023-10-14T09:38:49.679590+0000","last_undegraded":"2023-10-14T09:38:49.679590+0000","last_fullsized":"2023-10-14T09:38:49.679590+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'1","last_scrub_stamp":"2023-10-14T09:38:49.679411+0000","last_deep_scrub":"35'1","last_deep_scrub_stamp":"2023-10-14T09:38:49.679411+0000","last_clean_scrub_stamp":"2023-10-14T09:38:49.679411+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:15:55.728284+0000","scrub_duration":0.003799359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.932406+0000","last_change":"2023-10-14T09:38:31.030098+0000","last_active":"2023-10-14T09:38:34.932406+0000","last_peered":"2023-10-14T09:38:34.932406+0000","last_clean":"2023-10-14T09:38:34.932406+0000","last_became_active":"2023-10-14T09:38:31.029815+0000","last_became_peered":"2023-10-14T09:38:31.029815+0000","last_unstale":"2023-10-14T09:38:34.932406+0000","last_undegraded":"2023-10-14T09:38:34.932406+0000","last_fullsized":"2023-10-14T09:38:34.932406+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"36'3","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:03.074723+0000","last_change":"2023-10-14T09:39:03.074797+0000","last_active":"2023-10-14T09:39:03.074723+0000","last_peered":"2023-10-14T09:39:03.074723+0000","last_clean":"2023-10-14T09:39:03.074723+0000","last_became_active":"2023-10-14T09:38:30.017602+0000","last_became_peered":"2023-10-14T09:38:30.017602+0000","last_unstale":"2023-10-14T09:39:03.074723+0000","last_undegraded":"2023-10-14T09:39:03.074723+0000","last_fullsized":"2023-10-14T09:39:03.074723+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2023-10-14T09:39:03.074613+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2023-10-14T09:39:03.074613+0000","last_clean_scrub_stamp":"2023-10-14T09:39:03.074613+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:42:38.051760+0000","scrub_duration":0.0041427089999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.926694+0000","last_change":"2023-10-14T09:38:31.028602+0000","last_active":"2023-10-14T09:38:34.926694+0000","last_peered":"2023-10-14T09:38:34.926694+0000","last_clean":"2023-10-14T09:38:34.926694+0000","last_became_active":"2023-10-14T09:38:31.025645+0000","last_became_peered":"2023-10-14T09:38:31.025645+0000","last_unstale":"2023-10-14T09:38:34.926694+0000","last_undegraded":"2023-10-14T09:38:34.926694+0000","last_fullsized":"2023-10-14T09:38:34.926694+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"35'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:46.533770+0000","last_change":"2023-10-14T09:38:46.533816+0000","last_active":"2023-10-14T09:38:46.533770+0000","last_peered":"2023-10-14T09:38:46.533770+0000","last_clean":"2023-10-14T09:38:46.533770+0000","last_became_active":"2023-10-14T09:38:30.030556+0000","last_became_peered":"2023-10-14T09:38:30.030556+0000","last_unstale":"2023-10-14T09:38:46.533770+0000","last_undegraded":"2023-10-14T09:38:46.533770+0000","last_fullsized":"2023-10-14T09:38:46.533770+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2023-10-14T09:38:46.533705+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2023-10-14T09:38:46.533705+0000","last_clean_scrub_stamp":"2023-10-14T09:38:46.533705+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:33:11.988817+0000","scrub_duration":0.0026943039999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:02.272352+0000","last_change":"2023-10-14T09:39:02.272488+0000","last_active":"2023-10-14T09:39:02.272352+0000","last_peered":"2023-10-14T09:39:02.272352+0000","last_clean":"2023-10-14T09:39:02.272352+0000","last_became_active":"2023-10-14T09:38:31.028887+0000","last_became_peered":"2023-10-14T09:38:31.028887+0000","last_unstale":"2023-10-14T09:39:02.272352+0000","last_undegraded":"2023-10-14T09:39:02.272352+0000","last_fullsized":"2023-10-14T09:39:02.272352+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:02.272167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:02.272167+0000","last_clean_scrub_stamp":"2023-10-14T09:39:02.272167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:46:37.273684+0000","scrub_duration":0.0035637300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"35'1","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:57.786144+0000","last_change":"2023-10-14T09:38:57.786255+0000","last_active":"2023-10-14T09:38:57.786144+0000","last_peered":"2023-10-14T09:38:57.786144+0000","last_clean":"2023-10-14T09:38:57.786144+0000","last_became_active":"2023-10-14T09:38:30.025732+0000","last_became_peered":"2023-10-14T09:38:30.025732+0000","last_unstale":"2023-10-14T09:38:57.786144+0000","last_undegraded":"2023-10-14T09:38:57.786144+0000","last_fullsized":"2023-10-14T09:38:57.786144+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'1","last_scrub_stamp":"2023-10-14T09:38:57.785957+0000","last_deep_scrub":"35'1","last_deep_scrub_stamp":"2023-10-14T09:38:57.785957+0000","last_clean_scrub_stamp":"2023-10-14T09:38:57.785957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:18:36.524694+0000","scrub_duration":0.003769901,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:58.078771+0000","last_change":"2023-10-14T09:38:58.078887+0000","last_active":"2023-10-14T09:38:58.078771+0000","last_peered":"2023-10-14T09:38:58.078771+0000","last_clean":"2023-10-14T09:38:58.078771+0000","last_became_active":"2023-10-14T09:38:31.020184+0000","last_became_peered":"2023-10-14T09:38:31.020184+0000","last_unstale":"2023-10-14T09:38:58.078771+0000","last_undegraded":"2023-10-14T09:38:58.078771+0000","last_fullsized":"2023-10-14T09:38:58.078771+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:58.078588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:58.078588+0000","last_clean_scrub_stamp":"2023-10-14T09:38:58.078588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:19:22.355681+0000","scrub_duration":0.0039430919999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"35'1","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:02.624254+0000","last_change":"2023-10-14T09:39:02.624369+0000","last_active":"2023-10-14T09:39:02.624254+0000","last_peered":"2023-10-14T09:39:02.624254+0000","last_clean":"2023-10-14T09:39:02.624254+0000","last_became_active":"2023-10-14T09:38:30.031356+0000","last_became_peered":"2023-10-14T09:38:30.031356+0000","last_unstale":"2023-10-14T09:39:02.624254+0000","last_undegraded":"2023-10-14T09:39:02.624254+0000","last_fullsized":"2023-10-14T09:39:02.624254+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'1","last_scrub_stamp":"2023-10-14T09:39:02.624081+0000","last_deep_scrub":"35'1","last_deep_scrub_stamp":"2023-10-14T09:39:02.624081+0000","last_clean_scrub_stamp":"2023-10-14T09:39:02.624081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:56:17.115836+0000","scrub_duration":0.003185327,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:09.500306+0000","last_change":"2023-10-14T09:39:09.500416+0000","last_active":"2023-10-14T09:39:09.500306+0000","last_peered":"2023-10-14T09:39:09.500306+0000","last_clean":"2023-10-14T09:39:09.500306+0000","last_became_active":"2023-10-14T09:38:31.023990+0000","last_became_peered":"2023-10-14T09:38:31.023990+0000","last_unstale":"2023-10-14T09:39:09.500306+0000","last_undegraded":"2023-10-14T09:39:09.500306+0000","last_fullsized":"2023-10-14T09:39:09.500306+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:09.500130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:09.500130+0000","last_clean_scrub_stamp":"2023-10-14T09:39:09.500130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:10:28.900926+0000","scrub_duration":0.0035241199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:58.127909+0000","last_change":"2023-10-14T09:38:58.128101+0000","last_active":"2023-10-14T09:38:58.127909+0000","last_peered":"2023-10-14T09:38:58.127909+0000","last_clean":"2023-10-14T09:38:58.127909+0000","last_became_active":"2023-10-14T09:38:30.019461+0000","last_became_peered":"2023-10-14T09:38:30.019461+0000","last_unstale":"2023-10-14T09:38:58.127909+0000","last_undegraded":"2023-10-14T09:38:58.127909+0000","last_fullsized":"2023-10-14T09:38:58.127909+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:58.127652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:58.127652+0000","last_clean_scrub_stamp":"2023-10-14T09:38:58.127652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:12.463977+0000","scrub_duration":0.003828265,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:15.373931+0000","last_change":"2023-10-14T09:39:15.374074+0000","last_active":"2023-10-14T09:39:15.373931+0000","last_peered":"2023-10-14T09:39:15.373931+0000","last_clean":"2023-10-14T09:39:15.373931+0000","last_became_active":"2023-10-14T09:38:31.016514+0000","last_became_peered":"2023-10-14T09:38:31.016514+0000","last_unstale":"2023-10-14T09:39:15.373931+0000","last_undegraded":"2023-10-14T09:39:15.373931+0000","last_fullsized":"2023-10-14T09:39:15.373931+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:15.373751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:15.373751+0000","last_clean_scrub_stamp":"2023-10-14T09:39:15.373751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:17:11.945476+0000","scrub_duration":0.0038224510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:01.637044+0000","last_change":"2023-10-14T09:39:01.637150+0000","last_active":"2023-10-14T09:39:01.637044+0000","last_peered":"2023-10-14T09:39:01.637044+0000","last_clean":"2023-10-14T09:39:01.637044+0000","last_became_active":"2023-10-14T09:38:30.035470+0000","last_became_peered":"2023-10-14T09:38:30.035470+0000","last_unstale":"2023-10-14T09:39:01.637044+0000","last_undegraded":"2023-10-14T09:39:01.637044+0000","last_fullsized":"2023-10-14T09:39:01.637044+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:01.636840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:01.636840+0000","last_clean_scrub_stamp":"2023-10-14T09:39:01.636840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:24:23.494315+0000","scrub_duration":0.003674194,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:19.936421+0000","last_change":"2023-10-14T09:39:19.936552+0000","last_active":"2023-10-14T09:39:19.936421+0000","last_peered":"2023-10-14T09:39:19.936421+0000","last_clean":"2023-10-14T09:39:19.936421+0000","last_became_active":"2023-10-14T09:38:31.025794+0000","last_became_peered":"2023-10-14T09:38:31.025794+0000","last_unstale":"2023-10-14T09:39:19.936421+0000","last_undegraded":"2023-10-14T09:39:19.936421+0000","last_fullsized":"2023-10-14T09:39:19.936421+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:19.936193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:19.936193+0000","last_clean_scrub_stamp":"2023-10-14T09:39:19.936193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:23:18.021187+0000","scrub_duration":0.0035786260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:59.100371+0000","last_change":"2023-10-14T09:38:59.100482+0000","last_active":"2023-10-14T09:38:59.100371+0000","last_peered":"2023-10-14T09:38:59.100371+0000","last_clean":"2023-10-14T09:38:59.100371+0000","last_became_active":"2023-10-14T09:38:30.014042+0000","last_became_peered":"2023-10-14T09:38:30.014042+0000","last_unstale":"2023-10-14T09:38:59.100371+0000","last_undegraded":"2023-10-14T09:38:59.100371+0000","last_fullsized":"2023-10-14T09:38:59.100371+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:59.100189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:59.100189+0000","last_clean_scrub_stamp":"2023-10-14T09:38:59.100189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:03:57.444366+0000","scrub_duration":0.0039772050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:10.061296+0000","last_change":"2023-10-14T09:39:10.061334+0000","last_active":"2023-10-14T09:39:10.061296+0000","last_peered":"2023-10-14T09:39:10.061296+0000","last_clean":"2023-10-14T09:39:10.061296+0000","last_became_active":"2023-10-14T09:38:31.021662+0000","last_became_peered":"2023-10-14T09:38:31.021662+0000","last_unstale":"2023-10-14T09:39:10.061296+0000","last_undegraded":"2023-10-14T09:39:10.061296+0000","last_fullsized":"2023-10-14T09:39:10.061296+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:10.061229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:10.061229+0000","last_clean_scrub_stamp":"2023-10-14T09:39:10.061229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:52:22.258631+0000","scrub_duration":0.0018017630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:48.679147+0000","last_change":"2023-10-14T09:38:48.679274+0000","last_active":"2023-10-14T09:38:48.679147+0000","last_peered":"2023-10-14T09:38:48.679147+0000","last_clean":"2023-10-14T09:38:48.679147+0000","last_became_active":"2023-10-14T09:38:30.027696+0000","last_became_peered":"2023-10-14T09:38:30.027696+0000","last_unstale":"2023-10-14T09:38:48.679147+0000","last_undegraded":"2023-10-14T09:38:48.679147+0000","last_fullsized":"2023-10-14T09:38:48.679147+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:48.678929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:48.678929+0000","last_clean_scrub_stamp":"2023-10-14T09:38:48.678929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:06:16.707833+0000","scrub_duration":0.003213816,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:48.148306+0000","last_change":"2023-10-14T09:38:48.148375+0000","last_active":"2023-10-14T09:38:48.148306+0000","last_peered":"2023-10-14T09:38:48.148306+0000","last_clean":"2023-10-14T09:38:48.148306+0000","last_became_active":"2023-10-14T09:38:31.026676+0000","last_became_peered":"2023-10-14T09:38:31.026676+0000","last_unstale":"2023-10-14T09:38:48.148306+0000","last_undegraded":"2023-10-14T09:38:48.148306+0000","last_fullsized":"2023-10-14T09:38:48.148306+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:48.148221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:48.148221+0000","last_clean_scrub_stamp":"2023-10-14T09:38:48.148221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:01:40.381456+0000","scrub_duration":0.0028294069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"35'3","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:55.075403+0000","last_change":"2023-10-14T09:38:55.075551+0000","last_active":"2023-10-14T09:38:55.075403+0000","last_peered":"2023-10-14T09:38:55.075403+0000","last_clean":"2023-10-14T09:38:55.075403+0000","last_became_active":"2023-10-14T09:38:30.031907+0000","last_became_peered":"2023-10-14T09:38:30.031907+0000","last_unstale":"2023-10-14T09:38:55.075403+0000","last_undegraded":"2023-10-14T09:38:55.075403+0000","last_fullsized":"2023-10-14T09:38:55.075403+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2023-10-14T09:38:55.075222+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2023-10-14T09:38:55.075222+0000","last_clean_scrub_stamp":"2023-10-14T09:38:55.075222+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:49:52.115938+0000","scrub_duration":0.005129242,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:21.891228+0000","last_change":"2023-10-14T09:39:21.891334+0000","last_active":"2023-10-14T09:39:21.891228+0000","last_peered":"2023-10-14T09:39:21.891228+0000","last_clean":"2023-10-14T09:39:21.891228+0000","last_became_active":"2023-10-14T09:38:31.020267+0000","last_became_peered":"2023-10-14T09:38:31.020267+0000","last_unstale":"2023-10-14T09:39:21.891228+0000","last_undegraded":"2023-10-14T09:39:21.891228+0000","last_fullsized":"2023-10-14T09:39:21.891228+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:21.891034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:21.891034+0000","last_clean_scrub_stamp":"2023-10-14T09:39:21.891034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:58:53.811510+0000","scrub_duration":0.003696473,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"35'6","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:54.196331+0000","last_change":"2023-10-14T09:38:54.196449+0000","last_active":"2023-10-14T09:38:54.196331+0000","last_peered":"2023-10-14T09:38:54.196331+0000","last_clean":"2023-10-14T09:38:54.196331+0000","last_became_active":"2023-10-14T09:38:30.019839+0000","last_became_peered":"2023-10-14T09:38:30.019839+0000","last_unstale":"2023-10-14T09:38:54.196331+0000","last_undegraded":"2023-10-14T09:38:54.196331+0000","last_fullsized":"2023-10-14T09:38:54.196331+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2023-10-14T09:38:54.196133+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2023-10-14T09:38:54.196133+0000","last_clean_scrub_stamp":"2023-10-14T09:38:54.196133+0000","objects_scrubbed":4,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:12:19.956146+0000","scrub_duration":0.0055956779999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:21.482692+0000","last_change":"2023-10-14T09:39:21.482797+0000","last_active":"2023-10-14T09:39:21.482692+0000","last_peered":"2023-10-14T09:39:21.482692+0000","last_clean":"2023-10-14T09:39:21.482692+0000","last_became_active":"2023-10-14T09:38:31.020347+0000","last_became_peered":"2023-10-14T09:38:31.020347+0000","last_unstale":"2023-10-14T09:39:21.482692+0000","last_undegraded":"2023-10-14T09:39:21.482692+0000","last_fullsized":"2023-10-14T09:39:21.482692+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:21.482512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:21.482512+0000","last_clean_scrub_stamp":"2023-10-14T09:39:21.482512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:12:47.242524+0000","scrub_duration":0.0039880540000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"35'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:47.937746+0000","last_change":"2023-10-14T09:38:47.937954+0000","last_active":"2023-10-14T09:38:47.937746+0000","last_peered":"2023-10-14T09:38:47.937746+0000","last_clean":"2023-10-14T09:38:47.937746+0000","last_became_active":"2023-10-14T09:38:30.035424+0000","last_became_peered":"2023-10-14T09:38:30.035424+0000","last_unstale":"2023-10-14T09:38:47.937746+0000","last_undegraded":"2023-10-14T09:38:47.937746+0000","last_fullsized":"2023-10-14T09:38:47.937746+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2023-10-14T09:38:47.937565+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2023-10-14T09:38:47.937565+0000","last_clean_scrub_stamp":"2023-10-14T09:38:47.937565+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:56:13.779499+0000","scrub_duration":0.0048754560000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:14.976207+0000","last_change":"2023-10-14T09:39:14.976328+0000","last_active":"2023-10-14T09:39:14.976207+0000","last_peered":"2023-10-14T09:39:14.976207+0000","last_clean":"2023-10-14T09:39:14.976207+0000","last_became_active":"2023-10-14T09:38:31.027759+0000","last_became_peered":"2023-10-14T09:38:31.027759+0000","last_unstale":"2023-10-14T09:39:14.976207+0000","last_undegraded":"2023-10-14T09:39:14.976207+0000","last_fullsized":"2023-10-14T09:39:14.976207+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:14.975998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:14.975998+0000","last_clean_scrub_stamp":"2023-10-14T09:39:14.975998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:15:19.406655+0000","scrub_duration":0.0033840070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:57.334723+0000","last_change":"2023-10-14T09:38:57.334855+0000","last_active":"2023-10-14T09:38:57.334723+0000","last_peered":"2023-10-14T09:38:57.334723+0000","last_clean":"2023-10-14T09:38:57.334723+0000","last_became_active":"2023-10-14T09:38:30.025712+0000","last_became_peered":"2023-10-14T09:38:30.025712+0000","last_unstale":"2023-10-14T09:38:57.334723+0000","last_undegraded":"2023-10-14T09:38:57.334723+0000","last_fullsized":"2023-10-14T09:38:57.334723+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:57.334543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:57.334543+0000","last_clean_scrub_stamp":"2023-10-14T09:38:57.334543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:07:30.093467+0000","scrub_duration":0.0039162900000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:56.234815+0000","last_change":"2023-10-14T09:38:56.234942+0000","last_active":"2023-10-14T09:38:56.234815+0000","last_peered":"2023-10-14T09:38:56.234815+0000","last_clean":"2023-10-14T09:38:56.234815+0000","last_became_active":"2023-10-14T09:38:31.036628+0000","last_became_peered":"2023-10-14T09:38:31.036628+0000","last_unstale":"2023-10-14T09:38:56.234815+0000","last_undegraded":"2023-10-14T09:38:56.234815+0000","last_fullsized":"2023-10-14T09:38:56.234815+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:56.234625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:56.234625+0000","last_clean_scrub_stamp":"2023-10-14T09:38:56.234625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:58:59.569769+0000","scrub_duration":0.0035426099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:06.093421+0000","last_change":"2023-10-14T09:39:06.093539+0000","last_active":"2023-10-14T09:39:06.093421+0000","last_peered":"2023-10-14T09:39:06.093421+0000","last_clean":"2023-10-14T09:39:06.093421+0000","last_became_active":"2023-10-14T09:38:30.022182+0000","last_became_peered":"2023-10-14T09:38:30.022182+0000","last_unstale":"2023-10-14T09:39:06.093421+0000","last_undegraded":"2023-10-14T09:39:06.093421+0000","last_fullsized":"2023-10-14T09:39:06.093421+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:06.093233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:06.093233+0000","last_clean_scrub_stamp":"2023-10-14T09:39:06.093233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:50:35.550528+0000","scrub_duration":0.0039928780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:54.645085+0000","last_change":"2023-10-14T09:38:54.645278+0000","last_active":"2023-10-14T09:38:54.645085+0000","last_peered":"2023-10-14T09:38:54.645085+0000","last_clean":"2023-10-14T09:38:54.645085+0000","last_became_active":"2023-10-14T09:38:31.039518+0000","last_became_peered":"2023-10-14T09:38:31.039518+0000","last_unstale":"2023-10-14T09:38:54.645085+0000","last_undegraded":"2023-10-14T09:38:54.645085+0000","last_fullsized":"2023-10-14T09:38:54.645085+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:54.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:54.644882+0000","last_clean_scrub_stamp":"2023-10-14T09:38:54.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:49:46.705606+0000","scrub_duration":0.003904659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"35'8","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:52.142490+0000","last_change":"2023-10-14T09:38:52.142608+0000","last_active":"2023-10-14T09:38:52.142490+0000","last_peered":"2023-10-14T09:38:52.142490+0000","last_clean":"2023-10-14T09:38:52.142490+0000","last_became_active":"2023-10-14T09:38:30.014562+0000","last_became_peered":"2023-10-14T09:38:30.014562+0000","last_unstale":"2023-10-14T09:38:52.142490+0000","last_undegraded":"2023-10-14T09:38:52.142490+0000","last_fullsized":"2023-10-14T09:38:52.142490+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2023-10-14T09:38:52.142259+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2023-10-14T09:38:52.142259+0000","last_clean_scrub_stamp":"2023-10-14T09:38:52.142259+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:46:42.382320+0000","scrub_duration":0.0052490749999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:20.548887+0000","last_change":"2023-10-14T09:39:20.548996+0000","last_active":"2023-10-14T09:39:20.548887+0000","last_peered":"2023-10-14T09:39:20.548887+0000","last_clean":"2023-10-14T09:39:20.548887+0000","last_became_active":"2023-10-14T09:38:31.025665+0000","last_became_peered":"2023-10-14T09:38:31.025665+0000","last_unstale":"2023-10-14T09:39:20.548887+0000","last_undegraded":"2023-10-14T09:39:20.548887+0000","last_fullsized":"2023-10-14T09:39:20.548887+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:20.548692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:20.548692+0000","last_clean_scrub_stamp":"2023-10-14T09:39:20.548692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:05:20.350671+0000","scrub_duration":0.0035872819999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"35'1","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:55.318266+0000","last_change":"2023-10-14T09:38:55.318388+0000","last_active":"2023-10-14T09:38:55.318266+0000","last_peered":"2023-10-14T09:38:55.318266+0000","last_clean":"2023-10-14T09:38:55.318266+0000","last_became_active":"2023-10-14T09:38:30.025331+0000","last_became_peered":"2023-10-14T09:38:30.025331+0000","last_unstale":"2023-10-14T09:38:55.318266+0000","last_undegraded":"2023-10-14T09:38:55.318266+0000","last_fullsized":"2023-10-14T09:38:55.318266+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'1","last_scrub_stamp":"2023-10-14T09:38:55.318087+0000","last_deep_scrub":"35'1","last_deep_scrub_stamp":"2023-10-14T09:38:55.318087+0000","last_clean_scrub_stamp":"2023-10-14T09:38:55.318087+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:39:45.038902+0000","scrub_duration":0.0045992630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:16.984048+0000","last_change":"2023-10-14T09:39:16.984152+0000","last_active":"2023-10-14T09:39:16.984048+0000","last_peered":"2023-10-14T09:39:16.984048+0000","last_clean":"2023-10-14T09:39:16.984048+0000","last_became_active":"2023-10-14T09:38:31.032912+0000","last_became_peered":"2023-10-14T09:38:31.032912+0000","last_unstale":"2023-10-14T09:39:16.984048+0000","last_undegraded":"2023-10-14T09:39:16.984048+0000","last_fullsized":"2023-10-14T09:39:16.984048+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:16.983861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:16.983861+0000","last_clean_scrub_stamp":"2023-10-14T09:39:16.983861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:08:39.914600+0000","scrub_duration":0.0037026099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"36'3","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:07.573188+0000","last_change":"2023-10-14T09:39:07.573313+0000","last_active":"2023-10-14T09:39:07.573188+0000","last_peered":"2023-10-14T09:39:07.573188+0000","last_clean":"2023-10-14T09:39:07.573188+0000","last_became_active":"2023-10-14T09:38:30.035283+0000","last_became_peered":"2023-10-14T09:38:30.035283+0000","last_unstale":"2023-10-14T09:39:07.573188+0000","last_undegraded":"2023-10-14T09:39:07.573188+0000","last_fullsized":"2023-10-14T09:39:07.573188+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2023-10-14T09:39:07.572971+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2023-10-14T09:39:07.572971+0000","last_clean_scrub_stamp":"2023-10-14T09:39:07.572971+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:17:04.144697+0000","scrub_duration":0.0077526660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.926594+0000","last_change":"2023-10-14T09:38:31.035370+0000","last_active":"2023-10-14T09:38:34.926594+0000","last_peered":"2023-10-14T09:38:34.926594+0000","last_clean":"2023-10-14T09:38:34.926594+0000","last_became_active":"2023-10-14T09:38:31.034768+0000","last_became_peered":"2023-10-14T09:38:31.034768+0000","last_unstale":"2023-10-14T09:38:34.926594+0000","last_undegraded":"2023-10-14T09:38:34.926594+0000","last_fullsized":"2023-10-14T09:38:34.926594+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"35'1","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:00.677692+0000","last_change":"2023-10-14T09:39:00.677818+0000","last_active":"2023-10-14T09:39:00.677692+0000","last_peered":"2023-10-14T09:39:00.677692+0000","last_clean":"2023-10-14T09:39:00.677692+0000","last_became_active":"2023-10-14T09:38:30.030927+0000","last_became_peered":"2023-10-14T09:38:30.030927+0000","last_unstale":"2023-10-14T09:39:00.677692+0000","last_undegraded":"2023-10-14T09:39:00.677692+0000","last_fullsized":"2023-10-14T09:39:00.677692+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'1","last_scrub_stamp":"2023-10-14T09:39:00.677510+0000","last_deep_scrub":"35'1","last_deep_scrub_stamp":"2023-10-14T09:39:00.677510+0000","last_clean_scrub_stamp":"2023-10-14T09:39:00.677510+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:55:27.879986+0000","scrub_duration":0.0052586550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:52.540354+0000","last_change":"2023-10-14T09:38:52.540470+0000","last_active":"2023-10-14T09:38:52.540354+0000","last_peered":"2023-10-14T09:38:52.540354+0000","last_clean":"2023-10-14T09:38:52.540354+0000","last_became_active":"2023-10-14T09:38:31.026615+0000","last_became_peered":"2023-10-14T09:38:31.026615+0000","last_unstale":"2023-10-14T09:38:52.540354+0000","last_undegraded":"2023-10-14T09:38:52.540354+0000","last_fullsized":"2023-10-14T09:38:52.540354+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:52.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:52.540176+0000","last_clean_scrub_stamp":"2023-10-14T09:38:52.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:24:06.115731+0000","scrub_duration":0.0037872090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:55.712392+0000","last_change":"2023-10-14T09:38:55.712533+0000","last_active":"2023-10-14T09:38:55.712392+0000","last_peered":"2023-10-14T09:38:55.712392+0000","last_clean":"2023-10-14T09:38:55.712392+0000","last_became_active":"2023-10-14T09:38:30.026795+0000","last_became_peered":"2023-10-14T09:38:30.026795+0000","last_unstale":"2023-10-14T09:38:55.712392+0000","last_undegraded":"2023-10-14T09:38:55.712392+0000","last_fullsized":"2023-10-14T09:38:55.712392+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:55.712204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:55.712204+0000","last_clean_scrub_stamp":"2023-10-14T09:38:55.712204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:41:54.034096+0000","scrub_duration":0.003589709,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:47.540406+0000","last_change":"2023-10-14T09:38:47.540516+0000","last_active":"2023-10-14T09:38:47.540406+0000","last_peered":"2023-10-14T09:38:47.540406+0000","last_clean":"2023-10-14T09:38:47.540406+0000","last_became_active":"2023-10-14T09:38:31.031921+0000","last_became_peered":"2023-10-14T09:38:31.031921+0000","last_unstale":"2023-10-14T09:38:47.540406+0000","last_undegraded":"2023-10-14T09:38:47.540406+0000","last_fullsized":"2023-10-14T09:38:47.540406+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:47.540230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:47.540230+0000","last_clean_scrub_stamp":"2023-10-14T09:38:47.540230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:37:25.465061+0000","scrub_duration":0.003744247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"35'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:46.628250+0000","last_change":"2023-10-14T09:38:46.628305+0000","last_active":"2023-10-14T09:38:46.628250+0000","last_peered":"2023-10-14T09:38:46.628250+0000","last_clean":"2023-10-14T09:38:46.628250+0000","last_became_active":"2023-10-14T09:38:30.021312+0000","last_became_peered":"2023-10-14T09:38:30.021312+0000","last_unstale":"2023-10-14T09:38:46.628250+0000","last_undegraded":"2023-10-14T09:38:46.628250+0000","last_fullsized":"2023-10-14T09:38:46.628250+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2023-10-14T09:38:46.628156+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2023-10-14T09:38:46.628156+0000","last_clean_scrub_stamp":"2023-10-14T09:38:46.628156+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:52:45.439890+0000","scrub_duration":0.002195682,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:12.720238+0000","last_change":"2023-10-14T09:39:12.720412+0000","last_active":"2023-10-14T09:39:12.720238+0000","last_peered":"2023-10-14T09:39:12.720238+0000","last_clean":"2023-10-14T09:39:12.720238+0000","last_became_active":"2023-10-14T09:38:31.023340+0000","last_became_peered":"2023-10-14T09:38:31.023340+0000","last_unstale":"2023-10-14T09:39:12.720238+0000","last_undegraded":"2023-10-14T09:39:12.720238+0000","last_fullsized":"2023-10-14T09:39:12.720238+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:12.720066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:12.720066+0000","last_clean_scrub_stamp":"2023-10-14T09:39:12.720066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:07:45.478990+0000","scrub_duration":0.0038580799999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:48.556599+0000","last_change":"2023-10-14T09:38:48.556714+0000","last_active":"2023-10-14T09:38:48.556599+0000","last_peered":"2023-10-14T09:38:48.556599+0000","last_clean":"2023-10-14T09:38:48.556599+0000","last_became_active":"2023-10-14T09:38:30.033284+0000","last_became_peered":"2023-10-14T09:38:30.033284+0000","last_unstale":"2023-10-14T09:38:48.556599+0000","last_undegraded":"2023-10-14T09:38:48.556599+0000","last_fullsized":"2023-10-14T09:38:48.556599+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:48.556379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:48.556379+0000","last_clean_scrub_stamp":"2023-10-14T09:38:48.556379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:24:02.131934+0000","scrub_duration":0.0035783490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:06.806152+0000","last_change":"2023-10-14T09:39:06.806269+0000","last_active":"2023-10-14T09:39:06.806152+0000","last_peered":"2023-10-14T09:39:06.806152+0000","last_clean":"2023-10-14T09:39:06.806152+0000","last_became_active":"2023-10-14T09:38:31.019732+0000","last_became_peered":"2023-10-14T09:38:31.019732+0000","last_unstale":"2023-10-14T09:39:06.806152+0000","last_undegraded":"2023-10-14T09:39:06.806152+0000","last_fullsized":"2023-10-14T09:39:06.806152+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:06.805907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:06.805907+0000","last_clean_scrub_stamp":"2023-10-14T09:39:06.805907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:49:58.866632+0000","scrub_duration":0.003479851,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:56.739921+0000","last_change":"2023-10-14T09:38:56.740115+0000","last_active":"2023-10-14T09:38:56.739921+0000","last_peered":"2023-10-14T09:38:56.739921+0000","last_clean":"2023-10-14T09:38:56.739921+0000","last_became_active":"2023-10-14T09:38:30.032500+0000","last_became_peered":"2023-10-14T09:38:30.032500+0000","last_unstale":"2023-10-14T09:38:56.739921+0000","last_undegraded":"2023-10-14T09:38:56.739921+0000","last_fullsized":"2023-10-14T09:38:56.739921+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:56.739717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:56.739717+0000","last_clean_scrub_stamp":"2023-10-14T09:38:56.739717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:55.093910+0000","scrub_duration":0.0038890359999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:08.304521+0000","last_change":"2023-10-14T09:39:08.304726+0000","last_active":"2023-10-14T09:39:08.304521+0000","last_peered":"2023-10-14T09:39:08.304521+0000","last_clean":"2023-10-14T09:39:08.304521+0000","last_became_active":"2023-10-14T09:38:31.030399+0000","last_became_peered":"2023-10-14T09:38:31.030399+0000","last_unstale":"2023-10-14T09:39:08.304521+0000","last_undegraded":"2023-10-14T09:39:08.304521+0000","last_fullsized":"2023-10-14T09:39:08.304521+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:08.304284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:08.304284+0000","last_clean_scrub_stamp":"2023-10-14T09:39:08.304284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:42:43.281430+0000","scrub_duration":0.0035198899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:51.044759+0000","last_change":"2023-10-14T09:38:51.044863+0000","last_active":"2023-10-14T09:38:51.044759+0000","last_peered":"2023-10-14T09:38:51.044759+0000","last_clean":"2023-10-14T09:38:51.044759+0000","last_became_active":"2023-10-14T09:38:30.028540+0000","last_became_peered":"2023-10-14T09:38:30.028540+0000","last_unstale":"2023-10-14T09:38:51.044759+0000","last_undegraded":"2023-10-14T09:38:51.044759+0000","last_fullsized":"2023-10-14T09:38:51.044759+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:51.044578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:51.044578+0000","last_clean_scrub_stamp":"2023-10-14T09:38:51.044578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:49:06.337666+0000","scrub_duration":0.0033480110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:50.515103+0000","last_change":"2023-10-14T09:38:50.515213+0000","last_active":"2023-10-14T09:38:50.515103+0000","last_peered":"2023-10-14T09:38:50.515103+0000","last_clean":"2023-10-14T09:38:50.515103+0000","last_became_active":"2023-10-14T09:38:31.015654+0000","last_became_peered":"2023-10-14T09:38:31.015654+0000","last_unstale":"2023-10-14T09:38:50.515103+0000","last_undegraded":"2023-10-14T09:38:50.515103+0000","last_fullsized":"2023-10-14T09:38:50.515103+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:50.514814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:50.514814+0000","last_clean_scrub_stamp":"2023-10-14T09:38:50.514814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:04:26.034786+0000","scrub_duration":0.0037886759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"36'3","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:10.422177+0000","last_change":"2023-10-14T09:39:10.422290+0000","last_active":"2023-10-14T09:39:10.422177+0000","last_peered":"2023-10-14T09:39:10.422177+0000","last_clean":"2023-10-14T09:39:10.422177+0000","last_became_active":"2023-10-14T09:38:30.030387+0000","last_became_peered":"2023-10-14T09:38:30.030387+0000","last_unstale":"2023-10-14T09:39:10.422177+0000","last_undegraded":"2023-10-14T09:39:10.422177+0000","last_fullsized":"2023-10-14T09:39:10.422177+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2023-10-14T09:39:10.421983+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2023-10-14T09:39:10.421983+0000","last_clean_scrub_stamp":"2023-10-14T09:39:10.421983+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:24:25.959633+0000","scrub_duration":0.0079599300000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:11.134990+0000","last_change":"2023-10-14T09:39:11.135101+0000","last_active":"2023-10-14T09:39:11.134990+0000","last_peered":"2023-10-14T09:39:11.134990+0000","last_clean":"2023-10-14T09:39:11.134990+0000","last_became_active":"2023-10-14T09:38:31.023043+0000","last_became_peered":"2023-10-14T09:38:31.023043+0000","last_unstale":"2023-10-14T09:39:11.134990+0000","last_undegraded":"2023-10-14T09:39:11.134990+0000","last_fullsized":"2023-10-14T09:39:11.134990+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:11.134794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:11.134794+0000","last_clean_scrub_stamp":"2023-10-14T09:39:11.134794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:59:36.203576+0000","scrub_duration":0.0036520319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"36'1","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:47.634220+0000","last_change":"2023-10-14T09:38:47.634416+0000","last_active":"2023-10-14T09:38:47.634220+0000","last_peered":"2023-10-14T09:38:47.634220+0000","last_clean":"2023-10-14T09:38:47.634220+0000","last_became_active":"2023-10-14T09:38:30.024536+0000","last_became_peered":"2023-10-14T09:38:30.024536+0000","last_unstale":"2023-10-14T09:38:47.634220+0000","last_undegraded":"2023-10-14T09:38:47.634220+0000","last_fullsized":"2023-10-14T09:38:47.634220+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'1","last_scrub_stamp":"2023-10-14T09:38:47.633984+0000","last_deep_scrub":"36'1","last_deep_scrub_stamp":"2023-10-14T09:38:47.633984+0000","last_clean_scrub_stamp":"2023-10-14T09:38:47.633984+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:40:54.811008+0000","scrub_duration":0.0036899749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:54.649440+0000","last_change":"2023-10-14T09:38:54.649556+0000","last_active":"2023-10-14T09:38:54.649440+0000","last_peered":"2023-10-14T09:38:54.649440+0000","last_clean":"2023-10-14T09:38:54.649440+0000","last_became_active":"2023-10-14T09:38:31.023855+0000","last_became_peered":"2023-10-14T09:38:31.023855+0000","last_unstale":"2023-10-14T09:38:54.649440+0000","last_undegraded":"2023-10-14T09:38:54.649440+0000","last_fullsized":"2023-10-14T09:38:54.649440+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:54.649211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:54.649211+0000","last_clean_scrub_stamp":"2023-10-14T09:38:54.649211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:49:09.942300+0000","scrub_duration":0.0033030020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:14.415816+0000","last_change":"2023-10-14T09:39:14.415928+0000","last_active":"2023-10-14T09:39:14.415816+0000","last_peered":"2023-10-14T09:39:14.415816+0000","last_clean":"2023-10-14T09:39:14.415816+0000","last_became_active":"2023-10-14T09:38:30.023068+0000","last_became_peered":"2023-10-14T09:38:30.023068+0000","last_unstale":"2023-10-14T09:39:14.415816+0000","last_undegraded":"2023-10-14T09:39:14.415816+0000","last_fullsized":"2023-10-14T09:39:14.415816+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:14.415607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:14.415607+0000","last_clean_scrub_stamp":"2023-10-14T09:39:14.415607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:06.648843+0000","scrub_duration":0.0037813790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:59.729037+0000","last_change":"2023-10-14T09:38:59.729149+0000","last_active":"2023-10-14T09:38:59.729037+0000","last_peered":"2023-10-14T09:38:59.729037+0000","last_clean":"2023-10-14T09:38:59.729037+0000","last_became_active":"2023-10-14T09:38:31.026838+0000","last_became_peered":"2023-10-14T09:38:31.026838+0000","last_unstale":"2023-10-14T09:38:59.729037+0000","last_undegraded":"2023-10-14T09:38:59.729037+0000","last_fullsized":"2023-10-14T09:38:59.729037+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:59.728756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:59.728756+0000","last_clean_scrub_stamp":"2023-10-14T09:38:59.728756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:58.082949+0000","scrub_duration":0.00366154,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:45.578809+0000","last_change":"2023-10-14T09:38:45.578897+0000","last_active":"2023-10-14T09:38:45.578809+0000","last_peered":"2023-10-14T09:38:45.578809+0000","last_clean":"2023-10-14T09:38:45.578809+0000","last_became_active":"2023-10-14T09:38:30.029514+0000","last_became_peered":"2023-10-14T09:38:30.029514+0000","last_unstale":"2023-10-14T09:38:45.578809+0000","last_undegraded":"2023-10-14T09:38:45.578809+0000","last_fullsized":"2023-10-14T09:38:45.578809+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:45.578708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:45.578708+0000","last_clean_scrub_stamp":"2023-10-14T09:38:45.578708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:31:14.776956+0000","scrub_duration":0.0027720409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:00.622885+0000","last_change":"2023-10-14T09:39:00.623104+0000","last_active":"2023-10-14T09:39:00.622885+0000","last_peered":"2023-10-14T09:39:00.622885+0000","last_clean":"2023-10-14T09:39:00.622885+0000","last_became_active":"2023-10-14T09:38:31.029521+0000","last_became_peered":"2023-10-14T09:38:31.029521+0000","last_unstale":"2023-10-14T09:39:00.622885+0000","last_undegraded":"2023-10-14T09:39:00.622885+0000","last_fullsized":"2023-10-14T09:39:00.622885+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:00.622681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:00.622681+0000","last_clean_scrub_stamp":"2023-10-14T09:39:00.622681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:38:23.973228+0000","scrub_duration":0.0040747789999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:51.250186+0000","last_change":"2023-10-14T09:38:51.250374+0000","last_active":"2023-10-14T09:38:51.250186+0000","last_peered":"2023-10-14T09:38:51.250186+0000","last_clean":"2023-10-14T09:38:51.250186+0000","last_became_active":"2023-10-14T09:38:30.029517+0000","last_became_peered":"2023-10-14T09:38:30.029517+0000","last_unstale":"2023-10-14T09:38:51.250186+0000","last_undegraded":"2023-10-14T09:38:51.250186+0000","last_fullsized":"2023-10-14T09:38:51.250186+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:51.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:51.249926+0000","last_clean_scrub_stamp":"2023-10-14T09:38:51.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:49:43.310651+0000","scrub_duration":0.0038699889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:15.982619+0000","last_change":"2023-10-14T09:39:15.982729+0000","last_active":"2023-10-14T09:39:15.982619+0000","last_peered":"2023-10-14T09:39:15.982619+0000","last_clean":"2023-10-14T09:39:15.982619+0000","last_became_active":"2023-10-14T09:38:31.034300+0000","last_became_peered":"2023-10-14T09:38:31.034300+0000","last_unstale":"2023-10-14T09:39:15.982619+0000","last_undegraded":"2023-10-14T09:39:15.982619+0000","last_fullsized":"2023-10-14T09:39:15.982619+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:15.982433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:15.982433+0000","last_clean_scrub_stamp":"2023-10-14T09:39:15.982433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:45.273592+0000","scrub_duration":0.0035287259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:46.967921+0000","last_change":"2023-10-14T09:38:46.968047+0000","last_active":"2023-10-14T09:38:46.967921+0000","last_peered":"2023-10-14T09:38:46.967921+0000","last_clean":"2023-10-14T09:38:46.967921+0000","last_became_active":"2023-10-14T09:38:30.030374+0000","last_became_peered":"2023-10-14T09:38:30.030374+0000","last_unstale":"2023-10-14T09:38:46.967921+0000","last_undegraded":"2023-10-14T09:38:46.967921+0000","last_fullsized":"2023-10-14T09:38:46.967921+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:46.967740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:46.967740+0000","last_clean_scrub_stamp":"2023-10-14T09:38:46.967740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:02:37.918672+0000","scrub_duration":0.0037853489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.932254+0000","last_change":"2023-10-14T09:38:31.033069+0000","last_active":"2023-10-14T09:38:34.932254+0000","last_peered":"2023-10-14T09:38:34.932254+0000","last_clean":"2023-10-14T09:38:34.932254+0000","last_became_active":"2023-10-14T09:38:31.032648+0000","last_became_peered":"2023-10-14T09:38:31.032648+0000","last_unstale":"2023-10-14T09:38:34.932254+0000","last_undegraded":"2023-10-14T09:38:34.932254+0000","last_fullsized":"2023-10-14T09:38:34.932254+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:56.184606+0000","last_change":"2023-10-14T09:38:56.184716+0000","last_active":"2023-10-14T09:38:56.184606+0000","last_peered":"2023-10-14T09:38:56.184606+0000","last_clean":"2023-10-14T09:38:56.184606+0000","last_became_active":"2023-10-14T09:38:30.020321+0000","last_became_peered":"2023-10-14T09:38:30.020321+0000","last_unstale":"2023-10-14T09:38:56.184606+0000","last_undegraded":"2023-10-14T09:38:56.184606+0000","last_fullsized":"2023-10-14T09:38:56.184606+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:56.184416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:56.184416+0000","last_clean_scrub_stamp":"2023-10-14T09:38:56.184416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:59:55.799339+0000","scrub_duration":0.003775956,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:51.208601+0000","last_change":"2023-10-14T09:38:51.208788+0000","last_active":"2023-10-14T09:38:51.208601+0000","last_peered":"2023-10-14T09:38:51.208601+0000","last_clean":"2023-10-14T09:38:51.208601+0000","last_became_active":"2023-10-14T09:38:31.024478+0000","last_became_peered":"2023-10-14T09:38:31.024478+0000","last_unstale":"2023-10-14T09:38:51.208601+0000","last_undegraded":"2023-10-14T09:38:51.208601+0000","last_fullsized":"2023-10-14T09:38:51.208601+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:51.208358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:51.208358+0000","last_clean_scrub_stamp":"2023-10-14T09:38:51.208358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:55:18.410834+0000","scrub_duration":0.0035993549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:49.587807+0000","last_change":"2023-10-14T09:38:49.587913+0000","last_active":"2023-10-14T09:38:49.587807+0000","last_peered":"2023-10-14T09:38:49.587807+0000","last_clean":"2023-10-14T09:38:49.587807+0000","last_became_active":"2023-10-14T09:38:30.033358+0000","last_became_peered":"2023-10-14T09:38:30.033358+0000","last_unstale":"2023-10-14T09:38:49.587807+0000","last_undegraded":"2023-10-14T09:38:49.587807+0000","last_fullsized":"2023-10-14T09:38:49.587807+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:49.587584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:49.587584+0000","last_clean_scrub_stamp":"2023-10-14T09:38:49.587584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:54.741961+0000","scrub_duration":0.0034985849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"36'119","reported_seq":189,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:50.256743+0000","last_change":"2023-10-14T09:38:50.256743+0000","last_active":"2023-10-14T09:38:50.256743+0000","last_peered":"2023-10-14T09:38:50.256743+0000","last_clean":"2023-10-14T09:38:50.256743+0000","last_became_active":"2023-10-14T09:37:12.364623+0000","last_became_peered":"2023-10-14T09:37:12.364623+0000","last_unstale":"2023-10-14T09:38:50.256743+0000","last_undegraded":"2023-10-14T09:38:50.256743+0000","last_fullsized":"2023-10-14T09:38:50.256743+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'119","last_scrub_stamp":"2023-10-14T09:38:50.256394+0000","last_deep_scrub":"36'119","last_deep_scrub_stamp":"2023-10-14T09:38:50.256394+0000","last_clean_scrub_stamp":"2023-10-14T09:38:50.256394+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:31:14.101164+0000","scrub_duration":0.014946450999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509469,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":999424,"data_stored":748946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":0.97099999999999997,"15min":0.95099999999999996},"min":{"1min":0.755,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.569,"5min":1.623,"15min":1.623},"last":1.274},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.034,"15min":1.0149999999999999},"min":{"1min":0.78100000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.2370000000000001}]},{"osd":1,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.103,"15min":1.093},"min":{"1min":0.88900000000000001,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.21,"15min":1.1919999999999999},"min":{"1min":1.054,"5min":0.748,"15min":0.748},"max":{"1min":1.5740000000000001,"5min":1.79,"15min":1.79},"last":1.1120000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.137,"15min":1.1220000000000001},"min":{"1min":0.83999999999999997,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.391,"5min":1.2889999999999999,"15min":1.272},"min":{"1min":1.093,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.6950000000000001,"5min":1.841,"15min":1.841},"last":1.5509999999999999}]},{"osd":3,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.1639999999999999,"15min":1.1519999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.468,"5min":2.468,"15min":2.468},"last":1.327},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.3400000000000001,"15min":1.329},"min":{"1min":0.95799999999999996,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.2530000000000001,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":1.4319999999999999}]},{"osd":4,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":1.3120000000000001,"15min":1.282},"min":{"1min":0.80300000000000005,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.7589999999999999,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.387},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.387,"15min":1.3759999999999999},"min":{"1min":0.82899999999999996,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.595}]},{"osd":5,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.444,"15min":1.4470000000000001},"min":{"1min":0.83099999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.897,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":1.4990000000000001},{"interface":"front","average":{"1min":1.5589999999999999,"5min":1.4350000000000001,"15min":1.4139999999999999},"min":{"1min":1.071,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.52,"5min":2.52,"15min":2.52},"last":1.476}]},{"osd":6,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.6950000000000001,"5min":1.5529999999999999,"15min":1.5289999999999999},"min":{"1min":1.103,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.1739999999999999,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":1.631},{"interface":"front","average":{"1min":1.5740000000000001,"5min":1.482,"15min":1.4670000000000001},"min":{"1min":0.90000000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.3490000000000002,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":1.6870000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509471,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":409600,"data_stored":159104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.98899999999999999,"15min":0.98099999999999998},"min":{"1min":0.753,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1839999999999999,"15min":1.1890000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.6060000000000001,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.2150000000000001}]},{"osd":1,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.087,"15min":1.099},"min":{"1min":0.72299999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2450000000000001,"5min":2.069,"15min":2.069},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.224,"5min":1.1850000000000001,"15min":1.179},"min":{"1min":0.66100000000000003,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.8109999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.292}]},{"osd":2,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.2569999999999999,"15min":1.2609999999999999},"min":{"1min":0.79000000000000004,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.9119999999999999,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.387},{"interface":"front","average":{"1min":1.24,"5min":1.2310000000000001,"15min":1.2290000000000001},"min":{"1min":0.86299999999999999,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.7070000000000001,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.94699999999999995}]},{"osd":3,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3580000000000001,"15min":1.365},"min":{"1min":0.88400000000000001,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.8560000000000001,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.159,"5min":1.3260000000000001,"15min":1.3540000000000001},"min":{"1min":0.61399999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.448,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":1.3260000000000001}]},{"osd":4,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.3680000000000001,"15min":1.3879999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.5449999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.4139999999999999,"15min":1.4279999999999999},"min":{"1min":0.92500000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.6930000000000001,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":1.4139999999999999}]},{"osd":5,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.4570000000000001,"15min":1.48},"min":{"1min":0.89200000000000002,"5min":0.755,"15min":0.755},"max":{"1min":1.6080000000000001,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.605,"15min":1.619},"min":{"1min":1.093,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.0190000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":1.4510000000000001}]},{"osd":7,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.5369999999999999,"5min":1.5289999999999999,"15min":1.5269999999999999},"min":{"1min":1.1100000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.081,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.47},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.5049999999999999,"15min":1.514},"min":{"1min":1.141,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.919,"5min":2.5899999999999999,"15min":2.5899999999999999},"last":1.3720000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509471,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":409600,"data_stored":158592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.502,"15min":1.581},"min":{"1min":0.67600000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.375,"5min":13.404,"15min":13.404},"last":0.873},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.4570000000000001,"15min":1.524},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.6160000000000001,"5min":9.4640000000000004,"15min":9.4640000000000004},"last":0.95899999999999996}]},{"osd":1,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.4430000000000001,"15min":1.4810000000000001},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.6519999999999999,"5min":6.734,"15min":6.734},"last":1.198},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.4339999999999999,"15min":1.48},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.6890000000000001,"5min":7.8860000000000001,"15min":7.8860000000000001},"last":1.5720000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.528,"15min":1.5700000000000001},"min":{"1min":0.90800000000000003,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.637,"5min":7.8520000000000003,"15min":7.8520000000000003},"last":1.6739999999999999},{"interface":"front","average":{"1min":1.3,"5min":1.7709999999999999,"15min":1.849},"min":{"1min":0.93700000000000006,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.577,"5min":14.609,"15min":14.609},"last":1.359}]},{"osd":3,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.8340000000000001,"15min":1.9199999999999999},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.587,"5min":15.856,"15min":15.856},"last":1.262},{"interface":"front","average":{"1min":1.161,"5min":1.4530000000000001,"15min":1.5009999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.7829999999999999,"5min":6.1970000000000001,"15min":6.1970000000000001},"last":1.1020000000000001}]},{"osd":5,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.9810000000000001,"15min":2.101},"min":{"1min":0.89100000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.7589999999999999,"5min":16.547000000000001,"15min":16.547000000000001},"last":1.403},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.95,"15min":2.056},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.643,"5min":15.913,"15min":15.913},"last":1.5249999999999999}]},{"osd":6,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":2.101,"15min":2.2349999999999999},"min":{"1min":0.98099999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.7829999999999999,"5min":16.481999999999999,"15min":16.481999999999999},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.454,"5min":2.0830000000000002,"15min":2.1880000000000002},"min":{"1min":0.94799999999999995,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":1.7010000000000001,"5min":15.956,"15min":15.956},"last":1.4450000000000001}]},{"osd":7,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.7210000000000001,"15min":1.788},"min":{"1min":0.68799999999999994,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.889,"5min":6.6520000000000001,"15min":6.6520000000000001},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.95,"15min":2.032},"min":{"1min":1.0880000000000001,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":1.8720000000000001,"5min":10.314,"15min":10.314},"last":1.728}]}]},{"osd":3,"up_from":15,"seq":64424509470,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":417792,"data_stored":160122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.79600000000000004,"15min":0.80300000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3069999999999999,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.86399999999999999,"15min":0.85699999999999998},"min":{"1min":0.497,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.419,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.99399999999999999}]},{"osd":1,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.93000000000000005,"15min":0.94399999999999995},"min":{"1min":0.47799999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.3149999999999999,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.92500000000000004,"15min":0.92100000000000004},"min":{"1min":0.54000000000000004,"5min":0.504,"15min":0.504},"max":{"1min":1.3440000000000001,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":1.0549999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.105,"15min":1.087},"min":{"1min":0.61799999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.5840000000000001,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.264,"5min":1.2150000000000001,"15min":1.2070000000000001},"min":{"1min":0.66600000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.571,"5min":2.77,"15min":2.77},"last":1.456}]},{"osd":4,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.202,"15min":1.2090000000000001},"min":{"1min":0.872,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.5369999999999999,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3260000000000001,"15min":1.3240000000000001},"min":{"1min":1.0620000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.734,"5min":2.153,"15min":2.153},"last":1.3220000000000001}]},{"osd":5,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.3260000000000001,"15min":1.3360000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.5820000000000001,"5min":3.6469999999999998,"15min":3.6469999999999998},"last":1.27},{"interface":"front","average":{"1min":1.224,"5min":1.171,"15min":1.1619999999999999},"min":{"1min":0.83899999999999997,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.8100000000000001,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.5209999999999999}]},{"osd":6,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3580000000000001,"15min":1.3620000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.988,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.55},{"interface":"front","average":{"1min":1.343,"5min":1.4099999999999999,"15min":1.421},"min":{"1min":1.0980000000000001,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.5369999999999999,"5min":3.6930000000000001,"15min":3.6930000000000001},"last":1.3680000000000001}]},{"osd":7,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3089999999999999,"15min":1.3049999999999999},"min":{"1min":0.95199999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.897,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.583},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.4590000000000001,"15min":1.4770000000000001},"min":{"1min":0.79000000000000004,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.845,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.494}]}]},{"osd":2,"up_from":15,"seq":64424509471,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":405504,"data_stored":158558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.86299999999999999,"15min":0.88300000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.194,"5min":2.7789999999999999,"15min":2.7789999999999999},"last":1.355},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.81699999999999995,"15min":0.81399999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.4550000000000001,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.873}]},{"osd":1,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.365,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.753},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.91300000000000003,"15min":0.92300000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.3420000000000001,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":1.0660000000000001}]},{"osd":3,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.6899999999999999,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0589999999999999,"15min":1.0629999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.5449999999999999,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":1.1910000000000001}]},{"osd":4,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.294,"15min":1.306},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.6479999999999999,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":1.262},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.2130000000000001,"15min":1.2330000000000001},"min":{"1min":0.91200000000000003,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.5129999999999999,"5min":3.1469999999999998,"15min":3.1469999999999998},"last":1.0029999999999999}]},{"osd":5,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.3759999999999999,"15min":1.4019999999999999},"min":{"1min":0.78200000000000003,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":2.0009999999999999,"5min":4.0800000000000001,"15min":4.0800000000000001},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.3360000000000001,"15min":1.3520000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.734,"5min":3.6709999999999998,"15min":3.6709999999999998},"last":1.3129999999999999}]},{"osd":6,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.246,"15min":1.2709999999999999},"min":{"1min":0.79600000000000004,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.4410000000000001,"5min":2.9249999999999998,"15min":2.9249999999999998},"last":1.139},{"interface":"front","average":{"1min":1.319,"5min":1.3879999999999999,"15min":1.3999999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.891,"5min":3.081,"15min":3.081},"last":1.5029999999999999}]},{"osd":7,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.6619999999999999,"15min":1.7090000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":2.0939999999999999,"5min":5.0650000000000004,"15min":5.0650000000000004},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.476,"15min":1.5029999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.8220000000000001,"5min":3.8849999999999998,"15min":3.8849999999999998},"last":1.417}]}]},{"osd":1,"up_from":15,"seq":64424509471,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":417792,"data_stored":160122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.82799999999999996,"15min":0.81699999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.85499999999999998,"15min":0.83099999999999996},"min":{"1min":0.51900000000000002,"5min":0.378,"15min":0.378},"max":{"1min":1.476,"5min":1.72,"15min":1.72},"last":1.3109999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.96799999999999997,"15min":0.97999999999999998},"min":{"1min":0.42099999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.4490000000000001,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84999999999999998,"15min":0.85199999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.585,"5min":1.601,"15min":1.601},"last":0.96899999999999997}]},{"osd":3,"last update":"Sat Oct 14 09:39:13 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.0700000000000001,"15min":1.0800000000000001},"min":{"1min":0.47099999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.5469999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.403},{"interface":"front","average":{"1min":0.875,"5min":0.98599999999999999,"15min":1.004},"min":{"1min":0.47599999999999998,"5min":0.441,"15min":0.441},"max":{"1min":1.383,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.1339999999999999}]},{"osd":4,"last update":"Sat Oct 14 09:39:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.296,"15min":1.3100000000000001},"min":{"1min":0.73299999999999998,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.6200000000000001,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":1.292},{"interface":"front","average":{"1min":1.123,"5min":1.1879999999999999,"15min":1.1990000000000001},"min":{"1min":0.754,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.663,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.1970000000000001}]},{"osd":5,"last update":"Sat Oct 14 09:39:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.2310000000000001,"15min":1.2410000000000001},"min":{"1min":0.90100000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.4930000000000001,"5min":3.02,"15min":3.02},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.339,"15min":1.3460000000000001},"min":{"1min":0.80400000000000005,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.6919999999999999,"5min":3.827,"15min":3.827},"last":1.234}]},{"osd":6,"last update":"Sat Oct 14 09:39:13 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.258,"15min":1.2609999999999999},"min":{"1min":0.69899999999999995,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.698,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.518},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.3029999999999999,"15min":1.3149999999999999},"min":{"1min":0.73299999999999998,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.6060000000000001,"5min":3.3250000000000002,"15min":3.3250000000000002},"last":1.3720000000000001}]},{"osd":7,"last update":"Sat Oct 14 09:39:13 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.4550000000000001,"15min":1.4690000000000001},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.9419999999999999,"5min":3.9100000000000001,"15min":3.9100000000000001},"last":1.462},{"interface":"front","average":{"1min":1.401,"5min":1.361,"15min":1.3540000000000001},"min":{"1min":0.93400000000000005,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.9970000000000001,"5min":3.105,"15min":3.105},"last":1.798}]}]},{"osd":5,"up_from":14,"seq":60129542175,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":409600,"data_stored":159160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.98799999999999999,"15min":0.99099999999999999},"min":{"1min":0.59599999999999997,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5820000000000001,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.0149999999999999,"15min":0.997},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":1.0800000000000001}]},{"osd":1,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.117,"15min":1.1120000000000001},"min":{"1min":0.73499999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.512,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.048,"5min":1.0600000000000001,"15min":1.0620000000000001},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.651,"5min":1.756,"15min":1.756},"last":1.4359999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.3129999999999999,"15min":1.355},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.458,"5min":4.4610000000000003,"15min":4.4610000000000003},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.304,"15min":1.3240000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.6439999999999999,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.3779999999999999}]},{"osd":3,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.2410000000000001,"15min":1.2549999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.6439999999999999,"5min":1.712,"15min":1.712},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.2909999999999999,"15min":1.3089999999999999},"min":{"1min":0.79800000000000004,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.52,"5min":1.998,"15min":1.998},"last":1.246}]},{"osd":4,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.4119999999999999,"15min":1.425},"min":{"1min":0.79800000000000004,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.601,"5min":2.169,"15min":2.169},"last":1.131},{"interface":"front","average":{"1min":1.409,"5min":1.484,"15min":1.496},"min":{"1min":1.0349999999999999,"5min":0.88,"15min":0.88},"max":{"1min":1.6240000000000001,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.53}]},{"osd":6,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.377,"15min":1.3839999999999999},"min":{"1min":1.1040000000000001,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.7470000000000001,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.212},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.518,"15min":1.53},"min":{"1min":1.167,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":1.6990000000000001,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":1.292}]},{"osd":7,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.5349999999999999,"15min":1.5509999999999999},"min":{"1min":1.145,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.679,"5min":2.387,"15min":2.387},"last":1.478},{"interface":"front","average":{"1min":1.48,"5min":1.55,"15min":1.5620000000000001},"min":{"1min":1.143,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.1859999999999999,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.5780000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542175,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":995328,"data_stored":748856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.86099999999999999,"15min":0.88200000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.3759999999999999,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.95799999999999996,"15min":0.96799999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3939999999999999,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":1.1180000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.0009999999999999,"15min":1.0029999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.7470000000000001,"5min":2.133,"15min":2.133},"last":1.26},{"interface":"front","average":{"1min":0.878,"5min":0.94999999999999996,"15min":0.96199999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.653,"5min":4.2210000000000001,"15min":4.2210000000000001},"last":0.90900000000000003}]},{"osd":3,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":1.0029999999999999,"15min":1.03},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.2749999999999999,"5min":3.6070000000000002,"15min":3.6070000000000002},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.071,"5min":1.133,"15min":1.143},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.665,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.5229999999999999}]},{"osd":4,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.373,"15min":1.411},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.601,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.2809999999999999,"15min":1.3029999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.738,"5min":2.391,"15min":2.391},"last":1.1779999999999999}]},{"osd":5,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.375,"15min":1.387},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.6799999999999999,"5min":3.8620000000000001,"15min":3.8620000000000001},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.3620000000000001,"15min":1.377},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.641,"5min":2.4220000000000002,"15min":2.4220000000000002},"last":1.071}]},{"osd":6,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.4610000000000001,"15min":1.4830000000000001},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.75,"5min":3.8210000000000002,"15min":3.8210000000000002},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.341,"5min":1.494,"15min":1.52},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.8340000000000001,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":1.0189999999999999}]},{"osd":7,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.5389999999999999,"15min":1.5669999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.8859999999999999,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":1.341},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.4059999999999999,"15min":1.4199999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.8049999999999999,"5min":2.355,"15min":2.355},"last":1.3009999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T09:39:30.634 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:30.634 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:30.635 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:30.635 INFO:tasks.ceph:pgid 5.36 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:30.636 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:30.636 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:30.636 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:30.637 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:30.637 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:30.637 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:30.638 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:30.638 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:30.639 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:30.640 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:30.640 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:39:31.878 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T09:39:31.887 DEBUG:teuthology.orchestra.run.smithi129:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T09:39:50.642 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:39:50.867 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.865+0000 7f1da377c640 1 Processor -- start 2023-10-14T09:39:50.868 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.865+0000 7f1da377c640 1 -- start start 2023-10-14T09:39:50.869 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.867+0000 7f1da377c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1d9c0cd0c0 0x7f1d9c1615f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:39:50.870 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.867+0000 7f1da377c640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f1d9c0b0410 0x7f1d9c0b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:39:50.870 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.867+0000 7f1da377c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d9c15e3e0 con 0x7f1d9c15d3f0 2023-10-14T09:39:50.870 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.867+0000 7f1da377c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d9c0b0de0 con 0x7f1d9c0cd0c0 2023-10-14T09:39:50.870 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.867+0000 7f1da377c640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d9c0cd4a0 con 0x7f1d9c0b0410 2023-10-14T09:39:50.871 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.867+0000 7f1da1518640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1d9c0cd0c0 0x7f1d9c1615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:39:50.871 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.867+0000 7f1da1518640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1d9c0cd0c0 0x7f1d9c1615f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47472/0 (socket says 172.21.15.102:47472) 2023-10-14T09:39:50.871 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.867+0000 7f1da1518640 1 -- 172.21.15.102:0/3535538195 learned_addr learned my addr 172.21.15.102:0/3535538195 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:39:50.871 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.867+0000 7f1da0d17640 1 --2- 172.21.15.102:0/3535538195 >> v2:172.21.15.129:3300/0 conn(0x7f1d9c0b0410 0x7f1d9c0b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:39:50.872 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.867+0000 7f1da1518640 1 -- 172.21.15.102:0/3535538195 >> v2:172.21.15.129:3300/0 conn(0x7f1d9c0b0410 msgr2=0x7f1d9c0b08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:39:50.872 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.867+0000 7f1da1518640 1 --2- 172.21.15.102:0/3535538195 >> v2:172.21.15.129:3300/0 conn(0x7f1d9c0b0410 0x7f1d9c0b08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:39:50.872 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.867+0000 7f1da1518640 1 -- 172.21.15.102:0/3535538195 >> v1:172.21.15.102:6789/0 conn(0x7f1d9c15d3f0 legacy=0x7f1d9c15d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:39:50.873 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.867+0000 7f1da1518640 1 -- 172.21.15.102:0/3535538195 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d9c15e100 con 0x7f1d9c0cd0c0 2023-10-14T09:39:50.873 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.867+0000 7f1d9bfff640 1 -- 172.21.15.102:0/3535538195 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 763595625 0 0) 0x7f1d9c15e3e0 con 0x7f1d9c15d3f0 2023-10-14T09:39:50.873 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.867+0000 7f1da0d17640 1 --2- 172.21.15.102:0/3535538195 >> v2:172.21.15.129:3300/0 conn(0x7f1d9c0b0410 0x7f1d9c0b08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:39:50.876 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.869+0000 7f1da1518640 1 --2- 172.21.15.102:0/3535538195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d9c0cd0c0 0x7f1d9c1615f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c0cdad0 tx=0x7f1d9002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4073e0966d6cf611 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:39:50.876 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.869+0000 7f1d9bfff640 1 -- 172.21.15.102:0/3535538195 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9002ca80 con 0x7f1d9c0cd0c0 2023-10-14T09:39:50.877 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.869+0000 7f1d9bfff640 1 -- 172.21.15.102:0/3535538195 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9002cbe0 con 0x7f1d9c0cd0c0 2023-10-14T09:39:50.877 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.869+0000 7f1d9bfff640 1 -- 172.21.15.102:0/3535538195 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d900343f0 con 0x7f1d9c0cd0c0 2023-10-14T09:39:50.877 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.869+0000 7f1da377c640 1 -- 172.21.15.102:0/3535538195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d9c0cd0c0 msgr2=0x7f1d9c1615f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:39:50.878 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.869+0000 7f1da377c640 1 --2- 172.21.15.102:0/3535538195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d9c0cd0c0 0x7f1d9c1615f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c0cdad0 tx=0x7f1d9002bee0 comp rx=0 tx=0).stop 2023-10-14T09:39:50.878 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.869+0000 7f1da377c640 1 -- 172.21.15.102:0/3535538195 shutdown_connections 2023-10-14T09:39:50.878 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.869+0000 7f1da377c640 1 --2- 172.21.15.102:0/3535538195 >> v2:172.21.15.129:3300/0 conn(0x7f1d9c0b0410 0x7f1d9c0b08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:39:50.878 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.869+0000 7f1da377c640 1 --2- 172.21.15.102:0/3535538195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d9c0cd0c0 0x7f1d9c1615f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:39:50.879 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.869+0000 7f1da377c640 1 -- 172.21.15.102:0/3535538195 >> 172.21.15.102:0/3535538195 conn(0x7f1d9c0cb410 msgr2=0x7f1d9c0cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:39:50.879 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.870+0000 7f1da377c640 1 -- 172.21.15.102:0/3535538195 shutdown_connections 2023-10-14T09:39:50.879 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.870+0000 7f1da377c640 1 -- 172.21.15.102:0/3535538195 wait complete. 2023-10-14T09:39:50.879 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.871+0000 7f1da377c640 1 Processor -- start 2023-10-14T09:39:50.880 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.871+0000 7f1da377c640 1 -- start start 2023-10-14T09:39:50.880 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.872+0000 7f1da377c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d9c0b0410 0x7f1d9c1f56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:39:50.880 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.872+0000 7f1da377c640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1d9c0cd0c0 0x7f1d9c0b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:39:50.881 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.872+0000 7f1da377c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d9c15d3f0 0x7f1d9c159390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:39:50.881 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.872+0000 7f1da377c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c157030 con 0x7f1d9c0b0410 2023-10-14T09:39:50.881 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.872+0000 7f1da377c640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c0b2f50 con 0x7f1d9c15d3f0 2023-10-14T09:39:50.881 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.872+0000 7f1da377c640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c0b2340 con 0x7f1d9c0cd0c0 2023-10-14T09:39:50.882 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.873+0000 7f1da1518640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d9c0b0410 0x7f1d9c1f56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:39:50.882 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.873+0000 7f1da1518640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d9c0b0410 0x7f1d9c1f56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47484/0 (socket says 172.21.15.102:47484) 2023-10-14T09:39:50.882 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.873+0000 7f1da1518640 1 -- 172.21.15.102:0/3504137940 learned_addr learned my addr 172.21.15.102:0/3504137940 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:39:50.883 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.873+0000 7f1da1518640 1 -- 172.21.15.102:0/3504137940 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1d9c0cd0c0 msgr2=0x7f1d9c0b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:39:50.883 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.873+0000 7f1da1518640 1 --2- 172.21.15.102:0/3504137940 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1d9c0cd0c0 0x7f1d9c0b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:39:50.883 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.873+0000 7f1da1518640 1 -- 172.21.15.102:0/3504137940 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d9c15d3f0 msgr2=0x7f1d9c159390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:39:50.883 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.873+0000 7f1da1d19640 1 --2- 172.21.15.102:0/3504137940 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d9c15d3f0 0x7f1d9c159390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:39:50.884 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.873+0000 7f1da1518640 1 --2- 172.21.15.102:0/3504137940 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d9c15d3f0 0x7f1d9c159390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:39:50.884 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.873+0000 7f1da1518640 1 -- 172.21.15.102:0/3504137940 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d90009b30 con 0x7f1d9c0b0410 2023-10-14T09:39:50.884 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.873+0000 7f1da1518640 1 --2- 172.21.15.102:0/3504137940 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d9c0b0410 0x7f1d9c1f56b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1d90000f80 tx=0x7f1d90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:39:50.885 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.874+0000 7f1d99ffb640 1 -- 172.21.15.102:0/3504137940 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9003e450 con 0x7f1d9c0b0410 2023-10-14T09:39:50.885 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.874+0000 7f1d99ffb640 1 -- 172.21.15.102:0/3504137940 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9003e5b0 con 0x7f1d9c0b0410 2023-10-14T09:39:50.885 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.874+0000 7f1d99ffb640 1 -- 172.21.15.102:0/3504137940 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9003e740 con 0x7f1d9c0b0410 2023-10-14T09:39:50.885 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.874+0000 7f1da377c640 1 -- 172.21.15.102:0/3504137940 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d9c0b2620 con 0x7f1d9c0b0410 2023-10-14T09:39:50.886 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.874+0000 7f1da377c640 1 -- 172.21.15.102:0/3504137940 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d9c0b2be0 con 0x7f1d9c0b0410 2023-10-14T09:39:50.887 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.875+0000 7f1da377c640 1 -- 172.21.15.102:0/3504137940 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d9c0b0c00 con 0x7f1d9c0b0410 2023-10-14T09:39:50.887 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.876+0000 7f1d99ffb640 1 -- 172.21.15.102:0/3504137940 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1d9002cd50 con 0x7f1d9c0b0410 2023-10-14T09:39:50.887 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.877+0000 7f1d99ffb640 1 --2- 172.21.15.102:0/3504137940 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1d8006ae70 0x7f1d8006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:39:50.888 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.877+0000 7f1d99ffb640 1 -- 172.21.15.102:0/3504137940 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f1d900abf60 con 0x7f1d9c0b0410 2023-10-14T09:39:50.888 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.877+0000 7f1da0d17640 1 --2- 172.21.15.102:0/3504137940 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1d8006ae70 0x7f1d8006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:39:50.888 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.878+0000 7f1da0d17640 1 --2- 172.21.15.102:0/3504137940 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1d8006ae70 0x7f1d8006d330 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1d88006fd0 tx=0x7f1d88008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:39:50.888 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:50.882+0000 7f1d99ffb640 1 -- 172.21.15.102:0/3504137940 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1d90077000 con 0x7f1d9c0b0410 2023-10-14T09:39:51.077 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:51.076+0000 7f1da377c640 1 -- 172.21.15.102:0/3504137940 --> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1d9c160df0 con 0x7f1d8006ae70 2023-10-14T09:39:51.090 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:51.088+0000 7f1d99ffb640 1 -- 172.21.15.102:0/3504137940 <== mgr.4104 v2:172.21.15.102:6832/1125265706 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288830 (secure 0 0 0) 0x7f1d8800c7a0 con 0x7f1d8006ae70 2023-10-14T09:39:51.094 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:39:51.096 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2023-10-14T09:39:51.098 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:51.095+0000 7f1da377c640 1 -- 172.21.15.102:0/3504137940 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1d8006ae70 msgr2=0x7f1d8006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:39:51.098 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:51.095+0000 7f1da377c640 1 --2- 172.21.15.102:0/3504137940 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1d8006ae70 0x7f1d8006d330 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1d88006fd0 tx=0x7f1d88008040 comp rx=0 tx=0).stop 2023-10-14T09:39:51.099 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:51.095+0000 7f1da377c640 1 -- 172.21.15.102:0/3504137940 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d9c0b0410 msgr2=0x7f1d9c1f56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:39:51.099 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:51.095+0000 7f1da377c640 1 --2- 172.21.15.102:0/3504137940 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d9c0b0410 0x7f1d9c1f56b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1d90000f80 tx=0x7f1d90004a40 comp rx=0 tx=0).stop 2023-10-14T09:39:51.099 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:51.095+0000 7f1da377c640 1 -- 172.21.15.102:0/3504137940 shutdown_connections 2023-10-14T09:39:51.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:51.095+0000 7f1da377c640 1 --2- 172.21.15.102:0/3504137940 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f1d8006ae70 0x7f1d8006d330 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:39:51.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:51.095+0000 7f1da377c640 1 --2- 172.21.15.102:0/3504137940 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d9c15d3f0 0x7f1d9c159390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:39:51.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:51.095+0000 7f1da377c640 1 --2- 172.21.15.102:0/3504137940 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1d9c0cd0c0 0x7f1d9c0b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:39:51.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:51.095+0000 7f1da377c640 1 --2- 172.21.15.102:0/3504137940 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d9c0b0410 0x7f1d9c1f56b0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:39:51.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:51.095+0000 7f1da377c640 1 -- 172.21.15.102:0/3504137940 >> 172.21.15.102:0/3504137940 conn(0x7f1d9c0cb410 msgr2=0x7f1d9c15b640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:39:51.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:51.096+0000 7f1da377c640 1 -- 172.21.15.102:0/3504137940 shutdown_connections 2023-10-14T09:39:51.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:39:51.096+0000 7f1da377c640 1 -- 172.21.15.102:0/3504137940 wait complete. 2023-10-14T09:39:51.117 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2023-10-14T09:39:49.925968+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220488,"kb_used_data":4360,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754232,"statfs":{"total":773094113280,"available":772868333568,"internally_reserved":0,"allocated":4464640,"data_stored":2453460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004564"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:08.679134+0000","last_change":"2023-10-14T09:39:08.679315+0000","last_active":"2023-10-14T09:39:08.679134+0000","last_peered":"2023-10-14T09:39:08.679134+0000","last_clean":"2023-10-14T09:39:08.679134+0000","last_became_active":"2023-10-14T09:38:31.023780+0000","last_became_peered":"2023-10-14T09:38:31.023780+0000","last_unstale":"2023-10-14T09:39:08.679134+0000","last_undegraded":"2023-10-14T09:39:08.679134+0000","last_fullsized":"2023-10-14T09:39:08.679134+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:08.678892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:08.678892+0000","last_clean_scrub_stamp":"2023-10-14T09:39:08.678892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:24:24.216542+0000","scrub_duration":0.003218533,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:28.993817+0000","last_change":"2023-10-14T09:39:28.993921+0000","last_active":"2023-10-14T09:39:28.993817+0000","last_peered":"2023-10-14T09:39:28.993817+0000","last_clean":"2023-10-14T09:39:28.993817+0000","last_became_active":"2023-10-14T09:38:31.027820+0000","last_became_peered":"2023-10-14T09:38:31.027820+0000","last_unstale":"2023-10-14T09:39:28.993817+0000","last_undegraded":"2023-10-14T09:39:28.993817+0000","last_fullsized":"2023-10-14T09:39:28.993817+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:28.993631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:28.993631+0000","last_clean_scrub_stamp":"2023-10-14T09:39:28.993631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:39:31.485088+0000","scrub_duration":0.0032520259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:04.176269+0000","last_change":"2023-10-14T09:39:04.176464+0000","last_active":"2023-10-14T09:39:04.176269+0000","last_peered":"2023-10-14T09:39:04.176269+0000","last_clean":"2023-10-14T09:39:04.176269+0000","last_became_active":"2023-10-14T09:38:31.019892+0000","last_became_peered":"2023-10-14T09:38:31.019892+0000","last_unstale":"2023-10-14T09:39:04.176269+0000","last_undegraded":"2023-10-14T09:39:04.176269+0000","last_fullsized":"2023-10-14T09:39:04.176269+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:04.176059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:04.176059+0000","last_clean_scrub_stamp":"2023-10-14T09:39:04.176059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:01.866021+0000","scrub_duration":0.0038494269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:31.694190+0000","last_change":"2023-10-14T09:39:31.694310+0000","last_active":"2023-10-14T09:39:31.694190+0000","last_peered":"2023-10-14T09:39:31.694190+0000","last_clean":"2023-10-14T09:39:31.694190+0000","last_became_active":"2023-10-14T09:38:31.035189+0000","last_became_peered":"2023-10-14T09:38:31.035189+0000","last_unstale":"2023-10-14T09:39:31.694190+0000","last_undegraded":"2023-10-14T09:39:31.694190+0000","last_fullsized":"2023-10-14T09:39:31.694190+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:31.693898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:31.693898+0000","last_clean_scrub_stamp":"2023-10-14T09:39:31.693898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:46.030222+0000","scrub_duration":0.003878135,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:11.711538+0000","last_change":"2023-10-14T09:39:11.711716+0000","last_active":"2023-10-14T09:39:11.711538+0000","last_peered":"2023-10-14T09:39:11.711538+0000","last_clean":"2023-10-14T09:39:11.711538+0000","last_became_active":"2023-10-14T09:38:31.020777+0000","last_became_peered":"2023-10-14T09:38:31.020777+0000","last_unstale":"2023-10-14T09:39:11.711538+0000","last_undegraded":"2023-10-14T09:39:11.711538+0000","last_fullsized":"2023-10-14T09:39:11.711538+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:11.711327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:11.711327+0000","last_clean_scrub_stamp":"2023-10-14T09:39:11.711327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:57:10.065520+0000","scrub_duration":0.0032876120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:27.009678+0000","last_change":"2023-10-14T09:39:27.009795+0000","last_active":"2023-10-14T09:39:27.009678+0000","last_peered":"2023-10-14T09:39:27.009678+0000","last_clean":"2023-10-14T09:39:27.009678+0000","last_became_active":"2023-10-14T09:38:31.027342+0000","last_became_peered":"2023-10-14T09:38:31.027342+0000","last_unstale":"2023-10-14T09:39:27.009678+0000","last_undegraded":"2023-10-14T09:39:27.009678+0000","last_fullsized":"2023-10-14T09:39:27.009678+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:27.009479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:27.009479+0000","last_clean_scrub_stamp":"2023-10-14T09:39:27.009479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:17:47.055133+0000","scrub_duration":0.0037233190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:09.340813+0000","last_change":"2023-10-14T09:39:09.340915+0000","last_active":"2023-10-14T09:39:09.340813+0000","last_peered":"2023-10-14T09:39:09.340813+0000","last_clean":"2023-10-14T09:39:09.340813+0000","last_became_active":"2023-10-14T09:38:31.033760+0000","last_became_peered":"2023-10-14T09:38:31.033760+0000","last_unstale":"2023-10-14T09:39:09.340813+0000","last_undegraded":"2023-10-14T09:39:09.340813+0000","last_fullsized":"2023-10-14T09:39:09.340813+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:09.340626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:09.340626+0000","last_clean_scrub_stamp":"2023-10-14T09:39:09.340626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:22:23.056489+0000","scrub_duration":0.0036686370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:53.242083+0000","last_change":"2023-10-14T09:38:53.242193+0000","last_active":"2023-10-14T09:38:53.242083+0000","last_peered":"2023-10-14T09:38:53.242083+0000","last_clean":"2023-10-14T09:38:53.242083+0000","last_became_active":"2023-10-14T09:38:31.024702+0000","last_became_peered":"2023-10-14T09:38:31.024702+0000","last_unstale":"2023-10-14T09:38:53.242083+0000","last_undegraded":"2023-10-14T09:38:53.242083+0000","last_fullsized":"2023-10-14T09:38:53.242083+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:53.241901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:53.241901+0000","last_clean_scrub_stamp":"2023-10-14T09:38:53.241901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:24:15.099376+0000","scrub_duration":0.0037239859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:21.534934+0000","last_change":"2023-10-14T09:39:21.535050+0000","last_active":"2023-10-14T09:39:21.534934+0000","last_peered":"2023-10-14T09:39:21.534934+0000","last_clean":"2023-10-14T09:39:21.534934+0000","last_became_active":"2023-10-14T09:38:31.023498+0000","last_became_peered":"2023-10-14T09:38:31.023498+0000","last_unstale":"2023-10-14T09:39:21.534934+0000","last_undegraded":"2023-10-14T09:39:21.534934+0000","last_fullsized":"2023-10-14T09:39:21.534934+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:21.534743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:21.534743+0000","last_clean_scrub_stamp":"2023-10-14T09:39:21.534743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:46:56.536260+0000","scrub_duration":0.0037966150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:36.777204+0000","last_change":"2023-10-14T09:39:36.777321+0000","last_active":"2023-10-14T09:39:36.777204+0000","last_peered":"2023-10-14T09:39:36.777204+0000","last_clean":"2023-10-14T09:39:36.777204+0000","last_became_active":"2023-10-14T09:38:31.029268+0000","last_became_peered":"2023-10-14T09:38:31.029268+0000","last_unstale":"2023-10-14T09:39:36.777204+0000","last_undegraded":"2023-10-14T09:39:36.777204+0000","last_fullsized":"2023-10-14T09:39:36.777204+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:36.777007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:36.777007+0000","last_clean_scrub_stamp":"2023-10-14T09:39:36.777007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:10:49.435204+0000","scrub_duration":0.0039070880000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:54.281412+0000","last_change":"2023-10-14T09:38:54.281549+0000","last_active":"2023-10-14T09:38:54.281412+0000","last_peered":"2023-10-14T09:38:54.281412+0000","last_clean":"2023-10-14T09:38:54.281412+0000","last_became_active":"2023-10-14T09:38:31.033343+0000","last_became_peered":"2023-10-14T09:38:31.033343+0000","last_unstale":"2023-10-14T09:38:54.281412+0000","last_undegraded":"2023-10-14T09:38:54.281412+0000","last_fullsized":"2023-10-14T09:38:54.281412+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:54.281200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:54.281200+0000","last_clean_scrub_stamp":"2023-10-14T09:38:54.281200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:56:08.772956+0000","scrub_duration":0.003963818,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:02.146816+0000","last_change":"2023-10-14T09:39:02.146946+0000","last_active":"2023-10-14T09:39:02.146816+0000","last_peered":"2023-10-14T09:39:02.146816+0000","last_clean":"2023-10-14T09:39:02.146816+0000","last_became_active":"2023-10-14T09:38:31.017971+0000","last_became_peered":"2023-10-14T09:38:31.017971+0000","last_unstale":"2023-10-14T09:39:02.146816+0000","last_undegraded":"2023-10-14T09:39:02.146816+0000","last_fullsized":"2023-10-14T09:39:02.146816+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:02.146634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:02.146634+0000","last_clean_scrub_stamp":"2023-10-14T09:39:02.146634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:38:25.497182+0000","scrub_duration":0.0038723500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:49.533192+0000","last_change":"2023-10-14T09:38:49.533292+0000","last_active":"2023-10-14T09:38:49.533192+0000","last_peered":"2023-10-14T09:38:49.533192+0000","last_clean":"2023-10-14T09:38:49.533192+0000","last_became_active":"2023-10-14T09:38:31.019186+0000","last_became_peered":"2023-10-14T09:38:31.019186+0000","last_unstale":"2023-10-14T09:38:49.533192+0000","last_undegraded":"2023-10-14T09:38:49.533192+0000","last_fullsized":"2023-10-14T09:38:49.533192+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:49.532907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:49.532907+0000","last_clean_scrub_stamp":"2023-10-14T09:38:49.532907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:50:05.598559+0000","scrub_duration":0.0024617720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:21.034412+0000","last_change":"2023-10-14T09:39:21.034532+0000","last_active":"2023-10-14T09:39:21.034412+0000","last_peered":"2023-10-14T09:39:21.034412+0000","last_clean":"2023-10-14T09:39:21.034412+0000","last_became_active":"2023-10-14T09:38:31.020409+0000","last_became_peered":"2023-10-14T09:38:31.020409+0000","last_unstale":"2023-10-14T09:39:21.034412+0000","last_undegraded":"2023-10-14T09:39:21.034412+0000","last_fullsized":"2023-10-14T09:39:21.034412+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:21.034224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:21.034224+0000","last_clean_scrub_stamp":"2023-10-14T09:39:21.034224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:10:45.600855+0000","scrub_duration":0.0035651189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:13.063661+0000","last_change":"2023-10-14T09:39:13.063764+0000","last_active":"2023-10-14T09:39:13.063661+0000","last_peered":"2023-10-14T09:39:13.063661+0000","last_clean":"2023-10-14T09:39:13.063661+0000","last_became_active":"2023-10-14T09:38:31.025155+0000","last_became_peered":"2023-10-14T09:38:31.025155+0000","last_unstale":"2023-10-14T09:39:13.063661+0000","last_undegraded":"2023-10-14T09:39:13.063661+0000","last_fullsized":"2023-10-14T09:39:13.063661+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:13.063384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:13.063384+0000","last_clean_scrub_stamp":"2023-10-14T09:39:13.063384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:26.836471+0000","scrub_duration":0.0035710059999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:00.295754+0000","last_change":"2023-10-14T09:39:00.295945+0000","last_active":"2023-10-14T09:39:00.295754+0000","last_peered":"2023-10-14T09:39:00.295754+0000","last_clean":"2023-10-14T09:39:00.295754+0000","last_became_active":"2023-10-14T09:38:31.033869+0000","last_became_peered":"2023-10-14T09:38:31.033869+0000","last_unstale":"2023-10-14T09:39:00.295754+0000","last_undegraded":"2023-10-14T09:39:00.295754+0000","last_fullsized":"2023-10-14T09:39:00.295754+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:00.295522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:00.295522+0000","last_clean_scrub_stamp":"2023-10-14T09:39:00.295522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:12:26.055534+0000","scrub_duration":0.0036621850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:58.255288+0000","last_change":"2023-10-14T09:38:58.255392+0000","last_active":"2023-10-14T09:38:58.255288+0000","last_peered":"2023-10-14T09:38:58.255288+0000","last_clean":"2023-10-14T09:38:58.255288+0000","last_became_active":"2023-10-14T09:38:31.029457+0000","last_became_peered":"2023-10-14T09:38:31.029457+0000","last_unstale":"2023-10-14T09:38:58.255288+0000","last_undegraded":"2023-10-14T09:38:58.255288+0000","last_fullsized":"2023-10-14T09:38:58.255288+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:58.255108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:58.255108+0000","last_clean_scrub_stamp":"2023-10-14T09:38:58.255108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:10:17.655904+0000","scrub_duration":0.0033634659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:32.990487+0000","last_change":"2023-10-14T09:39:32.990609+0000","last_active":"2023-10-14T09:39:32.990487+0000","last_peered":"2023-10-14T09:39:32.990487+0000","last_clean":"2023-10-14T09:39:32.990487+0000","last_became_active":"2023-10-14T09:38:31.033040+0000","last_became_peered":"2023-10-14T09:38:31.033040+0000","last_unstale":"2023-10-14T09:39:32.990487+0000","last_undegraded":"2023-10-14T09:39:32.990487+0000","last_fullsized":"2023-10-14T09:39:32.990487+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:32.990298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:32.990298+0000","last_clean_scrub_stamp":"2023-10-14T09:39:32.990298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:04:33.825932+0000","scrub_duration":0.0035171180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:08.083614+0000","last_change":"2023-10-14T09:39:08.083715+0000","last_active":"2023-10-14T09:39:08.083614+0000","last_peered":"2023-10-14T09:39:08.083614+0000","last_clean":"2023-10-14T09:39:08.083614+0000","last_became_active":"2023-10-14T09:38:31.025735+0000","last_became_peered":"2023-10-14T09:38:31.025735+0000","last_unstale":"2023-10-14T09:39:08.083614+0000","last_undegraded":"2023-10-14T09:39:08.083614+0000","last_fullsized":"2023-10-14T09:39:08.083614+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:08.083434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:08.083434+0000","last_clean_scrub_stamp":"2023-10-14T09:39:08.083434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:13:04.453658+0000","scrub_duration":0.0033516599999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:59.645885+0000","last_change":"2023-10-14T09:38:59.645989+0000","last_active":"2023-10-14T09:38:59.645885+0000","last_peered":"2023-10-14T09:38:59.645885+0000","last_clean":"2023-10-14T09:38:59.645885+0000","last_became_active":"2023-10-14T09:38:31.011363+0000","last_became_peered":"2023-10-14T09:38:31.011363+0000","last_unstale":"2023-10-14T09:38:59.645885+0000","last_undegraded":"2023-10-14T09:38:59.645885+0000","last_fullsized":"2023-10-14T09:38:59.645885+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:59.645701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:59.645701+0000","last_clean_scrub_stamp":"2023-10-14T09:38:59.645701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:06:09.913970+0000","scrub_duration":0.0038696870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:11.540547+0000","last_change":"2023-10-14T09:39:11.540653+0000","last_active":"2023-10-14T09:39:11.540547+0000","last_peered":"2023-10-14T09:39:11.540547+0000","last_clean":"2023-10-14T09:39:11.540547+0000","last_became_active":"2023-10-14T09:38:31.021555+0000","last_became_peered":"2023-10-14T09:38:31.021555+0000","last_unstale":"2023-10-14T09:39:11.540547+0000","last_undegraded":"2023-10-14T09:39:11.540547+0000","last_fullsized":"2023-10-14T09:39:11.540547+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:11.540315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:11.540315+0000","last_clean_scrub_stamp":"2023-10-14T09:39:11.540315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:37:15.545521+0000","scrub_duration":0.0036936970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:32.426858+0000","last_change":"2023-10-14T09:39:32.426977+0000","last_active":"2023-10-14T09:39:32.426858+0000","last_peered":"2023-10-14T09:39:32.426858+0000","last_clean":"2023-10-14T09:39:32.426858+0000","last_became_active":"2023-10-14T09:38:31.029712+0000","last_became_peered":"2023-10-14T09:38:31.029712+0000","last_unstale":"2023-10-14T09:39:32.426858+0000","last_undegraded":"2023-10-14T09:39:32.426858+0000","last_fullsized":"2023-10-14T09:39:32.426858+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:32.426654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:32.426654+0000","last_clean_scrub_stamp":"2023-10-14T09:39:32.426654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:43:07.403801+0000","scrub_duration":0.003833707,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:57.630740+0000","last_change":"2023-10-14T09:38:57.630848+0000","last_active":"2023-10-14T09:38:57.630740+0000","last_peered":"2023-10-14T09:38:57.630740+0000","last_clean":"2023-10-14T09:38:57.630740+0000","last_became_active":"2023-10-14T09:38:31.023251+0000","last_became_peered":"2023-10-14T09:38:31.023251+0000","last_unstale":"2023-10-14T09:38:57.630740+0000","last_undegraded":"2023-10-14T09:38:57.630740+0000","last_fullsized":"2023-10-14T09:38:57.630740+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:57.630577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:57.630577+0000","last_clean_scrub_stamp":"2023-10-14T09:38:57.630577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:23:32.551600+0000","scrub_duration":0.0038587109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:15.975509+0000","last_change":"2023-10-14T09:39:15.975621+0000","last_active":"2023-10-14T09:39:15.975509+0000","last_peered":"2023-10-14T09:39:15.975509+0000","last_clean":"2023-10-14T09:39:15.975509+0000","last_became_active":"2023-10-14T09:38:31.010860+0000","last_became_peered":"2023-10-14T09:38:31.010860+0000","last_unstale":"2023-10-14T09:39:15.975509+0000","last_undegraded":"2023-10-14T09:39:15.975509+0000","last_fullsized":"2023-10-14T09:39:15.975509+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:15.975300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:15.975300+0000","last_clean_scrub_stamp":"2023-10-14T09:39:15.975300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:33:45.828182+0000","scrub_duration":0.0039747810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.926771+0000","last_change":"2023-10-14T09:38:31.023722+0000","last_active":"2023-10-14T09:38:34.926771+0000","last_peered":"2023-10-14T09:38:34.926771+0000","last_clean":"2023-10-14T09:38:34.926771+0000","last_became_active":"2023-10-14T09:38:31.023469+0000","last_became_peered":"2023-10-14T09:38:31.023469+0000","last_unstale":"2023-10-14T09:38:34.926771+0000","last_undegraded":"2023-10-14T09:38:34.926771+0000","last_fullsized":"2023-10-14T09:38:34.926771+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:27.984012+0000","last_change":"2023-10-14T09:39:27.984150+0000","last_active":"2023-10-14T09:39:27.984012+0000","last_peered":"2023-10-14T09:39:27.984012+0000","last_clean":"2023-10-14T09:39:27.984012+0000","last_became_active":"2023-10-14T09:38:31.026660+0000","last_became_peered":"2023-10-14T09:38:31.026660+0000","last_unstale":"2023-10-14T09:39:27.984012+0000","last_undegraded":"2023-10-14T09:39:27.984012+0000","last_fullsized":"2023-10-14T09:39:27.984012+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:27.983817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:27.983817+0000","last_clean_scrub_stamp":"2023-10-14T09:39:27.983817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:39:01.203454+0000","scrub_duration":0.0036768719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:38.771528+0000","last_change":"2023-10-14T09:39:38.771642+0000","last_active":"2023-10-14T09:39:38.771528+0000","last_peered":"2023-10-14T09:39:38.771528+0000","last_clean":"2023-10-14T09:39:38.771528+0000","last_became_active":"2023-10-14T09:38:31.025680+0000","last_became_peered":"2023-10-14T09:38:31.025680+0000","last_unstale":"2023-10-14T09:39:38.771528+0000","last_undegraded":"2023-10-14T09:39:38.771528+0000","last_fullsized":"2023-10-14T09:39:38.771528+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:38.771322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:38.771322+0000","last_clean_scrub_stamp":"2023-10-14T09:39:38.771322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:22:35.469692+0000","scrub_duration":0.0036031840000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:09.104667+0000","last_change":"2023-10-14T09:39:09.104780+0000","last_active":"2023-10-14T09:39:09.104667+0000","last_peered":"2023-10-14T09:39:09.104667+0000","last_clean":"2023-10-14T09:39:09.104667+0000","last_became_active":"2023-10-14T09:38:31.022641+0000","last_became_peered":"2023-10-14T09:38:31.022641+0000","last_unstale":"2023-10-14T09:39:09.104667+0000","last_undegraded":"2023-10-14T09:39:09.104667+0000","last_fullsized":"2023-10-14T09:39:09.104667+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:09.104477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:09.104477+0000","last_clean_scrub_stamp":"2023-10-14T09:39:09.104477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:40:11.222798+0000","scrub_duration":0.0041570940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:34.465197+0000","last_change":"2023-10-14T09:39:34.465377+0000","last_active":"2023-10-14T09:39:34.465197+0000","last_peered":"2023-10-14T09:39:34.465197+0000","last_clean":"2023-10-14T09:39:34.465197+0000","last_became_active":"2023-10-14T09:38:31.031302+0000","last_became_peered":"2023-10-14T09:38:31.031302+0000","last_unstale":"2023-10-14T09:39:34.465197+0000","last_undegraded":"2023-10-14T09:39:34.465197+0000","last_fullsized":"2023-10-14T09:39:34.465197+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:34.464975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:34.464975+0000","last_clean_scrub_stamp":"2023-10-14T09:39:34.464975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:04:00.688735+0000","scrub_duration":0.0039229520000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:01.297360+0000","last_change":"2023-10-14T09:39:01.297588+0000","last_active":"2023-10-14T09:39:01.297360+0000","last_peered":"2023-10-14T09:39:01.297360+0000","last_clean":"2023-10-14T09:39:01.297360+0000","last_became_active":"2023-10-14T09:38:31.029493+0000","last_became_peered":"2023-10-14T09:38:31.029493+0000","last_unstale":"2023-10-14T09:39:01.297360+0000","last_undegraded":"2023-10-14T09:39:01.297360+0000","last_fullsized":"2023-10-14T09:39:01.297360+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:01.297099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:01.297099+0000","last_clean_scrub_stamp":"2023-10-14T09:39:01.297099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:00:00.912022+0000","scrub_duration":0.0036701279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:01.810535+0000","last_change":"2023-10-14T09:39:01.810634+0000","last_active":"2023-10-14T09:39:01.810535+0000","last_peered":"2023-10-14T09:39:01.810535+0000","last_clean":"2023-10-14T09:39:01.810535+0000","last_became_active":"2023-10-14T09:38:31.025243+0000","last_became_peered":"2023-10-14T09:38:31.025243+0000","last_unstale":"2023-10-14T09:39:01.810535+0000","last_undegraded":"2023-10-14T09:39:01.810535+0000","last_fullsized":"2023-10-14T09:39:01.810535+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:01.810343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:01.810343+0000","last_clean_scrub_stamp":"2023-10-14T09:39:01.810343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:07:34.569268+0000","scrub_duration":0.0028920640000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:06.321798+0000","last_change":"2023-10-14T09:39:06.321903+0000","last_active":"2023-10-14T09:39:06.321798+0000","last_peered":"2023-10-14T09:39:06.321798+0000","last_clean":"2023-10-14T09:39:06.321798+0000","last_became_active":"2023-10-14T09:38:31.028420+0000","last_became_peered":"2023-10-14T09:38:31.028420+0000","last_unstale":"2023-10-14T09:39:06.321798+0000","last_undegraded":"2023-10-14T09:39:06.321798+0000","last_fullsized":"2023-10-14T09:39:06.321798+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:06.321596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:06.321596+0000","last_clean_scrub_stamp":"2023-10-14T09:39:06.321596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:04:04.665773+0000","scrub_duration":0.0036308410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:56.608953+0000","last_change":"2023-10-14T09:38:56.609079+0000","last_active":"2023-10-14T09:38:56.608953+0000","last_peered":"2023-10-14T09:38:56.608953+0000","last_clean":"2023-10-14T09:38:56.608953+0000","last_became_active":"2023-10-14T09:38:31.023482+0000","last_became_peered":"2023-10-14T09:38:31.023482+0000","last_unstale":"2023-10-14T09:38:56.608953+0000","last_undegraded":"2023-10-14T09:38:56.608953+0000","last_fullsized":"2023-10-14T09:38:56.608953+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:56.608786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:56.608786+0000","last_clean_scrub_stamp":"2023-10-14T09:38:56.608786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:22:18.269819+0000","scrub_duration":0.0034962940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"35'4","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:50.611267+0000","last_change":"2023-10-14T09:38:50.611392+0000","last_active":"2023-10-14T09:38:50.611267+0000","last_peered":"2023-10-14T09:38:50.611267+0000","last_clean":"2023-10-14T09:38:50.611267+0000","last_became_active":"2023-10-14T09:38:30.031374+0000","last_became_peered":"2023-10-14T09:38:30.031374+0000","last_unstale":"2023-10-14T09:38:50.611267+0000","last_undegraded":"2023-10-14T09:38:50.611267+0000","last_fullsized":"2023-10-14T09:38:50.611267+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2023-10-14T09:38:50.611077+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2023-10-14T09:38:50.611077+0000","last_clean_scrub_stamp":"2023-10-14T09:38:50.611077+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:06:00.879346+0000","scrub_duration":0.0046609240000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:02.766644+0000","last_change":"2023-10-14T09:39:02.766721+0000","last_active":"2023-10-14T09:39:02.766644+0000","last_peered":"2023-10-14T09:39:02.766644+0000","last_clean":"2023-10-14T09:39:02.766644+0000","last_became_active":"2023-10-14T09:38:31.026414+0000","last_became_peered":"2023-10-14T09:38:31.026414+0000","last_unstale":"2023-10-14T09:39:02.766644+0000","last_undegraded":"2023-10-14T09:39:02.766644+0000","last_fullsized":"2023-10-14T09:39:02.766644+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:02.766528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:02.766528+0000","last_clean_scrub_stamp":"2023-10-14T09:39:02.766528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:29:45.420889+0000","scrub_duration":0.003473659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"35'1","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:49.679590+0000","last_change":"2023-10-14T09:38:49.679696+0000","last_active":"2023-10-14T09:38:49.679590+0000","last_peered":"2023-10-14T09:38:49.679590+0000","last_clean":"2023-10-14T09:38:49.679590+0000","last_became_active":"2023-10-14T09:38:30.024910+0000","last_became_peered":"2023-10-14T09:38:30.024910+0000","last_unstale":"2023-10-14T09:38:49.679590+0000","last_undegraded":"2023-10-14T09:38:49.679590+0000","last_fullsized":"2023-10-14T09:38:49.679590+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'1","last_scrub_stamp":"2023-10-14T09:38:49.679411+0000","last_deep_scrub":"35'1","last_deep_scrub_stamp":"2023-10-14T09:38:49.679411+0000","last_clean_scrub_stamp":"2023-10-14T09:38:49.679411+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:15:55.728284+0000","scrub_duration":0.003799359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:33.461303+0000","last_change":"2023-10-14T09:39:33.461562+0000","last_active":"2023-10-14T09:39:33.461303+0000","last_peered":"2023-10-14T09:39:33.461303+0000","last_clean":"2023-10-14T09:39:33.461303+0000","last_became_active":"2023-10-14T09:38:31.029815+0000","last_became_peered":"2023-10-14T09:38:31.029815+0000","last_unstale":"2023-10-14T09:39:33.461303+0000","last_undegraded":"2023-10-14T09:39:33.461303+0000","last_fullsized":"2023-10-14T09:39:33.461303+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:33.461081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:33.461081+0000","last_clean_scrub_stamp":"2023-10-14T09:39:33.461081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:11:35.840092+0000","scrub_duration":0.0038462230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"36'3","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:03.074723+0000","last_change":"2023-10-14T09:39:03.074797+0000","last_active":"2023-10-14T09:39:03.074723+0000","last_peered":"2023-10-14T09:39:03.074723+0000","last_clean":"2023-10-14T09:39:03.074723+0000","last_became_active":"2023-10-14T09:38:30.017602+0000","last_became_peered":"2023-10-14T09:38:30.017602+0000","last_unstale":"2023-10-14T09:39:03.074723+0000","last_undegraded":"2023-10-14T09:39:03.074723+0000","last_fullsized":"2023-10-14T09:39:03.074723+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2023-10-14T09:39:03.074613+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2023-10-14T09:39:03.074613+0000","last_clean_scrub_stamp":"2023-10-14T09:39:03.074613+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:42:38.051760+0000","scrub_duration":0.0041427089999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:26.551416+0000","last_change":"2023-10-14T09:39:26.551551+0000","last_active":"2023-10-14T09:39:26.551416+0000","last_peered":"2023-10-14T09:39:26.551416+0000","last_clean":"2023-10-14T09:39:26.551416+0000","last_became_active":"2023-10-14T09:38:31.025645+0000","last_became_peered":"2023-10-14T09:38:31.025645+0000","last_unstale":"2023-10-14T09:39:26.551416+0000","last_undegraded":"2023-10-14T09:39:26.551416+0000","last_fullsized":"2023-10-14T09:39:26.551416+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:26.551018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:26.551018+0000","last_clean_scrub_stamp":"2023-10-14T09:39:26.551018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:05:26.352998+0000","scrub_duration":0.0041171640000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"35'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:46.533770+0000","last_change":"2023-10-14T09:38:46.533816+0000","last_active":"2023-10-14T09:38:46.533770+0000","last_peered":"2023-10-14T09:38:46.533770+0000","last_clean":"2023-10-14T09:38:46.533770+0000","last_became_active":"2023-10-14T09:38:30.030556+0000","last_became_peered":"2023-10-14T09:38:30.030556+0000","last_unstale":"2023-10-14T09:38:46.533770+0000","last_undegraded":"2023-10-14T09:38:46.533770+0000","last_fullsized":"2023-10-14T09:38:46.533770+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2023-10-14T09:38:46.533705+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2023-10-14T09:38:46.533705+0000","last_clean_scrub_stamp":"2023-10-14T09:38:46.533705+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:33:11.988817+0000","scrub_duration":0.0026943039999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:02.272352+0000","last_change":"2023-10-14T09:39:02.272488+0000","last_active":"2023-10-14T09:39:02.272352+0000","last_peered":"2023-10-14T09:39:02.272352+0000","last_clean":"2023-10-14T09:39:02.272352+0000","last_became_active":"2023-10-14T09:38:31.028887+0000","last_became_peered":"2023-10-14T09:38:31.028887+0000","last_unstale":"2023-10-14T09:39:02.272352+0000","last_undegraded":"2023-10-14T09:39:02.272352+0000","last_fullsized":"2023-10-14T09:39:02.272352+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:02.272167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:02.272167+0000","last_clean_scrub_stamp":"2023-10-14T09:39:02.272167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:46:37.273684+0000","scrub_duration":0.0035637300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"35'1","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:57.786144+0000","last_change":"2023-10-14T09:38:57.786255+0000","last_active":"2023-10-14T09:38:57.786144+0000","last_peered":"2023-10-14T09:38:57.786144+0000","last_clean":"2023-10-14T09:38:57.786144+0000","last_became_active":"2023-10-14T09:38:30.025732+0000","last_became_peered":"2023-10-14T09:38:30.025732+0000","last_unstale":"2023-10-14T09:38:57.786144+0000","last_undegraded":"2023-10-14T09:38:57.786144+0000","last_fullsized":"2023-10-14T09:38:57.786144+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'1","last_scrub_stamp":"2023-10-14T09:38:57.785957+0000","last_deep_scrub":"35'1","last_deep_scrub_stamp":"2023-10-14T09:38:57.785957+0000","last_clean_scrub_stamp":"2023-10-14T09:38:57.785957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:18:36.524694+0000","scrub_duration":0.003769901,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:58.078771+0000","last_change":"2023-10-14T09:38:58.078887+0000","last_active":"2023-10-14T09:38:58.078771+0000","last_peered":"2023-10-14T09:38:58.078771+0000","last_clean":"2023-10-14T09:38:58.078771+0000","last_became_active":"2023-10-14T09:38:31.020184+0000","last_became_peered":"2023-10-14T09:38:31.020184+0000","last_unstale":"2023-10-14T09:38:58.078771+0000","last_undegraded":"2023-10-14T09:38:58.078771+0000","last_fullsized":"2023-10-14T09:38:58.078771+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:58.078588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:58.078588+0000","last_clean_scrub_stamp":"2023-10-14T09:38:58.078588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:19:22.355681+0000","scrub_duration":0.0039430919999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"35'1","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:02.624254+0000","last_change":"2023-10-14T09:39:02.624369+0000","last_active":"2023-10-14T09:39:02.624254+0000","last_peered":"2023-10-14T09:39:02.624254+0000","last_clean":"2023-10-14T09:39:02.624254+0000","last_became_active":"2023-10-14T09:38:30.031356+0000","last_became_peered":"2023-10-14T09:38:30.031356+0000","last_unstale":"2023-10-14T09:39:02.624254+0000","last_undegraded":"2023-10-14T09:39:02.624254+0000","last_fullsized":"2023-10-14T09:39:02.624254+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'1","last_scrub_stamp":"2023-10-14T09:39:02.624081+0000","last_deep_scrub":"35'1","last_deep_scrub_stamp":"2023-10-14T09:39:02.624081+0000","last_clean_scrub_stamp":"2023-10-14T09:39:02.624081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:56:17.115836+0000","scrub_duration":0.003185327,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:09.500306+0000","last_change":"2023-10-14T09:39:09.500416+0000","last_active":"2023-10-14T09:39:09.500306+0000","last_peered":"2023-10-14T09:39:09.500306+0000","last_clean":"2023-10-14T09:39:09.500306+0000","last_became_active":"2023-10-14T09:38:31.023990+0000","last_became_peered":"2023-10-14T09:38:31.023990+0000","last_unstale":"2023-10-14T09:39:09.500306+0000","last_undegraded":"2023-10-14T09:39:09.500306+0000","last_fullsized":"2023-10-14T09:39:09.500306+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:09.500130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:09.500130+0000","last_clean_scrub_stamp":"2023-10-14T09:39:09.500130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:10:28.900926+0000","scrub_duration":0.0035241199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:58.127909+0000","last_change":"2023-10-14T09:38:58.128101+0000","last_active":"2023-10-14T09:38:58.127909+0000","last_peered":"2023-10-14T09:38:58.127909+0000","last_clean":"2023-10-14T09:38:58.127909+0000","last_became_active":"2023-10-14T09:38:30.019461+0000","last_became_peered":"2023-10-14T09:38:30.019461+0000","last_unstale":"2023-10-14T09:38:58.127909+0000","last_undegraded":"2023-10-14T09:38:58.127909+0000","last_fullsized":"2023-10-14T09:38:58.127909+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:58.127652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:58.127652+0000","last_clean_scrub_stamp":"2023-10-14T09:38:58.127652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:12.463977+0000","scrub_duration":0.003828265,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:15.373931+0000","last_change":"2023-10-14T09:39:15.374074+0000","last_active":"2023-10-14T09:39:15.373931+0000","last_peered":"2023-10-14T09:39:15.373931+0000","last_clean":"2023-10-14T09:39:15.373931+0000","last_became_active":"2023-10-14T09:38:31.016514+0000","last_became_peered":"2023-10-14T09:38:31.016514+0000","last_unstale":"2023-10-14T09:39:15.373931+0000","last_undegraded":"2023-10-14T09:39:15.373931+0000","last_fullsized":"2023-10-14T09:39:15.373931+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:15.373751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:15.373751+0000","last_clean_scrub_stamp":"2023-10-14T09:39:15.373751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:17:11.945476+0000","scrub_duration":0.0038224510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:01.637044+0000","last_change":"2023-10-14T09:39:01.637150+0000","last_active":"2023-10-14T09:39:01.637044+0000","last_peered":"2023-10-14T09:39:01.637044+0000","last_clean":"2023-10-14T09:39:01.637044+0000","last_became_active":"2023-10-14T09:38:30.035470+0000","last_became_peered":"2023-10-14T09:38:30.035470+0000","last_unstale":"2023-10-14T09:39:01.637044+0000","last_undegraded":"2023-10-14T09:39:01.637044+0000","last_fullsized":"2023-10-14T09:39:01.637044+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:01.636840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:01.636840+0000","last_clean_scrub_stamp":"2023-10-14T09:39:01.636840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:24:23.494315+0000","scrub_duration":0.003674194,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:19.936421+0000","last_change":"2023-10-14T09:39:19.936552+0000","last_active":"2023-10-14T09:39:19.936421+0000","last_peered":"2023-10-14T09:39:19.936421+0000","last_clean":"2023-10-14T09:39:19.936421+0000","last_became_active":"2023-10-14T09:38:31.025794+0000","last_became_peered":"2023-10-14T09:38:31.025794+0000","last_unstale":"2023-10-14T09:39:19.936421+0000","last_undegraded":"2023-10-14T09:39:19.936421+0000","last_fullsized":"2023-10-14T09:39:19.936421+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:19.936193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:19.936193+0000","last_clean_scrub_stamp":"2023-10-14T09:39:19.936193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:23:18.021187+0000","scrub_duration":0.0035786260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:59.100371+0000","last_change":"2023-10-14T09:38:59.100482+0000","last_active":"2023-10-14T09:38:59.100371+0000","last_peered":"2023-10-14T09:38:59.100371+0000","last_clean":"2023-10-14T09:38:59.100371+0000","last_became_active":"2023-10-14T09:38:30.014042+0000","last_became_peered":"2023-10-14T09:38:30.014042+0000","last_unstale":"2023-10-14T09:38:59.100371+0000","last_undegraded":"2023-10-14T09:38:59.100371+0000","last_fullsized":"2023-10-14T09:38:59.100371+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:59.100189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:59.100189+0000","last_clean_scrub_stamp":"2023-10-14T09:38:59.100189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:03:57.444366+0000","scrub_duration":0.0039772050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:10.061296+0000","last_change":"2023-10-14T09:39:10.061334+0000","last_active":"2023-10-14T09:39:10.061296+0000","last_peered":"2023-10-14T09:39:10.061296+0000","last_clean":"2023-10-14T09:39:10.061296+0000","last_became_active":"2023-10-14T09:38:31.021662+0000","last_became_peered":"2023-10-14T09:38:31.021662+0000","last_unstale":"2023-10-14T09:39:10.061296+0000","last_undegraded":"2023-10-14T09:39:10.061296+0000","last_fullsized":"2023-10-14T09:39:10.061296+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:10.061229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:10.061229+0000","last_clean_scrub_stamp":"2023-10-14T09:39:10.061229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:52:22.258631+0000","scrub_duration":0.0018017630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:48.679147+0000","last_change":"2023-10-14T09:38:48.679274+0000","last_active":"2023-10-14T09:38:48.679147+0000","last_peered":"2023-10-14T09:38:48.679147+0000","last_clean":"2023-10-14T09:38:48.679147+0000","last_became_active":"2023-10-14T09:38:30.027696+0000","last_became_peered":"2023-10-14T09:38:30.027696+0000","last_unstale":"2023-10-14T09:38:48.679147+0000","last_undegraded":"2023-10-14T09:38:48.679147+0000","last_fullsized":"2023-10-14T09:38:48.679147+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:48.678929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:48.678929+0000","last_clean_scrub_stamp":"2023-10-14T09:38:48.678929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:06:16.707833+0000","scrub_duration":0.003213816,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:48.148306+0000","last_change":"2023-10-14T09:38:48.148375+0000","last_active":"2023-10-14T09:38:48.148306+0000","last_peered":"2023-10-14T09:38:48.148306+0000","last_clean":"2023-10-14T09:38:48.148306+0000","last_became_active":"2023-10-14T09:38:31.026676+0000","last_became_peered":"2023-10-14T09:38:31.026676+0000","last_unstale":"2023-10-14T09:38:48.148306+0000","last_undegraded":"2023-10-14T09:38:48.148306+0000","last_fullsized":"2023-10-14T09:38:48.148306+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:48.148221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:48.148221+0000","last_clean_scrub_stamp":"2023-10-14T09:38:48.148221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:01:40.381456+0000","scrub_duration":0.0028294069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"35'3","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:55.075403+0000","last_change":"2023-10-14T09:38:55.075551+0000","last_active":"2023-10-14T09:38:55.075403+0000","last_peered":"2023-10-14T09:38:55.075403+0000","last_clean":"2023-10-14T09:38:55.075403+0000","last_became_active":"2023-10-14T09:38:30.031907+0000","last_became_peered":"2023-10-14T09:38:30.031907+0000","last_unstale":"2023-10-14T09:38:55.075403+0000","last_undegraded":"2023-10-14T09:38:55.075403+0000","last_fullsized":"2023-10-14T09:38:55.075403+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2023-10-14T09:38:55.075222+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2023-10-14T09:38:55.075222+0000","last_clean_scrub_stamp":"2023-10-14T09:38:55.075222+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:49:52.115938+0000","scrub_duration":0.005129242,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:21.891228+0000","last_change":"2023-10-14T09:39:21.891334+0000","last_active":"2023-10-14T09:39:21.891228+0000","last_peered":"2023-10-14T09:39:21.891228+0000","last_clean":"2023-10-14T09:39:21.891228+0000","last_became_active":"2023-10-14T09:38:31.020267+0000","last_became_peered":"2023-10-14T09:38:31.020267+0000","last_unstale":"2023-10-14T09:39:21.891228+0000","last_undegraded":"2023-10-14T09:39:21.891228+0000","last_fullsized":"2023-10-14T09:39:21.891228+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:21.891034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:21.891034+0000","last_clean_scrub_stamp":"2023-10-14T09:39:21.891034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:58:53.811510+0000","scrub_duration":0.003696473,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"35'6","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:54.196331+0000","last_change":"2023-10-14T09:38:54.196449+0000","last_active":"2023-10-14T09:38:54.196331+0000","last_peered":"2023-10-14T09:38:54.196331+0000","last_clean":"2023-10-14T09:38:54.196331+0000","last_became_active":"2023-10-14T09:38:30.019839+0000","last_became_peered":"2023-10-14T09:38:30.019839+0000","last_unstale":"2023-10-14T09:38:54.196331+0000","last_undegraded":"2023-10-14T09:38:54.196331+0000","last_fullsized":"2023-10-14T09:38:54.196331+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2023-10-14T09:38:54.196133+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2023-10-14T09:38:54.196133+0000","last_clean_scrub_stamp":"2023-10-14T09:38:54.196133+0000","objects_scrubbed":4,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:12:19.956146+0000","scrub_duration":0.0055956779999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:21.482692+0000","last_change":"2023-10-14T09:39:21.482797+0000","last_active":"2023-10-14T09:39:21.482692+0000","last_peered":"2023-10-14T09:39:21.482692+0000","last_clean":"2023-10-14T09:39:21.482692+0000","last_became_active":"2023-10-14T09:38:31.020347+0000","last_became_peered":"2023-10-14T09:38:31.020347+0000","last_unstale":"2023-10-14T09:39:21.482692+0000","last_undegraded":"2023-10-14T09:39:21.482692+0000","last_fullsized":"2023-10-14T09:39:21.482692+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:21.482512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:21.482512+0000","last_clean_scrub_stamp":"2023-10-14T09:39:21.482512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:12:47.242524+0000","scrub_duration":0.0039880540000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"35'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:47.937746+0000","last_change":"2023-10-14T09:38:47.937954+0000","last_active":"2023-10-14T09:38:47.937746+0000","last_peered":"2023-10-14T09:38:47.937746+0000","last_clean":"2023-10-14T09:38:47.937746+0000","last_became_active":"2023-10-14T09:38:30.035424+0000","last_became_peered":"2023-10-14T09:38:30.035424+0000","last_unstale":"2023-10-14T09:38:47.937746+0000","last_undegraded":"2023-10-14T09:38:47.937746+0000","last_fullsized":"2023-10-14T09:38:47.937746+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2023-10-14T09:38:47.937565+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2023-10-14T09:38:47.937565+0000","last_clean_scrub_stamp":"2023-10-14T09:38:47.937565+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:56:13.779499+0000","scrub_duration":0.0048754560000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:14.976207+0000","last_change":"2023-10-14T09:39:14.976328+0000","last_active":"2023-10-14T09:39:14.976207+0000","last_peered":"2023-10-14T09:39:14.976207+0000","last_clean":"2023-10-14T09:39:14.976207+0000","last_became_active":"2023-10-14T09:38:31.027759+0000","last_became_peered":"2023-10-14T09:38:31.027759+0000","last_unstale":"2023-10-14T09:39:14.976207+0000","last_undegraded":"2023-10-14T09:39:14.976207+0000","last_fullsized":"2023-10-14T09:39:14.976207+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:14.975998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:14.975998+0000","last_clean_scrub_stamp":"2023-10-14T09:39:14.975998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:15:19.406655+0000","scrub_duration":0.0033840070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:57.334723+0000","last_change":"2023-10-14T09:38:57.334855+0000","last_active":"2023-10-14T09:38:57.334723+0000","last_peered":"2023-10-14T09:38:57.334723+0000","last_clean":"2023-10-14T09:38:57.334723+0000","last_became_active":"2023-10-14T09:38:30.025712+0000","last_became_peered":"2023-10-14T09:38:30.025712+0000","last_unstale":"2023-10-14T09:38:57.334723+0000","last_undegraded":"2023-10-14T09:38:57.334723+0000","last_fullsized":"2023-10-14T09:38:57.334723+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:57.334543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:57.334543+0000","last_clean_scrub_stamp":"2023-10-14T09:38:57.334543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:07:30.093467+0000","scrub_duration":0.0039162900000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:56.234815+0000","last_change":"2023-10-14T09:38:56.234942+0000","last_active":"2023-10-14T09:38:56.234815+0000","last_peered":"2023-10-14T09:38:56.234815+0000","last_clean":"2023-10-14T09:38:56.234815+0000","last_became_active":"2023-10-14T09:38:31.036628+0000","last_became_peered":"2023-10-14T09:38:31.036628+0000","last_unstale":"2023-10-14T09:38:56.234815+0000","last_undegraded":"2023-10-14T09:38:56.234815+0000","last_fullsized":"2023-10-14T09:38:56.234815+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:56.234625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:56.234625+0000","last_clean_scrub_stamp":"2023-10-14T09:38:56.234625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:58:59.569769+0000","scrub_duration":0.0035426099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:06.093421+0000","last_change":"2023-10-14T09:39:06.093539+0000","last_active":"2023-10-14T09:39:06.093421+0000","last_peered":"2023-10-14T09:39:06.093421+0000","last_clean":"2023-10-14T09:39:06.093421+0000","last_became_active":"2023-10-14T09:38:30.022182+0000","last_became_peered":"2023-10-14T09:38:30.022182+0000","last_unstale":"2023-10-14T09:39:06.093421+0000","last_undegraded":"2023-10-14T09:39:06.093421+0000","last_fullsized":"2023-10-14T09:39:06.093421+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:06.093233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:06.093233+0000","last_clean_scrub_stamp":"2023-10-14T09:39:06.093233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:50:35.550528+0000","scrub_duration":0.0039928780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:54.645085+0000","last_change":"2023-10-14T09:38:54.645278+0000","last_active":"2023-10-14T09:38:54.645085+0000","last_peered":"2023-10-14T09:38:54.645085+0000","last_clean":"2023-10-14T09:38:54.645085+0000","last_became_active":"2023-10-14T09:38:31.039518+0000","last_became_peered":"2023-10-14T09:38:31.039518+0000","last_unstale":"2023-10-14T09:38:54.645085+0000","last_undegraded":"2023-10-14T09:38:54.645085+0000","last_fullsized":"2023-10-14T09:38:54.645085+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:54.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:54.644882+0000","last_clean_scrub_stamp":"2023-10-14T09:38:54.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:49:46.705606+0000","scrub_duration":0.003904659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"35'8","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:52.142490+0000","last_change":"2023-10-14T09:38:52.142608+0000","last_active":"2023-10-14T09:38:52.142490+0000","last_peered":"2023-10-14T09:38:52.142490+0000","last_clean":"2023-10-14T09:38:52.142490+0000","last_became_active":"2023-10-14T09:38:30.014562+0000","last_became_peered":"2023-10-14T09:38:30.014562+0000","last_unstale":"2023-10-14T09:38:52.142490+0000","last_undegraded":"2023-10-14T09:38:52.142490+0000","last_fullsized":"2023-10-14T09:38:52.142490+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2023-10-14T09:38:52.142259+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2023-10-14T09:38:52.142259+0000","last_clean_scrub_stamp":"2023-10-14T09:38:52.142259+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:46:42.382320+0000","scrub_duration":0.0052490749999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:20.548887+0000","last_change":"2023-10-14T09:39:20.548996+0000","last_active":"2023-10-14T09:39:20.548887+0000","last_peered":"2023-10-14T09:39:20.548887+0000","last_clean":"2023-10-14T09:39:20.548887+0000","last_became_active":"2023-10-14T09:38:31.025665+0000","last_became_peered":"2023-10-14T09:38:31.025665+0000","last_unstale":"2023-10-14T09:39:20.548887+0000","last_undegraded":"2023-10-14T09:39:20.548887+0000","last_fullsized":"2023-10-14T09:39:20.548887+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:20.548692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:20.548692+0000","last_clean_scrub_stamp":"2023-10-14T09:39:20.548692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:05:20.350671+0000","scrub_duration":0.0035872819999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"35'1","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:55.318266+0000","last_change":"2023-10-14T09:38:55.318388+0000","last_active":"2023-10-14T09:38:55.318266+0000","last_peered":"2023-10-14T09:38:55.318266+0000","last_clean":"2023-10-14T09:38:55.318266+0000","last_became_active":"2023-10-14T09:38:30.025331+0000","last_became_peered":"2023-10-14T09:38:30.025331+0000","last_unstale":"2023-10-14T09:38:55.318266+0000","last_undegraded":"2023-10-14T09:38:55.318266+0000","last_fullsized":"2023-10-14T09:38:55.318266+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'1","last_scrub_stamp":"2023-10-14T09:38:55.318087+0000","last_deep_scrub":"35'1","last_deep_scrub_stamp":"2023-10-14T09:38:55.318087+0000","last_clean_scrub_stamp":"2023-10-14T09:38:55.318087+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:39:45.038902+0000","scrub_duration":0.0045992630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:16.984048+0000","last_change":"2023-10-14T09:39:16.984152+0000","last_active":"2023-10-14T09:39:16.984048+0000","last_peered":"2023-10-14T09:39:16.984048+0000","last_clean":"2023-10-14T09:39:16.984048+0000","last_became_active":"2023-10-14T09:38:31.032912+0000","last_became_peered":"2023-10-14T09:38:31.032912+0000","last_unstale":"2023-10-14T09:39:16.984048+0000","last_undegraded":"2023-10-14T09:39:16.984048+0000","last_fullsized":"2023-10-14T09:39:16.984048+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:16.983861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:16.983861+0000","last_clean_scrub_stamp":"2023-10-14T09:39:16.983861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:08:39.914600+0000","scrub_duration":0.0037026099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"36'3","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:07.573188+0000","last_change":"2023-10-14T09:39:07.573313+0000","last_active":"2023-10-14T09:39:07.573188+0000","last_peered":"2023-10-14T09:39:07.573188+0000","last_clean":"2023-10-14T09:39:07.573188+0000","last_became_active":"2023-10-14T09:38:30.035283+0000","last_became_peered":"2023-10-14T09:38:30.035283+0000","last_unstale":"2023-10-14T09:39:07.573188+0000","last_undegraded":"2023-10-14T09:39:07.573188+0000","last_fullsized":"2023-10-14T09:39:07.573188+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2023-10-14T09:39:07.572971+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2023-10-14T09:39:07.572971+0000","last_clean_scrub_stamp":"2023-10-14T09:39:07.572971+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:17:04.144697+0000","scrub_duration":0.0077526660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:34.926594+0000","last_change":"2023-10-14T09:38:31.035370+0000","last_active":"2023-10-14T09:38:34.926594+0000","last_peered":"2023-10-14T09:38:34.926594+0000","last_clean":"2023-10-14T09:38:34.926594+0000","last_became_active":"2023-10-14T09:38:31.034768+0000","last_became_peered":"2023-10-14T09:38:31.034768+0000","last_unstale":"2023-10-14T09:38:34.926594+0000","last_undegraded":"2023-10-14T09:38:34.926594+0000","last_fullsized":"2023-10-14T09:38:34.926594+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:29.979593+0000","last_clean_scrub_stamp":"2023-10-14T09:38:29.979593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"35'1","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:00.677692+0000","last_change":"2023-10-14T09:39:00.677818+0000","last_active":"2023-10-14T09:39:00.677692+0000","last_peered":"2023-10-14T09:39:00.677692+0000","last_clean":"2023-10-14T09:39:00.677692+0000","last_became_active":"2023-10-14T09:38:30.030927+0000","last_became_peered":"2023-10-14T09:38:30.030927+0000","last_unstale":"2023-10-14T09:39:00.677692+0000","last_undegraded":"2023-10-14T09:39:00.677692+0000","last_fullsized":"2023-10-14T09:39:00.677692+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'1","last_scrub_stamp":"2023-10-14T09:39:00.677510+0000","last_deep_scrub":"35'1","last_deep_scrub_stamp":"2023-10-14T09:39:00.677510+0000","last_clean_scrub_stamp":"2023-10-14T09:39:00.677510+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:55:27.879986+0000","scrub_duration":0.0052586550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:52.540354+0000","last_change":"2023-10-14T09:38:52.540470+0000","last_active":"2023-10-14T09:38:52.540354+0000","last_peered":"2023-10-14T09:38:52.540354+0000","last_clean":"2023-10-14T09:38:52.540354+0000","last_became_active":"2023-10-14T09:38:31.026615+0000","last_became_peered":"2023-10-14T09:38:31.026615+0000","last_unstale":"2023-10-14T09:38:52.540354+0000","last_undegraded":"2023-10-14T09:38:52.540354+0000","last_fullsized":"2023-10-14T09:38:52.540354+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:52.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:52.540176+0000","last_clean_scrub_stamp":"2023-10-14T09:38:52.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:24:06.115731+0000","scrub_duration":0.0037872090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:55.712392+0000","last_change":"2023-10-14T09:38:55.712533+0000","last_active":"2023-10-14T09:38:55.712392+0000","last_peered":"2023-10-14T09:38:55.712392+0000","last_clean":"2023-10-14T09:38:55.712392+0000","last_became_active":"2023-10-14T09:38:30.026795+0000","last_became_peered":"2023-10-14T09:38:30.026795+0000","last_unstale":"2023-10-14T09:38:55.712392+0000","last_undegraded":"2023-10-14T09:38:55.712392+0000","last_fullsized":"2023-10-14T09:38:55.712392+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:55.712204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:55.712204+0000","last_clean_scrub_stamp":"2023-10-14T09:38:55.712204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:41:54.034096+0000","scrub_duration":0.003589709,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:47.540406+0000","last_change":"2023-10-14T09:38:47.540516+0000","last_active":"2023-10-14T09:38:47.540406+0000","last_peered":"2023-10-14T09:38:47.540406+0000","last_clean":"2023-10-14T09:38:47.540406+0000","last_became_active":"2023-10-14T09:38:31.031921+0000","last_became_peered":"2023-10-14T09:38:31.031921+0000","last_unstale":"2023-10-14T09:38:47.540406+0000","last_undegraded":"2023-10-14T09:38:47.540406+0000","last_fullsized":"2023-10-14T09:38:47.540406+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:47.540230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:47.540230+0000","last_clean_scrub_stamp":"2023-10-14T09:38:47.540230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:37:25.465061+0000","scrub_duration":0.003744247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"35'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:46.628250+0000","last_change":"2023-10-14T09:38:46.628305+0000","last_active":"2023-10-14T09:38:46.628250+0000","last_peered":"2023-10-14T09:38:46.628250+0000","last_clean":"2023-10-14T09:38:46.628250+0000","last_became_active":"2023-10-14T09:38:30.021312+0000","last_became_peered":"2023-10-14T09:38:30.021312+0000","last_unstale":"2023-10-14T09:38:46.628250+0000","last_undegraded":"2023-10-14T09:38:46.628250+0000","last_fullsized":"2023-10-14T09:38:46.628250+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2023-10-14T09:38:46.628156+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2023-10-14T09:38:46.628156+0000","last_clean_scrub_stamp":"2023-10-14T09:38:46.628156+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:52:45.439890+0000","scrub_duration":0.002195682,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:12.720238+0000","last_change":"2023-10-14T09:39:12.720412+0000","last_active":"2023-10-14T09:39:12.720238+0000","last_peered":"2023-10-14T09:39:12.720238+0000","last_clean":"2023-10-14T09:39:12.720238+0000","last_became_active":"2023-10-14T09:38:31.023340+0000","last_became_peered":"2023-10-14T09:38:31.023340+0000","last_unstale":"2023-10-14T09:39:12.720238+0000","last_undegraded":"2023-10-14T09:39:12.720238+0000","last_fullsized":"2023-10-14T09:39:12.720238+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:12.720066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:12.720066+0000","last_clean_scrub_stamp":"2023-10-14T09:39:12.720066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:07:45.478990+0000","scrub_duration":0.0038580799999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:48.556599+0000","last_change":"2023-10-14T09:38:48.556714+0000","last_active":"2023-10-14T09:38:48.556599+0000","last_peered":"2023-10-14T09:38:48.556599+0000","last_clean":"2023-10-14T09:38:48.556599+0000","last_became_active":"2023-10-14T09:38:30.033284+0000","last_became_peered":"2023-10-14T09:38:30.033284+0000","last_unstale":"2023-10-14T09:38:48.556599+0000","last_undegraded":"2023-10-14T09:38:48.556599+0000","last_fullsized":"2023-10-14T09:38:48.556599+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:48.556379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:48.556379+0000","last_clean_scrub_stamp":"2023-10-14T09:38:48.556379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:24:02.131934+0000","scrub_duration":0.0035783490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:06.806152+0000","last_change":"2023-10-14T09:39:06.806269+0000","last_active":"2023-10-14T09:39:06.806152+0000","last_peered":"2023-10-14T09:39:06.806152+0000","last_clean":"2023-10-14T09:39:06.806152+0000","last_became_active":"2023-10-14T09:38:31.019732+0000","last_became_peered":"2023-10-14T09:38:31.019732+0000","last_unstale":"2023-10-14T09:39:06.806152+0000","last_undegraded":"2023-10-14T09:39:06.806152+0000","last_fullsized":"2023-10-14T09:39:06.806152+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:06.805907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:06.805907+0000","last_clean_scrub_stamp":"2023-10-14T09:39:06.805907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:49:58.866632+0000","scrub_duration":0.003479851,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:56.739921+0000","last_change":"2023-10-14T09:38:56.740115+0000","last_active":"2023-10-14T09:38:56.739921+0000","last_peered":"2023-10-14T09:38:56.739921+0000","last_clean":"2023-10-14T09:38:56.739921+0000","last_became_active":"2023-10-14T09:38:30.032500+0000","last_became_peered":"2023-10-14T09:38:30.032500+0000","last_unstale":"2023-10-14T09:38:56.739921+0000","last_undegraded":"2023-10-14T09:38:56.739921+0000","last_fullsized":"2023-10-14T09:38:56.739921+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:56.739717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:56.739717+0000","last_clean_scrub_stamp":"2023-10-14T09:38:56.739717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:55.093910+0000","scrub_duration":0.0038890359999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:08.304521+0000","last_change":"2023-10-14T09:39:08.304726+0000","last_active":"2023-10-14T09:39:08.304521+0000","last_peered":"2023-10-14T09:39:08.304521+0000","last_clean":"2023-10-14T09:39:08.304521+0000","last_became_active":"2023-10-14T09:38:31.030399+0000","last_became_peered":"2023-10-14T09:38:31.030399+0000","last_unstale":"2023-10-14T09:39:08.304521+0000","last_undegraded":"2023-10-14T09:39:08.304521+0000","last_fullsized":"2023-10-14T09:39:08.304521+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:08.304284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:08.304284+0000","last_clean_scrub_stamp":"2023-10-14T09:39:08.304284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:42:43.281430+0000","scrub_duration":0.0035198899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:51.044759+0000","last_change":"2023-10-14T09:38:51.044863+0000","last_active":"2023-10-14T09:38:51.044759+0000","last_peered":"2023-10-14T09:38:51.044759+0000","last_clean":"2023-10-14T09:38:51.044759+0000","last_became_active":"2023-10-14T09:38:30.028540+0000","last_became_peered":"2023-10-14T09:38:30.028540+0000","last_unstale":"2023-10-14T09:38:51.044759+0000","last_undegraded":"2023-10-14T09:38:51.044759+0000","last_fullsized":"2023-10-14T09:38:51.044759+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:51.044578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:51.044578+0000","last_clean_scrub_stamp":"2023-10-14T09:38:51.044578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:49:06.337666+0000","scrub_duration":0.0033480110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:50.515103+0000","last_change":"2023-10-14T09:38:50.515213+0000","last_active":"2023-10-14T09:38:50.515103+0000","last_peered":"2023-10-14T09:38:50.515103+0000","last_clean":"2023-10-14T09:38:50.515103+0000","last_became_active":"2023-10-14T09:38:31.015654+0000","last_became_peered":"2023-10-14T09:38:31.015654+0000","last_unstale":"2023-10-14T09:38:50.515103+0000","last_undegraded":"2023-10-14T09:38:50.515103+0000","last_fullsized":"2023-10-14T09:38:50.515103+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:50.514814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:50.514814+0000","last_clean_scrub_stamp":"2023-10-14T09:38:50.514814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:04:26.034786+0000","scrub_duration":0.0037886759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"36'3","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:10.422177+0000","last_change":"2023-10-14T09:39:10.422290+0000","last_active":"2023-10-14T09:39:10.422177+0000","last_peered":"2023-10-14T09:39:10.422177+0000","last_clean":"2023-10-14T09:39:10.422177+0000","last_became_active":"2023-10-14T09:38:30.030387+0000","last_became_peered":"2023-10-14T09:38:30.030387+0000","last_unstale":"2023-10-14T09:39:10.422177+0000","last_undegraded":"2023-10-14T09:39:10.422177+0000","last_fullsized":"2023-10-14T09:39:10.422177+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2023-10-14T09:39:10.421983+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2023-10-14T09:39:10.421983+0000","last_clean_scrub_stamp":"2023-10-14T09:39:10.421983+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:24:25.959633+0000","scrub_duration":0.0079599300000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:11.134990+0000","last_change":"2023-10-14T09:39:11.135101+0000","last_active":"2023-10-14T09:39:11.134990+0000","last_peered":"2023-10-14T09:39:11.134990+0000","last_clean":"2023-10-14T09:39:11.134990+0000","last_became_active":"2023-10-14T09:38:31.023043+0000","last_became_peered":"2023-10-14T09:38:31.023043+0000","last_unstale":"2023-10-14T09:39:11.134990+0000","last_undegraded":"2023-10-14T09:39:11.134990+0000","last_fullsized":"2023-10-14T09:39:11.134990+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:11.134794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:11.134794+0000","last_clean_scrub_stamp":"2023-10-14T09:39:11.134794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:59:36.203576+0000","scrub_duration":0.0036520319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"36'1","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:47.634220+0000","last_change":"2023-10-14T09:38:47.634416+0000","last_active":"2023-10-14T09:38:47.634220+0000","last_peered":"2023-10-14T09:38:47.634220+0000","last_clean":"2023-10-14T09:38:47.634220+0000","last_became_active":"2023-10-14T09:38:30.024536+0000","last_became_peered":"2023-10-14T09:38:30.024536+0000","last_unstale":"2023-10-14T09:38:47.634220+0000","last_undegraded":"2023-10-14T09:38:47.634220+0000","last_fullsized":"2023-10-14T09:38:47.634220+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'1","last_scrub_stamp":"2023-10-14T09:38:47.633984+0000","last_deep_scrub":"36'1","last_deep_scrub_stamp":"2023-10-14T09:38:47.633984+0000","last_clean_scrub_stamp":"2023-10-14T09:38:47.633984+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:40:54.811008+0000","scrub_duration":0.0036899749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:54.649440+0000","last_change":"2023-10-14T09:38:54.649556+0000","last_active":"2023-10-14T09:38:54.649440+0000","last_peered":"2023-10-14T09:38:54.649440+0000","last_clean":"2023-10-14T09:38:54.649440+0000","last_became_active":"2023-10-14T09:38:31.023855+0000","last_became_peered":"2023-10-14T09:38:31.023855+0000","last_unstale":"2023-10-14T09:38:54.649440+0000","last_undegraded":"2023-10-14T09:38:54.649440+0000","last_fullsized":"2023-10-14T09:38:54.649440+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:54.649211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:54.649211+0000","last_clean_scrub_stamp":"2023-10-14T09:38:54.649211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:49:09.942300+0000","scrub_duration":0.0033030020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:14.415816+0000","last_change":"2023-10-14T09:39:14.415928+0000","last_active":"2023-10-14T09:39:14.415816+0000","last_peered":"2023-10-14T09:39:14.415816+0000","last_clean":"2023-10-14T09:39:14.415816+0000","last_became_active":"2023-10-14T09:38:30.023068+0000","last_became_peered":"2023-10-14T09:38:30.023068+0000","last_unstale":"2023-10-14T09:39:14.415816+0000","last_undegraded":"2023-10-14T09:39:14.415816+0000","last_fullsized":"2023-10-14T09:39:14.415816+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:14.415607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:14.415607+0000","last_clean_scrub_stamp":"2023-10-14T09:39:14.415607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:06.648843+0000","scrub_duration":0.0037813790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:59.729037+0000","last_change":"2023-10-14T09:38:59.729149+0000","last_active":"2023-10-14T09:38:59.729037+0000","last_peered":"2023-10-14T09:38:59.729037+0000","last_clean":"2023-10-14T09:38:59.729037+0000","last_became_active":"2023-10-14T09:38:31.026838+0000","last_became_peered":"2023-10-14T09:38:31.026838+0000","last_unstale":"2023-10-14T09:38:59.729037+0000","last_undegraded":"2023-10-14T09:38:59.729037+0000","last_fullsized":"2023-10-14T09:38:59.729037+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:59.728756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:59.728756+0000","last_clean_scrub_stamp":"2023-10-14T09:38:59.728756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:58.082949+0000","scrub_duration":0.00366154,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:45.578809+0000","last_change":"2023-10-14T09:38:45.578897+0000","last_active":"2023-10-14T09:38:45.578809+0000","last_peered":"2023-10-14T09:38:45.578809+0000","last_clean":"2023-10-14T09:38:45.578809+0000","last_became_active":"2023-10-14T09:38:30.029514+0000","last_became_peered":"2023-10-14T09:38:30.029514+0000","last_unstale":"2023-10-14T09:38:45.578809+0000","last_undegraded":"2023-10-14T09:38:45.578809+0000","last_fullsized":"2023-10-14T09:38:45.578809+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:45.578708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:45.578708+0000","last_clean_scrub_stamp":"2023-10-14T09:38:45.578708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:31:14.776956+0000","scrub_duration":0.0027720409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:00.622885+0000","last_change":"2023-10-14T09:39:00.623104+0000","last_active":"2023-10-14T09:39:00.622885+0000","last_peered":"2023-10-14T09:39:00.622885+0000","last_clean":"2023-10-14T09:39:00.622885+0000","last_became_active":"2023-10-14T09:38:31.029521+0000","last_became_peered":"2023-10-14T09:38:31.029521+0000","last_unstale":"2023-10-14T09:39:00.622885+0000","last_undegraded":"2023-10-14T09:39:00.622885+0000","last_fullsized":"2023-10-14T09:39:00.622885+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:00.622681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:00.622681+0000","last_clean_scrub_stamp":"2023-10-14T09:39:00.622681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:38:23.973228+0000","scrub_duration":0.0040747789999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:51.250186+0000","last_change":"2023-10-14T09:38:51.250374+0000","last_active":"2023-10-14T09:38:51.250186+0000","last_peered":"2023-10-14T09:38:51.250186+0000","last_clean":"2023-10-14T09:38:51.250186+0000","last_became_active":"2023-10-14T09:38:30.029517+0000","last_became_peered":"2023-10-14T09:38:30.029517+0000","last_unstale":"2023-10-14T09:38:51.250186+0000","last_undegraded":"2023-10-14T09:38:51.250186+0000","last_fullsized":"2023-10-14T09:38:51.250186+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:51.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:51.249926+0000","last_clean_scrub_stamp":"2023-10-14T09:38:51.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:49:43.310651+0000","scrub_duration":0.0038699889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:15.982619+0000","last_change":"2023-10-14T09:39:15.982729+0000","last_active":"2023-10-14T09:39:15.982619+0000","last_peered":"2023-10-14T09:39:15.982619+0000","last_clean":"2023-10-14T09:39:15.982619+0000","last_became_active":"2023-10-14T09:38:31.034300+0000","last_became_peered":"2023-10-14T09:38:31.034300+0000","last_unstale":"2023-10-14T09:39:15.982619+0000","last_undegraded":"2023-10-14T09:39:15.982619+0000","last_fullsized":"2023-10-14T09:39:15.982619+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:15.982433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:15.982433+0000","last_clean_scrub_stamp":"2023-10-14T09:39:15.982433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:45.273592+0000","scrub_duration":0.0035287259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:46.967921+0000","last_change":"2023-10-14T09:38:46.968047+0000","last_active":"2023-10-14T09:38:46.967921+0000","last_peered":"2023-10-14T09:38:46.967921+0000","last_clean":"2023-10-14T09:38:46.967921+0000","last_became_active":"2023-10-14T09:38:30.030374+0000","last_became_peered":"2023-10-14T09:38:30.030374+0000","last_unstale":"2023-10-14T09:38:46.967921+0000","last_undegraded":"2023-10-14T09:38:46.967921+0000","last_fullsized":"2023-10-14T09:38:46.967921+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:46.967740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:46.967740+0000","last_clean_scrub_stamp":"2023-10-14T09:38:46.967740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:02:37.918672+0000","scrub_duration":0.0037853489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:35.514126+0000","last_change":"2023-10-14T09:39:35.514248+0000","last_active":"2023-10-14T09:39:35.514126+0000","last_peered":"2023-10-14T09:39:35.514126+0000","last_clean":"2023-10-14T09:39:35.514126+0000","last_became_active":"2023-10-14T09:38:31.032648+0000","last_became_peered":"2023-10-14T09:38:31.032648+0000","last_unstale":"2023-10-14T09:39:35.514126+0000","last_undegraded":"2023-10-14T09:39:35.514126+0000","last_fullsized":"2023-10-14T09:39:35.514126+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:35.513939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:35.513939+0000","last_clean_scrub_stamp":"2023-10-14T09:39:35.513939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:07:32.173710+0000","scrub_duration":0.0036366580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:56.184606+0000","last_change":"2023-10-14T09:38:56.184716+0000","last_active":"2023-10-14T09:38:56.184606+0000","last_peered":"2023-10-14T09:38:56.184606+0000","last_clean":"2023-10-14T09:38:56.184606+0000","last_became_active":"2023-10-14T09:38:30.020321+0000","last_became_peered":"2023-10-14T09:38:30.020321+0000","last_unstale":"2023-10-14T09:38:56.184606+0000","last_undegraded":"2023-10-14T09:38:56.184606+0000","last_fullsized":"2023-10-14T09:38:56.184606+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:56.184416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:56.184416+0000","last_clean_scrub_stamp":"2023-10-14T09:38:56.184416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:59:55.799339+0000","scrub_duration":0.003775956,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:51.208601+0000","last_change":"2023-10-14T09:38:51.208788+0000","last_active":"2023-10-14T09:38:51.208601+0000","last_peered":"2023-10-14T09:38:51.208601+0000","last_clean":"2023-10-14T09:38:51.208601+0000","last_became_active":"2023-10-14T09:38:31.024478+0000","last_became_peered":"2023-10-14T09:38:31.024478+0000","last_unstale":"2023-10-14T09:38:51.208601+0000","last_undegraded":"2023-10-14T09:38:51.208601+0000","last_fullsized":"2023-10-14T09:38:51.208601+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:51.208358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:51.208358+0000","last_clean_scrub_stamp":"2023-10-14T09:38:51.208358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:55:18.410834+0000","scrub_duration":0.0035993549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:49.587807+0000","last_change":"2023-10-14T09:38:49.587913+0000","last_active":"2023-10-14T09:38:49.587807+0000","last_peered":"2023-10-14T09:38:49.587807+0000","last_clean":"2023-10-14T09:38:49.587807+0000","last_became_active":"2023-10-14T09:38:30.033358+0000","last_became_peered":"2023-10-14T09:38:30.033358+0000","last_unstale":"2023-10-14T09:38:49.587807+0000","last_undegraded":"2023-10-14T09:38:49.587807+0000","last_fullsized":"2023-10-14T09:38:49.587807+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:49.587584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:49.587584+0000","last_clean_scrub_stamp":"2023-10-14T09:38:49.587584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:54.741961+0000","scrub_duration":0.0034985849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"36'119","reported_seq":189,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:50.256743+0000","last_change":"2023-10-14T09:38:50.256743+0000","last_active":"2023-10-14T09:38:50.256743+0000","last_peered":"2023-10-14T09:38:50.256743+0000","last_clean":"2023-10-14T09:38:50.256743+0000","last_became_active":"2023-10-14T09:37:12.364623+0000","last_became_peered":"2023-10-14T09:37:12.364623+0000","last_unstale":"2023-10-14T09:38:50.256743+0000","last_undegraded":"2023-10-14T09:38:50.256743+0000","last_fullsized":"2023-10-14T09:38:50.256743+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'119","last_scrub_stamp":"2023-10-14T09:38:50.256394+0000","last_deep_scrub":"36'119","last_deep_scrub_stamp":"2023-10-14T09:38:50.256394+0000","last_clean_scrub_stamp":"2023-10-14T09:38:50.256394+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:31:14.101164+0000","scrub_duration":0.014946450999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509473,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":999424,"data_stored":748946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":0.97099999999999997,"15min":0.95099999999999996},"min":{"1min":0.755,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.569,"5min":1.623,"15min":1.623},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.034,"15min":1.0149999999999999},"min":{"1min":0.78100000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.4950000000000001}]},{"osd":1,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.103,"15min":1.093},"min":{"1min":0.88900000000000001,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":1.05},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.21,"15min":1.1919999999999999},"min":{"1min":1.054,"5min":0.748,"15min":0.748},"max":{"1min":1.5740000000000001,"5min":1.79,"15min":1.79},"last":1.1970000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.137,"15min":1.1220000000000001},"min":{"1min":0.83999999999999997,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.089},{"interface":"front","average":{"1min":1.391,"5min":1.2889999999999999,"15min":1.272},"min":{"1min":1.093,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.6950000000000001,"5min":1.841,"15min":1.841},"last":1.141}]},{"osd":3,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.1639999999999999,"15min":1.1519999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.468,"5min":2.468,"15min":2.468},"last":1.288},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.3400000000000001,"15min":1.329},"min":{"1min":0.95799999999999996,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.2530000000000001,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":1.248}]},{"osd":4,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":1.3120000000000001,"15min":1.282},"min":{"1min":0.80300000000000005,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.7589999999999999,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.387,"15min":1.3759999999999999},"min":{"1min":0.82899999999999996,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.419}]},{"osd":5,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.444,"15min":1.4470000000000001},"min":{"1min":0.83099999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.897,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":1.339},{"interface":"front","average":{"1min":1.5589999999999999,"5min":1.4350000000000001,"15min":1.4139999999999999},"min":{"1min":1.071,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.52,"5min":2.52,"15min":2.52},"last":1.377}]},{"osd":6,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.6950000000000001,"5min":1.5529999999999999,"15min":1.5289999999999999},"min":{"1min":1.103,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.1739999999999999,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.5740000000000001,"5min":1.482,"15min":1.4670000000000001},"min":{"1min":0.90000000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.3490000000000002,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":1.512}]}]},{"osd":6,"up_from":15,"seq":64424509475,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":409600,"data_stored":159104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.98899999999999999,"15min":0.98099999999999998},"min":{"1min":0.753,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":1.169},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1839999999999999,"15min":1.1890000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.6060000000000001,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.0529999999999999}]},{"osd":1,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.087,"15min":1.099},"min":{"1min":0.72299999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2450000000000001,"5min":2.069,"15min":2.069},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.224,"5min":1.1850000000000001,"15min":1.179},"min":{"1min":0.66100000000000003,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.8109999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.274}]},{"osd":2,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.2569999999999999,"15min":1.2609999999999999},"min":{"1min":0.79000000000000004,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.9119999999999999,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.381},{"interface":"front","average":{"1min":1.24,"5min":1.2310000000000001,"15min":1.2290000000000001},"min":{"1min":0.86299999999999999,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.7070000000000001,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.4179999999999999}]},{"osd":3,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3580000000000001,"15min":1.365},"min":{"1min":0.88400000000000001,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.8560000000000001,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.159,"5min":1.3260000000000001,"15min":1.3540000000000001},"min":{"1min":0.61399999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.448,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":0.94899999999999995}]},{"osd":4,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.3680000000000001,"15min":1.3879999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.5449999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.4139999999999999,"15min":1.4279999999999999},"min":{"1min":0.92500000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.6930000000000001,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":1.321}]},{"osd":5,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.4570000000000001,"15min":1.48},"min":{"1min":0.89200000000000002,"5min":0.755,"15min":0.755},"max":{"1min":1.6080000000000001,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":1.46},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.605,"15min":1.619},"min":{"1min":1.093,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.0190000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":1.552}]},{"osd":7,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.5369999999999999,"5min":1.5289999999999999,"15min":1.5269999999999999},"min":{"1min":1.1100000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.081,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.5049999999999999,"15min":1.514},"min":{"1min":1.141,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.919,"5min":2.5899999999999999,"15min":2.5899999999999999},"last":1.2290000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509475,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":409600,"data_stored":158592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.502,"15min":1.581},"min":{"1min":0.67600000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.375,"5min":13.404,"15min":13.404},"last":1.014},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.4570000000000001,"15min":1.524},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.6160000000000001,"5min":9.4640000000000004,"15min":9.4640000000000004},"last":0.95499999999999996}]},{"osd":1,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.4430000000000001,"15min":1.4810000000000001},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.6519999999999999,"5min":6.734,"15min":6.734},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.4339999999999999,"15min":1.48},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.6890000000000001,"5min":7.8860000000000001,"15min":7.8860000000000001},"last":1.0680000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.528,"15min":1.5700000000000001},"min":{"1min":0.90800000000000003,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.637,"5min":7.8520000000000003,"15min":7.8520000000000003},"last":1.339},{"interface":"front","average":{"1min":1.3,"5min":1.7709999999999999,"15min":1.849},"min":{"1min":0.93700000000000006,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.577,"5min":14.609,"15min":14.609},"last":0.90100000000000002}]},{"osd":3,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.8340000000000001,"15min":1.9199999999999999},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.587,"5min":15.856,"15min":15.856},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.161,"5min":1.4530000000000001,"15min":1.5009999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.7829999999999999,"5min":6.1970000000000001,"15min":6.1970000000000001},"last":1.246}]},{"osd":5,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.9810000000000001,"15min":2.101},"min":{"1min":0.89100000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.7589999999999999,"5min":16.547000000000001,"15min":16.547000000000001},"last":1.4930000000000001},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.95,"15min":2.056},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.643,"5min":15.913,"15min":15.913},"last":1.431}]},{"osd":6,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":2.101,"15min":2.2349999999999999},"min":{"1min":0.98099999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.7829999999999999,"5min":16.481999999999999,"15min":16.481999999999999},"last":1.5700000000000001},{"interface":"front","average":{"1min":1.454,"5min":2.0830000000000002,"15min":2.1880000000000002},"min":{"1min":0.94799999999999995,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":1.7010000000000001,"5min":15.956,"15min":15.956},"last":1.5409999999999999}]},{"osd":7,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.7210000000000001,"15min":1.788},"min":{"1min":0.68799999999999994,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.889,"5min":6.6520000000000001,"15min":6.6520000000000001},"last":1.389},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.95,"15min":2.032},"min":{"1min":1.0880000000000001,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":1.8720000000000001,"5min":10.314,"15min":10.314},"last":1.623}]}]},{"osd":3,"up_from":15,"seq":64424509474,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":417792,"data_stored":160122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.79600000000000004,"15min":0.80300000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3069999999999999,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.86399999999999999,"15min":0.85699999999999998},"min":{"1min":0.497,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.419,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.1719999999999999}]},{"osd":1,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.93000000000000005,"15min":0.94399999999999995},"min":{"1min":0.47799999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.3149999999999999,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.92500000000000004,"15min":0.92100000000000004},"min":{"1min":0.54000000000000004,"5min":0.504,"15min":0.504},"max":{"1min":1.3440000000000001,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":1.274}]},{"osd":2,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.105,"15min":1.087},"min":{"1min":0.61799999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.5840000000000001,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.617},{"interface":"front","average":{"1min":1.264,"5min":1.2150000000000001,"15min":1.2070000000000001},"min":{"1min":0.66600000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.571,"5min":2.77,"15min":2.77},"last":1.4870000000000001}]},{"osd":4,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.202,"15min":1.2090000000000001},"min":{"1min":0.872,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.5369999999999999,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3260000000000001,"15min":1.3240000000000001},"min":{"1min":1.0620000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.734,"5min":2.153,"15min":2.153},"last":1.5269999999999999}]},{"osd":5,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.3260000000000001,"15min":1.3360000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.5820000000000001,"5min":3.6469999999999998,"15min":3.6469999999999998},"last":1.72},{"interface":"front","average":{"1min":1.224,"5min":1.171,"15min":1.1619999999999999},"min":{"1min":0.83899999999999997,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.8100000000000001,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.3260000000000001}]},{"osd":6,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3580000000000001,"15min":1.3620000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.988,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.413},{"interface":"front","average":{"1min":1.343,"5min":1.4099999999999999,"15min":1.421},"min":{"1min":1.0980000000000001,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.5369999999999999,"5min":3.6930000000000001,"15min":3.6930000000000001},"last":1.883}]},{"osd":7,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3089999999999999,"15min":1.3049999999999999},"min":{"1min":0.95199999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.897,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.5700000000000001},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.4590000000000001,"15min":1.4770000000000001},"min":{"1min":0.79000000000000004,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.845,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.6890000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509475,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":405504,"data_stored":158558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.86299999999999999,"15min":0.88300000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.194,"5min":2.7789999999999999,"15min":2.7789999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.81699999999999995,"15min":0.81399999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.4550000000000001,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.0720000000000001}]},{"osd":1,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.365,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.91300000000000003,"15min":0.92300000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.3420000000000001,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.89800000000000002}]},{"osd":3,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.6899999999999999,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.155},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0589999999999999,"15min":1.0629999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.5449999999999999,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":1.002}]},{"osd":4,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.294,"15min":1.306},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.6479999999999999,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.2130000000000001,"15min":1.2330000000000001},"min":{"1min":0.91200000000000003,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.5129999999999999,"5min":3.1469999999999998,"15min":3.1469999999999998},"last":1.212}]},{"osd":5,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.3759999999999999,"15min":1.4019999999999999},"min":{"1min":0.78200000000000003,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":2.0009999999999999,"5min":4.0800000000000001,"15min":4.0800000000000001},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.3360000000000001,"15min":1.3520000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.734,"5min":3.6709999999999998,"15min":3.6709999999999998},"last":1.391}]},{"osd":6,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.246,"15min":1.2709999999999999},"min":{"1min":0.79600000000000004,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.4410000000000001,"5min":2.9249999999999998,"15min":2.9249999999999998},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.319,"5min":1.3879999999999999,"15min":1.3999999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.891,"5min":3.081,"15min":3.081},"last":1.345}]},{"osd":7,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.6619999999999999,"15min":1.7090000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":2.0939999999999999,"5min":5.0650000000000004,"15min":5.0650000000000004},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.476,"15min":1.5029999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.8220000000000001,"5min":3.8849999999999998,"15min":3.8849999999999998},"last":1.4730000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509475,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":417792,"data_stored":160122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.82799999999999996,"15min":0.81699999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.85499999999999998,"15min":0.83099999999999996},"min":{"1min":0.51900000000000002,"5min":0.378,"15min":0.378},"max":{"1min":1.476,"5min":1.72,"15min":1.72},"last":1.2150000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.96799999999999997,"15min":0.97999999999999998},"min":{"1min":0.42099999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.4490000000000001,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84999999999999998,"15min":0.85199999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.585,"5min":1.601,"15min":1.601},"last":0.88200000000000001}]},{"osd":3,"last update":"Sat Oct 14 09:39:13 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.0700000000000001,"15min":1.0800000000000001},"min":{"1min":0.47099999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.5469999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.2669999999999999},{"interface":"front","average":{"1min":0.875,"5min":0.98599999999999999,"15min":1.004},"min":{"1min":0.47599999999999998,"5min":0.441,"15min":0.441},"max":{"1min":1.383,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.0129999999999999}]},{"osd":4,"last update":"Sat Oct 14 09:39:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.296,"15min":1.3100000000000001},"min":{"1min":0.73299999999999998,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.6200000000000001,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":1.375},{"interface":"front","average":{"1min":1.123,"5min":1.1879999999999999,"15min":1.1990000000000001},"min":{"1min":0.754,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.663,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.1679999999999999}]},{"osd":5,"last update":"Sat Oct 14 09:39:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.2310000000000001,"15min":1.2410000000000001},"min":{"1min":0.90100000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.4930000000000001,"5min":3.02,"15min":3.02},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.339,"15min":1.3460000000000001},"min":{"1min":0.80400000000000005,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.6919999999999999,"5min":3.827,"15min":3.827},"last":1.4419999999999999}]},{"osd":6,"last update":"Sat Oct 14 09:39:13 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.258,"15min":1.2609999999999999},"min":{"1min":0.69899999999999995,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.698,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.413},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.3029999999999999,"15min":1.3149999999999999},"min":{"1min":0.73299999999999998,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.6060000000000001,"5min":3.3250000000000002,"15min":3.3250000000000002},"last":1.48}]},{"osd":7,"last update":"Sat Oct 14 09:39:13 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.4550000000000001,"15min":1.4690000000000001},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.9419999999999999,"5min":3.9100000000000001,"15min":3.9100000000000001},"last":1.607},{"interface":"front","average":{"1min":1.401,"5min":1.361,"15min":1.3540000000000001},"min":{"1min":0.93400000000000005,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.9970000000000001,"5min":3.105,"15min":3.105},"last":1.5660000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542179,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":409600,"data_stored":159160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.98799999999999999,"15min":0.99099999999999999},"min":{"1min":0.59599999999999997,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5820000000000001,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.647},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.0149999999999999,"15min":0.997},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":1.4079999999999999}]},{"osd":1,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.117,"15min":1.1120000000000001},"min":{"1min":0.73499999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.512,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.5129999999999999},{"interface":"front","average":{"1min":1.048,"5min":1.0600000000000001,"15min":1.0620000000000001},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.651,"5min":1.756,"15min":1.756},"last":0.95399999999999996}]},{"osd":2,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.3129999999999999,"15min":1.355},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.458,"5min":4.4610000000000003,"15min":4.4610000000000003},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.304,"15min":1.3240000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.6439999999999999,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.2270000000000001}]},{"osd":3,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.2410000000000001,"15min":1.2549999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.6439999999999999,"5min":1.712,"15min":1.712},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.2909999999999999,"15min":1.3089999999999999},"min":{"1min":0.79800000000000004,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.52,"5min":1.998,"15min":1.998},"last":1.7030000000000001}]},{"osd":4,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.4119999999999999,"15min":1.425},"min":{"1min":0.79800000000000004,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.601,"5min":2.169,"15min":2.169},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.409,"5min":1.484,"15min":1.496},"min":{"1min":1.0349999999999999,"5min":0.88,"15min":0.88},"max":{"1min":1.6240000000000001,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.5780000000000001}]},{"osd":6,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.377,"15min":1.3839999999999999},"min":{"1min":1.1040000000000001,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.7470000000000001,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.518,"15min":1.53},"min":{"1min":1.167,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":1.6990000000000001,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":1.548}]},{"osd":7,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.5349999999999999,"15min":1.5509999999999999},"min":{"1min":1.145,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.679,"5min":2.387,"15min":2.387},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.48,"5min":1.55,"15min":1.5620000000000001},"min":{"1min":1.143,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.1859999999999999,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.45}]}]},{"osd":0,"up_from":14,"seq":60129542179,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":995328,"data_stored":748856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.86099999999999999,"15min":0.88200000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.3759999999999999,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.95799999999999996,"15min":0.96799999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3939999999999999,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":1.361}]},{"osd":2,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.0009999999999999,"15min":1.0029999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.7470000000000001,"5min":2.133,"15min":2.133},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.878,"5min":0.94999999999999996,"15min":0.96199999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.653,"5min":4.2210000000000001,"15min":4.2210000000000001},"last":0.80500000000000005}]},{"osd":3,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":1.0029999999999999,"15min":1.03},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.2749999999999999,"5min":3.6070000000000002,"15min":3.6070000000000002},"last":1.083},{"interface":"front","average":{"1min":1.071,"5min":1.133,"15min":1.143},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.665,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.6120000000000001}]},{"osd":4,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.373,"15min":1.411},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.601,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.2809999999999999,"15min":1.3029999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.738,"5min":2.391,"15min":2.391},"last":1.304}]},{"osd":5,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.375,"15min":1.387},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.6799999999999999,"5min":3.8620000000000001,"15min":3.8620000000000001},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.27,"5min":1.3620000000000001,"15min":1.377},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.641,"5min":2.4220000000000002,"15min":2.4220000000000002},"last":1.4570000000000001}]},{"osd":6,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.4610000000000001,"15min":1.4830000000000001},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.75,"5min":3.8210000000000002,"15min":3.8210000000000002},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.341,"5min":1.494,"15min":1.52},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.8340000000000001,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":1.5289999999999999}]},{"osd":7,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.5389999999999999,"15min":1.5669999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.8859999999999999,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.4059999999999999,"15min":1.4199999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.8049999999999999,"5min":2.355,"15min":2.355},"last":1.5720000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T09:39:51.124 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:51.125 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-10-14T09:38:29.979593+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=29, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=38, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:39:51.125 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:40:02.027 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T09:40:02.036 DEBUG:teuthology.orchestra.run.smithi129:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T09:40:11.126 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:40:11.348 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.346+0000 7f3ce49c5640 1 Processor -- start 2023-10-14T09:40:11.349 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.346+0000 7f3ce49c5640 1 -- start start 2023-10-14T09:40:11.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.347+0000 7f3ce49c5640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3ce0159b20 0x7f3ce006bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:40:11.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.347+0000 7f3ce49c5640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3ce00b0b20 0x7f3ce006fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:40:11.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.347+0000 7f3ce49c5640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce006f7f0 con 0x7f3ce0159f00 2023-10-14T09:40:11.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.347+0000 7f3ce49c5640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ce006c5e0 con 0x7f3ce00b0b20 2023-10-14T09:40:11.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.347+0000 7f3ce49c5640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce006c8c0 con 0x7f3ce0159b20 2023-10-14T09:40:11.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.348+0000 7f3cded9d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3ce00b0b20 0x7f3ce006fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:40:11.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.348+0000 7f3cded9d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3ce00b0b20 0x7f3ce006fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:42272/0 (socket says 172.21.15.102:42272) 2023-10-14T09:40:11.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.348+0000 7f3cded9d640 1 -- 172.21.15.102:0/2352767978 learned_addr learned my addr 172.21.15.102:0/2352767978 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:40:11.354 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.348+0000 7f3cded9d640 1 -- 172.21.15.102:0/2352767978 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3ce0159b20 msgr2=0x7f3ce006bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:40:11.354 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.348+0000 7f3cded9d640 1 --2- 172.21.15.102:0/2352767978 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3ce0159b20 0x7f3ce006bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:40:11.354 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.348+0000 7f3cded9d640 1 -- 172.21.15.102:0/2352767978 >> v1:172.21.15.129:6789/0 conn(0x7f3ce0159f00 legacy=0x7f3ce00b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:40:11.354 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.348+0000 7f3cded9d640 1 -- 172.21.15.102:0/2352767978 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce006cba0 con 0x7f3ce00b0b20 2023-10-14T09:40:11.355 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.349+0000 7f3cded9d640 1 --2- 172.21.15.102:0/2352767978 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ce00b0b20 0x7f3ce006fc80 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8009e50 tx=0x7f3cd802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4c8aca1f25c9a0d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:40:11.355 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.350+0000 7f3cdd59a640 1 -- 172.21.15.102:0/2352767978 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd802ca70 con 0x7f3ce00b0b20 2023-10-14T09:40:11.355 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.350+0000 7f3cdd59a640 1 -- 172.21.15.102:0/2352767978 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd802cbd0 con 0x7f3ce00b0b20 2023-10-14T09:40:11.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.350+0000 7f3cdd59a640 1 -- 172.21.15.102:0/2352767978 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd80343f0 con 0x7f3ce00b0b20 2023-10-14T09:40:11.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.350+0000 7f3ce49c5640 1 -- 172.21.15.102:0/2352767978 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ce00b0b20 msgr2=0x7f3ce006fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:40:11.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.350+0000 7f3ce49c5640 1 --2- 172.21.15.102:0/2352767978 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ce00b0b20 0x7f3ce006fc80 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8009e50 tx=0x7f3cd802bed0 comp rx=0 tx=0).stop 2023-10-14T09:40:11.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.350+0000 7f3ce49c5640 1 -- 172.21.15.102:0/2352767978 shutdown_connections 2023-10-14T09:40:11.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.350+0000 7f3ce49c5640 1 --2- 172.21.15.102:0/2352767978 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ce00b0b20 0x7f3ce006fc80 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:40:11.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.350+0000 7f3ce49c5640 1 --2- 172.21.15.102:0/2352767978 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3ce0159b20 0x7f3ce006bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:40:11.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.350+0000 7f3ce49c5640 1 -- 172.21.15.102:0/2352767978 >> 172.21.15.102:0/2352767978 conn(0x7f3ce00cb410 msgr2=0x7f3ce00cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:40:11.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.350+0000 7f3ce49c5640 1 -- 172.21.15.102:0/2352767978 shutdown_connections 2023-10-14T09:40:11.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.350+0000 7f3ce49c5640 1 -- 172.21.15.102:0/2352767978 wait complete. 2023-10-14T09:40:11.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.352+0000 7f3ce49c5640 1 Processor -- start 2023-10-14T09:40:11.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.352+0000 7f3ce49c5640 1 -- start start 2023-10-14T09:40:11.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.353+0000 7f3ce49c5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ce00b0b20 0x7f3ce014cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:40:11.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.353+0000 7f3ce49c5640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3ce0159b20 0x7f3ce014e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:40:11.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.353+0000 7f3ce49c5640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3ce0159f00 0x7f3ce00aec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:40:11.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.353+0000 7f3ce49c5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce00c4e40 con 0x7f3ce00b0b20 2023-10-14T09:40:11.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.353+0000 7f3ce49c5640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce00c41c0 con 0x7f3ce0159b20 2023-10-14T09:40:11.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.353+0000 7f3ce49c5640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce00c44a0 con 0x7f3ce0159f00 2023-10-14T09:40:11.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.353+0000 7f3cde59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ce00b0b20 0x7f3ce014cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:40:11.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.353+0000 7f3cde59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ce00b0b20 0x7f3ce014cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:42284/0 (socket says 172.21.15.102:42284) 2023-10-14T09:40:11.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.353+0000 7f3cde59c640 1 -- 172.21.15.102:0/2818730391 learned_addr learned my addr 172.21.15.102:0/2818730391 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:40:11.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.354+0000 7f3cddd9b640 1 --2- 172.21.15.102:0/2818730391 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3ce0159b20 0x7f3ce014e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:40:11.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.354+0000 7f3cded9d640 1 --2- 172.21.15.102:0/2818730391 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3ce0159f00 0x7f3ce00aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:40:11.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.354+0000 7f3cde59c640 1 -- 172.21.15.102:0/2818730391 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3ce0159f00 msgr2=0x7f3ce00aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:40:11.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.354+0000 7f3cde59c640 1 --2- 172.21.15.102:0/2818730391 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3ce0159f00 0x7f3ce00aec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:40:11.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.354+0000 7f3cde59c640 1 -- 172.21.15.102:0/2818730391 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3ce0159b20 msgr2=0x7f3ce014e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:40:11.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.354+0000 7f3cde59c640 1 --2- 172.21.15.102:0/2818730391 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3ce0159b20 0x7f3ce014e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:40:11.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.354+0000 7f3cde59c640 1 -- 172.21.15.102:0/2818730391 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd8009b30 con 0x7f3ce00b0b20 2023-10-14T09:40:11.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.354+0000 7f3cde59c640 1 --2- 172.21.15.102:0/2818730391 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ce00b0b20 0x7f3ce014cda0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000b4a0 tx=0x7f3cd000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:40:11.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.354+0000 7f3cceffd640 1 -- 172.21.15.102:0/2818730391 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0010610 con 0x7f3ce00b0b20 2023-10-14T09:40:11.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.355+0000 7f3cceffd640 1 -- 172.21.15.102:0/2818730391 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd0010770 con 0x7f3ce00b0b20 2023-10-14T09:40:11.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.355+0000 7f3cceffd640 1 -- 172.21.15.102:0/2818730391 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0010b20 con 0x7f3ce00b0b20 2023-10-14T09:40:11.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.355+0000 7f3ce49c5640 1 -- 172.21.15.102:0/2818730391 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ce00c4780 con 0x7f3ce00b0b20 2023-10-14T09:40:11.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.355+0000 7f3ce49c5640 1 -- 172.21.15.102:0/2818730391 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce014d2e0 con 0x7f3ce00b0b20 2023-10-14T09:40:11.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.356+0000 7f3ce49c5640 1 -- 172.21.15.102:0/2818730391 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce004e160 con 0x7f3ce00b0b20 2023-10-14T09:40:11.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.357+0000 7f3cceffd640 1 -- 172.21.15.102:0/2818730391 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3cd0010c80 con 0x7f3ce00b0b20 2023-10-14T09:40:11.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.358+0000 7f3cceffd640 1 --2- 172.21.15.102:0/2818730391 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f3cc006ae70 0x7f3cc006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:40:11.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.358+0000 7f3cceffd640 1 -- 172.21.15.102:0/2818730391 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f3cd00892a0 con 0x7f3ce00b0b20 2023-10-14T09:40:11.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.358+0000 7f3cddd9b640 1 --2- 172.21.15.102:0/2818730391 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f3cc006ae70 0x7f3cc006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:40:11.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.359+0000 7f3cddd9b640 1 --2- 172.21.15.102:0/2818730391 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f3cc006ae70 0x7f3cc006d330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0159450 tx=0x7f3cd4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:40:11.371 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.362+0000 7f3cceffd640 1 -- 172.21.15.102:0/2818730391 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3cd0054320 con 0x7f3ce00b0b20 2023-10-14T09:40:11.550 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.548+0000 7f3ce49c5640 1 -- 172.21.15.102:0/2818730391 --> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3ce006ce80 con 0x7f3cc006ae70 2023-10-14T09:40:11.560 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.558+0000 7f3cceffd640 1 -- 172.21.15.102:0/2818730391 <== mgr.4104 v2:172.21.15.102:6832/1125265706 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288959 (secure 0 0 0) 0x7f3cd400a380 con 0x7f3cc006ae70 2023-10-14T09:40:11.564 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:40:11.566 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2023-10-14T09:40:11.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.564+0000 7f3ce49c5640 1 -- 172.21.15.102:0/2818730391 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f3cc006ae70 msgr2=0x7f3cc006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:40:11.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.564+0000 7f3ce49c5640 1 --2- 172.21.15.102:0/2818730391 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f3cc006ae70 0x7f3cc006d330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0159450 tx=0x7f3cd4008040 comp rx=0 tx=0).stop 2023-10-14T09:40:11.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.564+0000 7f3ce49c5640 1 -- 172.21.15.102:0/2818730391 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ce00b0b20 msgr2=0x7f3ce014cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:40:11.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.564+0000 7f3ce49c5640 1 --2- 172.21.15.102:0/2818730391 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ce00b0b20 0x7f3ce014cda0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000b4a0 tx=0x7f3cd000b960 comp rx=0 tx=0).stop 2023-10-14T09:40:11.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.565+0000 7f3ce49c5640 1 -- 172.21.15.102:0/2818730391 shutdown_connections 2023-10-14T09:40:11.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.565+0000 7f3ce49c5640 1 --2- 172.21.15.102:0/2818730391 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f3cc006ae70 0x7f3cc006d330 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:40:11.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.565+0000 7f3ce49c5640 1 --2- 172.21.15.102:0/2818730391 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3ce0159f00 0x7f3ce00aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:40:11.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.565+0000 7f3ce49c5640 1 --2- 172.21.15.102:0/2818730391 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3ce0159b20 0x7f3ce014e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:40:11.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.565+0000 7f3ce49c5640 1 --2- 172.21.15.102:0/2818730391 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ce00b0b20 0x7f3ce014cda0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:40:11.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.565+0000 7f3ce49c5640 1 -- 172.21.15.102:0/2818730391 >> 172.21.15.102:0/2818730391 conn(0x7f3ce00cb410 msgr2=0x7f3ce0153ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:40:11.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.565+0000 7f3ce49c5640 1 -- 172.21.15.102:0/2818730391 shutdown_connections 2023-10-14T09:40:11.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.565+0000 7f3ce49c5640 1 -- 172.21.15.102:0/2818730391 wait complete. 2023-10-14T09:40:11.584 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2023-10-14T09:40:09.934499+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220488,"kb_used_data":4360,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754232,"statfs":{"total":773094113280,"available":772868333568,"internally_reserved":0,"allocated":4464640,"data_stored":2453460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004600"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:08.679134+0000","last_change":"2023-10-14T09:39:08.679315+0000","last_active":"2023-10-14T09:39:08.679134+0000","last_peered":"2023-10-14T09:39:08.679134+0000","last_clean":"2023-10-14T09:39:08.679134+0000","last_became_active":"2023-10-14T09:38:31.023780+0000","last_became_peered":"2023-10-14T09:38:31.023780+0000","last_unstale":"2023-10-14T09:39:08.679134+0000","last_undegraded":"2023-10-14T09:39:08.679134+0000","last_fullsized":"2023-10-14T09:39:08.679134+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:08.678892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:08.678892+0000","last_clean_scrub_stamp":"2023-10-14T09:39:08.678892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:24:24.216542+0000","scrub_duration":0.003218533,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:28.993817+0000","last_change":"2023-10-14T09:39:28.993921+0000","last_active":"2023-10-14T09:39:28.993817+0000","last_peered":"2023-10-14T09:39:28.993817+0000","last_clean":"2023-10-14T09:39:28.993817+0000","last_became_active":"2023-10-14T09:38:31.027820+0000","last_became_peered":"2023-10-14T09:38:31.027820+0000","last_unstale":"2023-10-14T09:39:28.993817+0000","last_undegraded":"2023-10-14T09:39:28.993817+0000","last_fullsized":"2023-10-14T09:39:28.993817+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:28.993631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:28.993631+0000","last_clean_scrub_stamp":"2023-10-14T09:39:28.993631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:39:31.485088+0000","scrub_duration":0.0032520259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:04.176269+0000","last_change":"2023-10-14T09:39:04.176464+0000","last_active":"2023-10-14T09:39:04.176269+0000","last_peered":"2023-10-14T09:39:04.176269+0000","last_clean":"2023-10-14T09:39:04.176269+0000","last_became_active":"2023-10-14T09:38:31.019892+0000","last_became_peered":"2023-10-14T09:38:31.019892+0000","last_unstale":"2023-10-14T09:39:04.176269+0000","last_undegraded":"2023-10-14T09:39:04.176269+0000","last_fullsized":"2023-10-14T09:39:04.176269+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:04.176059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:04.176059+0000","last_clean_scrub_stamp":"2023-10-14T09:39:04.176059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:01.866021+0000","scrub_duration":0.0038494269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:31.694190+0000","last_change":"2023-10-14T09:39:31.694310+0000","last_active":"2023-10-14T09:39:31.694190+0000","last_peered":"2023-10-14T09:39:31.694190+0000","last_clean":"2023-10-14T09:39:31.694190+0000","last_became_active":"2023-10-14T09:38:31.035189+0000","last_became_peered":"2023-10-14T09:38:31.035189+0000","last_unstale":"2023-10-14T09:39:31.694190+0000","last_undegraded":"2023-10-14T09:39:31.694190+0000","last_fullsized":"2023-10-14T09:39:31.694190+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:31.693898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:31.693898+0000","last_clean_scrub_stamp":"2023-10-14T09:39:31.693898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:46.030222+0000","scrub_duration":0.003878135,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:11.711538+0000","last_change":"2023-10-14T09:39:11.711716+0000","last_active":"2023-10-14T09:39:11.711538+0000","last_peered":"2023-10-14T09:39:11.711538+0000","last_clean":"2023-10-14T09:39:11.711538+0000","last_became_active":"2023-10-14T09:38:31.020777+0000","last_became_peered":"2023-10-14T09:38:31.020777+0000","last_unstale":"2023-10-14T09:39:11.711538+0000","last_undegraded":"2023-10-14T09:39:11.711538+0000","last_fullsized":"2023-10-14T09:39:11.711538+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:11.711327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:11.711327+0000","last_clean_scrub_stamp":"2023-10-14T09:39:11.711327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:57:10.065520+0000","scrub_duration":0.0032876120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:27.009678+0000","last_change":"2023-10-14T09:39:27.009795+0000","last_active":"2023-10-14T09:39:27.009678+0000","last_peered":"2023-10-14T09:39:27.009678+0000","last_clean":"2023-10-14T09:39:27.009678+0000","last_became_active":"2023-10-14T09:38:31.027342+0000","last_became_peered":"2023-10-14T09:38:31.027342+0000","last_unstale":"2023-10-14T09:39:27.009678+0000","last_undegraded":"2023-10-14T09:39:27.009678+0000","last_fullsized":"2023-10-14T09:39:27.009678+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:27.009479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:27.009479+0000","last_clean_scrub_stamp":"2023-10-14T09:39:27.009479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:17:47.055133+0000","scrub_duration":0.0037233190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:09.340813+0000","last_change":"2023-10-14T09:39:09.340915+0000","last_active":"2023-10-14T09:39:09.340813+0000","last_peered":"2023-10-14T09:39:09.340813+0000","last_clean":"2023-10-14T09:39:09.340813+0000","last_became_active":"2023-10-14T09:38:31.033760+0000","last_became_peered":"2023-10-14T09:38:31.033760+0000","last_unstale":"2023-10-14T09:39:09.340813+0000","last_undegraded":"2023-10-14T09:39:09.340813+0000","last_fullsized":"2023-10-14T09:39:09.340813+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:09.340626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:09.340626+0000","last_clean_scrub_stamp":"2023-10-14T09:39:09.340626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:22:23.056489+0000","scrub_duration":0.0036686370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:53.242083+0000","last_change":"2023-10-14T09:38:53.242193+0000","last_active":"2023-10-14T09:38:53.242083+0000","last_peered":"2023-10-14T09:38:53.242083+0000","last_clean":"2023-10-14T09:38:53.242083+0000","last_became_active":"2023-10-14T09:38:31.024702+0000","last_became_peered":"2023-10-14T09:38:31.024702+0000","last_unstale":"2023-10-14T09:38:53.242083+0000","last_undegraded":"2023-10-14T09:38:53.242083+0000","last_fullsized":"2023-10-14T09:38:53.242083+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:53.241901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:53.241901+0000","last_clean_scrub_stamp":"2023-10-14T09:38:53.241901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:24:15.099376+0000","scrub_duration":0.0037239859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:21.534934+0000","last_change":"2023-10-14T09:39:21.535050+0000","last_active":"2023-10-14T09:39:21.534934+0000","last_peered":"2023-10-14T09:39:21.534934+0000","last_clean":"2023-10-14T09:39:21.534934+0000","last_became_active":"2023-10-14T09:38:31.023498+0000","last_became_peered":"2023-10-14T09:38:31.023498+0000","last_unstale":"2023-10-14T09:39:21.534934+0000","last_undegraded":"2023-10-14T09:39:21.534934+0000","last_fullsized":"2023-10-14T09:39:21.534934+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:21.534743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:21.534743+0000","last_clean_scrub_stamp":"2023-10-14T09:39:21.534743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:46:56.536260+0000","scrub_duration":0.0037966150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:36.777204+0000","last_change":"2023-10-14T09:39:36.777321+0000","last_active":"2023-10-14T09:39:36.777204+0000","last_peered":"2023-10-14T09:39:36.777204+0000","last_clean":"2023-10-14T09:39:36.777204+0000","last_became_active":"2023-10-14T09:38:31.029268+0000","last_became_peered":"2023-10-14T09:38:31.029268+0000","last_unstale":"2023-10-14T09:39:36.777204+0000","last_undegraded":"2023-10-14T09:39:36.777204+0000","last_fullsized":"2023-10-14T09:39:36.777204+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:36.777007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:36.777007+0000","last_clean_scrub_stamp":"2023-10-14T09:39:36.777007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:10:49.435204+0000","scrub_duration":0.0039070880000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:54.281412+0000","last_change":"2023-10-14T09:38:54.281549+0000","last_active":"2023-10-14T09:38:54.281412+0000","last_peered":"2023-10-14T09:38:54.281412+0000","last_clean":"2023-10-14T09:38:54.281412+0000","last_became_active":"2023-10-14T09:38:31.033343+0000","last_became_peered":"2023-10-14T09:38:31.033343+0000","last_unstale":"2023-10-14T09:38:54.281412+0000","last_undegraded":"2023-10-14T09:38:54.281412+0000","last_fullsized":"2023-10-14T09:38:54.281412+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:54.281200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:54.281200+0000","last_clean_scrub_stamp":"2023-10-14T09:38:54.281200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:56:08.772956+0000","scrub_duration":0.003963818,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:02.146816+0000","last_change":"2023-10-14T09:39:02.146946+0000","last_active":"2023-10-14T09:39:02.146816+0000","last_peered":"2023-10-14T09:39:02.146816+0000","last_clean":"2023-10-14T09:39:02.146816+0000","last_became_active":"2023-10-14T09:38:31.017971+0000","last_became_peered":"2023-10-14T09:38:31.017971+0000","last_unstale":"2023-10-14T09:39:02.146816+0000","last_undegraded":"2023-10-14T09:39:02.146816+0000","last_fullsized":"2023-10-14T09:39:02.146816+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:02.146634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:02.146634+0000","last_clean_scrub_stamp":"2023-10-14T09:39:02.146634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:38:25.497182+0000","scrub_duration":0.0038723500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:49.533192+0000","last_change":"2023-10-14T09:38:49.533292+0000","last_active":"2023-10-14T09:38:49.533192+0000","last_peered":"2023-10-14T09:38:49.533192+0000","last_clean":"2023-10-14T09:38:49.533192+0000","last_became_active":"2023-10-14T09:38:31.019186+0000","last_became_peered":"2023-10-14T09:38:31.019186+0000","last_unstale":"2023-10-14T09:38:49.533192+0000","last_undegraded":"2023-10-14T09:38:49.533192+0000","last_fullsized":"2023-10-14T09:38:49.533192+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:49.532907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:49.532907+0000","last_clean_scrub_stamp":"2023-10-14T09:38:49.532907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:50:05.598559+0000","scrub_duration":0.0024617720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:21.034412+0000","last_change":"2023-10-14T09:39:21.034532+0000","last_active":"2023-10-14T09:39:21.034412+0000","last_peered":"2023-10-14T09:39:21.034412+0000","last_clean":"2023-10-14T09:39:21.034412+0000","last_became_active":"2023-10-14T09:38:31.020409+0000","last_became_peered":"2023-10-14T09:38:31.020409+0000","last_unstale":"2023-10-14T09:39:21.034412+0000","last_undegraded":"2023-10-14T09:39:21.034412+0000","last_fullsized":"2023-10-14T09:39:21.034412+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:21.034224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:21.034224+0000","last_clean_scrub_stamp":"2023-10-14T09:39:21.034224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:10:45.600855+0000","scrub_duration":0.0035651189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:13.063661+0000","last_change":"2023-10-14T09:39:13.063764+0000","last_active":"2023-10-14T09:39:13.063661+0000","last_peered":"2023-10-14T09:39:13.063661+0000","last_clean":"2023-10-14T09:39:13.063661+0000","last_became_active":"2023-10-14T09:38:31.025155+0000","last_became_peered":"2023-10-14T09:38:31.025155+0000","last_unstale":"2023-10-14T09:39:13.063661+0000","last_undegraded":"2023-10-14T09:39:13.063661+0000","last_fullsized":"2023-10-14T09:39:13.063661+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:13.063384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:13.063384+0000","last_clean_scrub_stamp":"2023-10-14T09:39:13.063384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:26.836471+0000","scrub_duration":0.0035710059999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:00.295754+0000","last_change":"2023-10-14T09:39:00.295945+0000","last_active":"2023-10-14T09:39:00.295754+0000","last_peered":"2023-10-14T09:39:00.295754+0000","last_clean":"2023-10-14T09:39:00.295754+0000","last_became_active":"2023-10-14T09:38:31.033869+0000","last_became_peered":"2023-10-14T09:38:31.033869+0000","last_unstale":"2023-10-14T09:39:00.295754+0000","last_undegraded":"2023-10-14T09:39:00.295754+0000","last_fullsized":"2023-10-14T09:39:00.295754+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:00.295522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:00.295522+0000","last_clean_scrub_stamp":"2023-10-14T09:39:00.295522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:12:26.055534+0000","scrub_duration":0.0036621850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:58.255288+0000","last_change":"2023-10-14T09:38:58.255392+0000","last_active":"2023-10-14T09:38:58.255288+0000","last_peered":"2023-10-14T09:38:58.255288+0000","last_clean":"2023-10-14T09:38:58.255288+0000","last_became_active":"2023-10-14T09:38:31.029457+0000","last_became_peered":"2023-10-14T09:38:31.029457+0000","last_unstale":"2023-10-14T09:38:58.255288+0000","last_undegraded":"2023-10-14T09:38:58.255288+0000","last_fullsized":"2023-10-14T09:38:58.255288+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:58.255108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:58.255108+0000","last_clean_scrub_stamp":"2023-10-14T09:38:58.255108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:10:17.655904+0000","scrub_duration":0.0033634659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:32.990487+0000","last_change":"2023-10-14T09:39:32.990609+0000","last_active":"2023-10-14T09:39:32.990487+0000","last_peered":"2023-10-14T09:39:32.990487+0000","last_clean":"2023-10-14T09:39:32.990487+0000","last_became_active":"2023-10-14T09:38:31.033040+0000","last_became_peered":"2023-10-14T09:38:31.033040+0000","last_unstale":"2023-10-14T09:39:32.990487+0000","last_undegraded":"2023-10-14T09:39:32.990487+0000","last_fullsized":"2023-10-14T09:39:32.990487+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:32.990298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:32.990298+0000","last_clean_scrub_stamp":"2023-10-14T09:39:32.990298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:04:33.825932+0000","scrub_duration":0.0035171180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:08.083614+0000","last_change":"2023-10-14T09:39:08.083715+0000","last_active":"2023-10-14T09:39:08.083614+0000","last_peered":"2023-10-14T09:39:08.083614+0000","last_clean":"2023-10-14T09:39:08.083614+0000","last_became_active":"2023-10-14T09:38:31.025735+0000","last_became_peered":"2023-10-14T09:38:31.025735+0000","last_unstale":"2023-10-14T09:39:08.083614+0000","last_undegraded":"2023-10-14T09:39:08.083614+0000","last_fullsized":"2023-10-14T09:39:08.083614+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:08.083434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:08.083434+0000","last_clean_scrub_stamp":"2023-10-14T09:39:08.083434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:13:04.453658+0000","scrub_duration":0.0033516599999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:59.645885+0000","last_change":"2023-10-14T09:38:59.645989+0000","last_active":"2023-10-14T09:38:59.645885+0000","last_peered":"2023-10-14T09:38:59.645885+0000","last_clean":"2023-10-14T09:38:59.645885+0000","last_became_active":"2023-10-14T09:38:31.011363+0000","last_became_peered":"2023-10-14T09:38:31.011363+0000","last_unstale":"2023-10-14T09:38:59.645885+0000","last_undegraded":"2023-10-14T09:38:59.645885+0000","last_fullsized":"2023-10-14T09:38:59.645885+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:59.645701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:59.645701+0000","last_clean_scrub_stamp":"2023-10-14T09:38:59.645701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:06:09.913970+0000","scrub_duration":0.0038696870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:11.540547+0000","last_change":"2023-10-14T09:39:11.540653+0000","last_active":"2023-10-14T09:39:11.540547+0000","last_peered":"2023-10-14T09:39:11.540547+0000","last_clean":"2023-10-14T09:39:11.540547+0000","last_became_active":"2023-10-14T09:38:31.021555+0000","last_became_peered":"2023-10-14T09:38:31.021555+0000","last_unstale":"2023-10-14T09:39:11.540547+0000","last_undegraded":"2023-10-14T09:39:11.540547+0000","last_fullsized":"2023-10-14T09:39:11.540547+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:11.540315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:11.540315+0000","last_clean_scrub_stamp":"2023-10-14T09:39:11.540315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:37:15.545521+0000","scrub_duration":0.0036936970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:32.426858+0000","last_change":"2023-10-14T09:39:32.426977+0000","last_active":"2023-10-14T09:39:32.426858+0000","last_peered":"2023-10-14T09:39:32.426858+0000","last_clean":"2023-10-14T09:39:32.426858+0000","last_became_active":"2023-10-14T09:38:31.029712+0000","last_became_peered":"2023-10-14T09:38:31.029712+0000","last_unstale":"2023-10-14T09:39:32.426858+0000","last_undegraded":"2023-10-14T09:39:32.426858+0000","last_fullsized":"2023-10-14T09:39:32.426858+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:32.426654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:32.426654+0000","last_clean_scrub_stamp":"2023-10-14T09:39:32.426654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:43:07.403801+0000","scrub_duration":0.003833707,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:57.630740+0000","last_change":"2023-10-14T09:38:57.630848+0000","last_active":"2023-10-14T09:38:57.630740+0000","last_peered":"2023-10-14T09:38:57.630740+0000","last_clean":"2023-10-14T09:38:57.630740+0000","last_became_active":"2023-10-14T09:38:31.023251+0000","last_became_peered":"2023-10-14T09:38:31.023251+0000","last_unstale":"2023-10-14T09:38:57.630740+0000","last_undegraded":"2023-10-14T09:38:57.630740+0000","last_fullsized":"2023-10-14T09:38:57.630740+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:57.630577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:57.630577+0000","last_clean_scrub_stamp":"2023-10-14T09:38:57.630577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:23:32.551600+0000","scrub_duration":0.0038587109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:15.975509+0000","last_change":"2023-10-14T09:39:15.975621+0000","last_active":"2023-10-14T09:39:15.975509+0000","last_peered":"2023-10-14T09:39:15.975509+0000","last_clean":"2023-10-14T09:39:15.975509+0000","last_became_active":"2023-10-14T09:38:31.010860+0000","last_became_peered":"2023-10-14T09:38:31.010860+0000","last_unstale":"2023-10-14T09:39:15.975509+0000","last_undegraded":"2023-10-14T09:39:15.975509+0000","last_fullsized":"2023-10-14T09:39:15.975509+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:15.975300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:15.975300+0000","last_clean_scrub_stamp":"2023-10-14T09:39:15.975300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:33:45.828182+0000","scrub_duration":0.0039747810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:45.808579+0000","last_change":"2023-10-14T09:39:45.808699+0000","last_active":"2023-10-14T09:39:45.808579+0000","last_peered":"2023-10-14T09:39:45.808579+0000","last_clean":"2023-10-14T09:39:45.808579+0000","last_became_active":"2023-10-14T09:38:31.023469+0000","last_became_peered":"2023-10-14T09:38:31.023469+0000","last_unstale":"2023-10-14T09:39:45.808579+0000","last_undegraded":"2023-10-14T09:39:45.808579+0000","last_fullsized":"2023-10-14T09:39:45.808579+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:45.808397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:45.808397+0000","last_clean_scrub_stamp":"2023-10-14T09:39:45.808397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:04:12.032157+0000","scrub_duration":0.0036597560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:27.984012+0000","last_change":"2023-10-14T09:39:27.984150+0000","last_active":"2023-10-14T09:39:27.984012+0000","last_peered":"2023-10-14T09:39:27.984012+0000","last_clean":"2023-10-14T09:39:27.984012+0000","last_became_active":"2023-10-14T09:38:31.026660+0000","last_became_peered":"2023-10-14T09:38:31.026660+0000","last_unstale":"2023-10-14T09:39:27.984012+0000","last_undegraded":"2023-10-14T09:39:27.984012+0000","last_fullsized":"2023-10-14T09:39:27.984012+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:27.983817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:27.983817+0000","last_clean_scrub_stamp":"2023-10-14T09:39:27.983817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:39:01.203454+0000","scrub_duration":0.0036768719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:38.771528+0000","last_change":"2023-10-14T09:39:38.771642+0000","last_active":"2023-10-14T09:39:38.771528+0000","last_peered":"2023-10-14T09:39:38.771528+0000","last_clean":"2023-10-14T09:39:38.771528+0000","last_became_active":"2023-10-14T09:38:31.025680+0000","last_became_peered":"2023-10-14T09:38:31.025680+0000","last_unstale":"2023-10-14T09:39:38.771528+0000","last_undegraded":"2023-10-14T09:39:38.771528+0000","last_fullsized":"2023-10-14T09:39:38.771528+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:38.771322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:38.771322+0000","last_clean_scrub_stamp":"2023-10-14T09:39:38.771322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:22:35.469692+0000","scrub_duration":0.0036031840000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:09.104667+0000","last_change":"2023-10-14T09:39:09.104780+0000","last_active":"2023-10-14T09:39:09.104667+0000","last_peered":"2023-10-14T09:39:09.104667+0000","last_clean":"2023-10-14T09:39:09.104667+0000","last_became_active":"2023-10-14T09:38:31.022641+0000","last_became_peered":"2023-10-14T09:38:31.022641+0000","last_unstale":"2023-10-14T09:39:09.104667+0000","last_undegraded":"2023-10-14T09:39:09.104667+0000","last_fullsized":"2023-10-14T09:39:09.104667+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:09.104477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:09.104477+0000","last_clean_scrub_stamp":"2023-10-14T09:39:09.104477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:40:11.222798+0000","scrub_duration":0.0041570940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:34.465197+0000","last_change":"2023-10-14T09:39:34.465377+0000","last_active":"2023-10-14T09:39:34.465197+0000","last_peered":"2023-10-14T09:39:34.465197+0000","last_clean":"2023-10-14T09:39:34.465197+0000","last_became_active":"2023-10-14T09:38:31.031302+0000","last_became_peered":"2023-10-14T09:38:31.031302+0000","last_unstale":"2023-10-14T09:39:34.465197+0000","last_undegraded":"2023-10-14T09:39:34.465197+0000","last_fullsized":"2023-10-14T09:39:34.465197+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:34.464975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:34.464975+0000","last_clean_scrub_stamp":"2023-10-14T09:39:34.464975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:04:00.688735+0000","scrub_duration":0.0039229520000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:01.297360+0000","last_change":"2023-10-14T09:39:01.297588+0000","last_active":"2023-10-14T09:39:01.297360+0000","last_peered":"2023-10-14T09:39:01.297360+0000","last_clean":"2023-10-14T09:39:01.297360+0000","last_became_active":"2023-10-14T09:38:31.029493+0000","last_became_peered":"2023-10-14T09:38:31.029493+0000","last_unstale":"2023-10-14T09:39:01.297360+0000","last_undegraded":"2023-10-14T09:39:01.297360+0000","last_fullsized":"2023-10-14T09:39:01.297360+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:01.297099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:01.297099+0000","last_clean_scrub_stamp":"2023-10-14T09:39:01.297099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:00:00.912022+0000","scrub_duration":0.0036701279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:01.810535+0000","last_change":"2023-10-14T09:39:01.810634+0000","last_active":"2023-10-14T09:39:01.810535+0000","last_peered":"2023-10-14T09:39:01.810535+0000","last_clean":"2023-10-14T09:39:01.810535+0000","last_became_active":"2023-10-14T09:38:31.025243+0000","last_became_peered":"2023-10-14T09:38:31.025243+0000","last_unstale":"2023-10-14T09:39:01.810535+0000","last_undegraded":"2023-10-14T09:39:01.810535+0000","last_fullsized":"2023-10-14T09:39:01.810535+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:01.810343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:01.810343+0000","last_clean_scrub_stamp":"2023-10-14T09:39:01.810343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:07:34.569268+0000","scrub_duration":0.0028920640000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:06.321798+0000","last_change":"2023-10-14T09:39:06.321903+0000","last_active":"2023-10-14T09:39:06.321798+0000","last_peered":"2023-10-14T09:39:06.321798+0000","last_clean":"2023-10-14T09:39:06.321798+0000","last_became_active":"2023-10-14T09:38:31.028420+0000","last_became_peered":"2023-10-14T09:38:31.028420+0000","last_unstale":"2023-10-14T09:39:06.321798+0000","last_undegraded":"2023-10-14T09:39:06.321798+0000","last_fullsized":"2023-10-14T09:39:06.321798+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:06.321596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:06.321596+0000","last_clean_scrub_stamp":"2023-10-14T09:39:06.321596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:04:04.665773+0000","scrub_duration":0.0036308410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:56.608953+0000","last_change":"2023-10-14T09:38:56.609079+0000","last_active":"2023-10-14T09:38:56.608953+0000","last_peered":"2023-10-14T09:38:56.608953+0000","last_clean":"2023-10-14T09:38:56.608953+0000","last_became_active":"2023-10-14T09:38:31.023482+0000","last_became_peered":"2023-10-14T09:38:31.023482+0000","last_unstale":"2023-10-14T09:38:56.608953+0000","last_undegraded":"2023-10-14T09:38:56.608953+0000","last_fullsized":"2023-10-14T09:38:56.608953+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:56.608786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:56.608786+0000","last_clean_scrub_stamp":"2023-10-14T09:38:56.608786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:22:18.269819+0000","scrub_duration":0.0034962940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"35'4","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:50.611267+0000","last_change":"2023-10-14T09:38:50.611392+0000","last_active":"2023-10-14T09:38:50.611267+0000","last_peered":"2023-10-14T09:38:50.611267+0000","last_clean":"2023-10-14T09:38:50.611267+0000","last_became_active":"2023-10-14T09:38:30.031374+0000","last_became_peered":"2023-10-14T09:38:30.031374+0000","last_unstale":"2023-10-14T09:38:50.611267+0000","last_undegraded":"2023-10-14T09:38:50.611267+0000","last_fullsized":"2023-10-14T09:38:50.611267+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2023-10-14T09:38:50.611077+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2023-10-14T09:38:50.611077+0000","last_clean_scrub_stamp":"2023-10-14T09:38:50.611077+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:06:00.879346+0000","scrub_duration":0.0046609240000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:02.766644+0000","last_change":"2023-10-14T09:39:02.766721+0000","last_active":"2023-10-14T09:39:02.766644+0000","last_peered":"2023-10-14T09:39:02.766644+0000","last_clean":"2023-10-14T09:39:02.766644+0000","last_became_active":"2023-10-14T09:38:31.026414+0000","last_became_peered":"2023-10-14T09:38:31.026414+0000","last_unstale":"2023-10-14T09:39:02.766644+0000","last_undegraded":"2023-10-14T09:39:02.766644+0000","last_fullsized":"2023-10-14T09:39:02.766644+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:02.766528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:02.766528+0000","last_clean_scrub_stamp":"2023-10-14T09:39:02.766528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:29:45.420889+0000","scrub_duration":0.003473659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"35'1","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:49.679590+0000","last_change":"2023-10-14T09:38:49.679696+0000","last_active":"2023-10-14T09:38:49.679590+0000","last_peered":"2023-10-14T09:38:49.679590+0000","last_clean":"2023-10-14T09:38:49.679590+0000","last_became_active":"2023-10-14T09:38:30.024910+0000","last_became_peered":"2023-10-14T09:38:30.024910+0000","last_unstale":"2023-10-14T09:38:49.679590+0000","last_undegraded":"2023-10-14T09:38:49.679590+0000","last_fullsized":"2023-10-14T09:38:49.679590+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'1","last_scrub_stamp":"2023-10-14T09:38:49.679411+0000","last_deep_scrub":"35'1","last_deep_scrub_stamp":"2023-10-14T09:38:49.679411+0000","last_clean_scrub_stamp":"2023-10-14T09:38:49.679411+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:15:55.728284+0000","scrub_duration":0.003799359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:33.461303+0000","last_change":"2023-10-14T09:39:33.461562+0000","last_active":"2023-10-14T09:39:33.461303+0000","last_peered":"2023-10-14T09:39:33.461303+0000","last_clean":"2023-10-14T09:39:33.461303+0000","last_became_active":"2023-10-14T09:38:31.029815+0000","last_became_peered":"2023-10-14T09:38:31.029815+0000","last_unstale":"2023-10-14T09:39:33.461303+0000","last_undegraded":"2023-10-14T09:39:33.461303+0000","last_fullsized":"2023-10-14T09:39:33.461303+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:33.461081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:33.461081+0000","last_clean_scrub_stamp":"2023-10-14T09:39:33.461081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:11:35.840092+0000","scrub_duration":0.0038462230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"36'3","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:03.074723+0000","last_change":"2023-10-14T09:39:03.074797+0000","last_active":"2023-10-14T09:39:03.074723+0000","last_peered":"2023-10-14T09:39:03.074723+0000","last_clean":"2023-10-14T09:39:03.074723+0000","last_became_active":"2023-10-14T09:38:30.017602+0000","last_became_peered":"2023-10-14T09:38:30.017602+0000","last_unstale":"2023-10-14T09:39:03.074723+0000","last_undegraded":"2023-10-14T09:39:03.074723+0000","last_fullsized":"2023-10-14T09:39:03.074723+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2023-10-14T09:39:03.074613+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2023-10-14T09:39:03.074613+0000","last_clean_scrub_stamp":"2023-10-14T09:39:03.074613+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:42:38.051760+0000","scrub_duration":0.0041427089999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:26.551416+0000","last_change":"2023-10-14T09:39:26.551551+0000","last_active":"2023-10-14T09:39:26.551416+0000","last_peered":"2023-10-14T09:39:26.551416+0000","last_clean":"2023-10-14T09:39:26.551416+0000","last_became_active":"2023-10-14T09:38:31.025645+0000","last_became_peered":"2023-10-14T09:38:31.025645+0000","last_unstale":"2023-10-14T09:39:26.551416+0000","last_undegraded":"2023-10-14T09:39:26.551416+0000","last_fullsized":"2023-10-14T09:39:26.551416+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:26.551018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:26.551018+0000","last_clean_scrub_stamp":"2023-10-14T09:39:26.551018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:05:26.352998+0000","scrub_duration":0.0041171640000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"35'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:46.533770+0000","last_change":"2023-10-14T09:38:46.533816+0000","last_active":"2023-10-14T09:38:46.533770+0000","last_peered":"2023-10-14T09:38:46.533770+0000","last_clean":"2023-10-14T09:38:46.533770+0000","last_became_active":"2023-10-14T09:38:30.030556+0000","last_became_peered":"2023-10-14T09:38:30.030556+0000","last_unstale":"2023-10-14T09:38:46.533770+0000","last_undegraded":"2023-10-14T09:38:46.533770+0000","last_fullsized":"2023-10-14T09:38:46.533770+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2023-10-14T09:38:46.533705+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2023-10-14T09:38:46.533705+0000","last_clean_scrub_stamp":"2023-10-14T09:38:46.533705+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:33:11.988817+0000","scrub_duration":0.0026943039999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:02.272352+0000","last_change":"2023-10-14T09:39:02.272488+0000","last_active":"2023-10-14T09:39:02.272352+0000","last_peered":"2023-10-14T09:39:02.272352+0000","last_clean":"2023-10-14T09:39:02.272352+0000","last_became_active":"2023-10-14T09:38:31.028887+0000","last_became_peered":"2023-10-14T09:38:31.028887+0000","last_unstale":"2023-10-14T09:39:02.272352+0000","last_undegraded":"2023-10-14T09:39:02.272352+0000","last_fullsized":"2023-10-14T09:39:02.272352+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:02.272167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:02.272167+0000","last_clean_scrub_stamp":"2023-10-14T09:39:02.272167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:46:37.273684+0000","scrub_duration":0.0035637300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"35'1","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:57.786144+0000","last_change":"2023-10-14T09:38:57.786255+0000","last_active":"2023-10-14T09:38:57.786144+0000","last_peered":"2023-10-14T09:38:57.786144+0000","last_clean":"2023-10-14T09:38:57.786144+0000","last_became_active":"2023-10-14T09:38:30.025732+0000","last_became_peered":"2023-10-14T09:38:30.025732+0000","last_unstale":"2023-10-14T09:38:57.786144+0000","last_undegraded":"2023-10-14T09:38:57.786144+0000","last_fullsized":"2023-10-14T09:38:57.786144+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'1","last_scrub_stamp":"2023-10-14T09:38:57.785957+0000","last_deep_scrub":"35'1","last_deep_scrub_stamp":"2023-10-14T09:38:57.785957+0000","last_clean_scrub_stamp":"2023-10-14T09:38:57.785957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:18:36.524694+0000","scrub_duration":0.003769901,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:58.078771+0000","last_change":"2023-10-14T09:38:58.078887+0000","last_active":"2023-10-14T09:38:58.078771+0000","last_peered":"2023-10-14T09:38:58.078771+0000","last_clean":"2023-10-14T09:38:58.078771+0000","last_became_active":"2023-10-14T09:38:31.020184+0000","last_became_peered":"2023-10-14T09:38:31.020184+0000","last_unstale":"2023-10-14T09:38:58.078771+0000","last_undegraded":"2023-10-14T09:38:58.078771+0000","last_fullsized":"2023-10-14T09:38:58.078771+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:58.078588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:58.078588+0000","last_clean_scrub_stamp":"2023-10-14T09:38:58.078588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:19:22.355681+0000","scrub_duration":0.0039430919999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"35'1","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:02.624254+0000","last_change":"2023-10-14T09:39:02.624369+0000","last_active":"2023-10-14T09:39:02.624254+0000","last_peered":"2023-10-14T09:39:02.624254+0000","last_clean":"2023-10-14T09:39:02.624254+0000","last_became_active":"2023-10-14T09:38:30.031356+0000","last_became_peered":"2023-10-14T09:38:30.031356+0000","last_unstale":"2023-10-14T09:39:02.624254+0000","last_undegraded":"2023-10-14T09:39:02.624254+0000","last_fullsized":"2023-10-14T09:39:02.624254+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'1","last_scrub_stamp":"2023-10-14T09:39:02.624081+0000","last_deep_scrub":"35'1","last_deep_scrub_stamp":"2023-10-14T09:39:02.624081+0000","last_clean_scrub_stamp":"2023-10-14T09:39:02.624081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:56:17.115836+0000","scrub_duration":0.003185327,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:09.500306+0000","last_change":"2023-10-14T09:39:09.500416+0000","last_active":"2023-10-14T09:39:09.500306+0000","last_peered":"2023-10-14T09:39:09.500306+0000","last_clean":"2023-10-14T09:39:09.500306+0000","last_became_active":"2023-10-14T09:38:31.023990+0000","last_became_peered":"2023-10-14T09:38:31.023990+0000","last_unstale":"2023-10-14T09:39:09.500306+0000","last_undegraded":"2023-10-14T09:39:09.500306+0000","last_fullsized":"2023-10-14T09:39:09.500306+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:09.500130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:09.500130+0000","last_clean_scrub_stamp":"2023-10-14T09:39:09.500130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:10:28.900926+0000","scrub_duration":0.0035241199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:58.127909+0000","last_change":"2023-10-14T09:38:58.128101+0000","last_active":"2023-10-14T09:38:58.127909+0000","last_peered":"2023-10-14T09:38:58.127909+0000","last_clean":"2023-10-14T09:38:58.127909+0000","last_became_active":"2023-10-14T09:38:30.019461+0000","last_became_peered":"2023-10-14T09:38:30.019461+0000","last_unstale":"2023-10-14T09:38:58.127909+0000","last_undegraded":"2023-10-14T09:38:58.127909+0000","last_fullsized":"2023-10-14T09:38:58.127909+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:58.127652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:58.127652+0000","last_clean_scrub_stamp":"2023-10-14T09:38:58.127652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:12.463977+0000","scrub_duration":0.003828265,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:15.373931+0000","last_change":"2023-10-14T09:39:15.374074+0000","last_active":"2023-10-14T09:39:15.373931+0000","last_peered":"2023-10-14T09:39:15.373931+0000","last_clean":"2023-10-14T09:39:15.373931+0000","last_became_active":"2023-10-14T09:38:31.016514+0000","last_became_peered":"2023-10-14T09:38:31.016514+0000","last_unstale":"2023-10-14T09:39:15.373931+0000","last_undegraded":"2023-10-14T09:39:15.373931+0000","last_fullsized":"2023-10-14T09:39:15.373931+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:15.373751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:15.373751+0000","last_clean_scrub_stamp":"2023-10-14T09:39:15.373751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:17:11.945476+0000","scrub_duration":0.0038224510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:01.637044+0000","last_change":"2023-10-14T09:39:01.637150+0000","last_active":"2023-10-14T09:39:01.637044+0000","last_peered":"2023-10-14T09:39:01.637044+0000","last_clean":"2023-10-14T09:39:01.637044+0000","last_became_active":"2023-10-14T09:38:30.035470+0000","last_became_peered":"2023-10-14T09:38:30.035470+0000","last_unstale":"2023-10-14T09:39:01.637044+0000","last_undegraded":"2023-10-14T09:39:01.637044+0000","last_fullsized":"2023-10-14T09:39:01.637044+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:01.636840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:01.636840+0000","last_clean_scrub_stamp":"2023-10-14T09:39:01.636840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:24:23.494315+0000","scrub_duration":0.003674194,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:19.936421+0000","last_change":"2023-10-14T09:39:19.936552+0000","last_active":"2023-10-14T09:39:19.936421+0000","last_peered":"2023-10-14T09:39:19.936421+0000","last_clean":"2023-10-14T09:39:19.936421+0000","last_became_active":"2023-10-14T09:38:31.025794+0000","last_became_peered":"2023-10-14T09:38:31.025794+0000","last_unstale":"2023-10-14T09:39:19.936421+0000","last_undegraded":"2023-10-14T09:39:19.936421+0000","last_fullsized":"2023-10-14T09:39:19.936421+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:19.936193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:19.936193+0000","last_clean_scrub_stamp":"2023-10-14T09:39:19.936193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:23:18.021187+0000","scrub_duration":0.0035786260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:59.100371+0000","last_change":"2023-10-14T09:38:59.100482+0000","last_active":"2023-10-14T09:38:59.100371+0000","last_peered":"2023-10-14T09:38:59.100371+0000","last_clean":"2023-10-14T09:38:59.100371+0000","last_became_active":"2023-10-14T09:38:30.014042+0000","last_became_peered":"2023-10-14T09:38:30.014042+0000","last_unstale":"2023-10-14T09:38:59.100371+0000","last_undegraded":"2023-10-14T09:38:59.100371+0000","last_fullsized":"2023-10-14T09:38:59.100371+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:59.100189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:59.100189+0000","last_clean_scrub_stamp":"2023-10-14T09:38:59.100189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:03:57.444366+0000","scrub_duration":0.0039772050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:10.061296+0000","last_change":"2023-10-14T09:39:10.061334+0000","last_active":"2023-10-14T09:39:10.061296+0000","last_peered":"2023-10-14T09:39:10.061296+0000","last_clean":"2023-10-14T09:39:10.061296+0000","last_became_active":"2023-10-14T09:38:31.021662+0000","last_became_peered":"2023-10-14T09:38:31.021662+0000","last_unstale":"2023-10-14T09:39:10.061296+0000","last_undegraded":"2023-10-14T09:39:10.061296+0000","last_fullsized":"2023-10-14T09:39:10.061296+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:10.061229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:10.061229+0000","last_clean_scrub_stamp":"2023-10-14T09:39:10.061229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:52:22.258631+0000","scrub_duration":0.0018017630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:48.679147+0000","last_change":"2023-10-14T09:38:48.679274+0000","last_active":"2023-10-14T09:38:48.679147+0000","last_peered":"2023-10-14T09:38:48.679147+0000","last_clean":"2023-10-14T09:38:48.679147+0000","last_became_active":"2023-10-14T09:38:30.027696+0000","last_became_peered":"2023-10-14T09:38:30.027696+0000","last_unstale":"2023-10-14T09:38:48.679147+0000","last_undegraded":"2023-10-14T09:38:48.679147+0000","last_fullsized":"2023-10-14T09:38:48.679147+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:48.678929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:48.678929+0000","last_clean_scrub_stamp":"2023-10-14T09:38:48.678929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:06:16.707833+0000","scrub_duration":0.003213816,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:48.148306+0000","last_change":"2023-10-14T09:38:48.148375+0000","last_active":"2023-10-14T09:38:48.148306+0000","last_peered":"2023-10-14T09:38:48.148306+0000","last_clean":"2023-10-14T09:38:48.148306+0000","last_became_active":"2023-10-14T09:38:31.026676+0000","last_became_peered":"2023-10-14T09:38:31.026676+0000","last_unstale":"2023-10-14T09:38:48.148306+0000","last_undegraded":"2023-10-14T09:38:48.148306+0000","last_fullsized":"2023-10-14T09:38:48.148306+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:48.148221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:48.148221+0000","last_clean_scrub_stamp":"2023-10-14T09:38:48.148221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:01:40.381456+0000","scrub_duration":0.0028294069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"35'3","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:55.075403+0000","last_change":"2023-10-14T09:38:55.075551+0000","last_active":"2023-10-14T09:38:55.075403+0000","last_peered":"2023-10-14T09:38:55.075403+0000","last_clean":"2023-10-14T09:38:55.075403+0000","last_became_active":"2023-10-14T09:38:30.031907+0000","last_became_peered":"2023-10-14T09:38:30.031907+0000","last_unstale":"2023-10-14T09:38:55.075403+0000","last_undegraded":"2023-10-14T09:38:55.075403+0000","last_fullsized":"2023-10-14T09:38:55.075403+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2023-10-14T09:38:55.075222+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2023-10-14T09:38:55.075222+0000","last_clean_scrub_stamp":"2023-10-14T09:38:55.075222+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:49:52.115938+0000","scrub_duration":0.005129242,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:21.891228+0000","last_change":"2023-10-14T09:39:21.891334+0000","last_active":"2023-10-14T09:39:21.891228+0000","last_peered":"2023-10-14T09:39:21.891228+0000","last_clean":"2023-10-14T09:39:21.891228+0000","last_became_active":"2023-10-14T09:38:31.020267+0000","last_became_peered":"2023-10-14T09:38:31.020267+0000","last_unstale":"2023-10-14T09:39:21.891228+0000","last_undegraded":"2023-10-14T09:39:21.891228+0000","last_fullsized":"2023-10-14T09:39:21.891228+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:21.891034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:21.891034+0000","last_clean_scrub_stamp":"2023-10-14T09:39:21.891034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:58:53.811510+0000","scrub_duration":0.003696473,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"35'6","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:54.196331+0000","last_change":"2023-10-14T09:38:54.196449+0000","last_active":"2023-10-14T09:38:54.196331+0000","last_peered":"2023-10-14T09:38:54.196331+0000","last_clean":"2023-10-14T09:38:54.196331+0000","last_became_active":"2023-10-14T09:38:30.019839+0000","last_became_peered":"2023-10-14T09:38:30.019839+0000","last_unstale":"2023-10-14T09:38:54.196331+0000","last_undegraded":"2023-10-14T09:38:54.196331+0000","last_fullsized":"2023-10-14T09:38:54.196331+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2023-10-14T09:38:54.196133+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2023-10-14T09:38:54.196133+0000","last_clean_scrub_stamp":"2023-10-14T09:38:54.196133+0000","objects_scrubbed":4,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:12:19.956146+0000","scrub_duration":0.0055956779999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:21.482692+0000","last_change":"2023-10-14T09:39:21.482797+0000","last_active":"2023-10-14T09:39:21.482692+0000","last_peered":"2023-10-14T09:39:21.482692+0000","last_clean":"2023-10-14T09:39:21.482692+0000","last_became_active":"2023-10-14T09:38:31.020347+0000","last_became_peered":"2023-10-14T09:38:31.020347+0000","last_unstale":"2023-10-14T09:39:21.482692+0000","last_undegraded":"2023-10-14T09:39:21.482692+0000","last_fullsized":"2023-10-14T09:39:21.482692+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:21.482512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:21.482512+0000","last_clean_scrub_stamp":"2023-10-14T09:39:21.482512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:12:47.242524+0000","scrub_duration":0.0039880540000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"35'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:47.937746+0000","last_change":"2023-10-14T09:38:47.937954+0000","last_active":"2023-10-14T09:38:47.937746+0000","last_peered":"2023-10-14T09:38:47.937746+0000","last_clean":"2023-10-14T09:38:47.937746+0000","last_became_active":"2023-10-14T09:38:30.035424+0000","last_became_peered":"2023-10-14T09:38:30.035424+0000","last_unstale":"2023-10-14T09:38:47.937746+0000","last_undegraded":"2023-10-14T09:38:47.937746+0000","last_fullsized":"2023-10-14T09:38:47.937746+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2023-10-14T09:38:47.937565+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2023-10-14T09:38:47.937565+0000","last_clean_scrub_stamp":"2023-10-14T09:38:47.937565+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:56:13.779499+0000","scrub_duration":0.0048754560000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:14.976207+0000","last_change":"2023-10-14T09:39:14.976328+0000","last_active":"2023-10-14T09:39:14.976207+0000","last_peered":"2023-10-14T09:39:14.976207+0000","last_clean":"2023-10-14T09:39:14.976207+0000","last_became_active":"2023-10-14T09:38:31.027759+0000","last_became_peered":"2023-10-14T09:38:31.027759+0000","last_unstale":"2023-10-14T09:39:14.976207+0000","last_undegraded":"2023-10-14T09:39:14.976207+0000","last_fullsized":"2023-10-14T09:39:14.976207+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:14.975998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:14.975998+0000","last_clean_scrub_stamp":"2023-10-14T09:39:14.975998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:15:19.406655+0000","scrub_duration":0.0033840070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:57.334723+0000","last_change":"2023-10-14T09:38:57.334855+0000","last_active":"2023-10-14T09:38:57.334723+0000","last_peered":"2023-10-14T09:38:57.334723+0000","last_clean":"2023-10-14T09:38:57.334723+0000","last_became_active":"2023-10-14T09:38:30.025712+0000","last_became_peered":"2023-10-14T09:38:30.025712+0000","last_unstale":"2023-10-14T09:38:57.334723+0000","last_undegraded":"2023-10-14T09:38:57.334723+0000","last_fullsized":"2023-10-14T09:38:57.334723+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:57.334543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:57.334543+0000","last_clean_scrub_stamp":"2023-10-14T09:38:57.334543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:07:30.093467+0000","scrub_duration":0.0039162900000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:56.234815+0000","last_change":"2023-10-14T09:38:56.234942+0000","last_active":"2023-10-14T09:38:56.234815+0000","last_peered":"2023-10-14T09:38:56.234815+0000","last_clean":"2023-10-14T09:38:56.234815+0000","last_became_active":"2023-10-14T09:38:31.036628+0000","last_became_peered":"2023-10-14T09:38:31.036628+0000","last_unstale":"2023-10-14T09:38:56.234815+0000","last_undegraded":"2023-10-14T09:38:56.234815+0000","last_fullsized":"2023-10-14T09:38:56.234815+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:56.234625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:56.234625+0000","last_clean_scrub_stamp":"2023-10-14T09:38:56.234625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:58:59.569769+0000","scrub_duration":0.0035426099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:06.093421+0000","last_change":"2023-10-14T09:39:06.093539+0000","last_active":"2023-10-14T09:39:06.093421+0000","last_peered":"2023-10-14T09:39:06.093421+0000","last_clean":"2023-10-14T09:39:06.093421+0000","last_became_active":"2023-10-14T09:38:30.022182+0000","last_became_peered":"2023-10-14T09:38:30.022182+0000","last_unstale":"2023-10-14T09:39:06.093421+0000","last_undegraded":"2023-10-14T09:39:06.093421+0000","last_fullsized":"2023-10-14T09:39:06.093421+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:06.093233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:06.093233+0000","last_clean_scrub_stamp":"2023-10-14T09:39:06.093233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:50:35.550528+0000","scrub_duration":0.0039928780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:54.645085+0000","last_change":"2023-10-14T09:38:54.645278+0000","last_active":"2023-10-14T09:38:54.645085+0000","last_peered":"2023-10-14T09:38:54.645085+0000","last_clean":"2023-10-14T09:38:54.645085+0000","last_became_active":"2023-10-14T09:38:31.039518+0000","last_became_peered":"2023-10-14T09:38:31.039518+0000","last_unstale":"2023-10-14T09:38:54.645085+0000","last_undegraded":"2023-10-14T09:38:54.645085+0000","last_fullsized":"2023-10-14T09:38:54.645085+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:54.644882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:54.644882+0000","last_clean_scrub_stamp":"2023-10-14T09:38:54.644882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:49:46.705606+0000","scrub_duration":0.003904659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"35'8","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:52.142490+0000","last_change":"2023-10-14T09:38:52.142608+0000","last_active":"2023-10-14T09:38:52.142490+0000","last_peered":"2023-10-14T09:38:52.142490+0000","last_clean":"2023-10-14T09:38:52.142490+0000","last_became_active":"2023-10-14T09:38:30.014562+0000","last_became_peered":"2023-10-14T09:38:30.014562+0000","last_unstale":"2023-10-14T09:38:52.142490+0000","last_undegraded":"2023-10-14T09:38:52.142490+0000","last_fullsized":"2023-10-14T09:38:52.142490+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2023-10-14T09:38:52.142259+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2023-10-14T09:38:52.142259+0000","last_clean_scrub_stamp":"2023-10-14T09:38:52.142259+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:46:42.382320+0000","scrub_duration":0.0052490749999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:20.548887+0000","last_change":"2023-10-14T09:39:20.548996+0000","last_active":"2023-10-14T09:39:20.548887+0000","last_peered":"2023-10-14T09:39:20.548887+0000","last_clean":"2023-10-14T09:39:20.548887+0000","last_became_active":"2023-10-14T09:38:31.025665+0000","last_became_peered":"2023-10-14T09:38:31.025665+0000","last_unstale":"2023-10-14T09:39:20.548887+0000","last_undegraded":"2023-10-14T09:39:20.548887+0000","last_fullsized":"2023-10-14T09:39:20.548887+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:20.548692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:20.548692+0000","last_clean_scrub_stamp":"2023-10-14T09:39:20.548692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:05:20.350671+0000","scrub_duration":0.0035872819999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"35'1","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:55.318266+0000","last_change":"2023-10-14T09:38:55.318388+0000","last_active":"2023-10-14T09:38:55.318266+0000","last_peered":"2023-10-14T09:38:55.318266+0000","last_clean":"2023-10-14T09:38:55.318266+0000","last_became_active":"2023-10-14T09:38:30.025331+0000","last_became_peered":"2023-10-14T09:38:30.025331+0000","last_unstale":"2023-10-14T09:38:55.318266+0000","last_undegraded":"2023-10-14T09:38:55.318266+0000","last_fullsized":"2023-10-14T09:38:55.318266+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'1","last_scrub_stamp":"2023-10-14T09:38:55.318087+0000","last_deep_scrub":"35'1","last_deep_scrub_stamp":"2023-10-14T09:38:55.318087+0000","last_clean_scrub_stamp":"2023-10-14T09:38:55.318087+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:39:45.038902+0000","scrub_duration":0.0045992630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:16.984048+0000","last_change":"2023-10-14T09:39:16.984152+0000","last_active":"2023-10-14T09:39:16.984048+0000","last_peered":"2023-10-14T09:39:16.984048+0000","last_clean":"2023-10-14T09:39:16.984048+0000","last_became_active":"2023-10-14T09:38:31.032912+0000","last_became_peered":"2023-10-14T09:38:31.032912+0000","last_unstale":"2023-10-14T09:39:16.984048+0000","last_undegraded":"2023-10-14T09:39:16.984048+0000","last_fullsized":"2023-10-14T09:39:16.984048+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:16.983861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:16.983861+0000","last_clean_scrub_stamp":"2023-10-14T09:39:16.983861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:08:39.914600+0000","scrub_duration":0.0037026099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"36'3","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:07.573188+0000","last_change":"2023-10-14T09:39:07.573313+0000","last_active":"2023-10-14T09:39:07.573188+0000","last_peered":"2023-10-14T09:39:07.573188+0000","last_clean":"2023-10-14T09:39:07.573188+0000","last_became_active":"2023-10-14T09:38:30.035283+0000","last_became_peered":"2023-10-14T09:38:30.035283+0000","last_unstale":"2023-10-14T09:39:07.573188+0000","last_undegraded":"2023-10-14T09:39:07.573188+0000","last_fullsized":"2023-10-14T09:39:07.573188+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2023-10-14T09:39:07.572971+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2023-10-14T09:39:07.572971+0000","last_clean_scrub_stamp":"2023-10-14T09:39:07.572971+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:17:04.144697+0000","scrub_duration":0.0077526660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:47.756501+0000","last_change":"2023-10-14T09:39:47.756697+0000","last_active":"2023-10-14T09:39:47.756501+0000","last_peered":"2023-10-14T09:39:47.756501+0000","last_clean":"2023-10-14T09:39:47.756501+0000","last_became_active":"2023-10-14T09:38:31.034768+0000","last_became_peered":"2023-10-14T09:38:31.034768+0000","last_unstale":"2023-10-14T09:39:47.756501+0000","last_undegraded":"2023-10-14T09:39:47.756501+0000","last_fullsized":"2023-10-14T09:39:47.756501+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:47.756292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:47.756292+0000","last_clean_scrub_stamp":"2023-10-14T09:39:47.756292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:31:13.935253+0000","scrub_duration":0.0042186159999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"35'1","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:00.677692+0000","last_change":"2023-10-14T09:39:00.677818+0000","last_active":"2023-10-14T09:39:00.677692+0000","last_peered":"2023-10-14T09:39:00.677692+0000","last_clean":"2023-10-14T09:39:00.677692+0000","last_became_active":"2023-10-14T09:38:30.030927+0000","last_became_peered":"2023-10-14T09:38:30.030927+0000","last_unstale":"2023-10-14T09:39:00.677692+0000","last_undegraded":"2023-10-14T09:39:00.677692+0000","last_fullsized":"2023-10-14T09:39:00.677692+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'1","last_scrub_stamp":"2023-10-14T09:39:00.677510+0000","last_deep_scrub":"35'1","last_deep_scrub_stamp":"2023-10-14T09:39:00.677510+0000","last_clean_scrub_stamp":"2023-10-14T09:39:00.677510+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:55:27.879986+0000","scrub_duration":0.0052586550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:52.540354+0000","last_change":"2023-10-14T09:38:52.540470+0000","last_active":"2023-10-14T09:38:52.540354+0000","last_peered":"2023-10-14T09:38:52.540354+0000","last_clean":"2023-10-14T09:38:52.540354+0000","last_became_active":"2023-10-14T09:38:31.026615+0000","last_became_peered":"2023-10-14T09:38:31.026615+0000","last_unstale":"2023-10-14T09:38:52.540354+0000","last_undegraded":"2023-10-14T09:38:52.540354+0000","last_fullsized":"2023-10-14T09:38:52.540354+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:52.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:52.540176+0000","last_clean_scrub_stamp":"2023-10-14T09:38:52.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:24:06.115731+0000","scrub_duration":0.0037872090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:55.712392+0000","last_change":"2023-10-14T09:38:55.712533+0000","last_active":"2023-10-14T09:38:55.712392+0000","last_peered":"2023-10-14T09:38:55.712392+0000","last_clean":"2023-10-14T09:38:55.712392+0000","last_became_active":"2023-10-14T09:38:30.026795+0000","last_became_peered":"2023-10-14T09:38:30.026795+0000","last_unstale":"2023-10-14T09:38:55.712392+0000","last_undegraded":"2023-10-14T09:38:55.712392+0000","last_fullsized":"2023-10-14T09:38:55.712392+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:55.712204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:55.712204+0000","last_clean_scrub_stamp":"2023-10-14T09:38:55.712204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:41:54.034096+0000","scrub_duration":0.003589709,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:47.540406+0000","last_change":"2023-10-14T09:38:47.540516+0000","last_active":"2023-10-14T09:38:47.540406+0000","last_peered":"2023-10-14T09:38:47.540406+0000","last_clean":"2023-10-14T09:38:47.540406+0000","last_became_active":"2023-10-14T09:38:31.031921+0000","last_became_peered":"2023-10-14T09:38:31.031921+0000","last_unstale":"2023-10-14T09:38:47.540406+0000","last_undegraded":"2023-10-14T09:38:47.540406+0000","last_fullsized":"2023-10-14T09:38:47.540406+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:47.540230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:47.540230+0000","last_clean_scrub_stamp":"2023-10-14T09:38:47.540230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:37:25.465061+0000","scrub_duration":0.003744247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"35'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:46.628250+0000","last_change":"2023-10-14T09:38:46.628305+0000","last_active":"2023-10-14T09:38:46.628250+0000","last_peered":"2023-10-14T09:38:46.628250+0000","last_clean":"2023-10-14T09:38:46.628250+0000","last_became_active":"2023-10-14T09:38:30.021312+0000","last_became_peered":"2023-10-14T09:38:30.021312+0000","last_unstale":"2023-10-14T09:38:46.628250+0000","last_undegraded":"2023-10-14T09:38:46.628250+0000","last_fullsized":"2023-10-14T09:38:46.628250+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2023-10-14T09:38:46.628156+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2023-10-14T09:38:46.628156+0000","last_clean_scrub_stamp":"2023-10-14T09:38:46.628156+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:52:45.439890+0000","scrub_duration":0.002195682,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:12.720238+0000","last_change":"2023-10-14T09:39:12.720412+0000","last_active":"2023-10-14T09:39:12.720238+0000","last_peered":"2023-10-14T09:39:12.720238+0000","last_clean":"2023-10-14T09:39:12.720238+0000","last_became_active":"2023-10-14T09:38:31.023340+0000","last_became_peered":"2023-10-14T09:38:31.023340+0000","last_unstale":"2023-10-14T09:39:12.720238+0000","last_undegraded":"2023-10-14T09:39:12.720238+0000","last_fullsized":"2023-10-14T09:39:12.720238+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:12.720066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:12.720066+0000","last_clean_scrub_stamp":"2023-10-14T09:39:12.720066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:07:45.478990+0000","scrub_duration":0.0038580799999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:48.556599+0000","last_change":"2023-10-14T09:38:48.556714+0000","last_active":"2023-10-14T09:38:48.556599+0000","last_peered":"2023-10-14T09:38:48.556599+0000","last_clean":"2023-10-14T09:38:48.556599+0000","last_became_active":"2023-10-14T09:38:30.033284+0000","last_became_peered":"2023-10-14T09:38:30.033284+0000","last_unstale":"2023-10-14T09:38:48.556599+0000","last_undegraded":"2023-10-14T09:38:48.556599+0000","last_fullsized":"2023-10-14T09:38:48.556599+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:48.556379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:48.556379+0000","last_clean_scrub_stamp":"2023-10-14T09:38:48.556379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:24:02.131934+0000","scrub_duration":0.0035783490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:06.806152+0000","last_change":"2023-10-14T09:39:06.806269+0000","last_active":"2023-10-14T09:39:06.806152+0000","last_peered":"2023-10-14T09:39:06.806152+0000","last_clean":"2023-10-14T09:39:06.806152+0000","last_became_active":"2023-10-14T09:38:31.019732+0000","last_became_peered":"2023-10-14T09:38:31.019732+0000","last_unstale":"2023-10-14T09:39:06.806152+0000","last_undegraded":"2023-10-14T09:39:06.806152+0000","last_fullsized":"2023-10-14T09:39:06.806152+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:06.805907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:06.805907+0000","last_clean_scrub_stamp":"2023-10-14T09:39:06.805907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:49:58.866632+0000","scrub_duration":0.003479851,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:56.739921+0000","last_change":"2023-10-14T09:38:56.740115+0000","last_active":"2023-10-14T09:38:56.739921+0000","last_peered":"2023-10-14T09:38:56.739921+0000","last_clean":"2023-10-14T09:38:56.739921+0000","last_became_active":"2023-10-14T09:38:30.032500+0000","last_became_peered":"2023-10-14T09:38:30.032500+0000","last_unstale":"2023-10-14T09:38:56.739921+0000","last_undegraded":"2023-10-14T09:38:56.739921+0000","last_fullsized":"2023-10-14T09:38:56.739921+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:56.739717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:56.739717+0000","last_clean_scrub_stamp":"2023-10-14T09:38:56.739717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:55.093910+0000","scrub_duration":0.0038890359999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:08.304521+0000","last_change":"2023-10-14T09:39:08.304726+0000","last_active":"2023-10-14T09:39:08.304521+0000","last_peered":"2023-10-14T09:39:08.304521+0000","last_clean":"2023-10-14T09:39:08.304521+0000","last_became_active":"2023-10-14T09:38:31.030399+0000","last_became_peered":"2023-10-14T09:38:31.030399+0000","last_unstale":"2023-10-14T09:39:08.304521+0000","last_undegraded":"2023-10-14T09:39:08.304521+0000","last_fullsized":"2023-10-14T09:39:08.304521+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:08.304284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:08.304284+0000","last_clean_scrub_stamp":"2023-10-14T09:39:08.304284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:42:43.281430+0000","scrub_duration":0.0035198899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:51.044759+0000","last_change":"2023-10-14T09:38:51.044863+0000","last_active":"2023-10-14T09:38:51.044759+0000","last_peered":"2023-10-14T09:38:51.044759+0000","last_clean":"2023-10-14T09:38:51.044759+0000","last_became_active":"2023-10-14T09:38:30.028540+0000","last_became_peered":"2023-10-14T09:38:30.028540+0000","last_unstale":"2023-10-14T09:38:51.044759+0000","last_undegraded":"2023-10-14T09:38:51.044759+0000","last_fullsized":"2023-10-14T09:38:51.044759+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:51.044578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:51.044578+0000","last_clean_scrub_stamp":"2023-10-14T09:38:51.044578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:49:06.337666+0000","scrub_duration":0.0033480110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:50.515103+0000","last_change":"2023-10-14T09:38:50.515213+0000","last_active":"2023-10-14T09:38:50.515103+0000","last_peered":"2023-10-14T09:38:50.515103+0000","last_clean":"2023-10-14T09:38:50.515103+0000","last_became_active":"2023-10-14T09:38:31.015654+0000","last_became_peered":"2023-10-14T09:38:31.015654+0000","last_unstale":"2023-10-14T09:38:50.515103+0000","last_undegraded":"2023-10-14T09:38:50.515103+0000","last_fullsized":"2023-10-14T09:38:50.515103+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:50.514814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:50.514814+0000","last_clean_scrub_stamp":"2023-10-14T09:38:50.514814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:04:26.034786+0000","scrub_duration":0.0037886759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"36'3","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:10.422177+0000","last_change":"2023-10-14T09:39:10.422290+0000","last_active":"2023-10-14T09:39:10.422177+0000","last_peered":"2023-10-14T09:39:10.422177+0000","last_clean":"2023-10-14T09:39:10.422177+0000","last_became_active":"2023-10-14T09:38:30.030387+0000","last_became_peered":"2023-10-14T09:38:30.030387+0000","last_unstale":"2023-10-14T09:39:10.422177+0000","last_undegraded":"2023-10-14T09:39:10.422177+0000","last_fullsized":"2023-10-14T09:39:10.422177+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2023-10-14T09:39:10.421983+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2023-10-14T09:39:10.421983+0000","last_clean_scrub_stamp":"2023-10-14T09:39:10.421983+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:24:25.959633+0000","scrub_duration":0.0079599300000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:11.134990+0000","last_change":"2023-10-14T09:39:11.135101+0000","last_active":"2023-10-14T09:39:11.134990+0000","last_peered":"2023-10-14T09:39:11.134990+0000","last_clean":"2023-10-14T09:39:11.134990+0000","last_became_active":"2023-10-14T09:38:31.023043+0000","last_became_peered":"2023-10-14T09:38:31.023043+0000","last_unstale":"2023-10-14T09:39:11.134990+0000","last_undegraded":"2023-10-14T09:39:11.134990+0000","last_fullsized":"2023-10-14T09:39:11.134990+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:11.134794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:11.134794+0000","last_clean_scrub_stamp":"2023-10-14T09:39:11.134794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:59:36.203576+0000","scrub_duration":0.0036520319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"36'1","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:47.634220+0000","last_change":"2023-10-14T09:38:47.634416+0000","last_active":"2023-10-14T09:38:47.634220+0000","last_peered":"2023-10-14T09:38:47.634220+0000","last_clean":"2023-10-14T09:38:47.634220+0000","last_became_active":"2023-10-14T09:38:30.024536+0000","last_became_peered":"2023-10-14T09:38:30.024536+0000","last_unstale":"2023-10-14T09:38:47.634220+0000","last_undegraded":"2023-10-14T09:38:47.634220+0000","last_fullsized":"2023-10-14T09:38:47.634220+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'1","last_scrub_stamp":"2023-10-14T09:38:47.633984+0000","last_deep_scrub":"36'1","last_deep_scrub_stamp":"2023-10-14T09:38:47.633984+0000","last_clean_scrub_stamp":"2023-10-14T09:38:47.633984+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:40:54.811008+0000","scrub_duration":0.0036899749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:54.649440+0000","last_change":"2023-10-14T09:38:54.649556+0000","last_active":"2023-10-14T09:38:54.649440+0000","last_peered":"2023-10-14T09:38:54.649440+0000","last_clean":"2023-10-14T09:38:54.649440+0000","last_became_active":"2023-10-14T09:38:31.023855+0000","last_became_peered":"2023-10-14T09:38:31.023855+0000","last_unstale":"2023-10-14T09:38:54.649440+0000","last_undegraded":"2023-10-14T09:38:54.649440+0000","last_fullsized":"2023-10-14T09:38:54.649440+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:54.649211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:54.649211+0000","last_clean_scrub_stamp":"2023-10-14T09:38:54.649211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:49:09.942300+0000","scrub_duration":0.0033030020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:14.415816+0000","last_change":"2023-10-14T09:39:14.415928+0000","last_active":"2023-10-14T09:39:14.415816+0000","last_peered":"2023-10-14T09:39:14.415816+0000","last_clean":"2023-10-14T09:39:14.415816+0000","last_became_active":"2023-10-14T09:38:30.023068+0000","last_became_peered":"2023-10-14T09:38:30.023068+0000","last_unstale":"2023-10-14T09:39:14.415816+0000","last_undegraded":"2023-10-14T09:39:14.415816+0000","last_fullsized":"2023-10-14T09:39:14.415816+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:14.415607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:14.415607+0000","last_clean_scrub_stamp":"2023-10-14T09:39:14.415607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:06.648843+0000","scrub_duration":0.0037813790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:59.729037+0000","last_change":"2023-10-14T09:38:59.729149+0000","last_active":"2023-10-14T09:38:59.729037+0000","last_peered":"2023-10-14T09:38:59.729037+0000","last_clean":"2023-10-14T09:38:59.729037+0000","last_became_active":"2023-10-14T09:38:31.026838+0000","last_became_peered":"2023-10-14T09:38:31.026838+0000","last_unstale":"2023-10-14T09:38:59.729037+0000","last_undegraded":"2023-10-14T09:38:59.729037+0000","last_fullsized":"2023-10-14T09:38:59.729037+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:59.728756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:59.728756+0000","last_clean_scrub_stamp":"2023-10-14T09:38:59.728756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:58.082949+0000","scrub_duration":0.00366154,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:45.578809+0000","last_change":"2023-10-14T09:38:45.578897+0000","last_active":"2023-10-14T09:38:45.578809+0000","last_peered":"2023-10-14T09:38:45.578809+0000","last_clean":"2023-10-14T09:38:45.578809+0000","last_became_active":"2023-10-14T09:38:30.029514+0000","last_became_peered":"2023-10-14T09:38:30.029514+0000","last_unstale":"2023-10-14T09:38:45.578809+0000","last_undegraded":"2023-10-14T09:38:45.578809+0000","last_fullsized":"2023-10-14T09:38:45.578809+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:45.578708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:45.578708+0000","last_clean_scrub_stamp":"2023-10-14T09:38:45.578708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:31:14.776956+0000","scrub_duration":0.0027720409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:00.622885+0000","last_change":"2023-10-14T09:39:00.623104+0000","last_active":"2023-10-14T09:39:00.622885+0000","last_peered":"2023-10-14T09:39:00.622885+0000","last_clean":"2023-10-14T09:39:00.622885+0000","last_became_active":"2023-10-14T09:38:31.029521+0000","last_became_peered":"2023-10-14T09:38:31.029521+0000","last_unstale":"2023-10-14T09:39:00.622885+0000","last_undegraded":"2023-10-14T09:39:00.622885+0000","last_fullsized":"2023-10-14T09:39:00.622885+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:00.622681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:00.622681+0000","last_clean_scrub_stamp":"2023-10-14T09:39:00.622681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:38:23.973228+0000","scrub_duration":0.0040747789999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:51.250186+0000","last_change":"2023-10-14T09:38:51.250374+0000","last_active":"2023-10-14T09:38:51.250186+0000","last_peered":"2023-10-14T09:38:51.250186+0000","last_clean":"2023-10-14T09:38:51.250186+0000","last_became_active":"2023-10-14T09:38:30.029517+0000","last_became_peered":"2023-10-14T09:38:30.029517+0000","last_unstale":"2023-10-14T09:38:51.250186+0000","last_undegraded":"2023-10-14T09:38:51.250186+0000","last_fullsized":"2023-10-14T09:38:51.250186+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:51.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:51.249926+0000","last_clean_scrub_stamp":"2023-10-14T09:38:51.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:49:43.310651+0000","scrub_duration":0.0038699889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:15.982619+0000","last_change":"2023-10-14T09:39:15.982729+0000","last_active":"2023-10-14T09:39:15.982619+0000","last_peered":"2023-10-14T09:39:15.982619+0000","last_clean":"2023-10-14T09:39:15.982619+0000","last_became_active":"2023-10-14T09:38:31.034300+0000","last_became_peered":"2023-10-14T09:38:31.034300+0000","last_unstale":"2023-10-14T09:39:15.982619+0000","last_undegraded":"2023-10-14T09:39:15.982619+0000","last_fullsized":"2023-10-14T09:39:15.982619+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:15.982433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:15.982433+0000","last_clean_scrub_stamp":"2023-10-14T09:39:15.982433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:45.273592+0000","scrub_duration":0.0035287259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:46.967921+0000","last_change":"2023-10-14T09:38:46.968047+0000","last_active":"2023-10-14T09:38:46.967921+0000","last_peered":"2023-10-14T09:38:46.967921+0000","last_clean":"2023-10-14T09:38:46.967921+0000","last_became_active":"2023-10-14T09:38:30.030374+0000","last_became_peered":"2023-10-14T09:38:30.030374+0000","last_unstale":"2023-10-14T09:38:46.967921+0000","last_undegraded":"2023-10-14T09:38:46.967921+0000","last_fullsized":"2023-10-14T09:38:46.967921+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:46.967740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:46.967740+0000","last_clean_scrub_stamp":"2023-10-14T09:38:46.967740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:02:37.918672+0000","scrub_duration":0.0037853489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:39:35.514126+0000","last_change":"2023-10-14T09:39:35.514248+0000","last_active":"2023-10-14T09:39:35.514126+0000","last_peered":"2023-10-14T09:39:35.514126+0000","last_clean":"2023-10-14T09:39:35.514126+0000","last_became_active":"2023-10-14T09:38:31.032648+0000","last_became_peered":"2023-10-14T09:38:31.032648+0000","last_unstale":"2023-10-14T09:39:35.514126+0000","last_undegraded":"2023-10-14T09:39:35.514126+0000","last_fullsized":"2023-10-14T09:39:35.514126+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:39:35.513939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:39:35.513939+0000","last_clean_scrub_stamp":"2023-10-14T09:39:35.513939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:07:32.173710+0000","scrub_duration":0.0036366580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:56.184606+0000","last_change":"2023-10-14T09:38:56.184716+0000","last_active":"2023-10-14T09:38:56.184606+0000","last_peered":"2023-10-14T09:38:56.184606+0000","last_clean":"2023-10-14T09:38:56.184606+0000","last_became_active":"2023-10-14T09:38:30.020321+0000","last_became_peered":"2023-10-14T09:38:30.020321+0000","last_unstale":"2023-10-14T09:38:56.184606+0000","last_undegraded":"2023-10-14T09:38:56.184606+0000","last_fullsized":"2023-10-14T09:38:56.184606+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:56.184416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:56.184416+0000","last_clean_scrub_stamp":"2023-10-14T09:38:56.184416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:59:55.799339+0000","scrub_duration":0.003775956,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:51.208601+0000","last_change":"2023-10-14T09:38:51.208788+0000","last_active":"2023-10-14T09:38:51.208601+0000","last_peered":"2023-10-14T09:38:51.208601+0000","last_clean":"2023-10-14T09:38:51.208601+0000","last_became_active":"2023-10-14T09:38:31.024478+0000","last_became_peered":"2023-10-14T09:38:31.024478+0000","last_unstale":"2023-10-14T09:38:51.208601+0000","last_undegraded":"2023-10-14T09:38:51.208601+0000","last_fullsized":"2023-10-14T09:38:51.208601+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:51.208358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:51.208358+0000","last_clean_scrub_stamp":"2023-10-14T09:38:51.208358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:55:18.410834+0000","scrub_duration":0.0035993549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:49.587807+0000","last_change":"2023-10-14T09:38:49.587913+0000","last_active":"2023-10-14T09:38:49.587807+0000","last_peered":"2023-10-14T09:38:49.587807+0000","last_clean":"2023-10-14T09:38:49.587807+0000","last_became_active":"2023-10-14T09:38:30.033358+0000","last_became_peered":"2023-10-14T09:38:30.033358+0000","last_unstale":"2023-10-14T09:38:49.587807+0000","last_undegraded":"2023-10-14T09:38:49.587807+0000","last_fullsized":"2023-10-14T09:38:49.587807+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:38:49.587584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:38:49.587584+0000","last_clean_scrub_stamp":"2023-10-14T09:38:49.587584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:54.741961+0000","scrub_duration":0.0034985849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"36'119","reported_seq":189,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T09:38:50.256743+0000","last_change":"2023-10-14T09:38:50.256743+0000","last_active":"2023-10-14T09:38:50.256743+0000","last_peered":"2023-10-14T09:38:50.256743+0000","last_clean":"2023-10-14T09:38:50.256743+0000","last_became_active":"2023-10-14T09:37:12.364623+0000","last_became_peered":"2023-10-14T09:37:12.364623+0000","last_unstale":"2023-10-14T09:38:50.256743+0000","last_undegraded":"2023-10-14T09:38:50.256743+0000","last_fullsized":"2023-10-14T09:38:50.256743+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'119","last_scrub_stamp":"2023-10-14T09:38:50.256394+0000","last_deep_scrub":"36'119","last_deep_scrub_stamp":"2023-10-14T09:38:50.256394+0000","last_clean_scrub_stamp":"2023-10-14T09:38:50.256394+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:31:14.101164+0000","scrub_duration":0.014946450999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509477,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":999424,"data_stored":748946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":0.97099999999999997,"15min":0.95099999999999996},"min":{"1min":0.755,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.569,"5min":1.623,"15min":1.623},"last":1.004},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.034,"15min":1.0149999999999999},"min":{"1min":0.78100000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.61599999999999999}]},{"osd":1,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.103,"15min":1.093},"min":{"1min":0.88900000000000001,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.21,"15min":1.1919999999999999},"min":{"1min":1.054,"5min":0.748,"15min":0.748},"max":{"1min":1.5740000000000001,"5min":1.79,"15min":1.79},"last":0.73399999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.137,"15min":1.1220000000000001},"min":{"1min":0.83999999999999997,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.391,"5min":1.2889999999999999,"15min":1.272},"min":{"1min":1.093,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.6950000000000001,"5min":1.841,"15min":1.841},"last":0.84299999999999997}]},{"osd":3,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.1639999999999999,"15min":1.1519999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.468,"5min":2.468,"15min":2.468},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.3400000000000001,"15min":1.329},"min":{"1min":0.95799999999999996,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.2530000000000001,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":0.76300000000000001}]},{"osd":4,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":1.3120000000000001,"15min":1.282},"min":{"1min":0.80300000000000005,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.7589999999999999,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":0.871},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.387,"15min":1.3759999999999999},"min":{"1min":0.82899999999999996,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.95999999999999996}]},{"osd":5,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.444,"15min":1.4470000000000001},"min":{"1min":0.83099999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.897,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.5589999999999999,"5min":1.4350000000000001,"15min":1.4139999999999999},"min":{"1min":1.071,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.52,"5min":2.52,"15min":2.52},"last":0.81499999999999995}]},{"osd":6,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.6950000000000001,"5min":1.5529999999999999,"15min":1.5289999999999999},"min":{"1min":1.103,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.1739999999999999,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.5740000000000001,"5min":1.482,"15min":1.4670000000000001},"min":{"1min":0.90000000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.3490000000000002,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.66800000000000004}]}]},{"osd":6,"up_from":15,"seq":64424509479,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":409600,"data_stored":159104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.98899999999999999,"15min":0.98099999999999998},"min":{"1min":0.753,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1839999999999999,"15min":1.1890000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.6060000000000001,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.117}]},{"osd":1,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.087,"15min":1.099},"min":{"1min":0.72299999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2450000000000001,"5min":2.069,"15min":2.069},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.224,"5min":1.1850000000000001,"15min":1.179},"min":{"1min":0.66100000000000003,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.8109999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.365}]},{"osd":2,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.2569999999999999,"15min":1.2609999999999999},"min":{"1min":0.79000000000000004,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.9119999999999999,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.486},{"interface":"front","average":{"1min":1.24,"5min":1.2310000000000001,"15min":1.2290000000000001},"min":{"1min":0.86299999999999999,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.7070000000000001,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.0109999999999999}]},{"osd":3,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3580000000000001,"15min":1.365},"min":{"1min":0.88400000000000001,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.8560000000000001,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":1.397},{"interface":"front","average":{"1min":1.159,"5min":1.3260000000000001,"15min":1.3540000000000001},"min":{"1min":0.61399999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.448,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":1.2629999999999999}]},{"osd":4,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.3680000000000001,"15min":1.3879999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.5449999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.216},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.4139999999999999,"15min":1.4279999999999999},"min":{"1min":0.92500000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.6930000000000001,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":0.85099999999999998}]},{"osd":5,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.4570000000000001,"15min":1.48},"min":{"1min":0.89200000000000002,"5min":0.755,"15min":0.755},"max":{"1min":1.6080000000000001,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.605,"15min":1.619},"min":{"1min":1.093,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.0190000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":1.5580000000000001}]},{"osd":7,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.5369999999999999,"5min":1.5289999999999999,"15min":1.5269999999999999},"min":{"1min":1.1100000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.081,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.302},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.5049999999999999,"15min":1.514},"min":{"1min":1.141,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.919,"5min":2.5899999999999999,"15min":2.5899999999999999},"last":1.329}]}]},{"osd":4,"up_from":15,"seq":64424509479,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":409600,"data_stored":158592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.502,"15min":1.581},"min":{"1min":0.67600000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.375,"5min":13.404,"15min":13.404},"last":1.403},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.4570000000000001,"15min":1.524},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.6160000000000001,"5min":9.4640000000000004,"15min":9.4640000000000004},"last":0.91100000000000003}]},{"osd":1,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.4430000000000001,"15min":1.4810000000000001},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.6519999999999999,"5min":6.734,"15min":6.734},"last":1.103},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.4339999999999999,"15min":1.48},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.6890000000000001,"5min":7.8860000000000001,"15min":7.8860000000000001},"last":1.371}]},{"osd":2,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.528,"15min":1.5700000000000001},"min":{"1min":0.90800000000000003,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.637,"5min":7.8520000000000003,"15min":7.8520000000000003},"last":1.319},{"interface":"front","average":{"1min":1.3,"5min":1.7709999999999999,"15min":1.849},"min":{"1min":0.93700000000000006,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.577,"5min":14.609,"15min":14.609},"last":1.4650000000000001}]},{"osd":3,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.8340000000000001,"15min":1.9199999999999999},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.587,"5min":15.856,"15min":15.856},"last":1.262},{"interface":"front","average":{"1min":1.161,"5min":1.4530000000000001,"15min":1.5009999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.7829999999999999,"5min":6.1970000000000001,"15min":6.1970000000000001},"last":0.97999999999999998}]},{"osd":5,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.9810000000000001,"15min":2.101},"min":{"1min":0.89100000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.7589999999999999,"5min":16.547000000000001,"15min":16.547000000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.95,"15min":2.056},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.643,"5min":15.913,"15min":15.913},"last":1.143}]},{"osd":6,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":2.101,"15min":2.2349999999999999},"min":{"1min":0.98099999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.7829999999999999,"5min":16.481999999999999,"15min":16.481999999999999},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.454,"5min":2.0830000000000002,"15min":2.1880000000000002},"min":{"1min":0.94799999999999995,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":1.7010000000000001,"5min":15.956,"15min":15.956},"last":1.044}]},{"osd":7,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.7210000000000001,"15min":1.788},"min":{"1min":0.68799999999999994,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.889,"5min":6.6520000000000001,"15min":6.6520000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.95,"15min":2.032},"min":{"1min":1.0880000000000001,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":1.8720000000000001,"5min":10.314,"15min":10.314},"last":1.425}]}]},{"osd":3,"up_from":15,"seq":64424509478,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":417792,"data_stored":160122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.79600000000000004,"15min":0.80300000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3069999999999999,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.86399999999999999,"15min":0.85699999999999998},"min":{"1min":0.497,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.419,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.216}]},{"osd":1,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.93000000000000005,"15min":0.94399999999999995},"min":{"1min":0.47799999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.3149999999999999,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.92500000000000004,"15min":0.92100000000000004},"min":{"1min":0.54000000000000004,"5min":0.504,"15min":0.504},"max":{"1min":1.3440000000000001,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":0.86499999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.105,"15min":1.087},"min":{"1min":0.61799999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.5840000000000001,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.264,"5min":1.2150000000000001,"15min":1.2070000000000001},"min":{"1min":0.66600000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.571,"5min":2.77,"15min":2.77},"last":1.357}]},{"osd":4,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.202,"15min":1.2090000000000001},"min":{"1min":0.872,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.5369999999999999,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3260000000000001,"15min":1.3240000000000001},"min":{"1min":1.0620000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.734,"5min":2.153,"15min":2.153},"last":1.3999999999999999}]},{"osd":5,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.3260000000000001,"15min":1.3360000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.5820000000000001,"5min":3.6469999999999998,"15min":3.6469999999999998},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.224,"5min":1.171,"15min":1.1619999999999999},"min":{"1min":0.83899999999999997,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.8100000000000001,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.4610000000000001}]},{"osd":6,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3580000000000001,"15min":1.3620000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.988,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.29},{"interface":"front","average":{"1min":1.343,"5min":1.4099999999999999,"15min":1.421},"min":{"1min":1.0980000000000001,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.5369999999999999,"5min":3.6930000000000001,"15min":3.6930000000000001},"last":1.2649999999999999}]},{"osd":7,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3089999999999999,"15min":1.3049999999999999},"min":{"1min":0.95199999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.897,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.4590000000000001,"15min":1.4770000000000001},"min":{"1min":0.79000000000000004,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.845,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.601}]}]},{"osd":2,"up_from":15,"seq":64424509479,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":405504,"data_stored":158558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.86299999999999999,"15min":0.88300000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.194,"5min":2.7789999999999999,"15min":2.7789999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.81699999999999995,"15min":0.81399999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.4550000000000001,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.228}]},{"osd":1,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.365,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.91300000000000003,"15min":0.92300000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.3420000000000001,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":1.131}]},{"osd":3,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.6899999999999999,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0589999999999999,"15min":1.0629999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.5449999999999999,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":1.034}]},{"osd":4,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.294,"15min":1.306},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.6479999999999999,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.2130000000000001,"15min":1.2330000000000001},"min":{"1min":0.91200000000000003,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.5129999999999999,"5min":3.1469999999999998,"15min":3.1469999999999998},"last":0.96599999999999997}]},{"osd":5,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.3759999999999999,"15min":1.4019999999999999},"min":{"1min":0.78200000000000003,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":2.0009999999999999,"5min":4.0800000000000001,"15min":4.0800000000000001},"last":1.512},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.3360000000000001,"15min":1.3520000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.734,"5min":3.6709999999999998,"15min":3.6709999999999998},"last":1.4810000000000001}]},{"osd":6,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.246,"15min":1.2709999999999999},"min":{"1min":0.79600000000000004,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.4410000000000001,"5min":2.9249999999999998,"15min":2.9249999999999998},"last":1.27},{"interface":"front","average":{"1min":1.319,"5min":1.3879999999999999,"15min":1.3999999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.891,"5min":3.081,"15min":3.081},"last":1.365}]},{"osd":7,"last update":"Sat Oct 14 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.6619999999999999,"15min":1.7090000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":2.0939999999999999,"5min":5.0650000000000004,"15min":5.0650000000000004},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.476,"15min":1.5029999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.8220000000000001,"5min":3.8849999999999998,"15min":3.8849999999999998},"last":1.421}]}]},{"osd":1,"up_from":15,"seq":64424509479,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":417792,"data_stored":160122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.82799999999999996,"15min":0.81699999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.85499999999999998,"15min":0.83099999999999996},"min":{"1min":0.51900000000000002,"5min":0.378,"15min":0.378},"max":{"1min":1.476,"5min":1.72,"15min":1.72},"last":1.248}]},{"osd":2,"last update":"Sat Oct 14 09:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.96799999999999997,"15min":0.97999999999999998},"min":{"1min":0.42099999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.4490000000000001,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.1890000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84999999999999998,"15min":0.85199999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.585,"5min":1.601,"15min":1.601},"last":0.81999999999999995}]},{"osd":3,"last update":"Sat Oct 14 09:39:13 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.0700000000000001,"15min":1.0800000000000001},"min":{"1min":0.47099999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.5469999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.2809999999999999},{"interface":"front","average":{"1min":0.875,"5min":0.98599999999999999,"15min":1.004},"min":{"1min":0.47599999999999998,"5min":0.441,"15min":0.441},"max":{"1min":1.383,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.0209999999999999}]},{"osd":4,"last update":"Sat Oct 14 09:39:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.296,"15min":1.3100000000000001},"min":{"1min":0.73299999999999998,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.6200000000000001,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":1.087},{"interface":"front","average":{"1min":1.123,"5min":1.1879999999999999,"15min":1.1990000000000001},"min":{"1min":0.754,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.663,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.6000000000000001}]},{"osd":5,"last update":"Sat Oct 14 09:39:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.2310000000000001,"15min":1.2410000000000001},"min":{"1min":0.90100000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.4930000000000001,"5min":3.02,"15min":3.02},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.339,"15min":1.3460000000000001},"min":{"1min":0.80400000000000005,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.6919999999999999,"5min":3.827,"15min":3.827},"last":1.339}]},{"osd":6,"last update":"Sat Oct 14 09:39:13 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.258,"15min":1.2609999999999999},"min":{"1min":0.69899999999999995,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.698,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.3029999999999999,"15min":1.3149999999999999},"min":{"1min":0.73299999999999998,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.6060000000000001,"5min":3.3250000000000002,"15min":3.3250000000000002},"last":1.494}]},{"osd":7,"last update":"Sat Oct 14 09:39:13 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.4550000000000001,"15min":1.4690000000000001},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.9419999999999999,"5min":3.9100000000000001,"15min":3.9100000000000001},"last":1.393},{"interface":"front","average":{"1min":1.401,"5min":1.361,"15min":1.3540000000000001},"min":{"1min":0.93400000000000005,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.9970000000000001,"5min":3.105,"15min":3.105},"last":1.423}]}]},{"osd":5,"up_from":14,"seq":60129542183,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":409600,"data_stored":159160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.98799999999999999,"15min":0.99099999999999999},"min":{"1min":0.59599999999999997,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5820000000000001,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.0149999999999999,"15min":0.997},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":1.2789999999999999}]},{"osd":1,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.117,"15min":1.1120000000000001},"min":{"1min":0.73499999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.512,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.048,"5min":1.0600000000000001,"15min":1.0620000000000001},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.651,"5min":1.756,"15min":1.756},"last":1.339}]},{"osd":2,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.3129999999999999,"15min":1.355},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.458,"5min":4.4610000000000003,"15min":4.4610000000000003},"last":1.085},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.304,"15min":1.3240000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.6439999999999999,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.97099999999999997}]},{"osd":3,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.2410000000000001,"15min":1.2549999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.6439999999999999,"5min":1.712,"15min":1.712},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.2909999999999999,"15min":1.3089999999999999},"min":{"1min":0.79800000000000004,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.52,"5min":1.998,"15min":1.998},"last":1.26}]},{"osd":4,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.4119999999999999,"15min":1.425},"min":{"1min":0.79800000000000004,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.601,"5min":2.169,"15min":2.169},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.409,"5min":1.484,"15min":1.496},"min":{"1min":1.0349999999999999,"5min":0.88,"15min":0.88},"max":{"1min":1.6240000000000001,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.381}]},{"osd":6,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.377,"15min":1.3839999999999999},"min":{"1min":1.1040000000000001,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.7470000000000001,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.161},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.518,"15min":1.53},"min":{"1min":1.167,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":1.6990000000000001,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":1.3089999999999999}]},{"osd":7,"last update":"Sat Oct 14 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.5349999999999999,"15min":1.5509999999999999},"min":{"1min":1.145,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.679,"5min":2.387,"15min":2.387},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.48,"5min":1.55,"15min":1.5620000000000001},"min":{"1min":1.143,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.1859999999999999,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.4630000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542183,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":995328,"data_stored":748856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.86099999999999999,"15min":0.88200000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.3759999999999999,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.95799999999999996,"15min":0.96799999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3939999999999999,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.83099999999999996}]},{"osd":2,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.0009999999999999,"15min":1.0029999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.7470000000000001,"5min":2.133,"15min":2.133},"last":1.5149999999999999},{"interface":"front","average":{"1min":0.878,"5min":0.94999999999999996,"15min":0.96199999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.653,"5min":4.2210000000000001,"15min":4.2210000000000001},"last":0.78500000000000003}]},{"osd":3,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":1.0029999999999999,"15min":1.03},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.2749999999999999,"5min":3.6070000000000002,"15min":3.6070000000000002},"last":1.593},{"interface":"front","average":{"1min":1.071,"5min":1.133,"15min":1.143},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.665,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.204}]},{"osd":4,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.373,"15min":1.411},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.601,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.2809999999999999,"15min":1.3029999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.738,"5min":2.391,"15min":2.391},"last":1.2929999999999999}]},{"osd":5,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.375,"15min":1.387},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.6799999999999999,"5min":3.8620000000000001,"15min":3.8620000000000001},"last":1.7450000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.3620000000000001,"15min":1.377},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.641,"5min":2.4220000000000002,"15min":2.4220000000000002},"last":1.7030000000000001}]},{"osd":6,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.4610000000000001,"15min":1.4830000000000001},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.75,"5min":3.8210000000000002,"15min":3.8210000000000002},"last":1.6399999999999999},{"interface":"front","average":{"1min":1.341,"5min":1.494,"15min":1.52},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.8340000000000001,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":1.4670000000000001}]},{"osd":7,"last update":"Sat Oct 14 09:39:15 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.5389999999999999,"15min":1.5669999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.8859999999999999,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":1.6759999999999999},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.4059999999999999,"15min":1.4199999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.8049999999999999,"5min":2.355,"15min":2.355},"last":1.7909999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T09:40:11.592 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-14T09:40:11.839 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.837+0000 7f712262e640 1 Processor -- start 2023-10-14T09:40:11.840 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.838+0000 7f712262e640 1 -- start start 2023-10-14T09:40:11.842 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.839+0000 7f712262e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f711c06d220 0x7f711c0c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:40:11.842 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.839+0000 7f712262e640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f711c065ab0 0x7f711c0cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:40:11.843 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.839+0000 7f712262e640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f711c06d600 0x7f711c0ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:40:11.843 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.839+0000 7f712262e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f711c0acd70 con 0x7f711c06d220 2023-10-14T09:40:11.843 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.839+0000 7f712262e640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f711c0ac4a0 con 0x7f711c06d600 2023-10-14T09:40:11.843 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.839+0000 7f712262e640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711c065f40 con 0x7f711c065ab0 2023-10-14T09:40:11.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.840+0000 7f712162c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f711c06d220 0x7f711c0c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:40:11.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.840+0000 7f712162c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f711c06d220 0x7f711c0c95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:42290/0 (socket says 172.21.15.102:42290) 2023-10-14T09:40:11.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.840+0000 7f712162c640 1 -- 172.21.15.102:0/1090999261 learned_addr learned my addr 172.21.15.102:0/1090999261 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:40:11.845 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.840+0000 7f7120e2b640 1 --2- 172.21.15.102:0/1090999261 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f711c065ab0 0x7f711c0cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:40:11.845 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.840+0000 7f712162c640 1 -- 172.21.15.102:0/1090999261 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f711c065ab0 msgr2=0x7f711c0cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:40:11.845 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.840+0000 7f712162c640 1 --2- 172.21.15.102:0/1090999261 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f711c065ab0 0x7f711c0cdb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:40:11.846 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.840+0000 7f712162c640 1 -- 172.21.15.102:0/1090999261 >> v2:172.21.15.129:3300/0 conn(0x7f711c06d600 msgr2=0x7f711c0ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:40:11.846 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.840+0000 7f7121e2d640 1 --2- 172.21.15.102:0/1090999261 >> v2:172.21.15.129:3300/0 conn(0x7f711c06d600 0x7f711c0ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:40:11.846 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.840+0000 7f712162c640 1 --2- 172.21.15.102:0/1090999261 >> v2:172.21.15.129:3300/0 conn(0x7f711c06d600 0x7f711c0ce0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:40:11.847 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.840+0000 7f712162c640 1 -- 172.21.15.102:0/1090999261 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711c0ac720 con 0x7f711c06d220 2023-10-14T09:40:11.847 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.840+0000 7f7121e2d640 1 --2- 172.21.15.102:0/1090999261 >> v2:172.21.15.129:3300/0 conn(0x7f711c06d600 0x7f711c0ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:40:11.850 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.841+0000 7f712162c640 1 --2- 172.21.15.102:0/1090999261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f711c06d220 0x7f711c0c95e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f711c0c9570 tx=0x7f711802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d806078389fe04 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:40:11.851 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.841+0000 7f7113fff640 1 -- 172.21.15.102:0/1090999261 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7118031870 con 0x7f711c06d220 2023-10-14T09:40:11.851 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.842+0000 7f7113fff640 1 -- 172.21.15.102:0/1090999261 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71180319d0 con 0x7f711c06d220 2023-10-14T09:40:11.851 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.842+0000 7f7113fff640 1 -- 172.21.15.102:0/1090999261 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7118031d60 con 0x7f711c06d220 2023-10-14T09:40:11.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.842+0000 7f712262e640 1 -- 172.21.15.102:0/1090999261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f711c06d220 msgr2=0x7f711c0c95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:40:11.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.842+0000 7f712262e640 1 --2- 172.21.15.102:0/1090999261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f711c06d220 0x7f711c0c95e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f711c0c9570 tx=0x7f711802b910 comp rx=0 tx=0).stop 2023-10-14T09:40:11.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.842+0000 7f712262e640 1 -- 172.21.15.102:0/1090999261 shutdown_connections 2023-10-14T09:40:11.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.842+0000 7f712262e640 1 --2- 172.21.15.102:0/1090999261 >> v2:172.21.15.129:3300/0 conn(0x7f711c06d600 0x7f711c0ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:40:11.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.842+0000 7f712262e640 1 --2- 172.21.15.102:0/1090999261 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f711c065ab0 0x7f711c0cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:40:11.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.842+0000 7f712262e640 1 --2- 172.21.15.102:0/1090999261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f711c06d220 0x7f711c0c95e0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:40:11.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.842+0000 7f712262e640 1 -- 172.21.15.102:0/1090999261 >> 172.21.15.102:0/1090999261 conn(0x7f711c0b0a80 msgr2=0x7f711c0b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:40:11.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.842+0000 7f712262e640 1 -- 172.21.15.102:0/1090999261 shutdown_connections 2023-10-14T09:40:11.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.842+0000 7f712262e640 1 -- 172.21.15.102:0/1090999261 wait complete. 2023-10-14T09:40:11.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.845+0000 7f712262e640 1 Processor -- start 2023-10-14T09:40:11.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.845+0000 7f712262e640 1 -- start start 2023-10-14T09:40:11.855 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.846+0000 7f712262e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f711c06d220 0x7f711c099c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:40:11.855 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.846+0000 7f712262e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f711c06d600 0x7f711c0c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:40:11.855 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.846+0000 7f712262e640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f711c0c8640 0x7f711c150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:40:11.856 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.846+0000 7f712262e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c09a820 con 0x7f711c06d600 2023-10-14T09:40:11.856 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.846+0000 7f712262e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c1f2230 con 0x7f711c06d220 2023-10-14T09:40:11.856 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.846+0000 7f712262e640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711c0c6bf0 con 0x7f711c0c8640 2023-10-14T09:40:11.856 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.846+0000 7f7120e2b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f711c06d600 0x7f711c0c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:40:11.857 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.846+0000 7f7120e2b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f711c06d600 0x7f711c0c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:42306/0 (socket says 172.21.15.102:42306) 2023-10-14T09:40:11.857 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.846+0000 7f7120e2b640 1 -- 172.21.15.102:0/3235791931 learned_addr learned my addr 172.21.15.102:0/3235791931 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:40:11.857 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.847+0000 7f712162c640 1 --2- 172.21.15.102:0/3235791931 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f711c06d220 0x7f711c099c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:40:11.857 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.847+0000 7f7121e2d640 1 --2- 172.21.15.102:0/3235791931 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f711c0c8640 0x7f711c150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:40:11.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.847+0000 7f7120e2b640 1 -- 172.21.15.102:0/3235791931 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f711c0c8640 msgr2=0x7f711c150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:40:11.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.847+0000 7f7120e2b640 1 --2- 172.21.15.102:0/3235791931 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f711c0c8640 0x7f711c150fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:40:11.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.847+0000 7f7120e2b640 1 -- 172.21.15.102:0/3235791931 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f711c06d220 msgr2=0x7f711c099c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:40:11.859 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.847+0000 7f7120e2b640 1 --2- 172.21.15.102:0/3235791931 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f711c06d220 0x7f711c099c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:40:11.859 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.847+0000 7f7120e2b640 1 -- 172.21.15.102:0/3235791931 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71180094d0 con 0x7f711c06d600 2023-10-14T09:40:11.859 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.847+0000 7f712162c640 1 --2- 172.21.15.102:0/3235791931 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f711c06d220 0x7f711c099c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:40:11.859 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.847+0000 7f7120e2b640 1 --2- 172.21.15.102:0/3235791931 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f711c06d600 0x7f711c0c8100 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f710c00c7f0 tx=0x7f710c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:40:11.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.847+0000 7f7111ffb640 1 -- 172.21.15.102:0/3235791931 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c004220 con 0x7f711c06d600 2023-10-14T09:40:11.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.847+0000 7f7111ffb640 1 -- 172.21.15.102:0/3235791931 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710c004380 con 0x7f711c06d600 2023-10-14T09:40:11.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.847+0000 7f7111ffb640 1 -- 172.21.15.102:0/3235791931 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c007840 con 0x7f711c06d600 2023-10-14T09:40:11.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.847+0000 7f712262e640 1 -- 172.21.15.102:0/3235791931 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f711c0c6ed0 con 0x7f711c06d600 2023-10-14T09:40:11.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.848+0000 7f712262e640 1 -- 172.21.15.102:0/3235791931 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f711c0c7490 con 0x7f711c06d600 2023-10-14T09:40:11.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.849+0000 7f712262e640 1 -- 172.21.15.102:0/3235791931 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f711c04e9b0 con 0x7f711c06d600 2023-10-14T09:40:11.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.850+0000 7f7111ffb640 1 -- 172.21.15.102:0/3235791931 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f710c007bb0 con 0x7f711c06d600 2023-10-14T09:40:11.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.850+0000 7f7111ffb640 1 --2- 172.21.15.102:0/3235791931 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f710006ae70 0x7f710006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:40:11.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.851+0000 7f7111ffb640 1 -- 172.21.15.102:0/3235791931 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f710c089620 con 0x7f711c06d600 2023-10-14T09:40:11.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.851+0000 7f712162c640 1 --2- 172.21.15.102:0/3235791931 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f710006ae70 0x7f710006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:40:11.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.852+0000 7f712162c640 1 --2- 172.21.15.102:0/3235791931 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f710006ae70 0x7f710006d330 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7118036000 tx=0x7f711803c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:40:11.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:11.855+0000 7f7111ffb640 1 -- 172.21.15.102:0/3235791931 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f710c054620 con 0x7f711c06d600 2023-10-14T09:40:12.052 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.051+0000 7f712262e640 1 -- 172.21.15.102:0/3235791931 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f711c0b4f10 con 0x7f711c06d600 2023-10-14T09:40:12.057 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.055+0000 7f7111ffb640 1 -- 172.21.15.102:0/3235791931 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v11)=0 v11) v1 ==== 123+0+0 (secure 0 0 0) 0x7f710c01e0c0 con 0x7f711c06d600 2023-10-14T09:40:12.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.056+0000 7f7111ffb640 1 -- 172.21.15.102:0/3235791931 <== mon.0 v2:172.21.15.102:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f710c00a3b0 con 0x7f711c06d600 2023-10-14T09:40:12.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.058+0000 7f712262e640 1 -- 172.21.15.102:0/3235791931 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f710006ae70 msgr2=0x7f710006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:40:12.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.058+0000 7f712262e640 1 --2- 172.21.15.102:0/3235791931 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f710006ae70 0x7f710006d330 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7118036000 tx=0x7f711803c040 comp rx=0 tx=0).stop 2023-10-14T09:40:12.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.058+0000 7f712262e640 1 -- 172.21.15.102:0/3235791931 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f711c06d600 msgr2=0x7f711c0c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:40:12.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.058+0000 7f712262e640 1 --2- 172.21.15.102:0/3235791931 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f711c06d600 0x7f711c0c8100 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f710c00c7f0 tx=0x7f710c00ccb0 comp rx=0 tx=0).stop 2023-10-14T09:40:12.062 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.059+0000 7f712262e640 1 -- 172.21.15.102:0/3235791931 shutdown_connections 2023-10-14T09:40:12.062 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.059+0000 7f712262e640 1 --2- 172.21.15.102:0/3235791931 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7f710006ae70 0x7f710006d330 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:40:12.062 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.059+0000 7f712262e640 1 --2- 172.21.15.102:0/3235791931 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f711c0c8640 0x7f711c150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:40:12.062 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.059+0000 7f712262e640 1 --2- 172.21.15.102:0/3235791931 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f711c06d600 0x7f711c0c8100 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:40:12.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.059+0000 7f712262e640 1 --2- 172.21.15.102:0/3235791931 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f711c06d220 0x7f711c099c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:40:12.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.059+0000 7f712262e640 1 -- 172.21.15.102:0/3235791931 >> 172.21.15.102:0/3235791931 conn(0x7f711c0b0a80 msgr2=0x7f711c070400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:40:12.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.059+0000 7f712262e640 1 -- 172.21.15.102:0/3235791931 shutdown_connections 2023-10-14T09:40:12.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.059+0000 7f712262e640 1 -- 172.21.15.102:0/3235791931 wait complete. 2023-10-14T09:40:12.079 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T09:40:12.079 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:40:12.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.285+0000 7faf78373640 1 Processor -- start 2023-10-14T09:40:12.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.285+0000 7faf78373640 1 -- start start 2023-10-14T09:40:12.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.287+0000 7faf78373640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7faf70159f00 0x7faf700b0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:40:12.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.287+0000 7faf78373640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7faf7015d880 0x7faf700b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:40:12.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.287+0000 7faf78373640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf7006f7f0 con 0x7faf70159b20 2023-10-14T09:40:12.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.287+0000 7faf78373640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf7006c5e0 con 0x7faf7015d880 2023-10-14T09:40:12.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.287+0000 7faf78373640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf7006c8c0 con 0x7faf70159f00 2023-10-14T09:40:12.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.287+0000 7faf76910640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7faf7015d880 0x7faf700b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:40:12.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.287+0000 7faf76910640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7faf7015d880 0x7faf700b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:58756/0 (socket says 172.21.15.102:58756) 2023-10-14T09:40:12.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.287+0000 7faf76910640 1 -- 172.21.15.102:0/3743602396 learned_addr learned my addr 172.21.15.102:0/3743602396 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:40:12.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.287+0000 7faf7610f640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7faf70159b20 0x7faf7006bbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:52350/0 (socket says 172.21.15.102:52350) 2023-10-14T09:40:12.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.287+0000 7faf7590e640 1 --2- 172.21.15.102:0/3743602396 >> v2:172.21.15.129:3300/0 conn(0x7faf70159f00 0x7faf700b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:40:12.293 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.288+0000 7faf76910640 1 -- 172.21.15.102:0/3743602396 >> v2:172.21.15.129:3300/0 conn(0x7faf70159f00 msgr2=0x7faf700b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:40:12.293 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.288+0000 7faf76910640 1 --2- 172.21.15.102:0/3743602396 >> v2:172.21.15.129:3300/0 conn(0x7faf70159f00 0x7faf700b0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:40:12.294 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.288+0000 7faf76910640 1 -- 172.21.15.102:0/3743602396 >> v1:172.21.15.102:6789/0 conn(0x7faf70159b20 legacy=0x7faf7006bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:40:12.294 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.288+0000 7faf76910640 1 -- 172.21.15.102:0/3743602396 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7006cba0 con 0x7faf7015d880 2023-10-14T09:40:12.294 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.288+0000 7faf7510d640 1 -- 172.21.15.102:0/3743602396 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1034577788 0 0) 0x7faf7006f7f0 con 0x7faf70159b20 2023-10-14T09:40:12.294 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.289+0000 7faf76910640 1 --2- 172.21.15.102:0/3743602396 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf7015d880 0x7faf700b0950 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7faf7015d770 tx=0x7faf6802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2445ce463746f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:40:12.295 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.289+0000 7faf7510d640 1 -- 172.21.15.102:0/3743602396 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6802cb20 con 0x7faf7015d880 2023-10-14T09:40:12.295 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.289+0000 7faf7510d640 1 -- 172.21.15.102:0/3743602396 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7faf6802cc80 con 0x7faf7015d880 2023-10-14T09:40:12.295 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.289+0000 7faf7510d640 1 -- 172.21.15.102:0/3743602396 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf680343f0 con 0x7faf7015d880 2023-10-14T09:40:12.296 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.290+0000 7faf78373640 1 -- 172.21.15.102:0/3743602396 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf7015d880 msgr2=0x7faf700b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:40:12.296 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.290+0000 7faf78373640 1 --2- 172.21.15.102:0/3743602396 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf7015d880 0x7faf700b0950 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7faf7015d770 tx=0x7faf6802bf80 comp rx=0 tx=0).stop 2023-10-14T09:40:12.296 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.290+0000 7faf78373640 1 -- 172.21.15.102:0/3743602396 shutdown_connections 2023-10-14T09:40:12.296 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.290+0000 7faf78373640 1 --2- 172.21.15.102:0/3743602396 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf7015d880 0x7faf700b0950 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:40:12.297 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.290+0000 7faf78373640 1 --2- 172.21.15.102:0/3743602396 >> v2:172.21.15.129:3300/0 conn(0x7faf70159f00 0x7faf700b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:40:12.297 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.290+0000 7faf78373640 1 -- 172.21.15.102:0/3743602396 >> 172.21.15.102:0/3743602396 conn(0x7faf700cb410 msgr2=0x7faf700cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:40:12.298 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.290+0000 7faf78373640 1 -- 172.21.15.102:0/3743602396 shutdown_connections 2023-10-14T09:40:12.298 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.290+0000 7faf78373640 1 -- 172.21.15.102:0/3743602396 wait complete. 2023-10-14T09:40:12.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.292+0000 7faf78373640 1 Processor -- start 2023-10-14T09:40:12.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.292+0000 7faf78373640 1 -- start start 2023-10-14T09:40:12.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.293+0000 7faf78373640 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7faf70159b20 0x7faf701590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:40:12.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.293+0000 7faf78373640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf70159f00 0x7faf7015cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:40:12.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.293+0000 7faf78373640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faf7015d880 0x7faf7015ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:40:12.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.293+0000 7faf78373640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7015b260 con 0x7faf70159f00 2023-10-14T09:40:12.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.293+0000 7faf78373640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7015bee0 con 0x7faf7015d880 2023-10-14T09:40:12.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.293+0000 7faf78373640 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf7015c1c0 con 0x7faf70159b20 2023-10-14T09:40:12.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.293+0000 7faf7590e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf70159f00 0x7faf7015cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:40:12.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.293+0000 7faf7590e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf70159f00 0x7faf7015cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:58764/0 (socket says 172.21.15.102:58764) 2023-10-14T09:40:12.304 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.293+0000 7faf7590e640 1 -- 172.21.15.102:0/570368525 learned_addr learned my addr 172.21.15.102:0/570368525 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-10-14T09:40:12.304 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.294+0000 7faf7610f640 1 --2- 172.21.15.102:0/570368525 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7faf70159b20 0x7faf701590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:40:12.304 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.294+0000 7faf76910640 1 --2- 172.21.15.102:0/570368525 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faf7015d880 0x7faf7015ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:40:12.304 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.294+0000 7faf7590e640 1 -- 172.21.15.102:0/570368525 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7faf70159b20 msgr2=0x7faf701590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:40:12.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.294+0000 7faf7590e640 1 --2- 172.21.15.102:0/570368525 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7faf70159b20 0x7faf701590b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:40:12.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.294+0000 7faf7590e640 1 -- 172.21.15.102:0/570368525 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faf7015d880 msgr2=0x7faf7015ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:40:12.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.294+0000 7faf7590e640 1 --2- 172.21.15.102:0/570368525 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faf7015d880 0x7faf7015ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:40:12.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.294+0000 7faf7590e640 1 -- 172.21.15.102:0/570368525 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf68009b30 con 0x7faf70159f00 2023-10-14T09:40:12.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.294+0000 7faf7610f640 1 --2- 172.21.15.102:0/570368525 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7faf70159b20 0x7faf701590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:40:12.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.294+0000 7faf7590e640 1 --2- 172.21.15.102:0/570368525 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf70159f00 0x7faf7015cca0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7faf6000d7d0 tx=0x7faf6000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:40:12.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.294+0000 7faf66ffd640 1 -- 172.21.15.102:0/570368525 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6000b6c0 con 0x7faf70159f00 2023-10-14T09:40:12.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.294+0000 7faf66ffd640 1 -- 172.21.15.102:0/570368525 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7faf6000b840 con 0x7faf70159f00 2023-10-14T09:40:12.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.294+0000 7faf66ffd640 1 -- 172.21.15.102:0/570368525 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6000bc10 con 0x7faf70159f00 2023-10-14T09:40:12.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.294+0000 7faf78373640 1 -- 172.21.15.102:0/570368525 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf7015c4a0 con 0x7faf70159f00 2023-10-14T09:40:12.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.294+0000 7faf78373640 1 -- 172.21.15.102:0/570368525 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf7014bf00 con 0x7faf70159f00 2023-10-14T09:40:12.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.295+0000 7faf78373640 1 -- 172.21.15.102:0/570368525 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf7004e160 con 0x7faf70159f00 2023-10-14T09:40:12.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.296+0000 7faf66ffd640 1 -- 172.21.15.102:0/570368525 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7faf6001e460 con 0x7faf70159f00 2023-10-14T09:40:12.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.297+0000 7faf66ffd640 1 --2- 172.21.15.102:0/570368525 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7faf5406ae70 0x7faf5406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:40:12.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.297+0000 7faf66ffd640 1 -- 172.21.15.102:0/570368525 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5729+0+0 (secure 0 0 0) 0x7faf60089d20 con 0x7faf70159f00 2023-10-14T09:40:12.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.298+0000 7faf7610f640 1 --2- 172.21.15.102:0/570368525 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7faf5406ae70 0x7faf5406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:40:12.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.298+0000 7faf7610f640 1 --2- 172.21.15.102:0/570368525 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7faf5406ae70 0x7faf5406d330 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7faf6c000f60 tx=0x7faf6c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:40:12.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.302+0000 7faf66ffd640 1 -- 172.21.15.102:0/570368525 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faf60054c80 con 0x7faf70159f00 2023-10-14T09:40:12.530 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.528+0000 7faf78373640 1 -- 172.21.15.102:0/570368525 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf700b10b0 con 0x7faf70159f00 2023-10-14T09:40:12.531 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.529+0000 7faf66ffd640 1 -- 172.21.15.102:0/570368525 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4930 (secure 0 0 0) 0x7faf600582a0 con 0x7faf70159f00 2023-10-14T09:40:12.531 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-10-14T09:40:12.532 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4690,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6834/2498306399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":2498306399},{"type":"v1","addr":"172.21.15.129:6834","nonce":2498306399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5112,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1229082928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1229082928},{"type":"v1","addr":"172.21.15.102:6835","nonce":1229082928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5115,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2934809937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2934809937},{"type":"v1","addr":"172.21.15.102:6837","nonce":2934809937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T09:38:30.451239+0000","modified":"2023-10-14T09:38:33.483456+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5130":{"gid":5130,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.129:6835/4209319148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6833","nonce":4209319148},{"type":"v1","addr":"172.21.15.129:6835","nonce":4209319148}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T09:40:12.532 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 15 2023-10-14T09:40:12.534 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.532+0000 7faf78373640 1 -- 172.21.15.102:0/570368525 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7faf5406ae70 msgr2=0x7faf5406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:40:12.534 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.532+0000 7faf78373640 1 --2- 172.21.15.102:0/570368525 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7faf5406ae70 0x7faf5406d330 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7faf6c000f60 tx=0x7faf6c009040 comp rx=0 tx=0).stop 2023-10-14T09:40:12.535 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.532+0000 7faf78373640 1 -- 172.21.15.102:0/570368525 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf70159f00 msgr2=0x7faf7015cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:40:12.535 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.532+0000 7faf78373640 1 --2- 172.21.15.102:0/570368525 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf70159f00 0x7faf7015cca0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7faf6000d7d0 tx=0x7faf6000dc90 comp rx=0 tx=0).stop 2023-10-14T09:40:12.535 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.532+0000 7faf78373640 1 -- 172.21.15.102:0/570368525 shutdown_connections 2023-10-14T09:40:12.535 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.532+0000 7faf78373640 1 --2- 172.21.15.102:0/570368525 >> [v2:172.21.15.102:6832/1125265706,v1:172.21.15.102:6833/1125265706] conn(0x7faf5406ae70 0x7faf5406d330 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:40:12.536 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.532+0000 7faf78373640 1 --2- 172.21.15.102:0/570368525 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faf7015d880 0x7faf7015ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:40:12.536 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.532+0000 7faf78373640 1 --2- 172.21.15.102:0/570368525 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf70159f00 0x7faf7015cca0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:40:12.536 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.532+0000 7faf78373640 1 --2- 172.21.15.102:0/570368525 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7faf70159b20 0x7faf701590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:40:12.537 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.532+0000 7faf78373640 1 -- 172.21.15.102:0/570368525 >> 172.21.15.102:0/570368525 conn(0x7faf700cb410 msgr2=0x7faf700cd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:40:12.537 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.532+0000 7faf78373640 1 -- 172.21.15.102:0/570368525 shutdown_connections 2023-10-14T09:40:12.537 INFO:teuthology.orchestra.run.smithi102.stderr:2023-10-14T09:40:12.532+0000 7faf78373640 1 -- 172.21.15.102:0/570368525 wait complete. 2023-10-14T09:40:12.550 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-14T09:40:12.550 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-14T09:40:12.551 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T09:40:12.551 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:40:12.566 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T09:40:12.566 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T09:40:12.567 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:40:12.632 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T09:40:12.633 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T09:40:12.633 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:40:12.656 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T09:40:12.657 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T09:40:12.657 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:40:12.725 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T09:40:12.726 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-14T09:40:12.726 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-14T09:40:12.726 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:40:12.791 INFO:tasks.ceph.osd.0:Stopped 2023-10-14T09:40:12.791 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-14T09:40:12.792 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:40:12.850 INFO:tasks.ceph.osd.1:Stopped 2023-10-14T09:40:12.850 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-14T09:40:12.851 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:40:12.920 INFO:tasks.ceph.osd.2:Stopped 2023-10-14T09:40:12.921 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-14T09:40:12.921 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:40:12.993 INFO:tasks.ceph.osd.3:Stopped 2023-10-14T09:40:12.994 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-14T09:40:12.995 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:40:13.055 INFO:tasks.ceph.osd.4:Stopped 2023-10-14T09:40:13.056 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-14T09:40:13.057 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:40:13.135 INFO:tasks.ceph.osd.5:Stopped 2023-10-14T09:40:13.136 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-14T09:40:13.136 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:40:13.185 INFO:tasks.ceph.osd.6:Stopped 2023-10-14T09:40:13.186 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-14T09:40:13.186 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:40:13.241 INFO:tasks.ceph.osd.7:Stopped 2023-10-14T09:40:13.241 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-14T09:40:13.242 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-14T09:40:13.242 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:40:13.323 INFO:tasks.ceph.mgr.y:Stopped 2023-10-14T09:40:13.324 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-14T09:40:13.324 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:40:13.402 INFO:tasks.ceph.mgr.x:Stopped 2023-10-14T09:40:13.403 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-14T09:40:13.403 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-14T09:40:13.404 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:40:13.432 INFO:tasks.ceph.mon.a:Stopped 2023-10-14T09:40:13.433 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-14T09:40:13.433 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:40:13.474 INFO:tasks.ceph.mon.b:Stopped 2023-10-14T09:40:13.475 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-14T09:40:13.475 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:40:13.503 INFO:tasks.ceph.mon.c:Stopped 2023-10-14T09:40:13.503 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-14T09:40:13.504 DEBUG:teuthology.orchestra.run.smithi102:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2023-10-14T09:40:13.614 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi102.front.sepia.ceph.com 2023-10-14T09:40:13.615 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-14T09:40:13.861 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi102.front.sepia.ceph.com 2023-10-14T09:40:13.862 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-14T09:40:14.024 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi102.front.sepia.ceph.com 2023-10-14T09:40:14.025 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-14T09:40:14.160 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi102.front.sepia.ceph.com 2023-10-14T09:40:14.161 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-14T09:40:14.312 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi129.front.sepia.ceph.com 2023-10-14T09:40:14.313 DEBUG:teuthology.orchestra.run.smithi129:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-14T09:40:14.563 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi129.front.sepia.ceph.com 2023-10-14T09:40:14.564 DEBUG:teuthology.orchestra.run.smithi129:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-14T09:40:14.716 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi129.front.sepia.ceph.com 2023-10-14T09:40:14.716 DEBUG:teuthology.orchestra.run.smithi129:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-14T09:40:14.860 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi129.front.sepia.ceph.com 2023-10-14T09:40:14.860 DEBUG:teuthology.orchestra.run.smithi129:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-14T09:40:15.008 INFO:tasks.ceph:Archiving mon data... 2023-10-14T09:40:15.010 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425164/data/mon.a.tgz 2023-10-14T09:40:15.011 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2023-10-14T09:40:15.072 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.RIhTxP3xmH 2023-10-14T09:40:15.072 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.RIhTxP3xmH 2023-10-14T09:40:15.255 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.RIhTxP3xmH 2023-10-14T09:40:15.415 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.RIhTxP3xmH is 298KB 2023-10-14T09:40:15.527 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.RIhTxP3xmH 2023-10-14T09:40:15.585 DEBUG:teuthology.misc:Transferring archived files from smithi129:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425164/data/mon.b.tgz 2023-10-14T09:40:15.585 DEBUG:teuthology.orchestra.run.smithi129:> mktemp 2023-10-14T09:40:15.648 INFO:teuthology.orchestra.run.smithi129.stdout:/tmp/tmp.2i8b6M5Q0r 2023-10-14T09:40:15.696 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.2i8b6M5Q0r 2023-10-14T09:40:15.886 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 0666 /tmp/tmp.2i8b6M5Q0r 2023-10-14T09:40:16.040 DEBUG:teuthology.orchestra.remote:smithi129:/tmp/tmp.2i8b6M5Q0r is 400KB 2023-10-14T09:40:16.152 DEBUG:teuthology.orchestra.run.smithi129:> rm -fr /tmp/tmp.2i8b6M5Q0r 2023-10-14T09:40:16.211 DEBUG:teuthology.misc:Transferring archived files from smithi129:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425164/data/mon.c.tgz 2023-10-14T09:40:16.212 DEBUG:teuthology.orchestra.run.smithi129:> mktemp 2023-10-14T09:40:16.263 INFO:teuthology.orchestra.run.smithi129.stdout:/tmp/tmp.MnhqphDeGF 2023-10-14T09:40:16.264 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.MnhqphDeGF 2023-10-14T09:40:16.444 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 0666 /tmp/tmp.MnhqphDeGF 2023-10-14T09:40:16.598 DEBUG:teuthology.orchestra.remote:smithi129:/tmp/tmp.MnhqphDeGF is 400KB 2023-10-14T09:40:16.711 DEBUG:teuthology.orchestra.run.smithi129:> rm -fr /tmp/tmp.MnhqphDeGF 2023-10-14T09:40:16.770 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-14T09:40:16.770 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-14T09:40:16.780 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-14T09:40:16.882 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-14T09:40:16.882 DEBUG:teuthology.orchestra.run.smithi102:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-14T09:40:16.891 DEBUG:teuthology.orchestra.run.smithi129:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-14T09:40:16.988 INFO:teuthology.orchestra.run.smithi102.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-14T09:40:16.997 INFO:teuthology.orchestra.run.smithi129.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-14T09:40:17.009 INFO:tasks.ceph:Archiving crash dumps... 2023-10-14T09:40:17.011 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425164/remote/smithi102/crash 2023-10-14T09:40:17.012 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-14T09:40:17.097 DEBUG:teuthology.misc:Transferring archived files from smithi129:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425164/remote/smithi129/crash 2023-10-14T09:40:17.099 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-14T09:40:17.199 INFO:tasks.ceph:Shutting down logrotate 2023-10-14T09:40:17.199 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T09:40:17.208 DEBUG:teuthology.orchestra.run.smithi129:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T09:40:17.360 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-14T09:40:17.459 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-14T09:40:17.563 INFO:tasks.ceph:Compressing logs... 2023-10-14T09:40:17.563 DEBUG:teuthology.orchestra.run.smithi102:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-14T09:40:17.572 DEBUG:teuthology.orchestra.run.smithi129:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-14T09:40:17.662 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101043.log 2023-10-14T09:40:17.663 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97957.log 2023-10-14T09:40:17.664 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.101043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93583.log 2023-10-14T09:40:17.665 INFO:teuthology.orchestra.run.smithi102.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101043.log.gz 2023-10-14T09:40:17.666 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.97957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94269.log 2023-10-14T09:40:17.666 INFO:teuthology.orchestra.run.smithi102.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97957.log.gz 2023-10-14T09:40:17.667 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.93583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100785.log 2023-10-14T09:40:17.667 INFO:teuthology.orchestra.run.smithi102.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.93583.log.gz 2023-10-14T09:40:17.668 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.94269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98768.log 2023-10-14T09:40:17.668 INFO:teuthology.orchestra.run.smithi102.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.94269.log.gz 2023-10-14T09:40:17.669 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.100785.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-14T09:40:17.669 INFO:teuthology.orchestra.run.smithi102.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100785.log.gz 2023-10-14T09:40:17.670 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.98768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93581.log 2023-10-14T09:40:17.671 INFO:teuthology.orchestra.run.smithi102.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.98768.log.gz 2023-10-14T09:40:17.671 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-14T09:40:17.672 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.95688.log 2023-10-14T09:40:17.673 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87097.log 2023-10-14T09:40:17.674 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.92627.log 2023-10-14T09:40:17.674 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.93581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93248.log 2023-10-14T09:40:17.675 INFO:teuthology.orchestra.run.smithi102.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.93581.log.gz 2023-10-14T09:40:17.675 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.2.95688.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.95688.log.gz 2023-10-14T09:40:17.675 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93586.log 2023-10-14T09:40:17.680 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.93248.log: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.93248.log.gz -5 2023-10-14T09:40:17.681 INFO:teuthology.orchestra.run.smithi102.stderr: --verbose -- /var/log/ceph/ceph-client.admin.96322.log 2023-10-14T09:40:17.681 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.93586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92035.log 2023-10-14T09:40:17.682 INFO:teuthology.orchestra.run.smithi102.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93586.log.gz 2023-10-14T09:40:17.682 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.96322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98684.log 2023-10-14T09:40:17.682 INFO:teuthology.orchestra.run.smithi102.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.96322.log.gz 2023-10-14T09:40:17.683 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.92035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98353.log 2023-10-14T09:40:17.683 INFO:teuthology.orchestra.run.smithi102.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.92035.log.gz 2023-10-14T09:40:17.683 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.98684.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.98684.log.gz 2023-10-14T09:40:17.684 INFO:teuthology.orchestra.run.smithi102.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.97789.log 2023-10-14T09:40:17.687 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.87097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87337.log 2023-10-14T09:40:17.688 INFO:teuthology.orchestra.run.smithi129.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.87097.log.gz 2023-10-14T09:40:17.688 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.1.92627.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.92627.log.gz 2023-10-14T09:40:17.688 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87217.log 2023-10-14T09:40:17.689 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.87337.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.87337.log.gz 2023-10-14T09:40:17.689 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87057.log 2023-10-14T09:40:17.689 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.87217.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.87217.log.gz 2023-10-14T09:40:17.689 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-14T09:40:17.690 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.87057.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.87057.log.gz 2023-10-14T09:40:17.690 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-14T09:40:17.690 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-14T09:40:17.691 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.93020.log 2023-10-14T09:40:17.691 INFO:teuthology.orchestra.run.smithi129.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-14T09:40:17.691 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-14T09:40:17.691 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.3.93020.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.93020.log.gz 2023-10-14T09:40:17.692 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-14T09:40:17.692 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-osd.7.log: 92.9% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-14T09:40:17.692 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87297.log 2023-10-14T09:40:17.692 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-14T09:40:17.699 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.87297.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.87297.log.gz 2023-10-14T09:40:17.699 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87257.log 2023-10-14T09:40:17.700 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87137.log 2023-10-14T09:40:17.700 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.87257.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.87257.log.gz 2023-10-14T09:40:17.700 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-14T09:40:17.701 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.87137.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.87137.log.gz 2023-10-14T09:40:17.701 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87177.log 2023-10-14T09:40:17.701 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-14T09:40:17.701 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.87177.log: 93.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-14T09:40:17.702 INFO:teuthology.orchestra.run.smithi129.stderr: 91.8% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-14T09:40:17.702 INFO:teuthology.orchestra.run.smithi129.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.87177.log.gz 2023-10-14T09:40:17.702 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-10-14T09:40:17.703 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-14T09:40:17.703 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-mds.d.log: 92.1% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-10-14T09:40:17.707 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.98353.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98353.log.gz 2023-10-14T09:40:17.707 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99434.log 2023-10-14T09:40:17.707 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.97789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99392.log 2023-10-14T09:40:17.708 INFO:teuthology.orchestra.run.smithi102.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97789.log.gz 2023-10-14T09:40:17.708 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.99434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96802.log 2023-10-14T09:40:17.708 INFO:teuthology.orchestra.run.smithi102.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99434.log.gz 2023-10-14T09:40:17.708 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.99392.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.99392.log.gz 2023-10-14T09:40:17.709 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98251.log 2023-10-14T09:40:17.709 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.96802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96955.log 2023-10-14T09:40:17.709 INFO:teuthology.orchestra.run.smithi102.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96802.log.gz 2023-10-14T09:40:17.709 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.98251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96742.log 2023-10-14T09:40:17.710 INFO:teuthology.orchestra.run.smithi102.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98251.log.gz 2023-10-14T09:40:17.710 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.96955.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.96955.log.gz 2023-10-14T09:40:17.710 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100869.log 2023-10-14T09:40:17.711 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.96742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96238.log 2023-10-14T09:40:17.711 INFO:teuthology.orchestra.run.smithi102.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.96742.log.gz 2023-10-14T09:40:17.711 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.100869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94143.log 2023-10-14T09:40:17.711 INFO:teuthology.orchestra.run.smithi102.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100869.log.gz 2023-10-14T09:40:17.712 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.96238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93257.log 2023-10-14T09:40:17.712 INFO:teuthology.orchestra.run.smithi102.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.96238.log.gz 2023-10-14T09:40:17.712 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.94143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99476.log 2023-10-14T09:40:17.713 INFO:teuthology.orchestra.run.smithi102.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94143.log.gz 2023-10-14T09:40:17.713 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.93257.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.93257.log.gz 2023-10-14T09:40:17.713 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98518.log 2023-10-14T09:40:17.713 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.99476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93920.log 2023-10-14T09:40:17.714 INFO:teuthology.orchestra.run.smithi102.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.99476.log.gz 2023-10-14T09:40:17.714 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.98518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100029.log 2023-10-14T09:40:17.715 INFO:teuthology.orchestra.run.smithi102.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98518.log.gz 2023-10-14T09:40:17.715 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.93920.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93920.log.gz 2023-10-14T09:40:17.715 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92949.log 2023-10-14T09:40:17.715 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.100029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98894.log 2023-10-14T09:40:17.716 INFO:teuthology.orchestra.run.smithi102.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100029.log.gz 2023-10-14T09:40:17.716 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.92949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96448.log 2023-10-14T09:40:17.716 INFO:teuthology.orchestra.run.smithi102.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.92949.log.gz 2023-10-14T09:40:17.717 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.98894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94911.log 2023-10-14T09:40:17.717 INFO:teuthology.orchestra.run.smithi102.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.98894.log.gz 2023-10-14T09:40:17.717 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.96448.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.96448.log.gz 2023-10-14T09:40:17.718 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97285.log 2023-10-14T09:40:17.718 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.94911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100365.log 2023-10-14T09:40:17.719 INFO:teuthology.orchestra.run.smithi102.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94911.log.gz 2023-10-14T09:40:17.719 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.97285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100983.log 2023-10-14T09:40:17.719 INFO:teuthology.orchestra.run.smithi102.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97285.log.gz 2023-10-14T09:40:17.719 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.100365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98396.log 2023-10-14T09:40:17.720 INFO:teuthology.orchestra.run.smithi102.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100365.log.gz 2023-10-14T09:40:17.720 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.100983.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.100983.log.gz 2023-10-14T09:40:17.720 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94227.log 2023-10-14T09:40:17.726 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.98396.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.98396.log.gz 2023-10-14T09:40:17.726 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95860.log 2023-10-14T09:40:17.727 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.94227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97459.log 2023-10-14T09:40:17.727 INFO:teuthology.orchestra.run.smithi102.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94227.log.gz 2023-10-14T09:40:17.728 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.95860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97159.log 2023-10-14T09:40:17.728 INFO:teuthology.orchestra.run.smithi102.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95860.log.gz 2023-10-14T09:40:17.729 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.97459.log: gzip -5 --verbose -- 89.0% /var/log/ceph/ceph-client.admin.100407.log -- replaced with /var/log/ceph/ceph-client.admin.97459.log.gz 2023-10-14T09:40:17.729 INFO:teuthology.orchestra.run.smithi102.stderr: 2023-10-14T09:40:17.729 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.97159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97747.log 2023-10-14T09:40:17.730 INFO:teuthology.orchestra.run.smithi102.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97159.log.gz 2023-10-14T09:40:17.730 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.100407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96196.log 2023-10-14T09:40:17.731 INFO:teuthology.orchestra.run.smithi102.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.100407.log.gz 2023-10-14T09:40:17.731 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.97747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97705.log 2023-10-14T09:40:17.731 INFO:teuthology.orchestra.run.smithi102.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.97747.log.gz 2023-10-14T09:40:17.732 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.96196.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.96196.log.gz 2023-10-14T09:40:17.732 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99122.log 2023-10-14T09:40:17.732 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.97705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98936.log 2023-10-14T09:40:17.732 INFO:teuthology.orchestra.run.smithi102.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97705.log.gz 2023-10-14T09:40:17.733 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.99122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92737.log 2023-10-14T09:40:17.733 INFO:teuthology.orchestra.run.smithi102.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99122.log.gz 2023-10-14T09:40:17.733 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.98936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.99855.log 2023-10-14T09:40:17.734 INFO:teuthology.orchestra.run.smithi102.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.98936.log.gz 2023-10-14T09:40:17.734 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.92737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92515.log 88.6% 2023-10-14T09:40:17.734 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.92737.log.gz 2023-10-14T09:40:17.734 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.99855.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.99855.log.gz 2023-10-14T09:40:17.735 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99518.log 2023-10-14T09:40:17.735 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.92515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94731.log 2023-10-14T09:40:17.735 INFO:teuthology.orchestra.run.smithi102.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.92515.log.gz 2023-10-14T09:40:17.736 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.99518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93584.log 2023-10-14T09:40:17.736 INFO:teuthology.orchestra.run.smithi102.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.99518.log.gz 2023-10-14T09:40:17.736 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.94731.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94731.log.gz 2023-10-14T09:40:17.737 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95252.log 2023-10-14T09:40:17.737 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.93584.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-14T09:40:17.737 INFO:teuthology.orchestra.run.smithi102.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93584.log.gz 2023-10-14T09:40:17.741 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.95252.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.95252.log.gz 2023-10-14T09:40:17.742 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97417.log 2023-10-14T09:40:17.742 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98810.log 2023-10-14T09:40:17.742 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.97417.log: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-14T09:40:17.743 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94521.log 2023-10-14T09:40:17.743 INFO:teuthology.orchestra.run.smithi102.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97417.log.gz 2023-10-14T09:40:17.743 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.98810.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98810.log.gz 2023-10-14T09:40:17.743 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94353.log 2023-10-14T09:40:17.744 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.94521.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94521.log.gz 2023-10-14T09:40:17.744 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93075.log 2023-10-14T09:40:17.744 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.94353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100071.log 2023-10-14T09:40:17.744 INFO:teuthology.orchestra.run.smithi102.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.94353.log.gz 2023-10-14T09:40:17.745 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.93075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93240.log 2023-10-14T09:40:17.745 INFO:teuthology.orchestra.run.smithi102.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.93075.log.gz 2023-10-14T09:40:17.745 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.100071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92127.log 2023-10-14T09:40:17.746 INFO:teuthology.orchestra.run.smithi102.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.100071.log.gz 2023-10-14T09:40:17.746 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.93240.log: gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93240.log.gz -5 2023-10-14T09:40:17.746 INFO:teuthology.orchestra.run.smithi102.stderr: --verbose -- /var/log/ceph/ceph-client.admin.92304.log 2023-10-14T09:40:17.747 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.92127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92991.log 2023-10-14T09:40:17.747 INFO:teuthology.orchestra.run.smithi102.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.92127.log.gz 2023-10-14T09:40:17.747 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.92304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94479.log 2023-10-14T09:40:17.747 INFO:teuthology.orchestra.run.smithi102.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.92304.log.gz 2023-10-14T09:40:17.748 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.92991.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.92991.log.gz -5 2023-10-14T09:40:17.748 INFO:teuthology.orchestra.run.smithi102.stderr: --verbose -- /var/log/ceph/ceph-client.admin.97201.log 2023-10-14T09:40:17.748 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.94479.log: gzip -5 --verbose -- 88.2% /var/log/ceph/ceph-client.admin.96913.log 2023-10-14T09:40:17.749 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94479.log.gz 2023-10-14T09:40:17.749 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.97201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96112.log 2023-10-14T09:40:17.749 INFO:teuthology.orchestra.run.smithi102.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97201.log.gz 2023-10-14T09:40:17.754 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.96913.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.81476.log 2023-10-14T09:40:17.754 INFO:teuthology.orchestra.run.smithi102.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.96913.log.gz 2023-10-14T09:40:17.754 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.96112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100449.log 2023-10-14T09:40:17.755 INFO:teuthology.orchestra.run.smithi102.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96112.log.gz 2023-10-14T09:40:17.755 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph.tmp-client.admin.81476.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.81476.log.gz 2023-10-14T09:40:17.755 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97999.log 2023-10-14T09:40:17.755 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.100449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95388.log 2023-10-14T09:40:17.756 INFO:teuthology.orchestra.run.smithi102.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100449.log.gz 2023-10-14T09:40:17.756 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.97999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93921.log 2023-10-14T09:40:17.756 INFO:teuthology.orchestra.run.smithi102.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97999.log.gz 2023-10-14T09:40:17.756 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.95388.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95388.log.gz 2023-10-14T09:40:17.757 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96070.log 2023-10-14T09:40:17.757 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.93921.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93921.log.gz 2023-10-14T09:40:17.757 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92473.log 2023-10-14T09:40:17.758 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.96070.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96070.log.gz 2023-10-14T09:40:17.758 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96658.log 2023-10-14T09:40:17.758 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.92473.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.92473.log.gz 2023-10-14T09:40:17.759 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-14T09:40:17.759 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.96658.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96658.log.gz 2023-10-14T09:40:17.759 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98642.log 2023-10-14T09:40:17.762 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93915.log 2023-10-14T09:40:17.762 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.98642.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.98642.log.gz 2023-10-14T09:40:17.763 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100281.log 2023-10-14T09:40:17.763 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.93915.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93915.log.gz 2023-10-14T09:40:17.763 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96154.log 2023-10-14T09:40:17.763 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.100281.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100281.log.gz 2023-10-14T09:40:17.764 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96028.log 2023-10-14T09:40:17.764 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.96154.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96154.log.gz 2023-10-14T09:40:17.764 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98852.log 2023-10-14T09:40:17.764 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.96028.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.96028.log.gz 2023-10-14T09:40:17.765 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93249.log 2023-10-14T09:40:17.765 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.98852.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98852.log.gz 2023-10-14T09:40:17.765 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94605.log 2023-10-14T09:40:17.767 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.93249.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93249.log.gz 2023-10-14T09:40:17.767 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94395.log 2023-10-14T09:40:17.768 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.94605.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94605.log.gz 2023-10-14T09:40:17.768 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95902.log 2023-10-14T09:40:17.768 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.94395.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94395.log.gz 2023-10-14T09:40:17.768 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93256.log 2023-10-14T09:40:17.769 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.95902.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95902.log.gz 2023-10-14T09:40:17.769 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97873.log 2023-10-14T09:40:17.771 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.93256.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.93256.log.gz 2023-10-14T09:40:17.771 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96532.log 2023-10-14T09:40:17.771 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.97873.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97873.log.gz 2023-10-14T09:40:17.772 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93883.log 2023-10-14T09:40:17.772 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.96532.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96532.log.gz 2023-10-14T09:40:17.772 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99077.log 2023-10-14T09:40:17.773 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.93883.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93883.log.gz 2023-10-14T09:40:17.774 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93252.log 2023-10-14T09:40:17.774 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.99077.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99077.log.gz 2023-10-14T09:40:17.774 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95986.log 2023-10-14T09:40:17.775 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.93252.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.93252.log.gz 2023-10-14T09:40:17.776 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92346.log 2023-10-14T09:40:17.776 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.95986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99308.log 2023-10-14T09:40:17.777 INFO:teuthology.orchestra.run.smithi102.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.95986.log.gz 2023-10-14T09:40:17.777 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.92346.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.92346.log.gz 2023-10-14T09:40:17.778 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98125.log 2023-10-14T09:40:17.779 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.99308.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99308.log.gz 2023-10-14T09:40:17.779 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96280.log 2023-10-14T09:40:17.780 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.98125.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.98125.log.gz 2023-10-14T09:40:17.780 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97915.log 2023-10-14T09:40:17.781 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.96280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97243.log 2023-10-14T09:40:17.781 INFO:teuthology.orchestra.run.smithi102.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96280.log.gz 2023-10-14T09:40:17.782 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.97915.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.97915.log.gz 2023-10-14T09:40:17.782 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99668.log 2023-10-14T09:40:17.783 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.97243.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97243.log.gz 2023-10-14T09:40:17.784 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94563.log 2023-10-14T09:40:17.785 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.99668.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.99668.log.gz 2023-10-14T09:40:17.785 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97543.log 2023-10-14T09:40:17.786 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.94563.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94563.log.gz 2023-10-14T09:40:17.786 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100659.log 2023-10-14T09:40:17.787 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.97543.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97543.log.gz 2023-10-14T09:40:17.787 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92223.log 2023-10-14T09:40:17.788 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.100659.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.100659.log.gz 2023-10-14T09:40:17.789 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-14T09:40:17.789 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.92223.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.92223.log.gz 2023-10-14T09:40:17.790 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93592.log 2023-10-14T09:40:17.791 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94437.log 2023-10-14T09:40:17.791 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.93592.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93592.log.gz 2023-10-14T09:40:17.792 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99029.log 2023-10-14T09:40:17.793 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.94437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98083.log 2023-10-14T09:40:17.794 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.99029.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94437.log.gz 2023-10-14T09:40:17.795 INFO:teuthology.orchestra.run.smithi102.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.99029.log.gz 2023-10-14T09:40:17.795 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100197.log 2023-10-14T09:40:17.796 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.98083.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98083.log.gz 2023-10-14T09:40:17.797 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92695.log 2023-10-14T09:40:17.797 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.100197.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.100197.log.gz 2023-10-14T09:40:17.798 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93255.log 2023-10-14T09:40:17.799 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.92695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87804.log 2023-10-14T09:40:17.800 INFO:teuthology.orchestra.run.smithi102.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92695.log.gz 2023-10-14T09:40:17.801 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.93255.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93255.log.gz 2023-10-14T09:40:17.801 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100617.log 2023-10-14T09:40:17.802 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-mon.c.log: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-14T09:40:17.803 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.87804.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.87804.log.gz 2023-10-14T09:40:17.803 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92389.log 2023-10-14T09:40:17.804 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.100617.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100617.log.gz 2023-10-14T09:40:17.804 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98167.log 2023-10-14T09:40:17.805 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.92389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97831.log 2023-10-14T09:40:17.806 INFO:teuthology.orchestra.run.smithi102.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.92389.log.gz 2023-10-14T09:40:17.807 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.98167.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98167.log.gz 2023-10-14T09:40:17.807 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97039.log 2023-10-14T09:40:17.808 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.97831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100941.log 2023-10-14T09:40:17.809 INFO:teuthology.orchestra.run.smithi102.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97831.log.gz 2023-10-14T09:40:17.810 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.97039.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97039.log.gz 2023-10-14T09:40:17.810 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92559.log 2023-10-14T09:40:17.811 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.100941.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100941.log.gz 2023-10-14T09:40:17.811 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97081.log 2023-10-14T09:40:17.812 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.92559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92603.log 2023-10-14T09:40:17.813 INFO:teuthology.orchestra.run.smithi102.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.92559.log.gz 2023-10-14T09:40:17.814 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.97081.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97081.log.gz 2023-10-14T09:40:17.814 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96700.log 2023-10-14T09:40:17.815 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.92603.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92603.log.gz 2023-10-14T09:40:17.815 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92865.log 2023-10-14T09:40:17.816 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.96700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99350.log 2023-10-14T09:40:17.817 INFO:teuthology.orchestra.run.smithi102.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96700.log.gz 2023-10-14T09:40:17.818 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.92865.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.92865.log.gz 2023-10-14T09:40:17.818 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96574.log 2023-10-14T09:40:17.819 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.99350.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99350.log.gz 2023-10-14T09:40:17.820 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101186.log 2023-10-14T09:40:17.820 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.96574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98209.log 2023-10-14T09:40:17.821 INFO:teuthology.orchestra.run.smithi102.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.96574.log.gz 2023-10-14T09:40:17.822 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.101186.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101186.log.gz 2023-10-14T09:40:17.822 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98041.log 2023-10-14T09:40:17.823 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.98209.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98209.log.gz 2023-10-14T09:40:17.824 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100701.log 2023-10-14T09:40:17.825 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.98041.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-14T09:40:17.825 INFO:teuthology.orchestra.run.smithi102.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98041.log.gz 2023-10-14T09:40:17.826 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.100701.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100701.log.gz 2023-10-14T09:40:17.827 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93575.log 2023-10-14T09:40:17.828 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94773.log 2023-10-14T09:40:17.829 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.93575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97327.log 2023-10-14T09:40:17.829 INFO:teuthology.orchestra.run.smithi102.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93575.log.gz 2023-10-14T09:40:17.831 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.94773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93929.log 2023-10-14T09:40:17.831 INFO:teuthology.orchestra.run.smithi102.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.94773.log.gz 2023-10-14T09:40:17.833 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.97327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100491.log 2023-10-14T09:40:17.833 INFO:teuthology.orchestra.run.smithi102.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.97327.log.gz 2023-10-14T09:40:17.834 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.93929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92653.log 2023-10-14T09:40:17.834 INFO:teuthology.orchestra.run.smithi102.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.93929.log.gz 2023-10-14T09:40:17.835 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.100491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94689.log 2023-10-14T09:40:17.835 INFO:teuthology.orchestra.run.smithi102.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100491.log.gz 2023-10-14T09:40:17.837 INFO:teuthology.orchestra.run.smithi129.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-14T09:40:17.837 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.92653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96364.log 2023-10-14T09:40:17.838 INFO:teuthology.orchestra.run.smithi102.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.92653.log.gz 2023-10-14T09:40:17.838 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.94689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87547.log 2023-10-14T09:40:17.839 INFO:teuthology.orchestra.run.smithi102.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94689.log.gz 2023-10-14T09:40:17.840 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.96364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99266.log 2023-10-14T09:40:17.840 INFO:teuthology.orchestra.run.smithi102.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.96364.log.gz 2023-10-14T09:40:17.842 INFO:teuthology.orchestra.run.smithi129.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-14T09:40:17.842 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.87547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100113.log 2023-10-14T09:40:17.842 INFO:teuthology.orchestra.run.smithi102.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.87547.log.gz 2023-10-14T09:40:17.843 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.99266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95818.log 2023-10-14T09:40:17.843 INFO:teuthology.orchestra.run.smithi102.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99266.log.gz 2023-10-14T09:40:17.844 INFO:teuthology.orchestra.run.smithi129.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-14T09:40:17.845 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.100113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92907.log 2023-10-14T09:40:17.845 INFO:teuthology.orchestra.run.smithi102.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100113.log.gz 2023-10-14T09:40:17.846 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.95818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96616.log 2023-10-14T09:40:17.846 INFO:teuthology.orchestra.run.smithi102.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95818.log.gz 2023-10-14T09:40:17.847 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.92907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96997.log 2023-10-14T09:40:17.847 INFO:teuthology.orchestra.run.smithi102.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.92907.log.gz 2023-10-14T09:40:17.849 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.96616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99164.log 2023-10-14T09:40:17.849 INFO:teuthology.orchestra.run.smithi102.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.96616.log.gz 2023-10-14T09:40:17.850 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.96997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99206.log 2023-10-14T09:40:17.851 INFO:teuthology.orchestra.run.smithi102.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96997.log.gz 2023-10-14T09:40:17.852 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.99164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92431.log 2023-10-14T09:40:17.852 INFO:teuthology.orchestra.run.smithi102.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99164.log.gz 2023-10-14T09:40:17.853 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.99206.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-14T09:40:17.854 INFO:teuthology.orchestra.run.smithi102.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99206.log.gz 2023-10-14T09:40:17.855 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.92431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96490.log 2023-10-14T09:40:17.855 INFO:teuthology.orchestra.run.smithi102.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.92431.log.gz 2023-10-14T09:40:17.856 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97663.log 2023-10-14T09:40:17.858 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.96490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100155.log 2023-10-14T09:40:17.858 INFO:teuthology.orchestra.run.smithi102.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.96490.log.gz 2023-10-14T09:40:17.859 INFO:teuthology.orchestra.run.smithi129.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-14T09:40:17.860 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.97663.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.97663.log.gz 2023-10-14T09:40:17.860 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101104.log 2023-10-14T09:40:17.861 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.100155.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100155.log.gz 2023-10-14T09:40:17.861 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94311.log 2023-10-14T09:40:17.863 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.101104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100575.log 2023-10-14T09:40:17.863 INFO:teuthology.orchestra.run.smithi102.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101104.log.gz 2023-10-14T09:40:17.864 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.94311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101144.log 2023-10-14T09:40:17.865 INFO:teuthology.orchestra.run.smithi102.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.94311.log.gz 2023-10-14T09:40:17.866 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.100575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96406.log 2023-10-14T09:40:17.866 INFO:teuthology.orchestra.run.smithi102.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.100575.log.gz 2023-10-14T09:40:17.867 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.101144.log: gzip 89.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.101144.log.gz --verbose 2023-10-14T09:40:17.867 INFO:teuthology.orchestra.run.smithi102.stderr: -- /var/log/ceph/ceph-client.admin.95944.log 2023-10-14T09:40:17.869 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.96406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97501.log 2023-10-14T09:40:17.869 INFO:teuthology.orchestra.run.smithi102.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.96406.log.gz 2023-10-14T09:40:17.870 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.95944.log: 89.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.95944.log.gz -5 2023-10-14T09:40:17.871 INFO:teuthology.orchestra.run.smithi102.stderr: --verbose -- /var/log/ceph/ceph-client.admin.97585.log 2023-10-14T09:40:17.872 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.97501.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-14T09:40:17.872 INFO:teuthology.orchestra.run.smithi102.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97501.log.gz 2023-10-14T09:40:17.874 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.97585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93593.log 2023-10-14T09:40:17.874 INFO:teuthology.orchestra.run.smithi102.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97585.log.gz 2023-10-14T09:40:17.875 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93245.log 2023-10-14T09:40:17.876 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.93593.log: 91.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-14T09:40:17.876 INFO:teuthology.orchestra.run.smithi102.stderr: 85.2% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-14T09:40:17.877 INFO:teuthology.orchestra.run.smithi102.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93593.log.gz 2023-10-14T09:40:17.877 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-14T09:40:17.878 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.93245.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93245.log.gz 2023-10-14T09:40:17.878 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-14T09:40:17.880 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93924.log 2023-10-14T09:40:17.881 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87949.log 2023-10-14T09:40:17.883 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.93924.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.93924.log.gz 2023-10-14T09:40:17.884 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99560.log 2023-10-14T09:40:17.890 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.87949.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.87949.log.gz 2023-10-14T09:40:17.890 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98600.log 2023-10-14T09:40:17.891 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.99560.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99560.log.gz 2023-10-14T09:40:17.891 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100533.log 2023-10-14T09:40:17.892 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.98600.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98600.log.gz 2023-10-14T09:40:17.892 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98293.log 2023-10-14T09:40:17.901 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.100533.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.100533.log.gz 2023-10-14T09:40:17.902 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92823.log 2023-10-14T09:40:17.902 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.98293.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98293.log.gz 2023-10-14T09:40:17.903 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93590.log 2023-10-14T09:40:17.903 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.92823.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.92823.log.gz 2023-10-14T09:40:17.904 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94647.log 2023-10-14T09:40:17.904 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.93590.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93590.log.gz 2023-10-14T09:40:17.904 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93923.log 2023-10-14T09:40:17.905 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.94647.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94647.log.gz 2023-10-14T09:40:17.905 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.93923.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93923.log.gz 2023-10-14T09:40:17.906 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100743.log 2023-10-14T09:40:17.909 INFO:teuthology.orchestra.run.smithi129.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-14T09:40:17.910 INFO:teuthology.orchestra.run.smithi129.stderr: 2023-10-14T09:40:17.910 INFO:teuthology.orchestra.run.smithi129.stderr:real 0m0.274s 2023-10-14T09:40:17.911 INFO:teuthology.orchestra.run.smithi129.stderr:user 0m0.904s 2023-10-14T09:40:17.913 INFO:teuthology.orchestra.run.smithi129.stderr:sys 0m0.195s 2023-10-14T09:40:17.916 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100323.log 2023-10-14T09:40:17.917 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.100743.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100743.log.gz 2023-10-14T09:40:17.917 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93925.log 2023-10-14T09:40:17.917 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.100323.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100323.log.gz 2023-10-14T09:40:17.918 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99602.log 2023-10-14T09:40:17.918 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.93925.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.93925.log.gz 2023-10-14T09:40:17.918 INFO:teuthology.orchestra.run.smithi102.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-14T09:40:17.918 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94185.log 2023-10-14T09:40:17.919 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.99602.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.99602.log.gz 2023-10-14T09:40:17.919 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98438.log 2023-10-14T09:40:17.919 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.94185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100827.log 2023-10-14T09:40:17.920 INFO:teuthology.orchestra.run.smithi102.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94185.log.gz 2023-10-14T09:40:17.920 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.98438.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.98438.log.gz 2023-10-14T09:40:17.920 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-14T09:40:17.920 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.100827.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.100827.log.gz 2023-10-14T09:40:17.921 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93033.log 2023-10-14T09:40:17.921 INFO:teuthology.orchestra.run.smithi102.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-14T09:40:17.923 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100239.log 2023-10-14T09:40:17.923 INFO:teuthology.orchestra.run.smithi102.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-14T09:40:17.923 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.93033.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93033.log.gz 2023-10-14T09:40:17.924 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98979.log 2023-10-14T09:40:17.924 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.100239.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100239.log.gz 2023-10-14T09:40:17.924 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92781.log 2023-10-14T09:40:17.924 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.98979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98726.log 2023-10-14T09:40:17.925 INFO:teuthology.orchestra.run.smithi102.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98979.log.gz 2023-10-14T09:40:17.925 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.92781.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.92781.log.gz 2023-10-14T09:40:17.926 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.98726.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98726.log.gz 2023-10-14T09:40:17.934 INFO:teuthology.orchestra.run.smithi102.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-14T09:40:17.959 INFO:teuthology.orchestra.run.smithi102.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-14T09:40:17.990 INFO:teuthology.orchestra.run.smithi102.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-14T09:40:17.995 INFO:teuthology.orchestra.run.smithi102.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-14T09:40:17.998 INFO:teuthology.orchestra.run.smithi102.stderr: 2023-10-14T09:40:17.999 INFO:teuthology.orchestra.run.smithi102.stderr:real 0m0.378s 2023-10-14T09:40:17.999 INFO:teuthology.orchestra.run.smithi102.stderr:user 0m0.938s 2023-10-14T09:40:17.999 INFO:teuthology.orchestra.run.smithi102.stderr:sys 0m0.639s 2023-10-14T09:40:18.001 INFO:tasks.ceph:Archiving logs... 2023-10-14T09:40:18.001 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425164/remote/smithi102/log 2023-10-14T09:40:18.003 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-14T09:40:18.352 DEBUG:teuthology.misc:Transferring archived files from smithi129:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425164/remote/smithi129/log 2023-10-14T09:40:18.354 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-14T09:40:18.560 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-14T09:40:18.585 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-14T09:40:18.585 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-14T09:40:18.594 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-14T09:40:18.740 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-14T09:40:18.751 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-14T09:40:18.752 DEBUG:teuthology.orchestra.run.smithi102:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T09:40:18.761 DEBUG:teuthology.orchestra.run.smithi129:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T09:40:18.810 INFO:teuthology.orchestra.run.smithi102.stderr:bash: line 1: ntpq: command not found 2023-10-14T09:40:18.817 INFO:teuthology.orchestra.run.smithi129.stderr:bash: line 1: ntpq: command not found 2023-10-14T09:40:18.819 INFO:teuthology.orchestra.run.smithi102.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T09:40:18.819 INFO:teuthology.orchestra.run.smithi102.stdout:=============================================================================== 2023-10-14T09:40:18.820 INFO:teuthology.orchestra.run.smithi102.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 55 +1190us[+1055us] +/- 100ms 2023-10-14T09:40:18.820 INFO:teuthology.orchestra.run.smithi102.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 55 -633us[ -767us] +/- 48ms 2023-10-14T09:40:18.820 INFO:teuthology.orchestra.run.smithi102.stdout:^* hv03.front.sepia.ceph.com 3 6 377 55 +42us[ -92us] +/- 74ms 2023-10-14T09:40:18.820 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T09:40:18.827 INFO:teuthology.orchestra.run.smithi129.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T09:40:18.827 INFO:teuthology.orchestra.run.smithi129.stdout:=============================================================================== 2023-10-14T09:40:18.828 INFO:teuthology.orchestra.run.smithi129.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 56 +1067us[+1074us] +/- 100ms 2023-10-14T09:40:18.828 INFO:teuthology.orchestra.run.smithi129.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 55 -749us[ -749us] +/- 48ms 2023-10-14T09:40:18.828 INFO:teuthology.orchestra.run.smithi129.stdout:^* hv03.front.sepia.ceph.com 3 6 377 56 -85us[ -78us] +/- 74ms 2023-10-14T09:40:18.829 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T09:40:18.830 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-14T09:40:18.839 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-14T09:40:18.840 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-14T09:40:18.849 DEBUG:teuthology.orchestra.run.smithi102:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-14T09:40:19.099 DEBUG:teuthology.orchestra.run.smithi129:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-14T09:40:19.356 DEBUG:teuthology.orchestra.run.smithi102:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T09:40:19.468 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:40:19.469 DEBUG:teuthology.orchestra.run.smithi129:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T09:40:19.578 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:40:19.579 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-14T09:40:19.589 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-14T09:40:19.599 INFO:teuthology.task.internal:Duration was 978.511482 seconds 2023-10-14T09:40:19.600 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-14T09:40:19.608 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-14T09:40:19.608 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-14T09:40:19.618 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-14T09:40:19.785 INFO:teuthology.orchestra.run.smithi102.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T09:40:19.790 INFO:teuthology.orchestra.run.smithi129.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T09:40:20.158 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-14T09:40:20.158 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi102.front.sepia.ceph.com 2023-10-14T09:40:20.159 DEBUG:teuthology.orchestra.run.smithi102:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-14T09:40:20.228 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi129.front.sepia.ceph.com 2023-10-14T09:40:20.229 DEBUG:teuthology.orchestra.run.smithi129:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-14T09:40:20.308 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-14T09:40:20.309 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-14T09:40:20.318 DEBUG:teuthology.orchestra.run.smithi129:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-14T09:40:20.411 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-14T09:40:20.412 DEBUG:teuthology.orchestra.run.smithi102:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-14T09:40:20.418 DEBUG:teuthology.orchestra.run.smithi129:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-14T09:40:20.599 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-14T09:40:20.611 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-14T09:40:20.611 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-14T09:40:20.705 DEBUG:teuthology.orchestra.run.smithi129:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-14T09:40:20.808 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-14T09:40:20.819 DEBUG:teuthology.orchestra.run.smithi102:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-14T09:40:20.828 DEBUG:teuthology.orchestra.run.smithi129:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-14T09:40:20.935 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = core 2023-10-14T09:40:20.943 INFO:teuthology.orchestra.run.smithi129.stdout:kernel.core_pattern = core 2023-10-14T09:40:20.996 DEBUG:teuthology.orchestra.run.smithi102:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-14T09:40:21.045 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:40:21.046 DEBUG:teuthology.orchestra.run.smithi129:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-14T09:40:21.101 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:40:21.102 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-14T09:40:21.120 INFO:teuthology.task.internal:Transferring archived files... 2023-10-14T09:40:21.121 DEBUG:teuthology.misc:Transferring archived files from smithi102:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425164/remote/smithi102 2023-10-14T09:40:21.122 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-14T09:40:21.236 DEBUG:teuthology.misc:Transferring archived files from smithi129:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425164/remote/smithi129 2023-10-14T09:40:21.237 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-14T09:40:21.349 INFO:teuthology.task.internal:Removing archive directory... 2023-10-14T09:40:21.349 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-14T09:40:21.358 DEBUG:teuthology.orchestra.run.smithi129:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-14T09:40:21.414 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-14T09:40:21.427 INFO:teuthology.task.internal:Not uploading archives. 2023-10-14T09:40:21.427 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-14T09:40:21.439 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-14T09:40:21.439 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-14T09:40:21.449 DEBUG:teuthology.orchestra.run.smithi129:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-14T09:40:21.501 INFO:teuthology.orchestra.run.smithi102.stdout: 524667 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Oct 14 09:40 /home/ubuntu/cephtest 2023-10-14T09:40:21.501 INFO:teuthology.orchestra.run.smithi102.stdout: 527726 4 d--------- 2 ubuntu ubuntu 4096 Oct 14 09:38 /home/ubuntu/cephtest/mnt.0 2023-10-14T09:40:21.502 INFO:teuthology.orchestra.run.smithi102.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2023-10-14T09:40:21.504 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:40:21.504 INFO:teuthology.orchestra.run.smithi102.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-10-14T09:40:21.505 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi102 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-10-14T09:40:21.513 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-14T09:40:21.524 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-14T09:40:21.539 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi102 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-10-14T09:40:21.539 INFO:teuthology.nuke:Checking targets against current locks 2023-10-14T09:40:21.547 INFO:teuthology.orchestra.run.smithi129.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 14 09:40 /home/ubuntu/cephtest 2023-10-14T09:40:21.579 DEBUG:teuthology.nuke:shortname: smithi102 2023-10-14T09:40:21.579 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T09:40:21.604 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425164', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 09:14:50.692757', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFwh5NEmomLdH1twgM0mFjSdTELICqTtUwIwr5b+COO+24s2altP7MGFi3jSA2PfHs9EFjfsxWBbDbY2MHU1oe4='} 2023-10-14T09:40:21.608 DEBUG:teuthology.nuke:shortname: smithi129 2023-10-14T09:40:21.608 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T09:40:21.630 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi129.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425164', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 09:14:50.694687', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCjJDbPyB/hulx2E9LwE3smeu/3pBngA8xVUoG2ZWnTy2bz9+39RnLbFTKciGkGMs/h7kdN6UjCdyI4AEIG0oMo='} 2023-10-14T09:40:21.660 INFO:teuthology.orchestra.console.smithi102:Power off 2023-10-14T09:40:21.661 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T09:40:21.684 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2023-10-14T09:40:21.685 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:40:21.701 INFO:teuthology.orchestra.console.smithi129:Power off 2023-10-14T09:40:21.702 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T09:40:21.711 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-10-14T09:40:21.724 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off 2023-10-14T09:40:21.724 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:40:21.746 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2023-10-14T09:40:25.713 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:40:25.748 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:40:25.824 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-10-14T09:40:25.858 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2023-10-14T09:40:29.825 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:40:29.859 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:40:29.936 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-10-14T09:40:29.970 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2023-10-14T09:40:33.940 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:40:33.971 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:40:34.051 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-10-14T09:40:34.082 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-10-14T09:40:34.152 INFO:teuthology.orchestra.console.smithi102:Power off completed 2023-10-14T09:40:34.184 INFO:teuthology.orchestra.console.smithi129:Power off completed 2023-10-14T09:40:34.290 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 client.1-kernel-sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} duration: 978.5114822387695 failure_reason: 'Test failure: test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc)' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=45c235aaf4cd4381b84056f77ea83b22 status: fail success: false 2023-10-14T09:40:34.290 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T09:40:34.373 INFO:teuthology.run:FAIL